paperlined.org
dev > perl > modules > related_modules

document updated 13 years ago, on Jun 23, 2011

Modules that do some sort of HTML ⇒ text conversion.

(there are lots of ways to do this sort of thing, including piping it through w3m/lynx.... but there many different approaches, some of them rather smart, some rather dumb)

HTML::Formater (HTML::FormatText)
There are other things that use it too:
- HTML::ExtractMain
- HTML::FormatText::WithLinks
HTML::Extract
HTML::Strip
HTML::FormatExternal::*
- html2text [1] [2] is a good program to do this
html2text.pl
convert HTML to various markup languages
- HTML::WikiConverter — lots of markups supported
- Text::EtText::HTML2EtText
- HTML::BBReverse

Extract targetted data

Ways to extract bits of an HTML file, without obliterating all tags.

HTML::TreeBuilder::XPath
- useful in combination with HTML::Selector::XPath::Simple
- things based on that:
  - Web::Scraper
  - Web::Query
  - WWW::Scraper::Lite
  - HTML::Feature
HTML::TreeBuilder::Select — traverse a HTML tree using CSS selectors
Scrappy::Scraper::Parser