Comments on: Blegging for Help: Web Scraping for Content?

By: fminer

fminer — Wed, 22 Jun 2011 04:27:05 +0000

You can try our production web scraping tool FMiner: http://www.fminer.com .
Now we will make a FREE extraction project for every new user.

By: What are some ways to extract the main text from an blog entry using Python? - Quora

Sun, 26 Dec 2010 19:13:35 +0000

[...] Stenström There are lots of good suggestions in the comment to this blog post: http://lingpipe-blog.com/2010/01…Insert a dynamic date here BIU @ Edit [...]

By: Web text extraction systems: How to get the main text of an arbitrary web page | FZ Blogs

Thu, 16 Sep 2010 19:05:37 +0000

[...] I have seen that the developer of the famous Lingpipe software also looked for a similar thing: Blegging for Help: Web Scraping for Content? [...]

By: Dori Stein

Dori Stein — Thu, 16 Sep 2010 15:14:17 +0000

I think you should also read about scraping tools and how to compare them on http://www.fornova.net/blog/?p=18

By: Emre Sevinç

Emre Sevinç — Mon, 23 Aug 2010 17:52:06 +0000

I’m trying Christian Kohlschütter’s boilerpipe code with Dutch and Turkish news sites, magazines and blogs. So far I’m satisfied with the results. Thanks for making it open source!

By: Vít Baisa

Vít Baisa — Mon, 23 Aug 2010 14:34:16 +0000

I knew why to write my thesis in English instead of Czech. :) I am glad for your feedback. If you are still interested, please, don’t hesitate to contact me via email (google “baisa vít muni”) and we will surely make understood. :)

By: Emre Sevinç

Emre Sevinç — Mon, 23 Aug 2010 14:05:22 +0000

> Ok. I might package up the code I’ve used and release it GPL’d on my
> website.

I’d definitely give it a try. Can you share your code?

By: Emre Sevinç

Emre Sevinç — Mon, 23 Aug 2010 14:02:29 +0000

Vít Baisa,

I’d definitely would like to have a copy of your software, is it open source?

By: Chris

Chris — Tue, 20 Apr 2010 02:32:46 +0000

I’ve spent the past nine months studying (and waiting out) the market to see what products would best sell via the Internet. I’ve come across a few price and product scraping services that all seemed just about the same with pricing and results… though some simply provided the data in a collective dump while others provided a more readable format for additional cost.

The one that seems most attractive to us at this time is Mozenda. They are the least expensive for the same level of results as a number of others. If you don’t have budget issues, there are a few that can definitely provide more robust and powerful results. Those are worth considering down the road for us, just not yet.

Good luck!

By: Keyvan

Keyvan — Wed, 07 Apr 2010 10:20:09 +0000

Someone mentioned Readability. I ported it a while ago to PHP and have a web-service available which tries to pick out content from HTML pages: http://fivefilters.org/content-only/

There’s a newer version released late January which is supposed to be more accurate: http://blog.arc90.com/2010/01/26/introducing-readability-1-5/