Hey Hacker
>>>>Sitescooper has been doing this for at least the last 5 years, probably longer, and it supports quite a few output formats (including my favorite).
Incorrect. Sitesooper merely gets the articles. Its doesn’t homogenize them , categorize them or index them. It also doesn’t provide cross source searching, filtering or field sorting. If NewsRaider were just an application that leeched news articles, then yes, it would hardly be revolutionary.
>>>>Its a dead-end approach, since the "templates" are very fragile. Add an inner table on the site and your whole template breaks and has to be debugged and written over. Rename a page resource on the server-side, change a query string and all of it topples down in to a pile of goo.
Incorrect with reference to NewsRaider. If a site template changes we get an aletr and change the script, and upload the script and it is automatically updated in every client. In general users wont even notice the change
>>>>The fear (speaking as a content provider) is that we're getting pounded by thousands of users who are all running these tools, crawlers, spiders and other things against our sites (and our client's sites) without considering the implications of a script that requests 1,600 pages in 5 minutes (as someone did yesterday on one of our servers, trying to get the entire history of the jpilot mailing list with some Java tool).
I’m not sure what sites you are referring to but NewsRaider is very polite in terms of bandwidth and retrieval. In our tests we find it saves bandwidth when compared against RSS and direct browsing. Sure, some of these “other things” are just plain rude, but NewsRaider isn’t, quite the contrary. You are jumping the gun a bit on these accusations
>>>>>Sorry, now you're blocked.
From where?
>>>>I wish people who wrote these "tools" would consider the implications of what they're doing. Most do not.
As said, most do not. But we have been in the business of handheld content since way before Avant Go, MobiPocket and Isilo and we do appreciate all of these concerns. NewsRaider was designed as a site friendly, user friendly and bandwidth friendly application. And I am friendly too
Mat