Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > Miscellaneous > Lounge

Notices

Reply
 
Thread Tools Search this Thread
Old 07-24-2005, 08:24 AM   #1
Alexander Turcic
Fully Converged
Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.
 
Alexander Turcic's Avatar
 
Posts: 17,455
Karma: 10995944
Join Date: Oct 2002
Location: Switzerland
Device: Sony PRS-650 / Nexus 7 / Kindle PW
NewsRaider scrapes sites for news

PalmAddicts has a post this morning on a new application called NewsRaider. The Proporta/Tomeraider guys advertise it as:

A revolutionary application for Windows that allows any News, Reviews or Magazine site to have its articles "raided" and converted into a single rolling news service. NewsRaider is free. We guarantee that no other product or service can give you so much news in such a distilled format. NewsRaider is fast. The articles are downloaded before you want to read them (It sits in the background taking up little system resources but huge amounts of news resources). NewsRaider does not use RSS or other syndication. It goes straight to the source. This means that you get the news content you want, whenever you want.

Really sorry, but I don't see the benefit in scraping news over using official RSS feeds. NewsRaider has scraping scripts for CNN, BBC News, and Guardian, even though each one of them already offers feeds for various sections of their site. And if you really have to scrape content, wouldn't it be better to learn how to do it with Regular Expressions + Sitescooper instead of studying an incompatible "Raid Script" language?
Alexander Turcic is offline   Reply With Quote
Old 07-24-2005, 10:16 AM   #2
csmith75
Member
csmith75 began at the beginning.
 
Posts: 17
Karma: 10
Join Date: Dec 2004
Device: Kindle
I've had Newsraider on my laptop for a number of months now and it's pretty easy to use since it just downloads news in the background. I used to use it with Tomeraider on my Axim x50 and take the news with me in the morning since it was quicker than downloading all my feeds via RSS (plus you get the full content). I stopped using it though because it just mysteriously stopped working with Tomeraider.
csmith75 is offline   Reply With Quote
Old 07-24-2005, 10:42 AM   #3
hacker
Technology Mercenary
hacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with others
 
hacker's Avatar
 
Posts: 614
Karma: 2561
Join Date: Feb 2003
Location: New London, CT
Device: Direct Neural Implant
Anyone happen to know the UserAgent string or netblock they are using, so I can be sure to block them? Thanks.
hacker is offline   Reply With Quote
Old 07-24-2005, 01:27 PM   #4
Laurens
Jah Blessed
Laurens is no ebook tyro.Laurens is no ebook tyro.Laurens is no ebook tyro.Laurens is no ebook tyro.Laurens is no ebook tyro.Laurens is no ebook tyro.Laurens is no ebook tyro.Laurens is no ebook tyro.Laurens is no ebook tyro.Laurens is no ebook tyro.
 
Laurens's Avatar
 
Posts: 1,295
Karma: 1373
Join Date: Apr 2003
Location: The Netherlands
Device: iPod Touch
The user agent is "NewsRaider". I wouldn't worry about this app hijacking too much bandwidth. The interface is spectacularly ugly and unintuitive, I don't think many people will want to use this app to begin with. Its only redeeming value is that the pages do come out sort of right on the PPC client. Admittedly, it does do what it says.
Laurens is offline   Reply With Quote
Old 07-24-2005, 01:51 PM   #5
hacker
Technology Mercenary
hacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with othershacker plays well with others
 
hacker's Avatar
 
Posts: 614
Karma: 2561
Join Date: Feb 2003
Location: New London, CT
Device: Direct Neural Implant
I was under the impression that it just pounded the hell out of your pages trying to find newsworthy sections from some basic word-analysis.

I've got enough bandwidth to throw around, but I don't if 500,000 people all hit the same domains with mal-behaved clients that ignorantly hammer pages looking for something that resembles "news".
hacker is offline   Reply With Quote
Old 08-12-2005, 05:38 AM   #6
MatYadabyte
Zealot
MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.
 
Posts: 111
Karma: 1013536
Join Date: Aug 2005
Hi

NewsRaider is actually very bandwidth efficient. It doesn’t download the content that is not relevant to the article.

I agree that its is one ugly interface but we are going to start working on that pretty soon First we are going to do the Palm version to compliment the PPC and PC versions. If anyone would like to beta test this we would be delighted.

Thanks very much,

And any questions, comments or criticisms you have, just ask

Mat
MatYadabyte is offline   Reply With Quote
Old 08-12-2005, 05:50 AM   #7
MatYadabyte
Zealot
MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.MatYadabyte ought to be getting tired of karma fortunes by now.
 
Posts: 111
Karma: 1013536
Join Date: Aug 2005
Hi Alexander

NewsRaider over RSS advantages:


• NewsRaider downloads articles before you read them, unlike with RSS.
• NewsRaider downloads articles from sources that do not provide full or even any syndication.
• NewsRaider brings together thousands of articles a day that can be browsed, searched and filtered faster than any other method available. Am I worng here?
• NewsRaider removes all unwanted content from sites, including popups, scripts, banners and adverts.
• NewsRaider provides a very unique reading experience. There is no other way to get so much news content so efficiently.

Thanks ,

Mat

Any questions, just ask
MatYadabyte is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Log-in to news sites? JDługosz Calibre 1 07-03-2010 11:06 PM
add more sites to download news VICTORSJG Calibre 1 01-10-2010 03:29 PM
Any news to ebook similar to Newsraider? richough3 Reading and Management 1 08-21-2009 12:50 PM
NewsRaider 1.34 Released MatYadabyte Reading and Management 0 05-08-2006 08:03 AM
Thoughts on Mobile News Sites Bob Russell Lounge 0 05-17-2005 09:38 AM


All times are GMT -4. The time now is 04:17 AM.


MobileRead.com is a privately owned, operated and funded community.