Reuters

[rasteps]

Has anyone ever tackled the Reuters website as a recipe???

If not, can anyone give me a start on how to go about it?

https://www.reuters.com/

[kovidgoyal]

Find an rss feed or an index page and get the list of articles to download from that. Then add the needed keep-only_tags and remove_tags to get rid of the cruft from the downloaded articles.

[rasteps]

It seems that Reuters no longer publishes its RSS feed.

[Parisien]

I used to get the Reuters News every day from here, but about a month ago it started failing with the message: <urlopen error [Errno 11001] getaddrinfo failed>

Any help to get it back would be much appreciated.

[kovidgoyal]

Originally Posted by rasteps

It seems that Reuters no longer publishes its RSS feed.

Then you need to find some page that lists current articles.

[rasteps]

Originally Posted by kovidgoyal

Then you need to find some page that lists current articles.

Unfortunately, I've only been able to get their front page so far.

[duluoz]

Hey rasteps. Yes, unfortunately Reuters cancelled their RSS feeds last month. Somebody has managed to use Google News to get one working again though, so its easy to build a recipe around that. Link is below - but this is a workaround so dont expect it to work forever.

https://news.google.com/rss/search?q...hl=en-US&gl=US

[kovidgoyal]

Originally Posted by rasteps

Unfortunately, I've only been able to get their front page so far.

They have per section pages as well, you would need to write a parse_index function in your recipe that extracts articles from these.

[rasteps]

Originally Posted by duluoz

Hey rasteps. Yes, unfortunately Reuters cancelled their RSS feeds last month. Somebody has managed to use Google News to get one working again though, so its easy to build a recipe around that. Link is below - but this is a workaround so dont expect it to work forever.

https://news.google.com/rss/search?q...hl=en-US&gl=US

That's quite ingenious!!!

[rasteps]

Originally Posted by kovidgoyal

They have per section pages as well, you would need to write a parse_index function in your recipe that extracts articles from these.

I'm not quite that advanced yet. I was just trying to fix the Japanese Reuters newsfeed. I have managed to get a different newsfeed from NHK (the Japanese public broadcasting network), but I can't figure out how to schedule the downloads.

[kovidgoyal]

I had 20 minutes so here you go: https://github.com/kovidgoyal/calibr...4b23eee3b91b96

[rasteps]

Originally Posted by kovidgoyal

I had 20 minutes so here you go: https://github.com/kovidgoyal/calibr...4b23eee3b91b96

Thanks. I'll give it a whirl.

[duluoz]

Originally Posted by kovidgoyal

I had 20 minutes so here you go: https://github.com/kovidgoyal/calibr...4b23eee3b91b96

Works perfectly

[noob12345]

Originally Posted by kovidgoyal

I had 20 minutes so here you go: https://github.com/kovidgoyal/calibr...4b23eee3b91b96

Sorry, I am new to this. So, how should I use this? Should I update Calibre? Or I need to do something else?

For your info, I still cant get Reuters from Calibre.

[rasteps]

Originally Posted by kovidgoyal

I had 20 minutes so here you go: https://github.com/kovidgoyal/calibr...4b23eee3b91b96

I finally got around to trying this recipe, and it works for the section headings, but the articles do not come with them. Thanks for taking the time to write this up though.