Fetch all news from a blog

[joseprl89]

Hi,

I am trying to create a recipe to obtain a cookbook from a gastronomic blog.

Therefore, I have created a recipe based on an already existing one, and it works like a charm except for a single issue, Calibre seems to ignore the pagination of the rss reader, and fetches only the first 10 posts (which are the ones obtained when accessing its news feeds), so, whatever values I set to oldest article and max_articles_per_feed (greater than 10), I end up with only 10 articles per feed, which for a cookbook is a little brief IMHO.

This is one of the feeds I try to get:

http://www.directoalpaladar.com/cate...ianas/rss2.xml

As you see, it only displays 10 posts, and those are exactly the ones obtained in the generated ebook.

How can I implement the rss pagination in Calibre? Is it already done or should I add a feed for each page?

Thanks for your attention,

Josep

[kovidgoyal]

RSS is designed to show only the most recent articles. That feed limits itself to 10. There's no way to get previous articles from the feed, in calibre or outside it. You need ot implement parse_index() in the recipe and parse the actual blog's index page to get a list of all articles.

[joseprl89]

Okay, thanks for your advice, I'll give it a shot!

[Prestidigitweeze]

What about one particular category of a blog? I'm not exactly sure where I'd find the index, but I'm interested in retrieving all of the writers' interviews from The Paris Review (which, as you can see from the tabs, go back to the 1950s):

http://www.theparisreview.org/interviews

(Incidentally, that section of the site is a great resource for writers, readers, editors and critics.)

[johnsk11]

how do i pull this article into how to guide ?

The rss feed isn't showing all the article i have tried different varaiables but i only get the recent rss feed. Can you pull pages from a feed ?

http://www.kitchengadgets.org.uk/how...t-breadmakers/

thanks