oldest article limit

flyingfoxlee · 12-23-2012, 05:16 AM

I was trying to fetch a blog into a mobi for kindle. the blog is kind of old, i.e. the articles
are more than 2 years or even older. In this case, calibre fails to fetch them.
I've tried to make the oldest_article varible very large in the advanced mode, but it seems that the limit could not exeed like 365 days in the basic mode.
Any help?

kovidgoyal · 12-23-2012, 05:19 AM

rss feeds usually only contain the most recent articles, there is no point in trying to use rss to download historical articles. Open the rss feed inn an rss feed reader or a browser and see how many articles are actually available.

flyingfoxlee · 12-23-2012, 05:26 AM

Quote:

Originally Posted by kovidgoyal

rss feeds usually only contain the most recent articles, there is no point in trying to use rss to download historical articles. Open the rss feed inn an rss feed reader or a browser and see how many articles are actually available.

That's the answer, calibre fetched all the articles in rss feeder.
Thank you for the great software and this answer.
Any suggestion on fetch old articles via calibre in this case?

kovidgoyal · 12-23-2012, 05:36 AM

Write a custom recipe with parse_index that parses the blogs html index page to get a list of articles.

flyingfoxlee · 12-24-2012, 05:33 AM

Quote:

Originally Posted by kovidgoyal

Write a custom recipe with parse_index that parses the blogs html index page to get a list of articles.

That really helps. Thanks again.
One more question, what can I do if there were more than one index.html that I want to put them together, index_to_soup seems to take only one string as a parameter.

kovidgoyal · 12-24-2012, 05:42 AM

call it twice.

flyingfoxlee · 12-24-2012, 06:24 AM

Quote:

Originally Posted by kovidgoyal

call it twice.

You mean

Code:

soup = index_to_soup(index_one)
# process soup
soup = index_to_soup(index_two)
# process soup

or

Code:

soup = index_to_soup(index_one)
 soup = index_to_soup(index_two)
# process soup

I'm afraid in the second case soup would be overwritten.

flyingfoxlee · 12-24-2012, 06:59 AM

I got it by using a for loop.

12-23-2012, 05:16 AM	#1
flyingfoxlee Member Posts: 21 Karma: 10 Join Date: May 2011 Device: kindle 3	oldest article limit I was trying to fetch a blog into a mobi for kindle. the blog is kind of old, i.e. the articles are more than 2 years or even older. In this case, calibre fails to fetch them. I've tried to make the oldest_article varible very large in the advanced mode, but it seems that the limit could not exeed like 365 days in the basic mode. Any help?

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Sort Problem (not sorting newest to oldest)	Ron.	Calibre	46	08-16-2011 03:06 PM
What is the oldest book in the world?	astra	General Discussions	17	04-22-2011 04:57 PM
Oldest Domesticated Cat?	kennyc	Lounge	0	11-12-2010 10:23 AM
Troubleshooting Sort is all reversed! - Oldest first	bibble	Amazon Kindle	5	06-24-2010 04:25 PM
Who has the oldest fully function reading device?	brecklundin	Legacy E-Book Devices	45	03-27-2009 06:27 PM

12-23-2012, 05:19 AM	#2
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	rss feeds usually only contain the most recent articles, there is no point in trying to use rss to download historical articles. Open the rss feed inn an rss feed reader or a browser and see how many articles are actually available.

12-23-2012, 05:36 AM	#4
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Write a custom recipe with parse_index that parses the blogs html index page to get a list of articles.

12-24-2012, 05:42 AM	#6
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	call it twice.

12-24-2012, 06:59 AM	#8
flyingfoxlee Member Posts: 21 Karma: 10 Join Date: May 2011 Device: kindle 3	I got it by using a for loop.