Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 12-23-2012, 05:16 AM   #1
flyingfoxlee
Member
flyingfoxlee began at the beginning.
 
Posts: 21
Karma: 10
Join Date: May 2011
Device: kindle 3
Red face oldest article limit

I was trying to fetch a blog into a mobi for kindle. the blog is kind of old, i.e. the articles
are more than 2 years or even older. In this case, calibre fails to fetch them.
I've tried to make the oldest_article varible very large in the advanced mode, but it seems that the limit could not exeed like 365 days in the basic mode.
Any help?
flyingfoxlee is offline   Reply With Quote
Old 12-23-2012, 05:19 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,468
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
rss feeds usually only contain the most recent articles, there is no point in trying to use rss to download historical articles. Open the rss feed inn an rss feed reader or a browser and see how many articles are actually available.
kovidgoyal is offline   Reply With Quote
Old 12-23-2012, 05:26 AM   #3
flyingfoxlee
Member
flyingfoxlee began at the beginning.
 
Posts: 21
Karma: 10
Join Date: May 2011
Device: kindle 3
Quote:
Originally Posted by kovidgoyal View Post
rss feeds usually only contain the most recent articles, there is no point in trying to use rss to download historical articles. Open the rss feed inn an rss feed reader or a browser and see how many articles are actually available.
That's the answer, calibre fetched all the articles in rss feeder.
Thank you for the great software and this answer.
Any suggestion on fetch old articles via calibre in this case?
flyingfoxlee is offline   Reply With Quote
Old 12-23-2012, 05:36 AM   #4
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,468
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Write a custom recipe with parse_index that parses the blogs html index page to get a list of articles.
kovidgoyal is offline   Reply With Quote
Old 12-24-2012, 05:33 AM   #5
flyingfoxlee
Member
flyingfoxlee began at the beginning.
 
Posts: 21
Karma: 10
Join Date: May 2011
Device: kindle 3
Thumbs up

Quote:
Originally Posted by kovidgoyal View Post
Write a custom recipe with parse_index that parses the blogs html index page to get a list of articles.
That really helps. Thanks again.
One more question, what can I do if there were more than one index.html that I want to put them together, index_to_soup seems to take only one string as a parameter.
flyingfoxlee is offline   Reply With Quote
Old 12-24-2012, 05:42 AM   #6
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,468
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
call it twice.
kovidgoyal is offline   Reply With Quote
Old 12-24-2012, 06:24 AM   #7
flyingfoxlee
Member
flyingfoxlee began at the beginning.
 
Posts: 21
Karma: 10
Join Date: May 2011
Device: kindle 3
Quote:
Originally Posted by kovidgoyal View Post
call it twice.
You mean
Code:
soup = index_to_soup(index_one)
# process soup
soup = index_to_soup(index_two)
# process soup
or
Code:
soup = index_to_soup(index_one)
 soup = index_to_soup(index_two)
# process soup
I'm afraid in the second case soup would be overwritten.
flyingfoxlee is offline   Reply With Quote
Old 12-24-2012, 06:59 AM   #8
flyingfoxlee
Member
flyingfoxlee began at the beginning.
 
Posts: 21
Karma: 10
Join Date: May 2011
Device: kindle 3
I got it by using a for loop.
flyingfoxlee is offline   Reply With Quote
Reply

Tags
oldest_article, recipe

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Sort Problem (not sorting newest to oldest) Ron. Calibre 46 08-16-2011 03:06 PM
What is the oldest book in the world? astra General Discussions 17 04-22-2011 04:57 PM
Oldest Domesticated Cat? kennyc Lounge 0 11-12-2010 10:23 AM
Troubleshooting Sort is all reversed! - Oldest first bibble Amazon Kindle 5 06-24-2010 04:25 PM
Who has the oldest fully function reading device? brecklundin Legacy E-Book Devices 45 03-27-2009 06:27 PM


All times are GMT -4. The time now is 12:02 PM.


MobileRead.com is a privately owned, operated and funded community.