View Single Post
Old 01-27-2010, 02:08 AM   #14
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 9,897
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Kindle PaperWhite SE 11th Gen
Quote:
Originally Posted by LlamaZorz View Post
The problem is my feed doesn't limit anything it contains no dates or time data. I can use many different agregators as well as feedbooks and they work great. They get every item of the RSS feed. It is only calibre which limits me.

Here is a sample of the RSS feed. As you can see its incredibly basic and uniform
http://paste2.org/p/634868
Update: It totally blew right past me that this was a custom feed. Maybe my rambling will help others.

Let me clarify things. In a news aggregator the first thing it does when you subscribe to a rss feed is go out and grabs all of the new items. This list of new items is what I'm referring to when I say your feed limits you to 120 new items.

The list of new items is what Calibre is able to get via the feed.

If you are using an interactive aggregator, when you scroll back past the new items it goes and asks the web site for the previous (archived) articles in the feed. When you scroll past that list it will ask for the (archived) articles before that. In very short order you can go back 1000s of articles.

Now if the rss feed didn't have the ability for a webmaster or web host (I don't know who sets it) to set a limit on the initial feed all hell would break loose, one query would return 1000s of archived articles.

Calibre recipes operate within this new items limit. If you want you can use Calibre to only get 40 of those 120 or use it to only get the articles within the set of 120 that are 4 days old or less , but you can't bust past that initial new item limit without being more interactive.

Google reader (or other aggregator) is the solution for this. There is a recipe for Google reader. You know how aggregators keep collecting every new item sent from the feed. So when the recipe goes to Google Reader it can download however many new items that Google reader has collected. Currently my Google Reader as 24 new articles from the site that limits me to 10 new items.

I hope I made some sense in this rambling of mine.

Maybe Calibre does have a 120 article limit per feed?

Last edited by DoctorOhh; 01-27-2010 at 02:23 AM.
DoctorOhh is offline   Reply With Quote