question about news downloads

[edzard]

Hello everybody,

First of all, thanks for the work you've done on making our e-readers so much more useful. I have been playing around with the news function of callibre, and I've selected that some sites will be downloaded and synchronized daily. This works excellently. However, the program does not download only the new articles that have been posted since the previous download, but it downloads all articles up to the maximum specified in the sync options.

I would like to set the news sync so that it only downloads new articles. Is this possible? Right now I set callibre that it keeps copies for one day in order to reduce the amount of duplication, but there must be a more elegant way. Is there an option somewhere so it only downloads the articles that have been newly added since the last download?

Thanks!

[Starson17]

Originally Posted by edzard

Hello everybody,

First of all, thanks for the work you've done on making our e-readers so much more useful. I have been playing around with the news function of callibre, and I've selected that some sites will be downloaded and synchronized daily. This works excellently. However, the program does not download only the new articles that have been posted since the previous download, but it downloads all articles up to the maximum specified in the sync options.

I would like to set the news sync so that it only downloads new articles. Is this possible? Right now I set callibre that it keeps copies for one day in order to reduce the amount of duplication, but there must be a more elegant way. Is there an option somewhere so it only downloads the articles that have been newly added since the last download?

There is code in the code sticky to do this. I believe it's triggered by the URL for each article. There's no global option, so you need to modify all recipes you want to use this on. If a recipe/ebook creation fails after the feed page is fetched, the article will still be marked as having been retrieved, so you will miss it on the next fetch.

[edzard]

Found the code. Thanks!