MobileRead Forums
Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes
Reload this Page News articles repeat

Notices

Reply
 
Thread Tools Search this Thread
Old 03-31-2014, 04:56 PM   #1
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
News articles repeat
Has anyone noticed that frequently articles will repeat in one download? I see this in the New York Times, the Boston Globe, Associated Press and others. It seems random, and to occur for news sources that have more (vs. fewer) articles per day.
NSILMike is offline   Reply With Quote
Old 03-31-2014, 06:48 PM   #2
Camper65
Enthusiast
Camper65 began at the beginning.
 
Posts: 32
Karma: 10
Join Date: Apr 2011
Device: Kindle wifi; Dell 2in1
Is this happening with the built-in recipes or custom recipes?

one thing to make sure that is in the recipe is the following. I know it works well with the few custom recipes I've been using.

ignore_duplicate_articles = {'title', 'url'}
remove_empty_feeds = True #Removes an empty feed in the download (especially if all duplicates).
Camper65 is offline   Reply With Quote
Advert
Old 04-01-2014, 10:27 AM   #3
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
Quote:
Originally Posted by Camper65 View Post
Is this happening with the built-in recipes or custom recipes?

one thing to make sure that is in the recipe is the following. I know it works well with the few custom recipes I've been using.

ignore_duplicate_articles = {'title', 'url'}
remove_empty_feeds = True #Removes an empty feed in the download (especially if all duplicates).
Built-in.
NSILMike is offline   Reply With Quote
Old 05-06-2014, 05:06 PM   #4
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
Quote:
Originally Posted by NSILMike View Post
Built-in.
Will anyone correct the built-in recipes? It seems to be getting more common.
NSILMike is offline   Reply With Quote
Old 05-06-2014, 09:22 PM   #5
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,345
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
SOme people like having repeated artricles in different sections, since they only browse a few sections. It is up to the authors of the recipes in question if they want to remove duplicates of not. If you disagree witht he recipe authros choice you are free to customize the builtin recipe for yourself.
kovidgoyal is offline   Reply With Quote
Advert
Old 05-07-2014, 09:19 AM   #6
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
Quote:
Originally Posted by kovidgoyal View Post
SOme people like having repeated artricles in different sections, since they only browse a few sections. It is up to the authors of the recipes in question if they want to remove duplicates of not. If you disagree witht he recipe authros choice you are free to customize the builtin recipe for yourself.
Hmmm...I suppose that may be so. I am using Calibre to sync to Calibre Companion to read items on a portable device. There are no 'sections' only a series of articles.
Is there an easy set of command lines I can insert into the recipes to eliminate the dupes?
Thanks.
NSILMike is offline   Reply With Quote
Old 05-07-2014, 09:23 AM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,345
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Camper65 already posted them for you.
kovidgoyal is offline   Reply With Quote
Old 05-07-2014, 09:42 AM   #8
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
Quote:
Originally Posted by kovidgoyal View Post
Camper65 already posted them for you.
Thanks
NSILMike is offline   Reply With Quote
Old 06-04-2014, 03:40 PM   #9
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
Quote:
Originally Posted by NSILMike View Post
Hmmm...I suppose that may be so. I am using Calibre to sync to Calibre Companion to read items on a portable device. There are no 'sections' only a series of articles.
Is there an easy set of command lines I can insert into the recipes to eliminate the dupes?
Thanks.
and now it's gotten worse. At least I could progress thru a news source and just skip the dupes. Now it goes back to an earlier instance of the article...
NSILMike is offline   Reply With Quote
Reply

« Previous Thread | Next Thread »

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
TOC - Categories and articles like Calibre News alexvf Conversion 4 05-08-2011 04:41 PM
Feed content instead of articles in downloaded news bubak Recipes 2 04-05-2011 06:38 PM
The Age Feed - repeat articles Quasii Recipes 2 03-09-2011 06:38 PM
News Articles List in 0.7.20 Ola Calibre 3 09-27-2010 07:38 AM


All times are GMT -4. The time now is 06:13 AM.

Contact Us - FAQ - Guidelines - Privacy - Top

MobileRead.com is a privately owned, operated and funded community.