The Help Debbie Thread

GatorDeb · 09-17-2008, 12:52 PM

I have three recipes I created, and none of them is working. The categories are there, but they all the first heading from the first category and no other content (and are around 5-15k each). The built-in Wired feed is also doing the same. If I post the recipes here can someone help please? Do people have recipes done they want to share? Thanks!

kovidgoyal · 09-17-2008, 01:25 PM

Sure post away.

GatorDeb · 09-17-2008, 01:29 PM

Hey you came over!

I'm very excited about recipes. It goes without saying thanks for the program! I think I'm finally going to buckle down and learn how to use it. Where are the python scripts located so that I can put them here?

Thanks again!

If this works it will be awesome and you'll save me at LEAST $180 a year!!

kovidgoyal · 09-17-2008, 01:31 PM

There's a link in the user manual to the built-in recipes. You can share the ones you've created by clicking on the email recipe button in the custom news sources dialog.

GatorDeb · 09-17-2008, 01:36 PM

I clicked on Advanced View and it showed it to me

Here's the El Universal one

class AdvancedUserRecipe1221672918(BasicNewsRecipe):
title = u'El Universal'
oldest_article = 2
max_articles_per_feed = 100

feeds = [(u'Avances Generales De Ultima Hora', u'http://www.eluniversal.com/rss/avances.xml'), (u'Economia', u'http://www.eluniversal.com/rss/eco_avances.xml'), (u'Internacionales', u'http://www.eluniversal.com/rss/int_avances.xml'), (u'Deportes', u'http://www.eluniversal.com/rss/dep_avances.xml'), (u'Tiempo Libre', u'http://www.eluniversal.com/rss/til_avances.xml'), (u'Universo Empresorial', u'http://www.eluniversal.com/rss/uni_avances.xml'), (u'Cultura', u'http://www.eluniversal.com/rss/cul_avances.xml'), (u'Guia Turistica', u'http://www.eluniversal.com/rss/gtu_avances.xml'), (u'Nacional y Politica', u'http://www.eluniversal.com/rss/pol_avances.xml'), (u'Indicadores', u'http://www.eluniversal.com/rss/indicadores.xml'), (u'Opinion', u'http://www.eluniversal.com/rss/opi_avances.xml'), (u'Caracas', u'http://www.eluniversal.com/rss/ccs_avances.xml'), (u'Calidad De Vida', u'http://www.eluniversal.com/rss/ten_avances.xml'), (u'Ciencia y Tecnologia', u'http://www.eluniversal.com/rss/cyt_avances.xml'), (u'Tendencias', u'http://www.eluniversal.com/rss/tre_avances.xml'), (u'Sucesos', u'http://www.eluniversal.com/rss/suc_avances.xml')]

GatorDeb · 09-17-2008, 01:36 PM

Daily Kos:

class AdvancedUserRecipe1221672989(BasicNewsRecipe):
title = u'The Daily Kos'
oldest_article = 2
max_articles_per_feed = 100

feeds = [(u'Main Feeds', u'http://feeds.dailykos.com/dailykos/index.xml'), (u'Diaries', u'http://www.dailykos.com/rss1/Diary.rdf')]

GatorDeb · 09-17-2008, 01:37 PM

My version of The New York Times (with all 65 feed links from their rss page):

class AdvancedUserRecipe1221673018(BasicNewsRecipe):
title = u'The New York Times'
oldest_article = 1
max_articles_per_feed = 100

feeds = [(u'Main Page', u'http://www.nytimes.com/services/xml/rss/nyt/HomePage.xml'), (u'Business', u'http://www.nytimes.com/services/xml/rss/nyt/Business.xml'), (u'Business - Media & Advertising', u'http://www.nytimes.com/services/xml/rss/nyt/MediaandAdvertising.xml'), (u'Business - World Business', u'http://www.nytimes.com/services/xml/rss/nyt/WorldBusiness.xml'), (u'Business - Small Business', u'http://www.nytimes.com/services/xml/rss/nyt/SmallBusiness.xml'), (u'Business - Your Money', u'http://www.nytimes.com/services/xml/rss/nyt/YourMoney.xml'), (u'Business - DealBook', u'http://dealbook.blogs.nytimes.com/rss2.xml'), (u'Education', u'http://www.nytimes.com/services/xml/rss/nyt/Education.xml'), (u'Health', u'http://www.nytimes.com/services/xml/rss/nyt/Health.xml'), (u'Health - Research', u'http://www.nytimes.com/services/xml/rss/nyt/Research.xml'), (u'Health - Fitness & Nutrition', u'http://www.nytimes.com/services/xml/rss/nyt/Nutrition.xml'), (u'Health - Money & Policy', u'http://www.nytimes.com/services/xml/rss/nyt/HealthCarePolicy.xml'), (u'World', u'http://www.nytimes.com/services/xml/rss/nyt/World.xml'), (u'World - Africa News', u'http://www.nytimes.com/services/xml/rss/nyt/Africa.xml'), (u'World - Americas News', u'http://www.nytimes.com/services/xml/rss/nyt/Americas.xml'), (u'World - Asia News', u'http://www.nytimes.com/services/xml/rss/nyt/AsiaPacific.xml'), (u'World - Europe News', u'http://www.nytimes.com/services/xml/rss/nyt/Europe.xml'), (u'World - Middle East News', u'http://www.nytimes.com/services/xml/rss/nyt/MiddleEast.xml'), (u'U.S.', u'http://www.nytimes.com/services/xml/rss/nyt/US.xml'), (u'New York / Region', u'http://www.nytimes.com/services/xml/rss/nyt/NYRegion.xml'), (u'New York / Region - The City', u'http://www.nytimes.com/services/xml/rss/nyt/TheCity.xml'), (u'Obituaries', u'http://www.nytimes.com/services/xml/rss/nyt/Obituaries.xml'), (u'Science', u'http://www.nytimes.com/services/xml/rss/nyt/Science.xml'), (u'Science - Environment', u'http://www.nytimes.com/services/xml/rss/nyt/Environment.xml'), (u'Science - Space & Cosmos', u'http://www.nytimes.com/services/xml/rss/nyt/Space.xml'), (u'Sports', u'http://www.nytimes.com/services/xml/rss/nyt/Sports.xml'), (u'Sports - College Basketball', u'http://www.nytimes.com/services/xml/rss/nyt/CollegeBasketball.xml'), (u'Sports - College Football', u'http://www.nytimes.com/services/xml/rss/nyt/CollegeFootball.xml'), (u'Sports - Golf', u'http://www.nytimes.com/services/xml/rss/nyt/Golf.xml'), (u'Sports - Hockey', u'http://www.nytimes.com/services/xml/rss/nyt/Hockey.xml'), (u'Sports - Other Sports', u'http://www.nytimes.com/services/xml/rss/nyt/OtherSports.xml'), (u'Sports - Pro Baseball', u'http://www.nytimes.com/services/xml/rss/nyt/Baseball.xml'), (u'Sports - Pro Basketball', u'http://www.nytimes.com/services/xml/rss/nyt/ProBasketball.xml'), (u'Sports - Soccer', u'http://www.nytimes.com/services/xml/rss/nyt/Soccer.xml'), (u'Sports - Pro Football', u'http://www.nytimes.com/services/xml/rss/nyt/ProFootball.xml'), (u'Technology', u'http://www.nytimes.com/services/xml/rss/nyt/Technology.xml'), (u'Technology - Bits', u'http://bits.blogs.nytimes.com/rss2.xml'), (u'Technology - Personal Tech', u'http://www.nytimes.com/services/xml/rss/nyt/PersonalTech.xml'), (u"Technology - Pogue's Posts", u'http://pogue.blogs.nytimes.com/?feed=rss2'), (u'Washington', u'http://www.nytimes.com/services/xml/rss/nyt/Washington.xml'), (u'Arts', u'http://www.nytimes.com/services/xml/rss/nyt/Arts.xml'), (u'Arts - Design', u'http://www.nytimes.com/services/xml/rss/nyt/ArtandDesign.xml'), (u'Arts - Music', u'http://www.nytimes.com/services/xml/rss/nyt/Music.xml'), (u'Arts - Television News', u'http://www.nytimes.com/services/xml/rss/nyt/Television.xml'), (u'Automobiles', u'http://www.nytimes.com/services/xml/rss/nyt/Automobiles.xml'), (u'Books', u'http://www.nytimes.com/services/xml/rss/nyt/Books.xml'), (u'Book Review', u'http://www.nytimes.com/services/xml/rss/nyt/SundayBookReview.xml'), (u'Dining & Wine', u'http://www.nytimes.com/services/xml/rss/nyt/DiningandWine.xml'), (u'Fashion & Style', u'http://www.nytimes.com/services/xml/rss/nyt/FashionandStyle.xml'), (u'Fashion & Style - Thursday Styles', u'http://www.nytimes.com/services/xml/rss/nyt/ThursdayStyles.xml'), (u'Fashion & Style - Weddings', u'http://www.nytimes.com/services/xml/rss/nyt/Weddings.xml'), (u'Home & Garden', u'http://www.nytimes.com/services/xml/rss/nyt/HomeandGarden.xml'), (u'Jobs', u'http://www.nytimes.com/services/xml/rss/nyt/JobMarket.xml'), (u'Magazine', u'http://www.nytimes.com/services/xml/rss/nyt/Magazine.xml'), (u'Movie News', u'http://www.nytimes.com/services/xml/rss/nyt/MovieNews.xml'), (u'Movie Reviews', u'http://www.nytimes.com/services/xml/rss/nyt/Movies.xml'), (u'Real Estate', u'http://www.nytimes.com/services/xml/rss/nyt/RealEstate.xml'), (u'Theater', u'http://www.nytimes.com/services/xml/rss/nyt/Theater.xml'), (u'Travel', u'http://www.nytimes.com/services/xml/rss/nyt/Travel.xml'), (u'Travel - Escapes', u'http://www.nytimes.com/services/xml/rss/nyt/Escapes.xml'), (u'Week In Review', u'http://www.nytimes.com/services/xml/rss/nyt/WeekinReview.xml'), (u'Most E-mailed Articles', u'http://www.nytimes.com/services/xml/rss/nyt/pop_top.xml'), (u'Multimedia', u'http://www.nytimes.com/services/xml/rss/nyt/Multimedia.xml'), (u'Essential Knowledge Of The Day', u'http://feeds.feedburner.com/essentialknowledge'), (u'Editorials / Op-Ed', u'http://www.nytimes.com/services/xml/rss/nyt/Opinion.xml')]

Thanks!

kovidgoyal · 09-17-2008, 02:13 PM

There's a regression in the betas that's causing this. Will be fixed in the next release. In any case you should set

Code:

use_embedded_content = False

in the advanced view to force calibre to try to go get the actual articles. Doing that will work around the regression.

GatorDeb · 09-17-2008, 02:36 PM

Awesome it was able to do The Daily Kos! I have to see in the Reader to appreciate it, the LRF viewer is not enough (will test it within 10 minutes).

The NYT gave me the following message along with a bunch more popup errors:

('httperror_seek_wrapper', u'HTTP Error 404: Feed not found error: FeedBurner cannot locate this feed URI.'):
Failed to perform job: Fetch news from The New York Times
Detailed traceback:
Traceback (most recent call last):
File "parallel.py", line 760, in worker
File "parallel.py", line 729, in work
File "calibre\ebooks\lrf\feeds\convert_from.pyo", line 42, in main
File "calibre\web\feeds\main.pyo", line 114, in run_recipe
File "calibre\web\feeds\news.pyo", line 473, in download
File "calibre\web\feeds\news.pyo", line 586, in build_index
File "calibre\web\feeds\news.pyo", line 781, in parse_feeds
File "mechanize\_mechanize.pyo", line 203, in open
File "mechanize\_mechanize.pyo", line 254, in _mech_open
httperror_seek_wrapper: HTTP Error 404: Feed not found error: FeedBurner cannot locate this feed URI.
Log:
DEBUG: Skipping article Advertising: A Pop-Up Agency Shows Off Emerging Talent (Tue, 16 Sep, 2008 07:18) from feed Business - Media & Advertising as it is too old.

DEBUG: Skipping article Advertising: A Pop-Up Agency Shows Off Emerging Talent (Tue, 16 Sep, 2008 07:18) from feed Business - Media & Advertising as it is too old.

El Universal keep doing the same thing

17k file with just the headings and the first line from the first section.

GatorDeb · 09-17-2008, 02:42 PM

class AdvancedUserRecipe1221675465(BasicNewsRecipe):
title = u'El Universal'
oldest_article = 10
max_articles_per_feed = 100
use_embedded_content = False

feeds = [(u'Avances Generales De Ultima Hora', u'http://www.eluniversal.com/rss/avances.xml'), (u'Economia', u'http://www.eluniversal.com/rss/eco_avances.xml'), (u'Internacionales', u'http://www.eluniversal.com/rss/int_avances.xml'), (u'Deportes', u'http://www.eluniversal.com/rss/dep_avances.xml'), (u'Tiempo Libre', u'http://www.eluniversal.com/rss/til_avances.xml'), (u'Universo Empresorial', u'http://www.eluniversal.com/rss/uni_avances.xml'), (u'Cultura', u'http://www.eluniversal.com/rss/cul_avances.xml'), (u'Guia Turistica', u'http://www.eluniversal.com/rss/gtu_avances.xml'), (u'Nacional y Politica', u'http://www.eluniversal.com/rss/pol_avances.xml'), (u'Indicadores', u'http://www.eluniversal.com/rss/indicadores.xml'), (u'Opinion', u'http://www.eluniversal.com/rss/opi_avances.xml'), (u'Caracas', u'http://www.eluniversal.com/rss/ccs_avances.xml'), (u'Calidad De Vida', u'http://www.eluniversal.com/rss/ten_avances.xml'), (u'Ciencia y Tecnologia', u'http://www.eluniversal.com/rss/cyt_avances.xml'), (u'Tendencias', u'http://www.eluniversal.com/rss/tre_avances.xml'), (u'Sucesos', u'http://www.eluniversal.com/rss/suc_avances.xml')]

class AdvancedUserRecipe1221675662(BasicNewsRecipe):
title = u'The New York Times'
oldest_article = 1
max_articles_per_feed = 100
use_embedded_content = False

feeds = [(u'Main Page', u'http://www.nytimes.com/services/xml/rss/nyt/HomePage.xml'), (u'Business', u'http://www.nytimes.com/services/xml/rss/nyt/Business.xml'), (u'Business - Media & Advertising', u'http://www.nytimes.com/services/xml/rss/nyt/MediaandAdvertising.xml'), (u'Business - World Business', u'http://www.nytimes.com/services/xml/rss/nyt/WorldBusiness.xml'), (u'Business - Small Business', u'http://www.nytimes.com/services/xml/rss/nyt/SmallBusiness.xml'), (u'Business - Your Money', u'http://www.nytimes.com/services/xml/rss/nyt/YourMoney.xml'), (u'Business - DealBook', u'http://dealbook.blogs.nytimes.com/rss2.xml'), (u'Education', u'http://www.nytimes.com/services/xml/rss/nyt/Education.xml'), (u'Health', u'http://www.nytimes.com/services/xml/rss/nyt/Health.xml'), (u'Health - Research', u'http://www.nytimes.com/services/xml/rss/nyt/Research.xml'), (u'Health - Fitness & Nutrition', u'http://www.nytimes.com/services/xml/rss/nyt/Nutrition.xml'), (u'Health - Money & Policy', u'http://www.nytimes.com/services/xml/rss/nyt/HealthCarePolicy.xml'), (u'World', u'http://www.nytimes.com/services/xml/rss/nyt/World.xml'), (u'World - Africa News', u'http://www.nytimes.com/services/xml/rss/nyt/Africa.xml'), (u'World - Americas News', u'http://www.nytimes.com/services/xml/rss/nyt/Americas.xml'), (u'World - Asia News', u'http://www.nytimes.com/services/xml/rss/nyt/AsiaPacific.xml'), (u'World - Europe News', u'http://www.nytimes.com/services/xml/rss/nyt/Europe.xml'), (u'World - Middle East News', u'http://www.nytimes.com/services/xml/rss/nyt/MiddleEast.xml'), (u'U.S.', u'http://www.nytimes.com/services/xml/rss/nyt/US.xml'), (u'New York / Region', u'http://www.nytimes.com/services/xml/rss/nyt/NYRegion.xml'), (u'New York / Region - The City', u'http://www.nytimes.com/services/xml/rss/nyt/TheCity.xml'), (u'Obituaries', u'http://www.nytimes.com/services/xml/rss/nyt/Obituaries.xml'), (u'Science', u'http://www.nytimes.com/services/xml/rss/nyt/Science.xml'), (u'Science - Environment', u'http://www.nytimes.com/services/xml/rss/nyt/Environment.xml'), (u'Science - Space & Cosmos', u'http://www.nytimes.com/services/xml/rss/nyt/Space.xml'), (u'Sports', u'http://www.nytimes.com/services/xml/rss/nyt/Sports.xml'), (u'Sports - College Basketball', u'http://www.nytimes.com/services/xml/rss/nyt/CollegeBasketball.xml'), (u'Sports - College Football', u'http://www.nytimes.com/services/xml/rss/nyt/CollegeFootball.xml'), (u'Sports - Golf', u'http://www.nytimes.com/services/xml/rss/nyt/Golf.xml'), (u'Sports - Hockey', u'http://www.nytimes.com/services/xml/rss/nyt/Hockey.xml'), (u'Sports - Other Sports', u'http://www.nytimes.com/services/xml/rss/nyt/OtherSports.xml'), (u'Sports - Pro Baseball', u'http://www.nytimes.com/services/xml/rss/nyt/Baseball.xml'), (u'Sports - Pro Basketball', u'http://www.nytimes.com/services/xml/rss/nyt/ProBasketball.xml'), (u'Sports - Soccer', u'http://www.nytimes.com/services/xml/rss/nyt/Soccer.xml'), (u'Sports - Pro Football', u'http://www.nytimes.com/services/xml/rss/nyt/ProFootball.xml'), (u'Technology', u'http://www.nytimes.com/services/xml/rss/nyt/Technology.xml'), (u'Technology - Bits', u'http://bits.blogs.nytimes.com/rss2.xml'), (u'Technology - Personal Tech', u'http://www.nytimes.com/services/xml/rss/nyt/PersonalTech.xml'), (u"Technology - Pogue's Posts", u'http://pogue.blogs.nytimes.com/?feed=rss2'), (u'Washington', u'http://www.nytimes.com/services/xml/rss/nyt/Washington.xml'), (u'Arts', u'http://www.nytimes.com/services/xml/rss/nyt/Arts.xml'), (u'Arts - Design', u'http://www.nytimes.com/services/xml/rss/nyt/ArtandDesign.xml'), (u'Arts - Music', u'http://www.nytimes.com/services/xml/rss/nyt/Music.xml'), (u'Arts - Television News', u'http://www.nytimes.com/services/xml/rss/nyt/Television.xml'), (u'Automobiles', u'http://www.nytimes.com/services/xml/rss/nyt/Automobiles.xml'), (u'Books', u'http://www.nytimes.com/services/xml/rss/nyt/Books.xml'), (u'Book Review', u'http://www.nytimes.com/services/xml/rss/nyt/SundayBookReview.xml'), (u'Dining & Wine', u'http://www.nytimes.com/services/xml/rss/nyt/DiningandWine.xml'), (u'Fashion & Style', u'http://www.nytimes.com/services/xml/rss/nyt/FashionandStyle.xml'), (u'Fashion & Style - Thursday Styles', u'http://www.nytimes.com/services/xml/rss/nyt/ThursdayStyles.xml'), (u'Fashion & Style - Weddings', u'http://www.nytimes.com/services/xml/rss/nyt/Weddings.xml'), (u'Home & Garden', u'http://www.nytimes.com/services/xml/rss/nyt/HomeandGarden.xml'), (u'Jobs', u'http://www.nytimes.com/services/xml/rss/nyt/JobMarket.xml'), (u'Magazine', u'http://www.nytimes.com/services/xml/rss/nyt/Magazine.xml'), (u'Movie News', u'http://www.nytimes.com/services/xml/rss/nyt/MovieNews.xml'), (u'Movie Reviews', u'http://www.nytimes.com/services/xml/rss/nyt/Movies.xml'), (u'Real Estate', u'http://www.nytimes.com/services/xml/rss/nyt/RealEstate.xml'), (u'Theater', u'http://www.nytimes.com/services/xml/rss/nyt/Theater.xml'), (u'Travel', u'http://www.nytimes.com/services/xml/rss/nyt/Travel.xml'), (u'Travel - Escapes', u'http://www.nytimes.com/services/xml/rss/nyt/Escapes.xml'), (u'Week In Review', u'http://www.nytimes.com/services/xml/rss/nyt/WeekinReview.xml'), (u'Most E-mailed Articles', u'http://www.nytimes.com/services/xml/rss/nyt/pop_top.xml'), (u'Multimedia', u'http://www.nytimes.com/services/xml/rss/nyt/Multimedia.xml'), (u'Essential Knowledge Of The Day', u'http://feeds.feedburner.com/essentialknowledge'), (u'Editorials / Op-Ed', u'http://www.nytimes.com/services/xml/rss/nyt/Opinion.xml')]

class AdvancedUserRecipe1221675438(BasicNewsRecipe):
title = u'The Daily Kos'
oldest_article = 1
max_articles_per_feed = 100
use_embedded_content = False

feeds = [(u'Main Feeds', u'http://feeds.dailykos.com/dailykos/index.xml'), (u'Diaries', u'http://www.dailykos.com/rss1/Diary.rdf')]

kovidgoyal · 09-17-2008, 02:47 PM

Quote:

Originally Posted by GatorDeb

Awesome it was able to do The Daily Kos! I have to see in the Reader to appreciate it, the LRF viewer is not enough (will test it within 10 minutes).

The NYT gave me the following message along with a bunch more popup errors:

('httperror_seek_wrapper', u'HTTP Error 404: Feed not found error: FeedBurner cannot locate this feed URI.'):
Failed to perform job: Fetch news from The New York Times
Detailed traceback:
Traceback (most recent call last):
File "parallel.py", line 760, in worker
File "parallel.py", line 729, in work
File "calibre\ebooks\lrf\feeds\convert_from.pyo", line 42, in main
File "calibre\web\feeds\main.pyo", line 114, in run_recipe
File "calibre\web\feeds\news.pyo", line 473, in download
File "calibre\web\feeds\news.pyo", line 586, in build_index
File "calibre\web\feeds\news.pyo", line 781, in parse_feeds
File "mechanize\_mechanize.pyo", line 203, in open
File "mechanize\_mechanize.pyo", line 254, in _mech_open
httperror_seek_wrapper: HTTP Error 404: Feed not found error: FeedBurner cannot locate this feed URI.
Log:
DEBUG: Skipping article Advertising: A Pop-Up Agency Shows Off Emerging Talent (Tue, 16 Sep, 2008 07:18) from feed Business - Media & Advertising as it is too old.

DEBUG: Skipping article Advertising: A Pop-Up Agency Shows Off Emerging Talent (Tue, 16 Sep, 2008 07:18) from feed Business - Media & Advertising as it is too old.

El Universal keep doing the same thing

17k file with just the headings and the first line from the first section.

One of the NYT feeds is incorrect/missing. Unfortunately, calibre doesn't handle that situation very gracefully.

GatorDeb · 09-17-2008, 02:52 PM

How can I find out which one of the 65 ones it is?

Any tips on El Universal? Thanks!

Ooohh I think I know what it is... Pogue's Post... probably thinks that ' is signaling something... off to test my theory ...

Nope, still broken

TNYT won't update and El Universal has no content. Sigh.

kovidgoyal · 09-17-2008, 03:01 PM

calibre will handle broken feed links more elegantly in the next release. I suggest waiting till then. I'll look at el universal in a bit, when i have some time.

GatorDeb · 09-17-2008, 03:05 PM

Take your time

Thanks, I appreciate all the help!

GatorDeb · 09-17-2008, 10:37 PM

I saw something about Feedburner in the feeds and recognized it from the error message... took that one off, it works great now! It was HUGE, though, so I'm taking off the feeds I don't want. I have 10 days to figure out if I can live with this one. Too bad it doesn't automatically create one once a day

Any plans to implement something in which it takes all feeds you specify and create one file? With links to each specific feed?

The only one left now is El Universal.

Thanks for the help!

09-17-2008, 12:52 PM	#1
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	The Help Debbie Thread I have three recipes I created, and none of them is working. The categories are there, but they all the first heading from the first category and no other content (and are around 5-15k each). The built-in Wired feed is also doing the same. If I post the recipes here can someone help please? Do people have recipes done they want to share? Thanks!

09-17-2008, 02:13 PM	#8
kovidgoyal creator of calibre Posts: 45,149 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	There's a regression in the betas that's causing this. Will be fixed in the next release. In any case you should set Code: use_embedded_content = False in the advanced view to force calibre to try to go get the actual articles. Doing that will work around the regression.

09-17-2008, 02:36 PM	#9
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	Awesome it was able to do The Daily Kos! I have to see in the Reader to appreciate it, the LRF viewer is not enough (will test it within 10 minutes). The NYT gave me the following message along with a bunch more popup errors: ('httperror_seek_wrapper', u'HTTP Error 404: Feed not found error: FeedBurner cannot locate this feed URI.'): Failed to perform job: Fetch news from The New York Times Detailed traceback: Traceback (most recent call last): File "parallel.py", line 760, in worker File "parallel.py", line 729, in work File "calibre\ebooks\lrf\feeds\convert_from.pyo", line 42, in main File "calibre\web\feeds\main.pyo", line 114, in run_recipe File "calibre\web\feeds\news.pyo", line 473, in download File "calibre\web\feeds\news.pyo", line 586, in build_index File "calibre\web\feeds\news.pyo", line 781, in parse_feeds File "mechanize\_mechanize.pyo", line 203, in open File "mechanize\_mechanize.pyo", line 254, in _mech_open httperror_seek_wrapper: HTTP Error 404: Feed not found error: FeedBurner cannot locate this feed URI. Log: DEBUG: Skipping article Advertising: A Pop-Up Agency Shows Off Emerging Talent (Tue, 16 Sep, 2008 07:18) from feed Business - Media & Advertising as it is too old. DEBUG: Skipping article Advertising: A Pop-Up Agency Shows Off Emerging Talent (Tue, 16 Sep, 2008 07:18) from feed Business - Media & Advertising as it is too old. El Universal keep doing the same thing 17k file with just the headings and the first line from the first section. Last edited by GatorDeb; 09-17-2008 at 02:40 PM.

09-17-2008, 02:52 PM	#12
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	How can I find out which one of the 65 ones it is? Any tips on El Universal? Thanks! Ooohh I think I know what it is... Pogue's Post... probably thinks that ' is signaling something... off to test my theory ... Nope, still broken TNYT won't update and El Universal has no content. Sigh. Last edited by GatorDeb; 09-17-2008 at 02:59 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
I followed a thread, and here I am!	Cadillac84	Introduce Yourself	6	08-25-2009 10:40 AM
MobileRead Official MobileRead Book Club: Welcome thread/November's book choice thread	PsyDocJoanne	Book Clubs	151	02-08-2009 08:42 PM
PRS-505 Debbie Macomber Special Edition	igorsk	News	11	12-01-2008 05:46 PM
Debbie Macomber Special Edition?	fishcube	Sony Reader	1	11-13-2008 07:49 PM

09-17-2008, 01:25 PM	#2
kovidgoyal creator of calibre Posts: 45,149 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Sure post away.

09-17-2008, 01:29 PM	#3
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	Hey you came over! I'm very excited about recipes. It goes without saying thanks for the program! I think I'm finally going to buckle down and learn how to use it. Where are the python scripts located so that I can put them here? Thanks again! If this works it will be awesome and you'll save me at LEAST $180 a year!!

09-17-2008, 01:31 PM	#4
kovidgoyal creator of calibre Posts: 45,149 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	There's a link in the user manual to the built-in recipes. You can share the ones you've created by clicking on the email recipe button in the custom news sources dialog.

09-17-2008, 01:36 PM	#5
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	I clicked on Advanced View and it showed it to me Here's the El Universal one class AdvancedUserRecipe1221672918(BasicNewsRecipe): title = u'El Universal' oldest_article = 2 max_articles_per_feed = 100 feeds = [(u'Avances Generales De Ultima Hora', u'http://www.eluniversal.com/rss/avances.xml'), (u'Economia', u'http://www.eluniversal.com/rss/eco_avances.xml'), (u'Internacionales', u'http://www.eluniversal.com/rss/int_avances.xml'), (u'Deportes', u'http://www.eluniversal.com/rss/dep_avances.xml'), (u'Tiempo Libre', u'http://www.eluniversal.com/rss/til_avances.xml'), (u'Universo Empresorial', u'http://www.eluniversal.com/rss/uni_avances.xml'), (u'Cultura', u'http://www.eluniversal.com/rss/cul_avances.xml'), (u'Guia Turistica', u'http://www.eluniversal.com/rss/gtu_avances.xml'), (u'Nacional y Politica', u'http://www.eluniversal.com/rss/pol_avances.xml'), (u'Indicadores', u'http://www.eluniversal.com/rss/indicadores.xml'), (u'Opinion', u'http://www.eluniversal.com/rss/opi_avances.xml'), (u'Caracas', u'http://www.eluniversal.com/rss/ccs_avances.xml'), (u'Calidad De Vida', u'http://www.eluniversal.com/rss/ten_avances.xml'), (u'Ciencia y Tecnologia', u'http://www.eluniversal.com/rss/cyt_avances.xml'), (u'Tendencias', u'http://www.eluniversal.com/rss/tre_avances.xml'), (u'Sucesos', u'http://www.eluniversal.com/rss/suc_avances.xml')]

09-17-2008, 01:37 PM	#7
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	My version of The New York Times (with all 65 feed links from their rss page): class AdvancedUserRecipe1221673018(BasicNewsRecipe): title = u'The New York Times' oldest_article = 1 max_articles_per_feed = 100 feeds = [(u'Main Page', u'http://www.nytimes.com/services/xml/rss/nyt/HomePage.xml'), (u'Business', u'http://www.nytimes.com/services/xml/rss/nyt/Business.xml'), (u'Business - Media & Advertising', u'http://www.nytimes.com/services/xml/rss/nyt/MediaandAdvertising.xml'), (u'Business - World Business', u'http://www.nytimes.com/services/xml/rss/nyt/WorldBusiness.xml'), (u'Business - Small Business', u'http://www.nytimes.com/services/xml/rss/nyt/SmallBusiness.xml'), (u'Business - Your Money', u'http://www.nytimes.com/services/xml/rss/nyt/YourMoney.xml'), (u'Business - DealBook', u'http://dealbook.blogs.nytimes.com/rss2.xml'), (u'Education', u'http://www.nytimes.com/services/xml/rss/nyt/Education.xml'), (u'Health', u'http://www.nytimes.com/services/xml/rss/nyt/Health.xml'), (u'Health - Research', u'http://www.nytimes.com/services/xml/rss/nyt/Research.xml'), (u'Health - Fitness & Nutrition', u'http://www.nytimes.com/services/xml/rss/nyt/Nutrition.xml'), (u'Health - Money & Policy', u'http://www.nytimes.com/services/xml/rss/nyt/HealthCarePolicy.xml'), (u'World', u'http://www.nytimes.com/services/xml/rss/nyt/World.xml'), (u'World - Africa News', u'http://www.nytimes.com/services/xml/rss/nyt/Africa.xml'), (u'World - Americas News', u'http://www.nytimes.com/services/xml/rss/nyt/Americas.xml'), (u'World - Asia News', u'http://www.nytimes.com/services/xml/rss/nyt/AsiaPacific.xml'), (u'World - Europe News', u'http://www.nytimes.com/services/xml/rss/nyt/Europe.xml'), (u'World - Middle East News', u'http://www.nytimes.com/services/xml/rss/nyt/MiddleEast.xml'), (u'U.S.', u'http://www.nytimes.com/services/xml/rss/nyt/US.xml'), (u'New York / Region', u'http://www.nytimes.com/services/xml/rss/nyt/NYRegion.xml'), (u'New York / Region - The City', u'http://www.nytimes.com/services/xml/rss/nyt/TheCity.xml'), (u'Obituaries', u'http://www.nytimes.com/services/xml/rss/nyt/Obituaries.xml'), (u'Science', u'http://www.nytimes.com/services/xml/rss/nyt/Science.xml'), (u'Science - Environment', u'http://www.nytimes.com/services/xml/rss/nyt/Environment.xml'), (u'Science - Space & Cosmos', u'http://www.nytimes.com/services/xml/rss/nyt/Space.xml'), (u'Sports', u'http://www.nytimes.com/services/xml/rss/nyt/Sports.xml'), (u'Sports - College Basketball', u'http://www.nytimes.com/services/xml/rss/nyt/CollegeBasketball.xml'), (u'Sports - College Football', u'http://www.nytimes.com/services/xml/rss/nyt/CollegeFootball.xml'), (u'Sports - Golf', u'http://www.nytimes.com/services/xml/rss/nyt/Golf.xml'), (u'Sports - Hockey', u'http://www.nytimes.com/services/xml/rss/nyt/Hockey.xml'), (u'Sports - Other Sports', u'http://www.nytimes.com/services/xml/rss/nyt/OtherSports.xml'), (u'Sports - Pro Baseball', u'http://www.nytimes.com/services/xml/rss/nyt/Baseball.xml'), (u'Sports - Pro Basketball', u'http://www.nytimes.com/services/xml/rss/nyt/ProBasketball.xml'), (u'Sports - Soccer', u'http://www.nytimes.com/services/xml/rss/nyt/Soccer.xml'), (u'Sports - Pro Football', u'http://www.nytimes.com/services/xml/rss/nyt/ProFootball.xml'), (u'Technology', u'http://www.nytimes.com/services/xml/rss/nyt/Technology.xml'), (u'Technology - Bits', u'http://bits.blogs.nytimes.com/rss2.xml'), (u'Technology - Personal Tech', u'http://www.nytimes.com/services/xml/rss/nyt/PersonalTech.xml'), (u"Technology - Pogue's Posts", u'http://pogue.blogs.nytimes.com/?feed=rss2'), (u'Washington', u'http://www.nytimes.com/services/xml/rss/nyt/Washington.xml'), (u'Arts', u'http://www.nytimes.com/services/xml/rss/nyt/Arts.xml'), (u'Arts - Design', u'http://www.nytimes.com/services/xml/rss/nyt/ArtandDesign.xml'), (u'Arts - Music', u'http://www.nytimes.com/services/xml/rss/nyt/Music.xml'), (u'Arts - Television News', u'http://www.nytimes.com/services/xml/rss/nyt/Television.xml'), (u'Automobiles', u'http://www.nytimes.com/services/xml/rss/nyt/Automobiles.xml'), (u'Books', u'http://www.nytimes.com/services/xml/rss/nyt/Books.xml'), (u'Book Review', u'http://www.nytimes.com/services/xml/rss/nyt/SundayBookReview.xml'), (u'Dining & Wine', u'http://www.nytimes.com/services/xml/rss/nyt/DiningandWine.xml'), (u'Fashion & Style', u'http://www.nytimes.com/services/xml/rss/nyt/FashionandStyle.xml'), (u'Fashion & Style - Thursday Styles', u'http://www.nytimes.com/services/xml/rss/nyt/ThursdayStyles.xml'), (u'Fashion & Style - Weddings', u'http://www.nytimes.com/services/xml/rss/nyt/Weddings.xml'), (u'Home & Garden', u'http://www.nytimes.com/services/xml/rss/nyt/HomeandGarden.xml'), (u'Jobs', u'http://www.nytimes.com/services/xml/rss/nyt/JobMarket.xml'), (u'Magazine', u'http://www.nytimes.com/services/xml/rss/nyt/Magazine.xml'), (u'Movie News', u'http://www.nytimes.com/services/xml/rss/nyt/MovieNews.xml'), (u'Movie Reviews', u'http://www.nytimes.com/services/xml/rss/nyt/Movies.xml'), (u'Real Estate', u'http://www.nytimes.com/services/xml/rss/nyt/RealEstate.xml'), (u'Theater', u'http://www.nytimes.com/services/xml/rss/nyt/Theater.xml'), (u'Travel', u'http://www.nytimes.com/services/xml/rss/nyt/Travel.xml'), (u'Travel - Escapes', u'http://www.nytimes.com/services/xml/rss/nyt/Escapes.xml'), (u'Week In Review', u'http://www.nytimes.com/services/xml/rss/nyt/WeekinReview.xml'), (u'Most E-mailed Articles', u'http://www.nytimes.com/services/xml/rss/nyt/pop_top.xml'), (u'Multimedia', u'http://www.nytimes.com/services/xml/rss/nyt/Multimedia.xml'), (u'Essential Knowledge Of The Day', u'http://feeds.feedburner.com/essentialknowledge'), (u'Editorials / Op-Ed', u'http://www.nytimes.com/services/xml/rss/nyt/Opinion.xml')] Thanks!

09-17-2008, 02:42 PM	#10
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	class AdvancedUserRecipe1221675465(BasicNewsRecipe): title = u'El Universal' oldest_article = 10 max_articles_per_feed = 100 use_embedded_content = False feeds = [(u'Avances Generales De Ultima Hora', u'http://www.eluniversal.com/rss/avances.xml'), (u'Economia', u'http://www.eluniversal.com/rss/eco_avances.xml'), (u'Internacionales', u'http://www.eluniversal.com/rss/int_avances.xml'), (u'Deportes', u'http://www.eluniversal.com/rss/dep_avances.xml'), (u'Tiempo Libre', u'http://www.eluniversal.com/rss/til_avances.xml'), (u'Universo Empresorial', u'http://www.eluniversal.com/rss/uni_avances.xml'), (u'Cultura', u'http://www.eluniversal.com/rss/cul_avances.xml'), (u'Guia Turistica', u'http://www.eluniversal.com/rss/gtu_avances.xml'), (u'Nacional y Politica', u'http://www.eluniversal.com/rss/pol_avances.xml'), (u'Indicadores', u'http://www.eluniversal.com/rss/indicadores.xml'), (u'Opinion', u'http://www.eluniversal.com/rss/opi_avances.xml'), (u'Caracas', u'http://www.eluniversal.com/rss/ccs_avances.xml'), (u'Calidad De Vida', u'http://www.eluniversal.com/rss/ten_avances.xml'), (u'Ciencia y Tecnologia', u'http://www.eluniversal.com/rss/cyt_avances.xml'), (u'Tendencias', u'http://www.eluniversal.com/rss/tre_avances.xml'), (u'Sucesos', u'http://www.eluniversal.com/rss/suc_avances.xml')] class AdvancedUserRecipe1221675662(BasicNewsRecipe): title = u'The New York Times' oldest_article = 1 max_articles_per_feed = 100 use_embedded_content = False feeds = [(u'Main Page', u'http://www.nytimes.com/services/xml/rss/nyt/HomePage.xml'), (u'Business', u'http://www.nytimes.com/services/xml/rss/nyt/Business.xml'), (u'Business - Media & Advertising', u'http://www.nytimes.com/services/xml/rss/nyt/MediaandAdvertising.xml'), (u'Business - World Business', u'http://www.nytimes.com/services/xml/rss/nyt/WorldBusiness.xml'), (u'Business - Small Business', u'http://www.nytimes.com/services/xml/rss/nyt/SmallBusiness.xml'), (u'Business - Your Money', u'http://www.nytimes.com/services/xml/rss/nyt/YourMoney.xml'), (u'Business - DealBook', u'http://dealbook.blogs.nytimes.com/rss2.xml'), (u'Education', u'http://www.nytimes.com/services/xml/rss/nyt/Education.xml'), (u'Health', u'http://www.nytimes.com/services/xml/rss/nyt/Health.xml'), (u'Health - Research', u'http://www.nytimes.com/services/xml/rss/nyt/Research.xml'), (u'Health - Fitness & Nutrition', u'http://www.nytimes.com/services/xml/rss/nyt/Nutrition.xml'), (u'Health - Money & Policy', u'http://www.nytimes.com/services/xml/rss/nyt/HealthCarePolicy.xml'), (u'World', u'http://www.nytimes.com/services/xml/rss/nyt/World.xml'), (u'World - Africa News', u'http://www.nytimes.com/services/xml/rss/nyt/Africa.xml'), (u'World - Americas News', u'http://www.nytimes.com/services/xml/rss/nyt/Americas.xml'), (u'World - Asia News', u'http://www.nytimes.com/services/xml/rss/nyt/AsiaPacific.xml'), (u'World - Europe News', u'http://www.nytimes.com/services/xml/rss/nyt/Europe.xml'), (u'World - Middle East News', u'http://www.nytimes.com/services/xml/rss/nyt/MiddleEast.xml'), (u'U.S.', u'http://www.nytimes.com/services/xml/rss/nyt/US.xml'), (u'New York / Region', u'http://www.nytimes.com/services/xml/rss/nyt/NYRegion.xml'), (u'New York / Region - The City', u'http://www.nytimes.com/services/xml/rss/nyt/TheCity.xml'), (u'Obituaries', u'http://www.nytimes.com/services/xml/rss/nyt/Obituaries.xml'), (u'Science', u'http://www.nytimes.com/services/xml/rss/nyt/Science.xml'), (u'Science - Environment', u'http://www.nytimes.com/services/xml/rss/nyt/Environment.xml'), (u'Science - Space & Cosmos', u'http://www.nytimes.com/services/xml/rss/nyt/Space.xml'), (u'Sports', u'http://www.nytimes.com/services/xml/rss/nyt/Sports.xml'), (u'Sports - College Basketball', u'http://www.nytimes.com/services/xml/rss/nyt/CollegeBasketball.xml'), (u'Sports - College Football', u'http://www.nytimes.com/services/xml/rss/nyt/CollegeFootball.xml'), (u'Sports - Golf', u'http://www.nytimes.com/services/xml/rss/nyt/Golf.xml'), (u'Sports - Hockey', u'http://www.nytimes.com/services/xml/rss/nyt/Hockey.xml'), (u'Sports - Other Sports', u'http://www.nytimes.com/services/xml/rss/nyt/OtherSports.xml'), (u'Sports - Pro Baseball', u'http://www.nytimes.com/services/xml/rss/nyt/Baseball.xml'), (u'Sports - Pro Basketball', u'http://www.nytimes.com/services/xml/rss/nyt/ProBasketball.xml'), (u'Sports - Soccer', u'http://www.nytimes.com/services/xml/rss/nyt/Soccer.xml'), (u'Sports - Pro Football', u'http://www.nytimes.com/services/xml/rss/nyt/ProFootball.xml'), (u'Technology', u'http://www.nytimes.com/services/xml/rss/nyt/Technology.xml'), (u'Technology - Bits', u'http://bits.blogs.nytimes.com/rss2.xml'), (u'Technology - Personal Tech', u'http://www.nytimes.com/services/xml/rss/nyt/PersonalTech.xml'), (u"Technology - Pogue's Posts", u'http://pogue.blogs.nytimes.com/?feed=rss2'), (u'Washington', u'http://www.nytimes.com/services/xml/rss/nyt/Washington.xml'), (u'Arts', u'http://www.nytimes.com/services/xml/rss/nyt/Arts.xml'), (u'Arts - Design', u'http://www.nytimes.com/services/xml/rss/nyt/ArtandDesign.xml'), (u'Arts - Music', u'http://www.nytimes.com/services/xml/rss/nyt/Music.xml'), (u'Arts - Television News', u'http://www.nytimes.com/services/xml/rss/nyt/Television.xml'), (u'Automobiles', u'http://www.nytimes.com/services/xml/rss/nyt/Automobiles.xml'), (u'Books', u'http://www.nytimes.com/services/xml/rss/nyt/Books.xml'), (u'Book Review', u'http://www.nytimes.com/services/xml/rss/nyt/SundayBookReview.xml'), (u'Dining & Wine', u'http://www.nytimes.com/services/xml/rss/nyt/DiningandWine.xml'), (u'Fashion & Style', u'http://www.nytimes.com/services/xml/rss/nyt/FashionandStyle.xml'), (u'Fashion & Style - Thursday Styles', u'http://www.nytimes.com/services/xml/rss/nyt/ThursdayStyles.xml'), (u'Fashion & Style - Weddings', u'http://www.nytimes.com/services/xml/rss/nyt/Weddings.xml'), (u'Home & Garden', u'http://www.nytimes.com/services/xml/rss/nyt/HomeandGarden.xml'), (u'Jobs', u'http://www.nytimes.com/services/xml/rss/nyt/JobMarket.xml'), (u'Magazine', u'http://www.nytimes.com/services/xml/rss/nyt/Magazine.xml'), (u'Movie News', u'http://www.nytimes.com/services/xml/rss/nyt/MovieNews.xml'), (u'Movie Reviews', u'http://www.nytimes.com/services/xml/rss/nyt/Movies.xml'), (u'Real Estate', u'http://www.nytimes.com/services/xml/rss/nyt/RealEstate.xml'), (u'Theater', u'http://www.nytimes.com/services/xml/rss/nyt/Theater.xml'), (u'Travel', u'http://www.nytimes.com/services/xml/rss/nyt/Travel.xml'), (u'Travel - Escapes', u'http://www.nytimes.com/services/xml/rss/nyt/Escapes.xml'), (u'Week In Review', u'http://www.nytimes.com/services/xml/rss/nyt/WeekinReview.xml'), (u'Most E-mailed Articles', u'http://www.nytimes.com/services/xml/rss/nyt/pop_top.xml'), (u'Multimedia', u'http://www.nytimes.com/services/xml/rss/nyt/Multimedia.xml'), (u'Essential Knowledge Of The Day', u'http://feeds.feedburner.com/essentialknowledge'), (u'Editorials / Op-Ed', u'http://www.nytimes.com/services/xml/rss/nyt/Opinion.xml')] class AdvancedUserRecipe1221675438(BasicNewsRecipe): title = u'The Daily Kos' oldest_article = 1 max_articles_per_feed = 100 use_embedded_content = False feeds = [(u'Main Feeds', u'http://feeds.dailykos.com/dailykos/index.xml'), (u'Diaries', u'http://www.dailykos.com/rss1/Diary.rdf')]

09-17-2008, 03:01 PM	#13
kovidgoyal creator of calibre Posts: 45,149 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	calibre will handle broken feed links more elegantly in the next release. I suggest waiting till then. I'll look at el universal in a bit, when i have some time.

09-17-2008, 03:05 PM	#14
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	Take your time Thanks, I appreciate all the help!

09-17-2008, 10:37 PM	#15
GatorDeb Evangelist Posts: 447 Karma: 5365 Join Date: Dec 2007 Location: Sin City Device: PW2 + HDX 8.9	I saw something about Feedburner in the feeds and recognized it from the error message... took that one off, it works great now! It was HUGE, though, so I'm taking off the feeds I don't want. I have 10 days to figure out if I can live with this one. Too bad it doesn't automatically create one once a day Any plans to implement something in which it takes all feeds you specify and create one file? With links to each specific feed? The only one left now is El Universal. Thanks for the help!

Advert

Advert