Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes


Thread Tools Search this Thread
Old 09-20-2012, 07:05 PM   #1
Junior Member
squigish began at the beginning.
Posts: 9
Karma: 10
Join Date: Jan 2012
Device: Kindle 3, Kindle Touch
Nytimes web recipe intermittent 404 error

I've got a crontab job on an ubuntu server set up to download the nytimes web edition every hour and put it on a web server where I can download it to my kindle.

Almost always (about 20-23 times a day, out of the 24 times it gets run), calibre generates a 404 error and doesn't generate the file. Here's what I'm running, and the output I get:

$ /u1/myhome/bin/ebook-convert /u1/myhome/nytimes/nytimes_sub.web.recipe /u1/myhome/pub_http_internet/nytimes/ --username myuser --password mypass --output-profile kindle
1% Converting input to HTML...
InputFormatPlugin: Recipe Input running
1% Fetching feeds...
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Index URL:
Traceback (most recent call last):
  File "", line 58, in main
  File "site-packages/calibre/ebooks/conversion/", line 325, in main
  File "site-packages/calibre/ebooks/conversion/", line 979, in run
  File "site-packages/calibre/customize/", line 208, in __call__
  File "site-packages/calibre/ebooks/conversion/plugins/", line 105, in convert
  File "site-packages/calibre/web/feeds/", line 881, in download
  File "site-packages/calibre/web/feeds/", line 1025, in build_index
  File "<string>", line 582, in parse_index
  File "<string>", line 455, in parse_web_edition
  File "<string>", line 379, in index_to_soup
  File "<string>", line 362, in get_the_soup
  File "site-packages/mechanize/", line 199, in open_novisit
  File "site-packages/mechanize/", line 255, in _mech_open
httperror_seek_wrapper: HTTP Error 404: Not found
The only diffs between nytimes_sub.web.recipe and the nytimes_sub recipe I downloaded today from launchpad are the following:
    webEdition = False					      |	    webEdition = True
    oldest_article = 7					      |	    oldest_article = 2
    useHighResImages = True				      |	    useHighResImages = False
    excludeSections = []				      |	    excludeSections = ['Sports']
                    (u'Sports',u'sports'),		      <
                    (u'Style',u'style'),		      <
                    (u'Fashion & Style',u'fashion'),	      <
                    (u'Home & Garden',u'garden'),	      <
                    ('Multimedia',u'multimedia'),	      <
                    (u'Obituaries',u'obituaries'),	      <
(for those of you who don't speak diff, all I changed was to turn on the WebEdition, and exclude some sections, old articles and high-res images.)

Has anyone else been experiencing similar problems?
squigish is offline   Reply With Quote

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
NYTimes recipe skipping articles jzall Recipes 3 12-04-2012 12:06 AM
Touch Kobo/Adobe not working--error 404 when I try to get the pubs--Server down? tea2 Kobo Reader 4 07-02-2012 10:02 AM
How do I suppress Stack Traces on HTTP 404 Error in the web browser? katsu Development 3 11-07-2011 12:25 AM
Import failed Error:404 when attempting to import from Calibre to Stanza dvond Apple Devices 0 05-13-2011 04:00 PM
Truncation of the NYTimes Headlines recipe Nanoox Recipes 7 03-05-2011 11:49 PM

All times are GMT -4. The time now is 05:33 AM. is a privately owned, operated and funded community.