07-20-2010, 01:51 PM | #1 |
Junior Member
Posts: 7
Karma: 10
Join Date: Jul 2010
Device: Kindle 2
|
LA Times fetch hangs interminably
6 hours later and my LA Times d/l is still chugging away at 1%. Doesn't time out and doesn't progress. Any guidance would be appreciated.
Job details as follows: Fetch news from The Los Angeles Times Resolved conversion options calibre version: 0.7.9 {'asciiize': False, 'author_sort': None, 'authors': None, 'base_font_size': 0, 'book_producer': None, 'change_justification': 'original', 'chapter': None, 'chapter_mark': 'pagebreak', 'comments': None, 'cover': None, 'debug_pipeline': None, 'disable_font_rescaling': False, 'dont_compress': False, 'dont_download_recipe': False, 'extra_css': None, 'font_size_mapping': None, 'footer_regex': '(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s* <a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)' , 'header_regex': '(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s* <a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)' , 'input_encoding': None, 'input_profile': <calibre.customize.profiles.InputProfile object at 0x04F594B0>, 'insert_blank_line': False, 'insert_metadata': False, 'isbn': None, 'keep_ligatures': False, 'language': None, 'level1_toc': None, 'level2_toc': None, 'level3_toc': None, 'line_height': 0, 'linearize_tables': False, 'lrf': False, 'margin_bottom': 5.0, 'margin_left': 5.0, 'margin_right': 5.0, 'margin_top': 5.0, 'max_toc_links': 50, 'no_chapters_in_toc': False, 'no_inline_navbars': True, 'no_inline_toc': False, 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x04F59790>, 'page_breaks_before': None, 'password': None, 'personal_doc': '[PDOC]', 'prefer_author_sort': False, 'prefer_metadata_cover': False, 'preprocess_html': False, 'pretty_print': False, 'pubdate': None, 'publisher': None, 'rating': None, 'read_metadata_from_opf': None, 'remove_first_image': False, 'remove_footer': False, 'remove_header': False, 'remove_paragraph_spacing': False, 'remove_paragraph_spacing_indent_size': 1.5, 'rescale_images': False, 'series': None, 'series_index': None, 'tags': None, 'test': False, 'timestamp': None, 'title': None, 'title_sort': None, 'toc_filter': None, 'toc_threshold': 6, 'toc_title': None, 'use_auto_toc': False, 'username': None, 'verbose': 2} InputFormatPlugin: Recipe Input running Looking for full story link in http://www.latimes.com/news/la-me-bi...,4748121.story Looking for full story link in http://www.latimes.com/news/la-sci-h...,5183013.story Looking for full story link in http://www.latimes.com/news/la-na-oi...,5787606.story Looking for full story link in http://www.latimes.com/news/la-me-07...0,318452.story Looking for full story link in http://www.latimes.com/news/la-me-li...,7075277.story Looking for full story link in http://www.latimes.com/news/la-me-07...,1955509.story Looking for full story link in http://www.latimes.com/news/la-me-07...,5138232.story Looking for full story link in http://www.latimes.com/news/la-na-jo...,2225607.story Found full story link http://www.latimes.com/news/la-na-jo...115,full.story Looking for full story link in http://www.latimes.com/news/la-me-07...,3088449.story Looking for full story link in http://www.latimes.com/news/local/la...,6229042.story Found full story link http://www.latimes.com/news/local/la...310,full.story Looking for full story link in http://www.latimes.com/news/local/la...,3128251.story Looking for full story link in http://www.latimes.com/news/local/la...,3651606.story Looking for full story link in http://www.latimes.com/news/local/la...0,771528.story Looking for full story link in http://www.latimes.com/news/local/la...,3188139.story Found full story link http://www.latimes.com/news/local/la...484,full.story Looking for full story link in http://www.latimes.com/news/local/la...0,718439.story Looking for full story link in http://www.latimes.com/news/local/la...,5232560.story Looking for full story link in http://www.latimes.com/news/local/la...,5455407.story Looking for full story link in http://www.latimes.com/news/local/me...7896235.column Looking for full story link in http://www.latimes.com/news/local/la...,0,81442.story Looking for full story link in http://www.latimes.com/news/health/l...,1610881.story Looking for full story link in http://www.latimes.com/news/custom/t...,4176839.story Looking for full story link in http://www.latimes.com/news/nationwo...,5232689.story Looking for full story link in http://www.latimes.com/news/local/la...,3128251.story Looking for full story link in http://www.latimes.com/news/custom/t...,2721392.story Looking for full story link in http://www.latimes.com/business/la-f...,6089020.story Looking for full story link in http://www.latimes.com/news/local/la...,1616500.story Looking for full story link in http://www.latimes.com/news/health/l...,1531545.story Found full story link http://www.latimes.com/news/health/l...357,full.story Looking for full story link in http://www.latimes.com/news/la-fiw-0...0,106596.story Looking for full story link in http://www.latimes.com/news/local/la...0,898989.story Looking for full story link in http://www.latimes.com/news/local/po...,3571179.story |
07-20-2010, 02:23 PM | #2 |
Wizard
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
|
Mine completed in 6.5 minutes. The recipe seems OK. Are other recipes working/failing? Can you reach the links in that recipe in a browser?
|
07-20-2010, 02:46 PM | #3 |
Junior Member
Posts: 7
Karma: 10
Join Date: Jul 2010
Device: Kindle 2
|
The recipe is the unadulterated version of the one offered within Calibre. Yeah, the links all send me to the full stories via Firefox. All other recipes (approx. 12) work beautifully.
|
07-20-2010, 02:59 PM | #4 |
creator of calibre
Posts: 44,321
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Probably temporary network trouble. Try it again.
|
07-20-2010, 03:39 PM | #5 |
Junior Member
Posts: 7
Karma: 10
Join Date: Jul 2010
Device: Kindle 2
|
Sadly, no. I've had the same issue for the week+ I've been using your program. I DID retry, however; I'm 20 minutes in and still at 1%.
It's no exaggeration to say that I'm finding Calibre life-enriching. Thank you. |
07-20-2010, 04:03 PM | #6 |
creator of calibre
Posts: 44,321
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Hmm, well that recipe jumps through a few hoops to try to get the full version of each article from the LA Times website, because of the way the website is designed. Which means it is more network intensive than most other recipes, which is probably what's causing the problem for you. I'm afraid there's no simple solution to this.
|
07-20-2010, 04:20 PM | #7 | |
Wizard
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
|
Quote:
Code:
simultaneous_downloads = 1 delay = 3 |
|
07-20-2010, 05:49 PM | #8 | |
Junior Member
Posts: 7
Karma: 10
Join Date: Jul 2010
Device: Kindle 2
|
Quote:
Edit: I added those lines under the "Class" heading and below "max_articles_per_feed." That sound right? Last edited by Rick's Kindle; 07-20-2010 at 06:00 PM. |
|
07-20-2010, 05:56 PM | #9 |
creator of calibre
Posts: 44,321
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Another thing you can do is delete the get_article_url function from the recipe, it will mean some articles will be incomplete, but the download itself should complete
|
07-20-2010, 07:16 PM | #10 |
Junior Member
Posts: 7
Karma: 10
Join Date: Jul 2010
Device: Kindle 2
|
The throttle seems to have done the trick. I'm getting a good sampling of articles in each section (though the job details do show a number of items as not being downloaded). Thanks for your help with this.
I think I'll also try deleting the get_article_url function from a fresh recipe and see which produces a better product. |
07-21-2010, 07:58 AM | #11 |
Wizard
Posts: 4,004
Karma: 177841
Join Date: Dec 2009
Device: WinMo: IPAQ; Android: HTC HD2, Archos 7o; Java:Gravity T
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
PRS-505 Hangs | vg89 | Sony Reader | 4 | 06-09-2010 02:28 PM |
Calibre hangs and can't do anything | vincentnoiseux | Calibre | 17 | 04-30-2010 09:13 AM |
Mobi2Mobi Mobi2MobiGUI Hangs | zdas04 | Kindle Formats | 5 | 04-20-2010 01:56 AM |
0.6.20 still hangs... | Xenophon | Calibre | 7 | 11-05-2009 01:54 PM |
Calibre hangs now | coase | Calibre | 5 | 07-14-2009 07:12 PM |