03-31-2011, 05:53 AM | #1 |
Member
Posts: 23
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
|
Fetching news. Timeout?
Hi!
I know this is probably the wrong place to ask this, but I couldn't find a more suitable section. I've setup Calibre to fetch news at night, so that in the morning I can put the resulting ebooks in my Kindle and read them while commuting to work. The problem is that very often, something happens during the news fetching and one or more jobs get stuck (probably due to a connection error, or some server glitches, I don't know). Well, anyway, in the morning I might still find that some jobs are active, and when I open the jobs window, there is one (or more) jobs stuck, with the progress bar at some percentage, and the running time at 5hrs or so... In the Preferences->Behavior page, the "Default network timeout" is set at 5 seconds, so I really don't understand why this is happening. Any help? Thanks |
04-01-2011, 05:11 PM | #2 |
Member
Posts: 23
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
|
No one?
|
Advert | |
|
04-01-2011, 05:18 PM | #3 |
creator of calibre
Posts: 44,327
Karma: 23661992
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
I doubt very much your hangs have anything to do with network timeouts. All network reads in the news download code have timeouts of a couple of minutes max.
The first place to look is the job log, the next is to see if you can replicate this during the day with a manual news download. Unfortunately these kinds of things are very hard to debug, so I won't hold out any hope. |
04-01-2011, 05:26 PM | #4 |
Member
Posts: 23
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
|
I see.
I don't have any log right now, but I'll check (and eventually post) as soon as I can get a useful one. Thanks. |
04-05-2011, 02:28 AM | #5 |
Member
Posts: 23
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
|
Ok, here is one log, after the job had been stuck for more than two hours:
Code:
Fetch news from Interisti.org Resolved conversion options calibre version: 0.7.53 {'asciiize': False, 'author_sort': None, 'authors': None, 'base_font_size': 0, 'book_producer': None, 'change_justification': 'original', 'chapter': None, 'chapter_mark': 'pagebreak', 'comments': None, 'cover': None, 'debug_pipeline': None, 'dehyphenate': True, 'delete_blank_paragraphs': True, 'disable_font_rescaling': False, 'dont_compress': False, 'dont_download_recipe': False, 'enable_heuristics': False, 'extra_css': None, 'fix_indents': True, 'font_size_mapping': None, 'format_scene_breaks': True, 'html_unwrap_factor': 0.4, 'input_encoding': None, 'input_profile': <calibre.customize.profiles.InputProfile object at 0x05A78A70>, 'insert_blank_line': False, 'insert_metadata': False, 'isbn': None, 'italicize_common_cases': True, 'keep_ligatures': False, 'language': None, 'level1_toc': None, 'level2_toc': None, 'level3_toc': None, 'line_height': 0, 'linearize_tables': False, 'lrf': False, 'margin_bottom': 5.0, 'margin_left': 5.0, 'margin_right': 5.0, 'margin_top': 5.0, 'markup_chapter_headings': True, 'max_toc_links': 50, 'minimum_line_height': 120.0, 'mobi_ignore_margins': False, 'no_chapters_in_toc': False, 'no_inline_navbars': True, 'no_inline_toc': False, 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x05A78D90>, 'page_breaks_before': None, 'password': None, 'personal_doc': '[PDOC]', 'prefer_author_sort': False, 'prefer_metadata_cover': False, 'pretty_print': False, 'pubdate': None, 'publisher': None, 'rating': None, 'read_metadata_from_opf': None, 'remove_fake_margins': True, 'remove_first_image': False, 'remove_paragraph_spacing': False, 'remove_paragraph_spacing_indent_size': 1.5, 'renumber_headings': True, 'replace_scene_breaks': '', 'rescale_images': False, 'series': None, 'series_index': None, 'smarten_punctuation': False, 'sr1_replace': '', 'sr1_search': '', 'sr2_replace': '', 'sr2_search': '', 'sr3_replace': '', 'sr3_search': '', 'tags': None, 'test': False, 'timestamp': None, 'title': None, 'title_sort': None, 'toc_filter': None, 'toc_threshold': 6, 'toc_title': None, 'unwrap_lines': True, 'use_auto_toc': False, 'username': None, 'verbose': 2} InputFormatPlugin: Recipe Input running |
Advert | |
|
04-05-2011, 04:08 AM | #6 |
Connoisseur
Posts: 63
Karma: 10
Join Date: Dec 2010
Device: kindle
|
I have the same problem, if it's any consolation for you :-) So far I've only found out that a freshly restarted calibre wouldn't do that. I suspend my laptop in the evening, resume in the morning and then calibre loads scheduled news and sometimes a job hangs right at the end, after actually having produced the output book, so this is definitely no network problem.
|
04-05-2011, 07:36 AM | #7 |
Member
Posts: 23
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
|
It's not really a consolation, but at least now I know I'm not the only one in the world to have this issue.
|
04-06-2011, 03:24 AM | #8 |
Connoisseur
Posts: 63
Karma: 10
Join Date: Dec 2010
Device: kindle
|
So let's elaborate a little on this. My jobs usually hang at 100%, yours at less? When you look at the log of the stuck job, does it always end with the same message? Have a look in the temporary directory where calibre stores the job logs, sometimes the button 'Show job details' shows nothing but the actual log is full of data. And, do you get the problem even after calibre is restarted? If not, you may do a quick fix by restarting calibre in the night using a cron job (if you are using Linux).
|
04-06-2011, 05:52 AM | #9 |
Member
Posts: 23
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
|
My jobs usually hang at less than 100%.
I'll monitor the situation and add any new logs I might find. Tonight everything went smooth, maybe because I closed and reopened Calibre before going to bed? I don't know, I can't say anything after just one session... But I'll keep the thread updated with new findings. I use Windows, but I guess I could find a way to restart Calibre on this OS too. |
04-13-2011, 06:30 AM | #10 |
Member
Posts: 23
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
|
It seems that closing Calibre works. I've never had any other hung job since I started closing Calibre late at night (I've scheduled fetching news at 4 AM).
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Performance of Fetching News | jkdawson | Library Management | 10 | 04-08-2011 05:44 PM |
Error for fetching news. | nick_martin | Calibre | 0 | 11-26-2010 01:52 AM |
Fetching News and Email | emalvick | Calibre | 3 | 09-01-2010 04:31 AM |
Trouble fetching news | jpustin | Calibre | 6 | 06-28-2010 01:57 PM |
automating news fetching | zerozombie72 | Calibre | 6 | 02-16-2010 04:31 PM |