Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 03-31-2011, 05:53 AM   #1
Sciamano
Member
Sciamano began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
Fetching news. Timeout?

Hi!
I know this is probably the wrong place to ask this, but I couldn't find a more suitable section.

I've setup Calibre to fetch news at night, so that in the morning I can put the resulting ebooks in my Kindle and read them while commuting to work.
The problem is that very often, something happens during the news fetching and one or more jobs get stuck (probably due to a connection error, or some server glitches, I don't know).
Well, anyway, in the morning I might still find that some jobs are active, and when I open the jobs window, there is one (or more) jobs stuck, with the progress bar at some percentage, and the running time at 5hrs or so...

In the Preferences->Behavior page, the "Default network timeout" is set at 5 seconds, so I really don't understand why this is happening.
Any help?
Thanks
Sciamano is offline   Reply With Quote
Old 04-01-2011, 05:11 PM   #2
Sciamano
Member
Sciamano began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
No one?
Sciamano is offline   Reply With Quote
Old 04-01-2011, 05:18 PM   #3
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 25,419
Karma: 4961459
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
I doubt very much your hangs have anything to do with network timeouts. All network reads in the news download code have timeouts of a couple of minutes max.

The first place to look is the job log, the next is to see if you can replicate this during the day with a manual news download. Unfortunately these kinds of things are very hard to debug, so I won't hold out any hope.
kovidgoyal is offline   Reply With Quote
Old 04-01-2011, 05:26 PM   #4
Sciamano
Member
Sciamano began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
I see.
I don't have any log right now, but I'll check (and eventually post) as soon as I can get a useful one.
Thanks.
Sciamano is offline   Reply With Quote
Old 04-05-2011, 02:28 AM   #5
Sciamano
Member
Sciamano began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
Ok, here is one log, after the job had been stuck for more than two hours:

Code:
Fetch news from Interisti.org
Resolved conversion options
calibre version: 0.7.53
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'enable_heuristics': False,
 'extra_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x05A78A70>,
 'insert_blank_line': False,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_ignore_margins': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x05A78D90>,
 'page_breaks_before': None,
 'password': None,
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'rescale_images': False,
 'series': None,
 'series_index': None,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'username': None,
 'verbose': 2}
InputFormatPlugin: Recipe Input running
I can't see any hint about what happened...
Sciamano is offline   Reply With Quote
Old 04-05-2011, 04:08 AM   #6
bubak
Member
bubak began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Dec 2010
Device: kindle
I have the same problem, if it's any consolation for you :-) So far I've only found out that a freshly restarted calibre wouldn't do that. I suspend my laptop in the evening, resume in the morning and then calibre loads scheduled news and sometimes a job hangs right at the end, after actually having produced the output book, so this is definitely no network problem.
bubak is offline   Reply With Quote
Old 04-05-2011, 07:36 AM   #7
Sciamano
Member
Sciamano began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
It's not really a consolation, but at least now I know I'm not the only one in the world to have this issue.
Sciamano is offline   Reply With Quote
Old 04-06-2011, 03:24 AM   #8
bubak
Member
bubak began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Dec 2010
Device: kindle
So let's elaborate a little on this. My jobs usually hang at 100%, yours at less? When you look at the log of the stuck job, does it always end with the same message? Have a look in the temporary directory where calibre stores the job logs, sometimes the button 'Show job details' shows nothing but the actual log is full of data. And, do you get the problem even after calibre is restarted? If not, you may do a quick fix by restarting calibre in the night using a cron job (if you are using Linux).
bubak is offline   Reply With Quote
Old 04-06-2011, 05:52 AM   #9
Sciamano
Member
Sciamano began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
My jobs usually hang at less than 100%.
I'll monitor the situation and add any new logs I might find. Tonight everything went smooth, maybe because I closed and reopened Calibre before going to bed? I don't know, I can't say anything after just one session... But I'll keep the thread updated with new findings.
I use Windows, but I guess I could find a way to restart Calibre on this OS too.
Sciamano is offline   Reply With Quote
Old 04-13-2011, 06:30 AM   #10
Sciamano
Member
Sciamano began at the beginning.
 
Posts: 22
Karma: 10
Join Date: Mar 2011
Device: Kindle 3
It seems that closing Calibre works. I've never had any other hung job since I started closing Calibre late at night (I've scheduled fetching news at 4 AM).
Sciamano is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Performance of Fetching News jkdawson Library Management 10 04-08-2011 05:44 PM
Error for fetching news. nick_martin Calibre 0 11-26-2010 01:52 AM
Fetching News and Email emalvick Calibre 3 09-01-2010 04:31 AM
Trouble fetching news jpustin Calibre 6 06-28-2010 01:57 PM
automating news fetching zerozombie72 Calibre 6 02-16-2010 04:31 PM


All times are GMT -4. The time now is 05:14 PM.


MobileRead.com is a privately owned, operated and funded community.