WSJ recipe fails

[ebonytowers]

This is the error I get:

Spoiler:

calibre, version 3.44.0 (win32, embedded-python: True)
Conversion error: Failed: Fetch news from The Wall Street Journal

Fetch news from The Wall Street Journal
Conversion options changed from defaults:
output_profile: u'kindle_pw3'
verbose: 2
Resolved conversion options
calibre version: 3.44.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': u'original',
'chapter': None,
'chapter_mark': u'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_compress': False,
'dont_download_recipe': False,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x04DA4CB0>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'mobi_file_type': u'old',
'mobi_ignore_margins': False,
'mobi_keep_original_images': False,
'mobi_toc_at_start': False,
'no_chapters_in_toc': False,
'no_inline_navbars': True,
'no_inline_toc': False,
'output_profile': <calibre.customize.profiles.KindlePaperWhite3Outpu t object at 0x04DAB0D0>,
'page_breaks_before': None,
'personal_doc': u'[PDOC]',
'prefer_author_sort': False,
'prefer_metadata_cover': False,
'pretty_print': False,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': u'',
'search_replace': None,
'series': None,
'series_index': None,
'share_not_sync': False,
'smarten_punctuation': False,
'sr1_replace': u'',
'sr1_search': u'',
'sr2_replace': u'',
'sr2_search': u'',
'sr3_replace': u'',
'sr3_search': u'',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:wsj
Trying to get latest version of recipe: wsj
Python function terminated unexpectedly
No articles found, aborting (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 101, in main
File "site.py", line 78, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 200, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 35, in gui_convert_recipe
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 27, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1110, in run
File "site-packages\calibre\customize\conversion.py", line 246, in __call__
File "site-packages\calibre\ebooks\conversion\plugins\recipe_ input.py", line 139, in convert
File "site-packages\calibre\web\feeds\news.py", line 1022, in download
File "site-packages\calibre\web\feeds\news.py", line 1201, in build_index
ValueError: No articles found, aborting

Thanks!

[CrazyWorld]

Same issue

[kovidgoyal]

https://github.com/kovidgoyal/calibr...b0d88a2db7d65a

[siyer1000]

Hey - this still does not appear to be working for me?

[kovidgoyal]

doesn't work with what error?

[siyer1000]

Thanks for the response! Looks like the error is on the email side:

IOError: Failed to send mail: error(10060, 'A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond')

So I think the WSJ recipe is fine, not sure the deal though!

[kovidgoyal]

That typically happens is something is blocking calibre or the remote server is malfunctioning. Try temporarily disabling your antivirus/firewall and see if it helps.

[duluoz]

Here's the current error I get from running the WSJ recipe. Any way to fix it?
Thanks

InputFormatPlugin: Recipe Input running
Trying to get latest version of recipe: wsj
Using downloaded builtin recipe
Starting login process...
Traceback (most recent call last):
  File "site.py", line 77, in main
  File "site-packages/calibre/ebooks/conversion/cli.py", line 401, in main
  File "site-packages/calibre/ebooks/conversion/plumber.py", line 1110, in run
  File "site-packages/calibre/customize/conversion.py", line 246, in __call__
  File "site-packages/calibre/ebooks/conversion/plugins/recipe_input.py", line 138, in convert
  File "site-packages/calibre/web/feeds/news.py", line 898, in __init__
  File "<string>", line 117, in get_browser
KeyError: u'connection'

[kovidgoyal]

This should take care of it: https://github.com/kovidgoyal/calibr...ef01b2c81fba94

[aritafari]

Hi Kovid,

I have been unable to download WSJ since yesterday.
The download fails with the following message:

"File "site-packages/calibre/web/feeds/news.py", line 898, in __init__
File "<string>", line 138, in get_browser
File "site-packages/mechanize/_mechanize.py", line 254, in open
File "site-packages/mechanize/_mechanize.py", line 310, in _mech_open
httperror_seek_wrapper: HTTP Error 400: Bad Request"

calibre 3.46 Debian Linux

[kovidgoyal]

Sigh, not only do those idiots use JS for their logins, they cant even keep the login logic stable. Oh well, this should take care of it https://github.com/kovidgoyal/calibr...1626772e2f6575

[aritafari]

Originally Posted by kovidgoyal

Sigh, not only do those idiots use JS for their logins, they cant even keep the login logic stable. Oh well, this should take care of it https://github.com/kovidgoyal/calibr...1626772e2f6575

It worked! Thanks

[aritafari]

It worked! Thanks

[duluoz]

Working perfectly, thanks Kovid

[bobbysteel]

Wsj died on me today. Can't see logs as not near a pc but something seems to have just changed