Wall Street Journal not available anymore !

[ThierryX]

I cannot download the articles of the Wall Street Journal anymore.
The free AND password versions weren't responding.

Moreover, the free version ("Wall Street Journal") has now disappeared from the list in Fetch News < English. The password version is still available on the list ("The Wall Street Journal").

Did the WSJ change its RSS feeds?
Will the recipe be adapted in Calibre?

Thanks a lot !

[kovidgoyal]

Wall street journal (free) is still available, I just checked it. And it downloads fine. Type Wall in the search bar above the list of recipes to locate it.

I don't have a subscription to wall street so I cant test the paid version.

[ThierryX]

Hi there,

Thanks.

I know where the recipes are but I still can't download it.

In the past, there were 2 recipes on Calibre for the WSJ:

- Wall Street Journal : free edition
- The Wall Street Journal : access with username and password

The first one vanished and, even though I have an online subscription with the Journal, the second recipe won't work with my username and password.

The following message appears on the screen:


ERROR: Conversion Error: <b>Failed</b>: Fetch news from The Wall Street Journal

Fetch news from The Wall Street Journal
Resolved conversion options
calibre version: 0.7.15
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'disable_font_rescaling': False,
'dont_compress': False,
'dont_download_recipe': False,
'extra_css': None,
'font_size_mapping': None,
'footer_regex': '(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s* <a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)' ,
'header_regex': '(?i)(?<=<hr>)((\\s*<a name=\\d+></a>((<img.+?>)*<br>\\s*)?\\d+<br>\\s*.*?\\s*)|(\\s* <a name=\\d+></a>((<img.+?>)*<br>\\s*)?.*?<br>\\s*\\d+))(?=<br>)' ,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x5e475b0>,
'insert_blank_line': False,
'insert_metadata': False,
'isbn': None,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'max_toc_links': 50,
'no_chapters_in_toc': False,
'no_inline_navbars': False,
'no_inline_toc': False,
'output_profile': <calibre.customize.profiles.CybookG3Output object at 0x5e47750>,
'page_breaks_before': None,
'password': 'streetwall',
'personal_doc': '[PDOC]',
'prefer_author_sort': False,
'prefer_metadata_cover': False,
'preprocess_html': False,
'pretty_print': False,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_first_image': False,
'remove_footer': False,
'remove_header': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'rescale_images': False,
'series': None,
'series_index': None,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'use_auto_toc': False,
'username': 'decoster67@hotmail.com',
'verbose': 2}
Python function terminated unexpectedly:
InputFormatPlugin: Recipe Input running
Traceback (most recent call last):
File "/Applications/calibre.app/Contents/Resources/Python/lib/python2.6/site.py", line 147, in main
return run_entry_point()
File "/Applications/calibre.app/Contents/Resources/Python/lib/python2.6/site.py", line 116, in run_entry_point
return getattr(pmod, func)()
File "site-packages/calibre/utils/ipc/worker.py", line 99, in main
File "site-packages/calibre/gui2/convert/gui_conversion.py", line 24, in gui_convert
File "site-packages/calibre/ebooks/conversion/plumber.py", line 815, in run
File "site-packages/calibre/customize/conversion.py", line 211, in __call__
File "site-packages/calibre/web/feeds/input.py", line 100, in convert
File "site-packages/calibre/web/feeds/news.py", line 611, in __init__
File "/var/folders/os/oscm5UhBEVSMXh4Jtpr6+U+++TI/-Tmp-/calibre_0.7.15_vncGe7_recipes/recipe0.py", line 55, in get_browser
res = br.submit()
File "site-packages/mechanize/_mechanize.py", line 547, in submit
File "site-packages/mechanize/_mechanize.py", line 209, in open
File "site-packages/mechanize/_mechanize.py", line 261, in _mech_open
mechanize._response.httperror_seek_wrapper: HTTP Error 400: Bad Request

[kovidgoyal]

can you download any other recipes?

[ThierryX]

Yes, I just downloaded the English edition of Der Spiegel.

[kovidgoyal]

Again, the free one has not vanished, type Wall in the search.

And if you want me to look at the paid one, you will have to PM me your WSJ account details.

[ThierryX]

This is what I get when I type Wall:
https://docs.google.com/drawings/d/1...CO37tdEO&pli=1

You can see there's only one choice on my screen and it is the subscriber version.

I'll send you a PM with the details.
Thanks!

[kovidgoyal]

You are running a version of calibre almost a year old. Update and you will be fine.

[ThierryX]

OK then, I'll try the latest version.
Thanks again, Calibre is a great tool.

[ThierryX]

Other than http://calibre-ebook.com/download_osx, which seems to take hours to download, where can I find the alternate download location for Calibre on Mac?
I followed the link to sourceforge.net but the file was Windows.

[ThierryX]

Found version 0.8.6 and tested the WSJ again.

Free version : OK
Password version : still not OK

Does this have anything to do with the WSJ policy of now trying to make readers (even subscribers) pay for every reading platform they might want to use?

[kovidgoyal]

fixed.

[ThierryX]

Thank you very much Kovid.
It's working fine now.