Boston Globe -- was working, now not

[mikebw]

The Boston Globe recipe by darkom was working fine but now is not. This may have something to do with an upgrade of the underlying platform from Ubuntu 14.04 to 14.10, but I can't be sure. Calibre version is 2.5.0+dfsg-1.

Here's the error:

calibre, version 2.5.0 (linux2, isfrozen: False)
Conversion Error: Failed: Fetch news from The Boston Globe

Fetch news from The Boston Globe
Resolved conversion options
calibre version: 2.5.0
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'embed_all_fonts': False,
 'embed_font_family': None,
 'enable_heuristics': False,
 'expand_css': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x7ff622365510>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_file_type': 'old',
 'mobi_ignore_margins': False,
 'mobi_keep_original_images': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleFireOutput object at 0x7ff622365c10>,
 'page_breaks_before': None,
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'search_replace': None,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'start_reading_at': None,
 'subset_embedded_fonts': False,
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'verbose': 2}
InputFormatPlugin: Recipe Input running
Using custom recipe
Traceback (most recent call last):
  File "/usr/bin/calibre-parallel", line 20, in <module>
    sys.exit(main())
  File "/usr/lib/calibre/calibre/utils/ipc/worker.py", line 195, in main
    result = func(*args, **kwargs)
  File "/usr/lib/calibre/calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
    plumber.run()
  File "/usr/lib/calibre/calibre/ebooks/conversion/plumber.py", line 1041, in run
    accelerators, tdir)
  File "/usr/lib/calibre/calibre/customize/conversion.py", line 241, in __call__
    log, accelerators)
  File "/usr/lib/calibre/calibre/ebooks/conversion/plugins/recipe_input.py", line 116, in convert
    ro = recipe(opts, log, self.report_progress)
  File "/usr/lib/calibre/calibre/web/feeds/news.py", line 880, in __init__
    raise ValueError(_('The "%s" recipe needs a username and password.')%self.title)
ValueError: The "Boston Globe Subscription" recipe needs a username and password.
Error in sys.excepthook:
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/apport_python_hook.py", line 112, in apport_excepthook
    if pr.check_ignored():
  File "/usr/lib/python2.7/dist-packages/apport/report.py", line 980, in check_ignored
    dom = self._get_ignore_dom()
  File "/usr/lib/python2.7/dist-packages/apport/report.py", line 921, in _get_ignore_dom
    dom = xml.dom.getDOMImplementation().createDocument(None, 'apport', None)
  File "/usr/lib/python2.7/dist-packages/cssutils/__init__.py", line 166, in createDocument
    raise NotImplementedError
NotImplementedError

Original exception was:
Traceback (most recent call last):
  File "/usr/bin/calibre-parallel", line 20, in <module>
    sys.exit(main())
  File "/usr/lib/calibre/calibre/utils/ipc/worker.py", line 195, in main
    result = func(*args, **kwargs)
  File "/usr/lib/calibre/calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
    plumber.run()
  File "/usr/lib/calibre/calibre/ebooks/conversion/plumber.py", line 1041, in run
    accelerators, tdir)
  File "/usr/lib/calibre/calibre/customize/conversion.py", line 241, in __call__
    log, accelerators)
  File "/usr/lib/calibre/calibre/ebooks/conversion/plugins/recipe_input.py", line 116, in convert
    ro = recipe(opts, log, self.report_progress)
  File "/usr/lib/calibre/calibre/web/feeds/news.py", line 880, in __init__
    raise ValueError(_('The "%s" recipe needs a username and password.')%self.title)
ValueError: The "Boston Globe Subscription" recipe needs a username and password.

[kovidgoyal]

See the last line of that error you posted

[mikebw]

I wasn't sure whether the bit about username and password was passive code or actually being emitted during the run.

There doesn't seem to be anything in the configuration page for the recipe that allows setting credentials, so if they are required then the recipe presumably will never work. I'm not sure why the recipe was working before today, either.

Forgive my inexperience with Calibre. It's a great program, but I'm still learning how to use it.

[NSILMike]

Yes, fails for me too, only as of today.

Error msg I get appears to be the same. I think the issue is at the very bottom:

[snipped]
File "site-packages\calibre\web\feeds\news.py", line 880, in __init__
ValueError: The "Boston Globe Subscription" recipe needs a username and password.


The recipe currently asks for no username/password, although the site does (as an option up to now... maybe it is now required.)

Edit: oops. I didn't see the replies to the original post. Sounds like Kovid sees the same thing I did.

Edit 2: there are 2 Boston Globe sites. Boston.com, and BostonGlobe.com
The second site requires a login, and only actual (paid) subscribers can get a login. I tried logging into the first site (no paid sub required, but only a limited # of articles can be accessed) and re-ran Calibre... same result.

[kovidgoyal]

The recipe was changed, to require a subscription. You will have to wait for todays calibre update to be able to enter the subscription details.