Boston Globe headline links misdirected

[ajkessel]

The Boston Globe recipe stopped working for me. I saw your note in this thread to drop username/password, and now it seems to work. I've copied the error below. But does this mean we just shouldn't use credentials for Boston Globe anymore? If so, shouldn't the username/password code just be removed?

calibre, version 3.42.0 (win32, embedded-python: True)
Conversion error: Failed: Fetch news from Boston Globe Subscription

Fetch news from Boston Globe Subscription
Conversion options changed from defaults:
  verbose: 2
  output_profile: u'kindle_voyage'
Resolved conversion options
calibre version: 3.42.0
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'embed_all_fonts': False,
 'embed_font_family': None,
 'enable_heuristics': False,
 'expand_css': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x04F83C10>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_file_type': 'old',
 'mobi_ignore_margins': False,
 'mobi_keep_original_images': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleVoyageOutput object at 0x04F9D050>,
 'page_breaks_before': None,
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'search_replace': None,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'start_reading_at': None,
 'subset_embedded_fonts': False,
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'transform_css_rules': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:boston.com
Trying to get latest version of recipe: boston.com
Python function terminated unexpectedly
  no form matching predicate <function is_login_form at 0x0588F170> (Error Code: 1)
Traceback (most recent call last):
  File "site.py", line 101, in main
  File "site.py", line 78, in run_entry_point
  File "site-packages\calibre\utils\ipc\worker.py", line 200, in main
  File "site-packages\calibre\gui2\convert\gui_conversion.py", line 35, in gui_convert_recipe
  File "site-packages\calibre\gui2\convert\gui_conversion.py", line 27, in gui_convert
  File "site-packages\calibre\ebooks\conversion\plumber.py", line 1107, in run
  File "site-packages\calibre\customize\conversion.py", line 245, in __call__
  File "site-packages\calibre\ebooks\conversion\plugins\recipe_input.py", line 136, in convert
  File "site-packages\calibre\web\feeds\news.py", line 900, in __init__
  File "<string>", line 90, in get_browser
  File "site-packages\mechanize\_mechanize.py", line 667, in select_form
mechanize._mechanize.FormNotFoundError: no form matching predicate <function is_login_form at 0x0588F170>

[kovidgoyal]

I'll be happy to fix the login code if someone is willing to PM me their boston globe username/password. If not, then yeah the login code should be removed.

[kovidgoyal]

Thanks for sending me the login details. I had a look at it. Unfortunately the site now uses Javascript for login. While I can implement it in the recipe (basically send the AJAX request and setthe cookies manually). it's rather more effort than is worth it, given that the recipe appears to work fine without logins. So I have removed the login from it.