NY Times Headline News Recipe - anyone else having problems?

[SilentSeven]

Hi, anyone else having problems getting this to run? Has run flawlessly for quite a while, now getting daily errors and the fetch is failing.

Recipe seems to bomb out with error - cannot find content table....

Calibre 9.22. Error code.

Fetch news from New York Times Headlines
calibre version: 0.9.22
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'embed_font_family': None,
 'enable_heuristics': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x03531FB0>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_file_type': 'old',
 'mobi_ignore_margins': False,
 'mobi_keep_original_images': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x03537310>,
 'page_breaks_before': None,
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'search_replace': None,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'start_reading_at': None,
 'subset_embedded_fonts': False,
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'verbose': 2}
InputFormatPlugin: Recipe Input running
Using custom recipe
FATAL ERROR: CANNOT FIND CONTENT TABLE
Python function terminated unexpectedly
  'NoneType' object is not iterable (Error Code: 1)
Traceback (most recent call last):
  File "site.py", line 132, in main
  File "site.py", line 109, in run_entry_point
  File "site-packages\calibre\utils\ipc\worker.py", line 189, in main
  File "site-packages\calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
  File "site-packages\calibre\ebooks\conversion\plumber.py", line 1009, in run
  File "site-packages\calibre\customize\conversion.py", line 239, in __call__
  File "site-packages\calibre\ebooks\conversion\plugins\recipe_input.py", line 114, in convert
  File "site-packages\calibre\web\feeds\news.py", line 934, in download
  File "site-packages\calibre\web\feeds\news.py", line 1103, in build_index
  File "site-packages\calibre\web\feeds\__init__.py", line 350, in feeds_from_index
TypeError: 'NoneType' object is not iterable

[nickredding]

I've modified the NYTimes recipe to account for changes in the format of the headlines page. The updated recipe is attached. If you have been using the headlines customization, set headlinesOnly = True in this recipe. If you don't want related articles to be downloaded, set recursions = 0.

[SilentSeven]

Nick-cool stuff. I'll give it a try! I love this feed; hard to live without it.

[SilentSeven]

Hi, this does fix the fetch errors. Thanks so much!

Doesn't seem to be 1:1 replacement of the prior NY Times headline news feed that is bundled with distribution version. I was able to set the flag to headlines only but not seeing it pickup the most viewed / most emailed sections. Did I miss a flag?

[nickredding]

I didn't put the most emailed/read in the new headlines code--I had to rewrite the headlines code because NYTimes is busy revamping its website and I think the changes to the headlines are a result of that.

The NYTimes recipe is going to need a complete rewrite when the new website is rolled out, and I'll do the rewrite when that happens. In the meantime I don't want to do a lot of little rewrites. If you want most emailed/read and tech posts I suggest using the daily recipe (which is the standard builtin-in recipe, without customization).

[SilentSeven]

Understood and thanks for the explanation.

It's a great feed, thanks for keeping it going! Really appreciate it.