Dutch: de Volkskrant (subscription) is broken

[cnsmr]

Hi,

Since a few days, de Volkskrant (subscription) recipe is broken. Probably because they changed the online paper. See code below, it looks like it has something to do with a conversion error.

calibre, version 0.8.36
ERROR: Conversiefout: <b>Mislukt</b>: Download nieuws van De Volkskrant (subscription)

Download nieuws van De Volkskrant (subscription)
Resolved conversion options
calibre version: 0.8.36
{'asciiize': False,
 'author_sort': None,
 'authors': None,
 'base_font_size': 0,
 'book_producer': None,
 'change_justification': 'original',
 'chapter': None,
 'chapter_mark': 'pagebreak',
 'comments': None,
 'cover': None,
 'debug_pipeline': None,
 'dehyphenate': True,
 'delete_blank_paragraphs': True,
 'disable_font_rescaling': False,
 'dont_compress': False,
 'dont_download_recipe': False,
 'duplicate_links_in_toc': False,
 'enable_heuristics': False,
 'extra_css': None,
 'extract_to': None,
 'filter_css': None,
 'fix_indents': True,
 'font_size_mapping': None,
 'format_scene_breaks': True,
 'html_unwrap_factor': 0.4,
 'input_encoding': None,
 'input_profile': <calibre.customize.profiles.InputProfile object at 0x056AFE50>,
 'insert_blank_line': False,
 'insert_blank_line_size': 0.5,
 'insert_metadata': False,
 'isbn': None,
 'italicize_common_cases': True,
 'keep_ligatures': False,
 'language': None,
 'level1_toc': None,
 'level2_toc': None,
 'level3_toc': None,
 'line_height': 0,
 'linearize_tables': False,
 'lrf': False,
 'margin_bottom': 5.0,
 'margin_left': 5.0,
 'margin_right': 5.0,
 'margin_top': 5.0,
 'markup_chapter_headings': True,
 'max_toc_links': 50,
 'minimum_line_height': 120.0,
 'mobi_ignore_margins': False,
 'mobi_toc_at_start': False,
 'no_chapters_in_toc': False,
 'no_inline_navbars': True,
 'no_inline_toc': False,
 'output_profile': <calibre.customize.profiles.KindleOutput object at 0x056B5190>,
 'page_breaks_before': None,
 'password': '234jzeph%',
 'personal_doc': '[PDOC]',
 'prefer_author_sort': False,
 'prefer_metadata_cover': False,
 'pretty_print': False,
 'pubdate': None,
 'publisher': None,
 'rating': None,
 'read_metadata_from_opf': None,
 'remove_fake_margins': True,
 'remove_first_image': False,
 'remove_paragraph_spacing': False,
 'remove_paragraph_spacing_indent_size': 1.5,
 'renumber_headings': True,
 'replace_scene_breaks': '',
 'rescale_images': False,
 'series': None,
 'series_index': None,
 'share_not_sync': False,
 'smarten_punctuation': False,
 'sr1_replace': '',
 'sr1_search': '',
 'sr2_replace': '',
 'sr2_search': '',
 'sr3_replace': '',
 'sr3_search': '',
 'tags': None,
 'test': False,
 'timestamp': None,
 'title': None,
 'title_sort': None,
 'toc_filter': None,
 'toc_threshold': 6,
 'toc_title': None,
 'unsmarten_punctuation': False,
 'unwrap_lines': True,
 'use_auto_toc': False,
 'username': 'jmvandervelde@gmail.com',
 'verbose': 2}
InputFormatPlugin: Recipe Input running
Python function terminated unexpectedly
  local variable 'soup' referenced before assignment (Error Code: 1)
Traceback (most recent call last):
  File "site.py", line 132, in main
  File "site.py", line 109, in run_entry_point
  File "site-packages\calibre\utils\ipc\worker.py", line 191, in main
  File "site-packages\calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
  File "site-packages\calibre\ebooks\conversion\plumber.py", line 959, in run
  File "site-packages\calibre\customize\conversion.py", line 204, in __call__
  File "site-packages\calibre\web\feeds\input.py", line 105, in convert
  File "site-packages\calibre\web\feeds\news.py", line 856, in download
  File "site-packages\calibre\web\feeds\news.py", line 1000, in build_index
  File "c:\users\mini-mac\appdata\local\temp\calibre_0.8.36_tmp_o8llsa\jsp9qo_recipes\recipe0.py", line 71, in parse_index
    mainsoup = soup.find('td', attrs={'id': 'select_page_top'})
UnboundLocalError: local variable 'soup' referenced before assignment

[markvdvelde]

Mmm, mine still works. It does create trouble on some days, however

[cnsmr]

Originally Posted by markvdvelde

Mmm, mine still works. It does create trouble on some days, however

Well, the free version works fine, but the paid version is not working for me

[RunningNoReason]

The recipe is broken since 25 of January most likely due to a format change.

[Selcal]

Correct, the paid version has changed over to Flash content.

As far as I know this can no longer be read. I'd be happy to update the script if anyone can tell me if reading such flash content is possible in Calibre, but for now the recipe should be removed from Calibre.....

[Selcal]

By the way; the free version still works as it gets its content from the website, unlike the subscribers version.

[kovidgoyal]

There's no easy way to get content from flash.

[Selcal]

I was afraid of that .

[Zeno_]

The articles themselves aren't flash, only when you load pages flash is used I think.

Does someone still have a (working) recipe of De Volkskrant for subscribers?

[Selcal]

That's correct but because of this it's no longer possible to retrieve the URLs to the articles using Calibre. As such I doubt that anyone will have a working recipe as I believe it to be impossible...