Le Monde Edition abonné does not work

[Muller]

Sorry about that, Kovid. I forgot I am using a slightly modified version (with sections names more similar to the paper edition). I will try the builtin version next time I get an error message (maybe next tuesday...)

Thank you very much for your answer.

[Muller]

Hello ! I just realised that I used a wrong name in my post of the last week : I wanted to refer to the recipe "Le monde : éditions abonnés papier", which was originally written by Rémi Vanicat and was the subject of this thread three months ago. Sorry about that.

Well, this tuesday, the "list index out of range" error is back and with the buitin recipe, as I just checked (I cancelled my custom version).

Thank you for your help.

[kovidgoyal]

I'm not the author f the recipe, so icant be sure, but it looks like there is some section i nthe download that has different HTML markup from what the recipe is expecting. The recipe will need to be updated to deal with that.

[Muller]

Thank you, Kovid !

[frague]

Hello Kovid,
Here is the updated version of the recipe I posted one year ago. There have been many modifications on Le Monde website. I have just updated the categories, it is working perfectly well.
Thanks again for all your work

[kovidgoyal]

thanks, updated.

[frague]

Hello Kovid,
The recipe does not work on the very last releases. It is still working on Calibre 3.39.1 bot not on 3.44 and 3.43. I have tried clean install of each version, still the same error. Here is the error :

calibre, version 3.44.0 (win32, embedded-python: True)
Erreur lors de la conversion: Échoué: Récupérer des actualités à partir de Le Monde: Édition abonnés papier
Récupérer des actualités à partir de Le Monde: Édition abonnés papier
Conversion options changed from defaults:
verbose: 2
output_profile: u'tablet'
Resolved conversion options
calibre version: 3.44.0
{'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': u'original',
'chapter': None,
'chapter_mark': u'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_download_recipe': False,
'dont_split_on_page_breaks': True,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_toc_at_end': False,
'epub_version': '2',
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x000001CA82338860>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.TabletOutput object at 0x000001CA823D6320>,
'page_breaks_before': None,
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': u'',
'search_replace': None,
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': u'',
'sr1_search': u'',
'sr2_replace': u'',
'sr2_search': u'',
'sr3_replace': u'',
'sr3_search': u'',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:le_monde_sub_paper
Trying to get latest version of recipe: le_monde_sub_paper
Python function terminated unexpectedly
'function' object has no attribute 'HTML_ENTITIES' (Error Code: 1)
Traceback (most recent call last):
File "site.py", line 101, in main
File "site.py", line 78, in run_entry_point
File "site-packages\calibre\utils\ipc\worker.py", line 200, in main
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 35, in gui_convert_recipe
File "site-packages\calibre\gui2\convert\gui_conversion.py", line 27, in gui_convert
File "site-packages\calibre\ebooks\conversion\plumber.py", line 1110, in run
File "site-packages\calibre\customize\conversion.py", line 246, in __call__
File "site-packages\calibre\ebooks\conversion\plugins\recipe_ input.py", line 139, in convert
File "site-packages\calibre\web\feeds\news.py", line 1022, in download
File "site-packages\calibre\web\feeds\news.py", line 1190, in build_index
File "<string>", line 132, in parse_index
AttributeError: 'function' object has no attribute 'HTML_ENTITIES'[/INDENT]

[MPec]

Hello,

i have the same issue with the the Rémi Vanicat's recipe "Le Monde: Édition abonnés papier" :
"File "<string>", line 132, in parse_index
AttributeError: 'function' object has no attribute 'HTML_ENTITIES'[/INDENT]"

i tried to fix it replacing "from calibre.ebooks.BeautifulSoup import BeautifulSoup" by "from bs4 import BeautifulSoup"

and, in line 132,
"soup = BeautifulSoup(tmp, convertEntities=BeautifulSoup.HTML_ENTITIES)" by "soup = BeautifulSoup(tmp).

it works, but the recipes returns only the articles titles without the contents.

i'm not an python expert, but it seems always like a parsing problem ?

here is the recipe i modified : Le Monde: Édition abonnés papier.txt

this recipe use data from http://medias.lemonde.fr/abonnes/edi...tml/190830.zip

who returns : 190830.zip

thank you for having a look.

[kovidgoyal]

This should fix that error:

https://github.com/kovidgoyal/calibr...794e6a9fc4a02c

[MPec]

Hello Kovid,

thank for your answer !

Sadly, the new recipe always only returns the titles ...

here is the epub file returned by the recipe : Monde_ Edition abonnes papier dimanche 01 septembre 2019, Le - calibre.epub

and the zip file with the the corresponding datas : 190901.zip

thank you

[kovidgoyal]

Sorry that's about as much effort as I am willing to put into this recipe

[MPec]

OK.

Thank you, nevertheless.

regards.