Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 09-09-2026, 11:38 AM   #76
nilsws
Junior Member
nilsws began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Mar 2022
Device: Onyx Boox
The Economist: working recipe that fetches through your own Chromium

I've created a replacement that works for me, by letting calibre fetch through a real Chromium I already have installed, driven over the Chrome DevTools Protocol. Full write-up, setup steps and code:

https://github.com/CR0CKER/calibre-economist-cdp

Requirements: an Economist subscription, Chrome/Chromium, calibre 8 or 9, and Linux. No third-party Python packages.

Linux only: that is the only platform it has ever run on. Windows will probably trip over two permission-bit checks that assume POSIX semantics and over the "python3" interpreter name, and macOS may trip over a browser path containing spaces. Each is small and the specifics are in the repo. I have no Mac or Windows machine to test on, so I would welcome someone taking that on; pull requests welcome.

Setup is a one-time cookie seed (DevTools, Copy as cURL, import script, one command), after which scheduled downloads run unattended. Why it works, and why UA and cookie tricks do not, is in the README and in my reply in the thread above (post #N).

No downloaded editions are or will be shared here. Code only.
nilsws is offline   Reply With Quote
Old 09-09-2026, 01:46 PM   #77
johnny M
Junior Member
johnny M began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Sep 2026
Device: amazon kindle
fetch news error

when trying to download (economist magazine) fetch news with calibre program on windows 11 laptop
keep getting this error:
Spoiler:

calibre, version 9.14.0 (win32, embedded-python: True)
Conversion error: Failed: Fetch news from The Economist

Fetch news from The Economist
Conversion options changed from defaults:
output_profile: 'generic_eink'
verbose: 2
Resolved conversion options
calibre version: 9.14.0
{'add_alt_text_to_img': False,
'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_download_recipe': False,
'dont_split_on_page_breaks': True,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_max_image_size': 'none',
'epub_toc_at_end': False,
'epub_version': '2',
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x0000012EED439FD0>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.GenericEink object at 0x0000012EED43B4D0>,
'page_breaks_before': None,
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'recipe_specific_option': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'transform_html_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:economist
Trying to get latest version of recipe: economist
Using user agent: Mozilla/5.0 (Linux; Android 14) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.6533.103 Mobile Safari/537.36 Liskov
Recipe specific options:
res = 600
Failed to get index from website with error: HTTP Error 403: Forbidden
Falling back to GraphQL for the edition index
Failed to get index from GraphQL with error: <urlopen error [Errno 11001] getaddrinfo failed>
Traceback (most recent call last):
File "runpy.py", line 203, in _run_module_as_main
File "runpy.py", line 88, in _run_code
File "site.py", line 83, in <module>
File "site.py", line 78, in main
File "site.py", line 50, in run_entry_point
File "calibre\utils\ipc\worker.py", line 185, in main
File "calibre\gui2\convert\gui_conversion.py", line 49, in gui_convert_recipe
File "calibre\gui2\convert\gui_conversion.py", line 36, in gui_convert
File "calibre\ebooks\conversion\plumber.py", line 1258, in run
File "calibre\customize\conversion.py", line 242, in __call__
File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 163, in convert
File "calibre\web\feeds\news.py", line 1152, in download
File "calibre\web\feeds\news.py", line 1322, in build_index
File "<string>", line 333, in parse_index
File "<string>", line 299, in economist_return_index
NoArticles: Could not find any articles, either the economist.com server is having trouble and you should try later or the website format has changed and the recipe needs to be updated.

Last edited by theducks; 09-09-2026 at 02:52 PM. Reason: spoilered logs
johnny M is offline   Reply With Quote
Old 09-09-2026, 03:58 PM   #78
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 54,507
Karma: 182218685
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Removed unnecessary link after previous message moved to correct thread.

Last edited by DNSB; 09-09-2026 at 10:33 PM.
DNSB is offline   Reply With Quote
Old 09-12-2026, 02:30 PM   #79
econofan
Junior Member
econofan doesn't littereconofan doesn't littereconofan doesn't litter
 
Posts: 1
Karma: 204
Join Date: Sep 2026
Device: Kindle Paperwhite
Hello,

I've created a script that builds a Kindle version of The Economist. It requires a paid subscription (after all, I would like the magazine to stay alive), and uses some Python in addition to an adaptation to Kovid's recipe.
You will need Playwright, Pillow and Image installed in Python. Tested on 3.11.

https://github.com/pdestefanis/EconomistKindle

Please use this any way you like. Maybe Kovid could find it useful to adapt it further for Calibre.

I did not try to create a version that would bypass login in The Economist. I may have benefited from free versions in the past, but I do think that this is good content worth supporting.

1) Create a new profile for Playwright in Chrome: Open_Chrome_for_Economist.cmd This creates a profile in %LOCALAPPDATA%\Economist-Calibre-Profile. Close that Chrome window after you are done with the capture.
2) Create your venv for Python: py -3 -m venv .venv
3) Call the capture script: .\.venv\Scripts\python.exe .\economist_capture.py --date 2026-08-29

Do not touch that Chrome session as the extraction proceeds. If you want to wipe it, you can find it at

--date is optional. If omitted it will fetch the latest issue. See the .py file for other switches.
You will need to have Economist_local.recipe in the same folder.
econofan is offline   Reply With Quote
Old 09-18-2026, 04:21 AM   #80
Braemor
Junior Member
Braemor began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Sep 2026
Device: Kindle
The economist recipe still doesn't work. For me, it worked after the upgrade to 9.10 and stopped working three weeks ago. I am using Calibre on Windows and have upgraded to version 9.15 Many thank! Alex

Here is the error log:
calibre, version 9.15.0 (win32, embedded-python: True)
Conversion error: Failed: Fetch news from The Economist
Spoiler:


Fetch news from The Economist
Conversion options changed from defaults:
output_profile: 'kindle_pw3'
verbose: 2
Resolved conversion options
calibre version: 9.15.0
{'add_alt_text_to_img': False,
'asciiize': False,
'author_sort': None,
'authors': None,
'base_font_size': 0,
'book_producer': None,
'change_justification': 'original',
'chapter': None,
'chapter_mark': 'pagebreak',
'comments': None,
'cover': None,
'debug_pipeline': None,
'dehyphenate': True,
'delete_blank_paragraphs': True,
'disable_font_rescaling': False,
'dont_download_recipe': False,
'dont_split_on_page_breaks': True,
'duplicate_links_in_toc': False,
'embed_all_fonts': False,
'embed_font_family': None,
'enable_heuristics': False,
'epub_flatten': False,
'epub_inline_toc': False,
'epub_max_image_size': 'none',
'epub_toc_at_end': False,
'epub_version': '2',
'expand_css': False,
'extra_css': None,
'extract_to': None,
'filter_css': None,
'fix_indents': True,
'flow_size': 260,
'font_size_mapping': None,
'format_scene_breaks': True,
'html_unwrap_factor': 0.4,
'input_encoding': None,
'input_profile': <calibre.customize.profiles.InputProfile object at 0x0000028AE9142270>,
'insert_blank_line': False,
'insert_blank_line_size': 0.5,
'insert_metadata': False,
'isbn': None,
'italicize_common_cases': True,
'keep_ligatures': False,
'language': None,
'level1_toc': None,
'level2_toc': None,
'level3_toc': None,
'line_height': 0,
'linearize_tables': False,
'lrf': False,
'margin_bottom': 5.0,
'margin_left': 5.0,
'margin_right': 5.0,
'margin_top': 5.0,
'markup_chapter_headings': True,
'max_toc_links': 50,
'minimum_line_height': 120.0,
'no_chapters_in_toc': False,
'no_default_epub_cover': False,
'no_inline_navbars': False,
'no_svg_cover': False,
'output_profile': <calibre.customize.profiles.KindlePaperWhite3Outpu t object at 0x0000028AE9150D70>,
'page_breaks_before': None,
'prefer_metadata_cover': False,
'preserve_cover_aspect_ratio': False,
'pretty_print': True,
'pubdate': None,
'publisher': None,
'rating': None,
'read_metadata_from_opf': None,
'recipe_specific_option': None,
'remove_fake_margins': True,
'remove_first_image': False,
'remove_paragraph_spacing': False,
'remove_paragraph_spacing_indent_size': 1.5,
'renumber_headings': True,
'replace_scene_breaks': '',
'search_replace': None,
'series': None,
'series_index': None,
'smarten_punctuation': False,
'sr1_replace': '',
'sr1_search': '',
'sr2_replace': '',
'sr2_search': '',
'sr3_replace': '',
'sr3_search': '',
'start_reading_at': None,
'subset_embedded_fonts': False,
'tags': None,
'test': False,
'timestamp': None,
'title': None,
'title_sort': None,
'toc_filter': None,
'toc_threshold': 6,
'toc_title': None,
'transform_css_rules': None,
'transform_html_rules': None,
'unsmarten_punctuation': False,
'unwrap_lines': True,
'use_auto_toc': False,
'verbose': 2}
InputFormatPlugin: Recipe Input running
Downloading recipe urn: builtin:economist
Trying to get latest version of recipe: economist
Using user agent: Mozilla/5.0 (Linux; Android 14) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.6533.103 Mobile Safari/537.36 Liskov
Recipe specific options:
res = 600
Failed to get index from website with error: HTTP Error 403: Forbidden
Falling back to GraphQL for the edition index
Failed to get index from GraphQL with error: <urlopen error [Errno 11001] getaddrinfo failed>
Traceback (most recent call last):
File "runpy.py", line 203, in _run_module_as_main
File "runpy.py", line 88, in _run_code
File "site.py", line 83, in <module>
File "site.py", line 78, in main
File "site.py", line 50, in run_entry_point
File "calibre\utils\ipc\worker.py", line 186, in main
File "calibre\gui2\convert\gui_conversion.py", line 49, in gui_convert_recipe
File "calibre\gui2\convert\gui_conversion.py", line 36, in gui_convert
File "calibre\ebooks\conversion\plumber.py", line 1258, in run
File "calibre\customize\conversion.py", line 242, in __call__
File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 163, in convert
File "calibre\web\feeds\news.py", line 1152, in download
File "calibre\web\feeds\news.py", line 1322, in build_index
File "<string>", line 333, in parse_index
File "<string>", line 299, in economist_return_index
NoArticles: Could not find any articles, either the economist.com server is having trouble and you should try later or the website format has changed and the recipe needs to be updated.

Last edited by theducks; 09-18-2026 at 10:03 AM.
Braemor is offline   Reply With Quote
Old 09-18-2026, 03:33 PM   #81
mr316
Junior Member
mr316 began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Nov 2025
Device: Samsung Galaxy Tab S8
[QUOTE=Braemor;4610426]The economist recipe still doesn't work. For me, it worked after the upgrade to 9.10 and stopped working three weeks ago. I am using Calibre on Windows and have upgraded to version 9.15 Many thank! Alex




Please read back a few messages in the thread. Kovid has explained this many times, unless you have a subscription, it probably won't work going forward.
mr316 is offline   Reply With Quote
Old Yesterday, 04:12 PM   #82
RunLikeAnAntelop
Junior Member
RunLikeAnAntelop began at the beginning.
 
Posts: 1
Karma: 10
Join Date: Sep 2026
Device: Kindle
Thank you SO much for this. I am a subscriber but have always preferred to read the Economist on my e-reader. I am an avid cover to cover weekly reader and it's been difficult staring at the harsh screens these past weeks!

Quote:
Originally Posted by econofan View Post
Hello,

I've created a script that builds a Kindle version of The Economist. It requires a paid subscription (after all, I would like the magazine to stay alive), and uses some Python in addition to an adaptation to Kovid's recipe.
You will need Playwright, Pillow and Image installed in Python. Tested on 3.11.

https://github.com/pdestefanis/EconomistKindle

Please use this any way you like. Maybe Kovid could find it useful to adapt it further for Calibre.

I did not try to create a version that would bypass login in The Economist. I may have benefited from free versions in the past, but I do think that this is good content worth supporting.

1) Create a new profile for Playwright in Chrome: Open_Chrome_for_Economist.cmd This creates a profile in %LOCALAPPDATA%\Economist-Calibre-Profile. Close that Chrome window after you are done with the capture.
2) Create your venv for Python: py -3 -m venv .venv
3) Call the capture script: .\.venv\Scripts\python.exe .\economist_capture.py --date 2026-08-29

Do not touch that Chrome session as the extraction proceeds. If you want to wipe it, you can find it at

--date is optional. If omitted it will fetch the latest issue. See the .py file for other switches.
You will need to have Economist_local.recipe in the same folder.
RunLikeAnAntelop is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
failed to fetch the economist etms88 Recipes 3 12-27-2022 09:07 PM
Firmware Upgrade Failed! greenapple Ectaco jetBook 6 07-06-2010 03:30 AM
Failed to Fetch Economist wayner Calibre 10 12-19-2009 12:30 AM
Jetbook Hardware Upgrade Failed Les Hall Ectaco jetBook 4 08-19-2009 11:28 PM
Upgrade to 0.4.84 failed BrendenM Calibre 14 10-24-2008 06:25 PM


All times are GMT -4. The time now is 11:55 AM.


MobileRead.com is a privately owned, operated and funded community.