I am still having issues with the Economist download. It seems to error out at the end after downloading a significant percentage of the file.
Code:
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "calibre/web/fetch/simple.py", line 434, in process_images
File "calibre/web/fetch/simple.py", line 292, in fetch_url
calibre.web.fetch.simple.FetchError: Too Many Requests
Fetching https://www.economist.com/cdn-cgi/image/width=600,quality=80,format=auto/media-assets/image/20240810_INT401.png
Fetched https://www.economist.com/cdn-cgi/image/width=600,quality=80,format=auto/media-assets/image/20240810_INT401.png in 1.076916 seconds
Recursion limit reached. Skipping links in file:////tmp/calibre_7.16.0_tmp_3zsv8jp1/i614yys9.html
file:////tmp/calibre_7.16.0_tmp_3zsv8jp1/i614yys9.html saved to /tmp/calibre_7.16.0_tmp_3zsv8jp1/7hud9dhs_plumber/feed_18/article_0/i614yys9.xhtml
Fetching file:////tmp/calibre_7.16.0_tmp_3zsv8jp1/9namj3e4.html
Fetched //tmp/calibre_7.16.0_tmp_3zsv8jp1/9namj3e4.html in 0.0 seconds
Downloaded article: Economic data, commodities and markets from https://www.economist.com/economic-and-financial-indicators/2024/08/08/economic-data-commodities-and-markets
Parsed file:////tmp/calibre_7.16.0_tmp_3zsv8jp1/9namj3e4.html in 0.0 seconds
Processing images...
Fetching https://www.economist.com/cdn-cgi/image/width=600,quality=80,format=auto/media-assets/image/20240810_OBP001.jpg
Could not fetch image https://www.economist.com/cdn-cgi/image/width=600,quality=80,format=auto/media-assets/image/20240810_OBP001.jpg
Traceback (most recent call last):
File "calibre/web/fetch/simple.py", line 287, in fetch_url
File "mechanize/_mechanize.py", line 241, in open_novisit
File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 429: Too Many Requests
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "calibre/web/fetch/simple.py", line 434, in process_images
File "calibre/web/fetch/simple.py", line 292, in fetch_url
calibre.web.fetch.simple.FetchError: Too Many Requests
Recursion limit reached. Skipping links in file:////tmp/calibre_7.16.0_tmp_3zsv8jp1/9namj3e4.html
file:////tmp/calibre_7.16.0_tmp_3zsv8jp1/9namj3e4.html saved to /tmp/calibre_7.16.0_tmp_3zsv8jp1/7hud9dhs_plumber/feed_19/article_0/9namj3e4.xhtml
Downloaded article: Inna Solovyova studied both stagecraft and the Russian soul from https://www.economist.com/obituary/2024/08/08/inna-solovyova-studied-both-stagecraft-and-the-russian-soul
Traceback (most recent call last):
File "runpy.py", line 198, in _run_module_as_main
File "runpy.py", line 88, in _run_code
File "site.py", line 47, in <module>
File "site.py", line 43, in main
File "calibre/utils/ipc/worker.py", line 215, in main
File "calibre/gui2/convert/gui_conversion.py", line 31, in gui_convert_recipe
File "calibre/gui2/convert/gui_conversion.py", line 25, in gui_convert
File "calibre/ebooks/conversion/plumber.py", line 1129, in run
File "calibre/customize/conversion.py", line 245, in __call__
File "calibre/ebooks/conversion/plugins/recipe_input.py", line 155, in convert
File "calibre/web/feeds/news.py", line 1099, in download
File "calibre/web/feeds/news.py", line 1370, in build_index
File "calibre/web/feeds/news.py", line 1522, in create_opf
File "<string>", line 220, in publication_date
File "mechanize/_mechanize.py", line 257, in open
File "mechanize/_mechanize.py", line 313, in _mech_open
mechanize._response.get_seek_wrapper_class.<locals>.httperror_seek_wrapper: HTTP Error 429: Too Many Requests