Economist - HTTP429 (throttling)

rj22 · 08-30-2025, 06:36 PM

Hello. I'm using CLI Calibre and have noticed throttling causing incomplete downloads with the economist recipe. Is this a common experience - is anyone aware of work-arounds? I'm based in UK, not using VPN.

Kovid Goyal (and others) - thank you for all your work, over years!

Richard

unkn0wn · 08-31-2025, 02:41 AM

Post the log and wrap in spoiler tags for reporting such issues.

is it some images are missing or are the articles missing?
I assume its images and increasing delay would fix it.

https://github.com/kovidgoyal/calibr...9a30340f2f4ad7

unkn0wn · 09-01-2025, 01:15 PM

I think you are the only one that is reporting this issue. The merge req for increasing delay has not been implemented.
Are you on latest version of calibre?

rj22 · Yesterday, 09:37 AM

Thanks very much for getting back.

Articles are missing. Not sure how to use spoiler tags but the log is a long list of failed articles. About 10% download successfully (the first ones). See as below:

Good point about version. I'm running the latest available on my distribution which is 5.12 apparently. I'll figure out a way to install an updated version and try that first.

Thanks again.
===

Could not fetch link https://www.economist.com/culture/20...ile-in-albania
Traceback (most recent call last):
File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 274, in fetch_url
with closing(open_func(url, timeout=self.timeout)) as f:
File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 241, in open_novisit
return self._mech_open(
File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 313, in _mech_open
raise response
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 429: Too Many Requests

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 529, in process_links
dsrc = self.fetch_url(iurl)
File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 279, in fetch_url
raise FetchError(responses[err.code])
calibre.web.fetch.simple.FetchError: Too Many Requests

08-30-2025, 06:36 PM	#1
rj22 Junior Member Posts: 2 Karma: 10 Join Date: Aug 2025 Device: Kindle	Economist - HTTP429 (throttling) Hello. I'm using CLI Calibre and have noticed throttling causing incomplete downloads with the economist recipe. Is this a common experience - is anyone aware of work-arounds? I'm based in UK, not using VPN. Kovid Goyal (and others) - thank you for all your work, over years! Richard

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Both "The Economist News" and "The Economist Espresso" keep failing	mkgtu	Recipes	40	06-25-2025 09:39 PM
The Economist	Cedrus	Recipes	1	09-30-2021 12:03 PM
The Economist...	RobbieW	Recipes	55	07-21-2021 07:55 PM
The Economist	NSILMike	Recipes	1	11-28-2014 12:57 PM
iLiad ipdf with CPU Throttling	yokos	iRex Developer's Corner	61	08-26-2008 07:10 PM

08-31-2025, 02:41 AM	#2
unkn0wn Guru Posts: 633 Karma: 85520 Join Date: May 2021 Device: kindle	Post the log and wrap in spoiler tags for reporting such issues. is it some images are missing or are the articles missing? I assume its images and increasing delay would fix it. https://github.com/kovidgoyal/calibr...9a30340f2f4ad7

09-01-2025, 01:15 PM	#3
unkn0wn Guru Posts: 633 Karma: 85520 Join Date: May 2021 Device: kindle	I think you are the only one that is reporting this issue. The merge req for increasing delay has not been implemented. Are you on latest version of calibre?

Yesterday, 09:37 AM	#4
rj22 Junior Member Posts: 2 Karma: 10 Join Date: Aug 2025 Device: Kindle	Thanks very much for getting back. Articles are missing. Not sure how to use spoiler tags but the log is a long list of failed articles. About 10% download successfully (the first ones). See as below: Good point about version. I'm running the latest available on my distribution which is 5.12 apparently. I'll figure out a way to install an updated version and try that first. Thanks again. === Could not fetch link https://www.economist.com/culture/20...ile-in-albania Traceback (most recent call last): File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 274, in fetch_url with closing(open_func(url, timeout=self.timeout)) as f: File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 241, in open_novisit return self._mech_open( File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 313, in _mech_open raise response mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 429: Too Many Requests During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 529, in process_links dsrc = self.fetch_url(iurl) File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 279, in fetch_url raise FetchError(responses[err.code]) calibre.web.fetch.simple.FetchError: Too Many Requests