Economist - HTTP429 (throttling)

rj22 · 08-30-2025, 06:36 PM

Hello. I'm using CLI Calibre and have noticed throttling causing incomplete downloads with the economist recipe. Is this a common experience - is anyone aware of work-arounds? I'm based in UK, not using VPN.

Kovid Goyal (and others) - thank you for all your work, over years!

Richard

unkn0wn · 08-31-2025, 02:41 AM

Post the log and wrap in spoiler tags for reporting such issues.

is it some images are missing or are the articles missing?
I assume its images and increasing delay would fix it.

https://github.com/kovidgoyal/calibr...9a30340f2f4ad7

unkn0wn · 09-01-2025, 01:15 PM

I think you are the only one that is reporting this issue. The merge req for increasing delay has not been implemented.
Are you on latest version of calibre?

rj22 · Yesterday, 09:37 AM

Thanks very much for getting back.

Articles are missing. Not sure how to use spoiler tags but the log is a long list of failed articles. About 10% download successfully (the first ones). See as below:

Good point about version. I'm running the latest available on my distribution which is 5.12 apparently. I'll figure out a way to install an updated version and try that first.

Thanks again.
===

Could not fetch link https://www.economist.com/culture/20...ile-in-albania
Traceback (most recent call last):
File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 274, in fetch_url
with closing(open_func(url, timeout=self.timeout)) as f:
File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 241, in open_novisit
return self._mech_open(
File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 313, in _mech_open
raise response
mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 429: Too Many Requests

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 529, in process_links
dsrc = self.fetch_url(iurl)
File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 279, in fetch_url
raise FetchError(responses[err.code])
calibre.web.fetch.simple.FetchError: Too Many Requests

08-30-2025, 06:36 PM	#1
rj22 Junior Member Posts: 2 Karma: 10 Join Date: Aug 2025 Device: Kindle	Economist - HTTP429 (throttling) Hello. I'm using CLI Calibre and have noticed throttling causing incomplete downloads with the economist recipe. Is this a common experience - is anyone aware of work-arounds? I'm based in UK, not using VPN. Kovid Goyal (and others) - thank you for all your work, over years! Richard

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Both "The Economist News" and "The Economist Espresso" keep failing	mkgtu	Recipes	40	06-25-2025 09:39 PM
The Economist	Cedrus	Recipes	1	09-30-2021 12:03 PM
The Economist...	RobbieW	Recipes	55	07-21-2021 07:55 PM
The Economist	NSILMike	Recipes	1	11-28-2014 12:57 PM
iLiad ipdf with CPU Throttling	yokos	iRex Developer's Corner	61	08-26-2008 07:10 PM

08-31-2025, 02:41 AM	#2
unkn0wn Guru Posts: 633 Karma: 85520 Join Date: May 2021 Device: kindle	Post the log and wrap in spoiler tags for reporting such issues. is it some images are missing or are the articles missing? I assume its images and increasing delay would fix it. https://github.com/kovidgoyal/calibr...9a30340f2f4ad7

09-01-2025, 01:15 PM	#3
unkn0wn Guru Posts: 633 Karma: 85520 Join Date: May 2021 Device: kindle	I think you are the only one that is reporting this issue. The merge req for increasing delay has not been implemented. Are you on latest version of calibre?

Yesterday, 09:37 AM	#4
rj22 Junior Member Posts: 2 Karma: 10 Join Date: Aug 2025 Device: Kindle	Thanks very much for getting back. Articles are missing. Not sure how to use spoiler tags but the log is a long list of failed articles. About 10% download successfully (the first ones). See as below: Good point about version. I'm running the latest available on my distribution which is 5.12 apparently. I'll figure out a way to install an updated version and try that first. Thanks again. === Could not fetch link https://www.economist.com/culture/20...ile-in-albania Traceback (most recent call last): File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 274, in fetch_url with closing(open_func(url, timeout=self.timeout)) as f: File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 241, in open_novisit return self._mech_open( File "/usr/lib/python3/dist-packages/mechanize/_mechanize.py", line 313, in _mech_open raise response mechanize._response.get_seek_wrapper_class.<locals >.httperror_seek_wrapper: HTTP Error 429: Too Many Requests During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 529, in process_links dsrc = self.fetch_url(iurl) File "/usr/lib/calibre/calibre/web/fetch/simple.py", line 279, in fetch_url raise FetchError(responses[err.code]) calibre.web.fetch.simple.FetchError: Too Many Requests

Advert