Captcha blocks New York Times recipe, maybe?

mkgtu · 11-15-2022, 07:01 PM

Using a VPN with a new IP address today, tried to open an article on website (paid subscription) and got a warning page identifying my IP address and forcing me to go through 3 elaborate Captchas removing pictures of busses to prove I was not a Robot.

I had been caught via calibre of being a robot this morning this morning during repeated failed downloads of NYT. My IP was blocked by NYT website for NINE HOURS today. So I had been using a VPN to access the website. That worked all day till I got flagged with this big Captcha this afternoon.

SO I TRIED DOWNLOADING NYT in calibre again using a VPN and a 15 second delay. That worked this morning but failed repeatedly this afternoon. I think maybe it got stuck on this Captcha right away. The failures were quick. Downloads completed but all sections empty.

Partial log (calibre 6.8):

File "socket.py", line 955, in getaddrinfo
socket.gaierror: [Errno 11001] getaddrinfo failed

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "runpy.py", line 196, in _run_module_as_main
File "runpy.py", line 86, in _run_code
File "site.py", line 82, in <module>
File "site.py", line 77, in main
File "site.py", line 49, in run_entry_point
File "calibre\utils\ipc\worker.py", line 215, in main
File "calibre\gui2\convert\gui_conversion.py", line 31, in gui_convert_recipe
File "calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert
File "calibre\ebooks\conversion\plumber.py", line 1108, in run
File "calibre\customize\conversion.py", line 242, in __call__
File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 138, in convert
File "calibre\web\feeds\news.py", line 1058, in download
File "calibre\web\feeds\news.py", line 1227, in build_index
File "<string>", line 272, in parse_index
File "<string>", line 141, in parse_todays_page
File "<string>", line 133, in read_nyt_metadata
File "<string>", line 130, in read_todays_paper
File "<string>", line 112, in get_nyt_page
File "mechanize\_mechanize.py", line 241, in open_novisit
File "mechanize\_mechanize.py", line 287, in _mech_open
File "mechanize\_opener.py", line 193, in open
File "mechanize\_urllib2_fork.py", line 425, in _open
File "mechanize\_urllib2_fork.py", line 414, in _call_chain
File "calibre\utils\browser.py", line 28, in https_open
File "mechanize\_urllib2_fork.py", line 1240, in do_open
urllib.error.URLError: <urlopen error [Errno 11001] getaddrinfo failed>

mkgtu · 11-15-2022, 07:06 PM

I don't want to go back to using my regular IP with calibre again for fear of getting blocked, put in the penalty box again tomorrow, maybe permanently. But I doubt the recipe is going to work with a VPN address.

May have to just skip the New York Times going forward.

11-15-2022, 07:01 PM	#1
mkgtu Zealot Posts: 139 Karma: 33000 Join Date: Feb 2010 Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire	Captcha blocks New York Times recipe, maybe? Using a VPN with a new IP address today, tried to open an article on website (paid subscription) and got a warning page identifying my IP address and forcing me to go through 3 elaborate Captchas removing pictures of busses to prove I was not a Robot. I had been caught via calibre of being a robot this morning this morning during repeated failed downloads of NYT. My IP was blocked by NYT website for NINE HOURS today. So I had been using a VPN to access the website. That worked all day till I got flagged with this big Captcha this afternoon. SO I TRIED DOWNLOADING NYT in calibre again using a VPN and a 15 second delay. That worked this morning but failed repeatedly this afternoon. I think maybe it got stuck on this Captcha right away. The failures were quick. Downloads completed but all sections empty. Partial log (calibre 6.8): File "socket.py", line 955, in getaddrinfo socket.gaierror: [Errno 11001] getaddrinfo failed During handling of the above exception, another exception occurred: Traceback (most recent call last): File "runpy.py", line 196, in _run_module_as_main File "runpy.py", line 86, in _run_code File "site.py", line 82, in <module> File "site.py", line 77, in main File "site.py", line 49, in run_entry_point File "calibre\utils\ipc\worker.py", line 215, in main File "calibre\gui2\convert\gui_conversion.py", line 31, in gui_convert_recipe File "calibre\gui2\convert\gui_conversion.py", line 25, in gui_convert File "calibre\ebooks\conversion\plumber.py", line 1108, in run File "calibre\customize\conversion.py", line 242, in __call__ File "calibre\ebooks\conversion\plugins\recipe_input.py ", line 138, in convert File "calibre\web\feeds\news.py", line 1058, in download File "calibre\web\feeds\news.py", line 1227, in build_index File "<string>", line 272, in parse_index File "<string>", line 141, in parse_todays_page File "<string>", line 133, in read_nyt_metadata File "<string>", line 130, in read_todays_paper File "<string>", line 112, in get_nyt_page File "mechanize\_mechanize.py", line 241, in open_novisit File "mechanize\_mechanize.py", line 287, in _mech_open File "mechanize\_opener.py", line 193, in open File "mechanize\_urllib2_fork.py", line 425, in _open File "mechanize\_urllib2_fork.py", line 414, in _call_chain File "calibre\utils\browser.py", line 28, in https_open File "mechanize\_urllib2_fork.py", line 1240, in do_open urllib.error.URLError: <urlopen error [Errno 11001] getaddrinfo failed>

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
NYT Spanish New York Times Español El Times Recipe	compa	Recipes	0	03-24-2022 02:40 PM
New York Times Recipe	dieterpops	Recipes	1	01-20-2013 12:26 PM
Which New York Times recipe?	jdomingos76	Recipes	1	03-25-2011 08:40 PM
Help - New York Times Recipe	brutalist	Recipes	6	03-20-2011 10:17 PM
New York Times recipe	madrone26	Calibre	4	04-02-2009 01:13 PM

11-15-2022, 07:06 PM	#2
mkgtu Zealot Posts: 139 Karma: 33000 Join Date: Feb 2010 Device: Currently:Voyage, Oasis 3, Kindle mobile apps, andKindle Fire	I don't want to go back to using my regular IP with calibre again for fear of getting blocked, put in the penalty box again tomorrow, maybe permanently. But I doubt the recipe is going to work with a VPN address. May have to just skip the New York Times going forward.

Advert