Financial Times may have removed captcha

bobbysteel · 11-06-2018, 05:55 AM

I've had some special help with the developers there but think they've finally removed the captcha. Does someone want to try a test recipe?

https://gist.github.com/a10kiloham/4...83a51657636736

1) this uses social referrers - Kovid do you object to checking in this in mainline code?

2) there are some failures intermittently. Kovid, is there a way to override the fetch mechanism to retry if exception is thrown the first time? It seems to work if retried (subsequent runs have different missing articles)

3) for whatever reason it seems to work best single threaded

kovidgoyal · 11-07-2018, 12:02 AM

a social referer is fine for me, although I doubt it will be very stable in the long term.

If you want to retry, simply override the open_novisit method for the browser object in get_browser(). That is the method used to download things.

bobbysteel · 11-16-2018, 02:15 PM

thanks for this. seems to work well. i'll clean it up and check it in again soon

mixedbaba · 01-23-2019, 12:14 AM

I tried using the link in 1st post but only headers of the group are only downloaded. Not even the headers of articles are being downloaded leave alone the articles. I Didnt understand where do we change what Kovid says. If anyone has Financial times Recipe working please share.
Thank you.

11-06-2018, 05:55 AM	#1
bobbysteel Big Poppa Posts: 110 Karma: 10 Join Date: Jul 2010 Device: Nook	Financial Times may have removed captcha I've had some special help with the developers there but think they've finally removed the captcha. Does someone want to try a test recipe? https://gist.github.com/a10kiloham/4...83a51657636736 1) this uses social referrers - Kovid do you object to checking in this in mainline code? 2) there are some failures intermittently. Kovid, is there a way to override the fetch mechanism to retry if exception is thrown the first time? It seems to work if retried (subsequent runs have different missing articles) 3) for whatever reason it seems to work best single threaded

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Financial times update	kiklop74	Recipes	0	08-20-2017 02:38 PM
Financial Times	teotjunk	Recipes	0	08-05-2017 10:20 PM
Financial Times via ftepaper	Spiri82	Recipes	0	10-06-2015 08:52 PM
Financial Times (UK) and Financial Times (International) recipes are broken	mattyb	Recipes	1	09-05-2014 10:49 AM
Financial Times	St28	Calibre	2	07-05-2011 10:50 AM

11-07-2018, 12:02 AM	#2
kovidgoyal creator of calibre Posts: 43,850 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	a social referer is fine for me, although I doubt it will be very stable in the long term. If you want to retry, simply override the open_novisit method for the browser object in get_browser(). That is the method used to download things.

11-16-2018, 02:15 PM	#3
bobbysteel Big Poppa Posts: 110 Karma: 10 Join Date: Jul 2010 Device: Nook	thanks for this. seems to work well. i'll clean it up and check it in again soon

01-23-2019, 12:14 AM	#4
mixedbaba Junior Member Posts: 7 Karma: 10 Join Date: Jan 2019 Device: Kindle PW2	I tried using the link in 1st post but only headers of the group are only downloaded. Not even the headers of articles are being downloaded leave alone the articles. I Didnt understand where do we change what Kovid says. If anyone has Financial times Recipe working please share. Thank you.