11-06-2018, 05:55 AM | #1 |
Big Poppa
Posts: 110
Karma: 10
Join Date: Jul 2010
Device: Nook
|
Financial Times may have removed captcha
I've had some special help with the developers there but think they've finally removed the captcha. Does someone want to try a test recipe?
https://gist.github.com/a10kiloham/4...83a51657636736 1) this uses social referrers - Kovid do you object to checking in this in mainline code? 2) there are some failures intermittently. Kovid, is there a way to override the fetch mechanism to retry if exception is thrown the first time? It seems to work if retried (subsequent runs have different missing articles) 3) for whatever reason it seems to work best single threaded |
11-07-2018, 12:02 AM | #2 |
creator of calibre
Posts: 43,866
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
a social referer is fine for me, although I doubt it will be very stable in the long term.
If you want to retry, simply override the open_novisit method for the browser object in get_browser(). That is the method used to download things. |
Advert | |
|
11-16-2018, 02:15 PM | #3 |
Big Poppa
Posts: 110
Karma: 10
Join Date: Jul 2010
Device: Nook
|
thanks for this. seems to work well. i'll clean it up and check it in again soon
|
01-23-2019, 12:14 AM | #4 |
Junior Member
Posts: 7
Karma: 10
Join Date: Jan 2019
Device: Kindle PW2
|
I tried using the link in 1st post but only headers of the group are only downloaded. Not even the headers of articles are being downloaded leave alone the articles. I Didnt understand where do we change what Kovid says. If anyone has Financial times Recipe working please share.
Thank you. |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Financial times update | kiklop74 | Recipes | 0 | 08-20-2017 02:38 PM |
Financial Times | teotjunk | Recipes | 0 | 08-05-2017 10:20 PM |
Financial Times via ftepaper | Spiri82 | Recipes | 0 | 10-06-2015 08:52 PM |
Financial Times (UK) and Financial Times (International) recipes are broken | mattyb | Recipes | 1 | 09-05-2014 10:49 AM |
Financial Times | St28 | Calibre | 2 | 07-05-2011 10:50 AM |