Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 11-06-2018, 06:55 AM   #1
bobbysteel
Big Poppa
bobbysteel began at the beginning.
 
Posts: 68
Karma: 10
Join Date: Jul 2010
Device: Nook
Financial Times may have removed captcha

I've had some special help with the developers there but think they've finally removed the captcha. Does someone want to try a test recipe?

https://gist.github.com/a10kiloham/4...83a51657636736

1) this uses social referrers - Kovid do you object to checking in this in mainline code?

2) there are some failures intermittently. Kovid, is there a way to override the fetch mechanism to retry if exception is thrown the first time? It seems to work if retried (subsequent runs have different missing articles)

3) for whatever reason it seems to work best single threaded
bobbysteel is offline   Reply With Quote
Old 11-07-2018, 01:02 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 34,063
Karma: 10261488
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
a social referer is fine for me, although I doubt it will be very stable in the long term.

If you want to retry, simply override the open_novisit method for the browser object in get_browser(). That is the method used to download things.
kovidgoyal is offline   Reply With Quote
Old 11-16-2018, 03:15 PM   #3
bobbysteel
Big Poppa
bobbysteel began at the beginning.
 
Posts: 68
Karma: 10
Join Date: Jul 2010
Device: Nook
thanks for this. seems to work well. i'll clean it up and check it in again soon
bobbysteel is offline   Reply With Quote
Old 01-23-2019, 01:14 AM   #4
mixedbaba
Junior Member
mixedbaba began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Jan 2019
Device: Kindle PW2
I tried using the link in 1st post but only headers of the group are only downloaded. Not even the headers of articles are being downloaded leave alone the articles. I Didnt understand where do we change what Kovid says. If anyone has Financial times Recipe working please share.
Thank you.
mixedbaba is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Financial times update kiklop74 Recipes 0 08-20-2017 03:38 PM
Financial Times teotjunk Recipes 0 08-05-2017 11:20 PM
Financial Times via ftepaper Spiri82 Recipes 0 10-06-2015 09:52 PM
Financial Times (UK) and Financial Times (International) recipes are broken mattyb Recipes 1 09-05-2014 11:49 AM
Financial Times St28 Calibre 2 07-05-2011 11:50 AM


All times are GMT -4. The time now is 10:51 AM.


MobileRead.com is a privately owned, operated and funded community.