MobileRead Forums
Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes
Reload this Page New York Times suddenly is slow

Notices

Reply
Page 1 of 2 1 2
 
Thread Tools Search this Thread
Old 11-14-2020, 04:34 PM   #1
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
New York Times suddenly is slow
Recipe by Kovid.
I use it daily and it always downloads reasonably fast. Today it was taking over 5 hours and was still showing only early progress. I stopped and restarted it and it's still slow.
All my other news recipes are fine.
Any ideas?
NSILMike is offline   Reply With Quote
Old 11-15-2020, 09:31 AM   #2
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
And this morning it's fine again...
NSILMike is offline   Reply With Quote
Advert
Old 11-16-2020, 01:38 PM   #3
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
And now it's slow again. 3hrs and 20 minutes and only 2% downloaded...
update: 3:40 and still at 2%
Last edited by NSILMike; 11-16-2020 at 01:56 PM.
NSILMike is offline   Reply With Quote
Old 11-20-2020, 11:57 PM   #4
rasteps
Zealot
rasteps began at the beginning.
 
Posts: 137
Karma: 10
Join Date: Sep 2010
Device: Kindle, Android phone
This recipe only downloads the 1st image in each article. How can I change it manually to download all the images in the article?
rasteps is offline   Reply With Quote
Old 11-25-2020, 10:44 PM   #5
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,343
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by rasteps View Post
This recipe only downloads the 1st image in each article. How can I change it manually to download all the images in the article?
post a link to an article with multiple images and I will take a look.
kovidgoyal is online now   Reply With Quote
Advert
Old 11-27-2020, 04:41 AM   #6
rasteps
Zealot
rasteps began at the beginning.
 
Posts: 137
Karma: 10
Join Date: Sep 2010
Device: Kindle, Android phone
Quote:
Originally Posted by kovidgoyal View Post
post a link to an article with multiple images and I will take a look.
This is one of many links that only download one image and leaves out the rest.

https://www.nytimes.com/2020/11/27/w...venezuela.html
rasteps is offline   Reply With Quote
Old 11-27-2020, 06:10 AM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,343
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
https://github.com/kovidgoyal/calibr...a92444befc5ef0
kovidgoyal is online now   Reply With Quote
Old 11-29-2020, 02:44 AM   #8
rasteps
Zealot
rasteps began at the beginning.
 
Posts: 137
Karma: 10
Join Date: Sep 2010
Device: Kindle, Android phone
Quote:
Originally Posted by kovidgoyal View Post
I just looked at the code you added and realized that there's no way I could have written that.... Still a long way to go in writing my own fixes.
rasteps is offline   Reply With Quote
Old 11-29-2020, 03:15 AM   #9
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 45,343
Karma: 27182818
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
It looks more complicated than it is. All its doing is searching for a particular type of tag that denotes an image on the NYT checking if there is no exisint img tag inside it, which means its a lazy loaded image with a single <span> tag saying "Image" and converting that span tag into a <img> tag for the rest of the news subsystem to download.
kovidgoyal is online now   Reply With Quote
Old 12-02-2020, 12:51 PM   #10
rasteps
Zealot
rasteps began at the beginning.
 
Posts: 137
Karma: 10
Join Date: Sep 2010
Device: Kindle, Android phone
Quote:
Originally Posted by kovidgoyal View Post
It looks more complicated than it is. All its doing is searching for a particular type of tag that denotes an image on the NYT checking if there is no exisint img tag inside it, which means its a lazy loaded image with a single <span> tag saying "Image" and converting that span tag into a <img> tag for the rest of the news subsystem to download.
:: Is that all???

Anyway, these news feeds have been saving my sanity, so thanks for all your help.
rasteps is offline   Reply With Quote
Old 12-03-2020, 09:32 AM   #11
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
Quote:
Originally Posted by NSILMike View Post
And now it's slow again. 3hrs and 20 minutes and only 2% downloaded...
update: 3:40 and still at 2%
Still supremely slow...
NSILMike is offline   Reply With Quote
Old 12-04-2020, 10:21 PM   #12
rasteps
Zealot
rasteps began at the beginning.
 
Posts: 137
Karma: 10
Join Date: Sep 2010
Device: Kindle, Android phone
Quote:
Originally Posted by NSILMike View Post
Still supremely slow...

Try quitting the job and resubmitting. I don't know why, but sometimes it stalls.
rasteps is offline   Reply With Quote
Old 12-05-2020, 07:48 AM   #13
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
Quote:
Originally Posted by rasteps View Post
Try quitting the job and resubmitting. I don't know why, but sometimes it stalls.
Yeah, I've tried that and it sometimes works but not consistently.
NSILMike is offline   Reply With Quote
Old 12-05-2020, 10:46 AM   #14
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
Posts: 13,504
Karma: 78910112
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
I'm just curious as to what you think can be done by calibre to resolve an issue with how the web server is handling the retrieval of pages, and the server possibly intentionally throttling your connection.
PeterT is offline   Reply With Quote
Old 12-06-2020, 08:50 AM   #15
rasteps
Zealot
rasteps began at the beginning.
 
Posts: 137
Karma: 10
Join Date: Sep 2010
Device: Kindle, Android phone
Quote:
Originally Posted by NSILMike View Post
Yeah, I've tried that and it sometimes works but not consistently.
You might want to consider limiting how many jobs you run simultaneously. Or run the job at off-peak times when the server may not be so busy.
rasteps is offline   Reply With Quote
Reply
Page 1 of 2 1 2

« Previous Thread | Next Thread »

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Glo - suddenly very slow spud357c Kobo Reader 8 06-02-2014 07:43 AM
Any idea what causes suddenly slow wifi? carld Kindle Fire 3 01-15-2012 10:41 PM
Problems with New York Times cyberheuze Recipes 1 04-14-2011 08:47 PM
New York Times review: K2 akira28 Amazon Kindle 32 02-28-2009 02:23 PM
New York times about Kindle 2 Kris777 News 12 02-18-2009 08:51 AM


All times are GMT -4. The time now is 11:32 PM.

Contact Us - FAQ - Guidelines - Privacy - Top

MobileRead.com is a privately owned, operated and funded community.