Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 02-12-2018, 06:29 AM   #16
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
This worked flawlessly on Sunday -- but it crashed on Monday (today) with the following error:

https://pastebin.com/fJ2ZWaq3

Note that it crashed with is_web_edition = False. It appears to be running successfully now with is_web_edition = True.

Thank you, as always, for your help.
nelson1379 is offline   Reply With Quote
Old 02-12-2018, 07:22 AM   #17
mspark
Member
mspark began at the beginning.
 
Posts: 10
Karma: 10
Join Date: Aug 2012
Device: kindal
Reinstalled Calibre in the hope that the NYT recipe was updated. It crashes immediately. Looked at the recipe and it has webedition = true.
mspark is offline   Reply With Quote
Advert
Old 02-12-2018, 07:56 AM   #18
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
Completed successfully for me with "is_web_edition = True".

I should note that when it crashed before with "is_web_edition = False", it crashed within seconds.

I don't know why mspark and I would get two separate outcomes.
nelson1379 is offline   Reply With Quote
Old 02-12-2018, 08:33 AM   #19
nanami
Member
nanami began at the beginning.
 
Posts: 12
Karma: 10
Join Date: May 2016
Device: none
I had the same result as in nelson 1379's previous post.

Off-topic: You used to be able to (drastically) reduce the size of the web edition by making...

recursions = 0 # set this to zero to omit Related articles lists
# speeds up processing by preventing index page links from being followed


Does anyone know how to accomplish this in the new recipe? Today's web edition is 1700 pages and 72.2 MB.

Thanks for the help.

Last edited by nanami; 02-12-2018 at 09:22 AM.
nanami is offline   Reply With Quote
Old 02-12-2018, 09:42 AM   #20
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
Regarding the size of the paper, I changed compress_news_images_auto_size from 5 to 16 and my (web edition) paper this morning was 11 MB. That's the only change I made to the default recipe, after reverting web edition back to True.
nelson1379 is offline   Reply With Quote
Advert
Old 02-12-2018, 11:23 AM   #21
danhotchkiss
Member
danhotchkiss began at the beginning.
 
Posts: 23
Karma: 10
Join Date: Aug 2012
Device: Kindle DX & Paperwhite
The latest NYT recipe is a great improvement. I particularly appreciate that the author bios (div story-notes on the web page) now appear in the output for the Opinion section. Very important, now more than ever, to know where writers are coming from!

I do miss some of the customization options, especially the one to set the maximum age of articles. I don't see that in the new recipe, and it is important for those of us who need to limit the output file size so it can be emailed.

Thanks!
danhotchkiss is offline   Reply With Quote
Old 02-12-2018, 01:06 PM   #22
mspark
Member
mspark began at the beginning.
 
Posts: 10
Karma: 10
Join Date: Aug 2012
Device: kindal
My bad. Checked again. I had two recipes -- one false and one true. Guess I was trying the false one. The true one seems to work.
mspark is offline   Reply With Quote
Old 02-12-2018, 08:29 PM   #23
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,778
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
https://github.com/kovidgoyal/calibr...26b4c345b25ec0

@danhotchkiss: Shouldn't be too hard to add back the option to control max age of articles. I'll look into it when I have a moment.
kovidgoyal is offline   Reply With Quote
Old 02-12-2018, 09:38 PM   #24
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,778
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
https://github.com/kovidgoyal/calibr...b8f90000612180
kovidgoyal is offline   Reply With Quote
Old 02-12-2018, 10:03 PM   #25
nanami
Member
nanami began at the beginning.
 
Posts: 12
Karma: 10
Join Date: May 2016
Device: none
@nelson1379... thanks very much but I should I worded my post more carefully. Reducing the page count is why I miss:

recursions = 0 # set this to zero to omit Related articles lists
# speeds up processing by preventing index page links from being followed
nanami is offline   Reply With Quote
Old 02-12-2018, 10:26 PM   #26
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,778
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
The new recipe does not follow links in any case.
kovidgoyal is offline   Reply With Quote
Old 02-13-2018, 08:03 AM   #27
nanami
Member
nanami began at the beginning.
 
Posts: 12
Karma: 10
Join Date: May 2016
Device: none
Ah. Thank you for the info. Apologies for my dumbness.

Thanks very much for all your work. It much appreciated.
nanami is offline   Reply With Quote
Old 02-14-2018, 07:36 AM   #28
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
Thank you, Kovid. It's worked for the last two days with "is_web_edition = False".

I've been doing some trial and error in remove_tags to remove some small and intermittent bits of cruft, and I'll post here later with the code when I figure out what works best.
nelson1379 is offline   Reply With Quote
Old 02-18-2018, 10:40 PM   #29
davidnye
Member
davidnye began at the beginning.
 
Posts: 18
Karma: 10
Join Date: Aug 2011
Device: Nook
Some of the articles are empty, and I'm wondering if these are subscriber-only. I am a subscriber, but I don't see the option to enter my username and password in the new script.
davidnye is offline   Reply With Quote
Old 02-19-2018, 09:15 AM   #30
bobbysteel
Big Poppa
bobbysteel began at the beginning.
 
Posts: 110
Karma: 10
Join Date: Jul 2010
Device: Nook
Why did the recursions get turned off? I rather liked the ability to go back in time to see older articles linked in each current article.
bobbysteel is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
New York Times Technology Beat is broken NSILMike Recipes 1 04-16-2017 12:55 AM
New York Times Book Review broken again. wingmongyee Recipes 9 03-24-2016 07:20 PM
New York Times Book Review broken wingmongyee Recipes 3 01-02-2016 12:32 AM
New York Times Recipe dieterpops Recipes 1 01-20-2013 12:26 PM
New York Times recipe broken? gianfri Calibre 1 03-20-2010 09:52 AM


All times are GMT -4. The time now is 03:32 AM.


MobileRead.com is a privately owned, operated and funded community.