02-12-2018, 06:29 AM | #16 |
Enthusiast
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
|
This worked flawlessly on Sunday -- but it crashed on Monday (today) with the following error:
https://pastebin.com/fJ2ZWaq3 Note that it crashed with is_web_edition = False. It appears to be running successfully now with is_web_edition = True. Thank you, as always, for your help. |
02-12-2018, 07:22 AM | #17 |
Member
Posts: 10
Karma: 10
Join Date: Aug 2012
Device: kindal
|
Reinstalled Calibre in the hope that the NYT recipe was updated. It crashes immediately. Looked at the recipe and it has webedition = true.
|
02-12-2018, 07:56 AM | #18 |
Enthusiast
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
|
Completed successfully for me with "is_web_edition = True".
I should note that when it crashed before with "is_web_edition = False", it crashed within seconds. I don't know why mspark and I would get two separate outcomes. |
02-12-2018, 08:33 AM | #19 |
Member
Posts: 12
Karma: 10
Join Date: May 2016
Device: none
|
I had the same result as in nelson 1379's previous post.
Off-topic: You used to be able to (drastically) reduce the size of the web edition by making... recursions = 0 # set this to zero to omit Related articles lists # speeds up processing by preventing index page links from being followed Does anyone know how to accomplish this in the new recipe? Today's web edition is 1700 pages and 72.2 MB. Thanks for the help. Last edited by nanami; 02-12-2018 at 09:22 AM. |
02-12-2018, 09:42 AM | #20 |
Enthusiast
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
|
Regarding the size of the paper, I changed compress_news_images_auto_size from 5 to 16 and my (web edition) paper this morning was 11 MB. That's the only change I made to the default recipe, after reverting web edition back to True.
|
02-12-2018, 11:23 AM | #21 |
Member
Posts: 23
Karma: 10
Join Date: Aug 2012
Device: Kindle DX & Paperwhite
|
The latest NYT recipe is a great improvement. I particularly appreciate that the author bios (div story-notes on the web page) now appear in the output for the Opinion section. Very important, now more than ever, to know where writers are coming from!
I do miss some of the customization options, especially the one to set the maximum age of articles. I don't see that in the new recipe, and it is important for those of us who need to limit the output file size so it can be emailed. Thanks! |
02-12-2018, 01:06 PM | #22 |
Member
Posts: 10
Karma: 10
Join Date: Aug 2012
Device: kindal
|
My bad. Checked again. I had two recipes -- one false and one true. Guess I was trying the false one. The true one seems to work.
|
02-12-2018, 08:29 PM | #23 |
creator of calibre
Posts: 44,017
Karma: 22669822
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
https://github.com/kovidgoyal/calibr...26b4c345b25ec0
@danhotchkiss: Shouldn't be too hard to add back the option to control max age of articles. I'll look into it when I have a moment. |
02-12-2018, 09:38 PM | #24 |
creator of calibre
Posts: 44,017
Karma: 22669822
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
|
02-12-2018, 10:03 PM | #25 |
Member
Posts: 12
Karma: 10
Join Date: May 2016
Device: none
|
@nelson1379... thanks very much but I should I worded my post more carefully. Reducing the page count is why I miss:
recursions = 0 # set this to zero to omit Related articles lists # speeds up processing by preventing index page links from being followed |
02-12-2018, 10:26 PM | #26 |
creator of calibre
Posts: 44,017
Karma: 22669822
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
The new recipe does not follow links in any case.
|
02-13-2018, 08:03 AM | #27 |
Member
Posts: 12
Karma: 10
Join Date: May 2016
Device: none
|
Ah. Thank you for the info. Apologies for my dumbness.
Thanks very much for all your work. It much appreciated. |
02-14-2018, 07:36 AM | #28 |
Enthusiast
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
|
Thank you, Kovid. It's worked for the last two days with "is_web_edition = False".
I've been doing some trial and error in remove_tags to remove some small and intermittent bits of cruft, and I'll post here later with the code when I figure out what works best. |
02-18-2018, 10:40 PM | #29 |
Member
Posts: 18
Karma: 10
Join Date: Aug 2011
Device: Nook
|
Some of the articles are empty, and I'm wondering if these are subscriber-only. I am a subscriber, but I don't see the option to enter my username and password in the new script.
|
02-19-2018, 09:15 AM | #30 |
Big Poppa
Posts: 110
Karma: 10
Join Date: Jul 2010
Device: Nook
|
Why did the recursions get turned off? I rather liked the ability to go back in time to see older articles linked in each current article.
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
New York Times Technology Beat is broken | NSILMike | Recipes | 1 | 04-16-2017 12:55 AM |
New York Times Book Review broken again. | wingmongyee | Recipes | 9 | 03-24-2016 07:20 PM |
New York Times Book Review broken | wingmongyee | Recipes | 3 | 01-02-2016 12:32 AM |
New York Times Recipe | dieterpops | Recipes | 1 | 01-20-2013 12:26 PM |
New York Times recipe broken? | gianfri | Calibre | 1 | 03-20-2010 09:52 AM |