Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 01-09-2014, 07:58 AM   #1
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
New York Times site redesign

The New York Times' website was revamped yesterday. Presumably as a result of this, the recipe now includes header cruft sprinkled inside the body of the article. Potentially, there may be other issues that I'm not aware of (not sure if 100% of article content is collected/displayed).

If someone with the proper technical expertise had the inclination to fix the recipe, I would greatly appreciate it. Thanks!
nelson1379 is offline   Reply With Quote
Old 01-09-2014, 08:19 AM   #2
gianfri
Connoisseur
gianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura about
 
Posts: 59
Karma: 4212
Join Date: Feb 2010
Device: Sony
It does not work for me

Today most articles were not downloaded. Only the title and the author. I wish I had the skills to fix that but I don't. I hope that others will!
gianfri is offline   Reply With Quote
Advert
Old 01-09-2014, 10:28 PM   #3
gianfri
Connoisseur
gianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura about
 
Posts: 59
Karma: 4212
Join Date: Feb 2010
Device: Sony
UPDATE

Quote:
Originally Posted by gianfri View Post
Today most articles were not downloaded. Only the title and the author. I wish I had the skills to fix that but I don't. I hope that others will!
https://bugs.launchpad.net/calibre/+bug/1267549

"Actually, the full body of the article is there; it's just that now every article is prepended with a "Loading" message, a bunch of menu links, the word "Inside" and a page break. If you go to the second page, the article appears correctly."
gianfri is offline   Reply With Quote
Old 01-10-2014, 03:36 PM   #4
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
I saw that the changelog for today's new Calibre version (1.1.19) mentions that the New York Times recipe has been improved, so if someone worked on that, thanks for the effort. However, when I ran the recipe with that new version, the problems with the resulting edition were the same as they were yesterday. Is anyone getting different results?
nelson1379 is offline   Reply With Quote
Old 01-10-2014, 04:37 PM   #5
NSILMike
Guru
NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.NSILMike turned on, tuned in, and dropped out.
 
Posts: 735
Karma: 35936
Join Date: Apr 2011
Location: Shrewsury, MA
Device: Lenovo Android Tablet
Interesting... It downloads fine for me on 1.1.19 but cannot open (loading flow... endlessly) while it syncs and appears to work fine on my Nexus tablet which uses calibre companion to get the file from Calibre on the PC.

Note that there are two NY Times recipes, at least the last time I looked. One uses just the name, and the other uses the name with Headlines appended as I recall.
NSILMike is offline   Reply With Quote
Advert
Old 01-11-2014, 08:28 AM   #6
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
Today's NYT edition removed much of the cruft but there are still "related links" sections interrupting several of the articles. I also had the same issue as NSILMike that it wouldn't open with Calibre but opened on my Kindle. So thanks to whoever improved the recipe... just a bit more work to perfect it.
nelson1379 is offline   Reply With Quote
Old 01-11-2014, 08:37 AM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,779
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Post a link to an article with related items.
kovidgoyal is offline   Reply With Quote
Old 01-11-2014, 02:35 PM   #8
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
Any of the news articles covering the latest New Jersey governor drama pull in "related coverage" from the sidebar. Here's an example of an article from today: http://www.nytimes.com/2014/01/11/ny...-released.html

Here's a mobi of today's edition that I put on my dropbox: https://dl.dropboxusercontent.com/u/...k%20Times.mobi

I did toggle some of the options in the recipe, like removing recursions, tech blogs, most popular articles, etc but I don't believe that to be making a difference. If you can't reproduce it on your end, I'll run it without any of those options toggled and I'll see what I get.

Thanks!
nelson1379 is offline   Reply With Quote
Old 01-11-2014, 10:12 PM   #9
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,779
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Looking at the recipe, as far as I can tell, the author intended for th erelated articles to be included. Set recursions = 0 if you dont want them.
kovidgoyal is offline   Reply With Quote
Old 01-12-2014, 07:37 AM   #10
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
It's not the related articles, appearing after the main article, that are the problem -- I know how to turn them off with the recursions variable and they've been a part of the recipe for months. It's the "related coverage" sidebar and its ilk that appear in the middle of the article and are pretty useless to anyone on an e-reader.

Another example in today's paper is the "interactive graphic" sidebar five paragraphs into this article: http://www.nytimes.com/2014/01/12/us...onopolies.html In the edition that Calibre generated today, it's not even a link, it's just a tiny picture of the graphic, the words "interactive graphic", and then in much larger text, "Who Controls the States and Where They Stand." It's not a huge deal, but it's pointless cruft that I'm sure was not intentionally pulled into the Calibre edition.

Again, not the biggest issue in the world (it was much worse when I originally posted) but I figured I'd try to inform the recipe's author about it.
nelson1379 is offline   Reply With Quote
Old 01-12-2014, 08:59 AM   #11
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,779
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Ah, ok, that's easily remedied.
kovidgoyal is offline   Reply With Quote
Old 01-12-2014, 02:48 PM   #12
gianfri
Connoisseur
gianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura about
 
Posts: 59
Karma: 4212
Join Date: Feb 2010
Device: Sony
Quote:
Originally Posted by nelson1379 View Post
It's not the related articles, appearing after the main article, that are the problem -- I know how to turn them off with the recursions variable and they've been a part of the recipe for months. It's the "related coverage" sidebar and its ilk that appear in the middle of the article and are pretty useless to anyone on an e-reader.

Another example in today's paper is the "interactive graphic" sidebar five paragraphs into this article: http://www.nytimes.com/2014/01/12/us...onopolies.html In the edition that Calibre generated today, it's not even a link, it's just a tiny picture of the graphic, the words "interactive graphic", and then in much larger text, "Who Controls the States and Where They Stand." It's not a huge deal, but it's pointless cruft that I'm sure was not intentionally pulled into the Calibre edition.

Again, not the biggest issue in the world (it was much worse when I originally posted) but I figured I'd try to inform the recipe's author about it.
This is a very clear description of the problem - thank you!

I addition, before the site redesign most articles were listed in their section summary with a brief synopsis of the con ten. Now most articles only list the title.
gianfri is offline   Reply With Quote
Old 01-12-2014, 07:05 PM   #13
mcnk522
Junior Member
mcnk522 began at the beginning.
 
Posts: 3
Karma: 10
Join Date: Sep 2011
Device: Kindle 3
Thank upi for working on improving this recipe. Where is the best place for getting an updated recipe if we don't want to download a whole new version of calibre? Is it the github site?
mcnk522 is offline   Reply With Quote
Old 01-12-2014, 09:59 PM   #14
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,779
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
yes .
kovidgoyal is offline   Reply With Quote
Old 01-13-2014, 09:09 AM   #15
nelson1379
Enthusiast
nelson1379 began at the beginning.
 
Posts: 31
Karma: 32
Join Date: Jan 2012
Device: Kindle Paperwhite
Using the latest recipe from Github removed the remaining cruft. Thanks, Kovid.
nelson1379 is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
New York Times - Website redesign BobbyVan Recipes 0 03-12-2013 01:12 PM
The Independent : Updated recipe for 2011 site redesign NotTaken Recipes 22 12-14-2012 12:01 PM
New York Times Paywall? Starson17 Recipes 7 04-03-2011 08:33 PM
New York times about Kindle 2 Kris777 News 12 02-18-2009 08:51 AM
New Reader Ad in New York Times TadW Sony Reader 7 07-28-2007 01:11 PM


All times are GMT -4. The time now is 01:40 AM.


MobileRead.com is a privately owned, operated and funded community.