Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Recipes

Notices

Reply
 
Thread Tools Search this Thread
Old 01-13-2014, 11:29 AM   #16
NSILMike
Zealot
NSILMike began at the beginning.
 
Posts: 114
Karma: 10
Join Date: Apr 2011
Location: Suburb of Boston, MA
Device: Kindle KeyBoard & Nexus 7
Quote:
Originally Posted by mcnk522 View Post
Thank upi for working on improving this recipe. Where is the best place for getting an updated recipe if we don't want to download a whole new version of calibre? Is it the github site?
Interesting... this suggests a question about recipe updates. If I enable a recipe within Calibre by clicking 'fetch news' and 'schedule a news download' my assumption has been that any subsequent updates or modifications to that recipe by the author would be reflected at the next download using that recipe. Is that not correct?
NSILMike is offline   Reply With Quote
Old 01-14-2014, 10:18 PM   #17
gianfri
Connoisseur
gianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura about
 
Posts: 59
Karma: 4212
Join Date: Feb 2010
Device: Sony
Quote:
Originally Posted by nelson1379 View Post
Using the latest recipe from Github removed the remaining cruft. Thanks, Kovid.
This recipe appears to be only for the headlines. Is there another one updated with the full edition of the NYT? Thank you.
gianfri is offline   Reply With Quote
Old 01-19-2014, 07:27 PM   #18
pa_ubach
Junior Member
pa_ubach began at the beginning.
 
Posts: 5
Karma: 10
Join Date: Jan 2014
Location: Sitges
Device: Sony Reader PRS-T3
Hi Gianfri,

The recipe is valid for the full edition as well. You only need to set the options accordingly. I use the following:
Code:
headlinesOnly = False
and
Code:
webEdition = True
Kovid, I have seen that the needs_subscription variable is set to False in all cases. Is this correct? I would suspect that you actually need the subscription to get the full version of the NYTimes. I have set it to 'optional'.

Maybe you also need to include this fragment of code to the definition of get_browser(self):
Code:
if self.username is not None and self.password is not None:
            br.open('http://www.nytimes.com/auth/login')
            br.form = br.forms().next()
            br['userid']   = self.username
            br['password'] = self.password
            raw = br.submit().read()
            if 'Please try again' in raw:
                raise Exception('Your username and password are incorrect')
I have included it myself from a previous version of the recipe and works well.

Now, if you are a perfectionist, there is still a small glitch. When the recursions is set to a value different than zero, some fetched articles show the numbers "1" and "2" bulleted at the end, along with a "Next Page" would-be-button. Example (note that the website doesn't show multiple pages for the article and that the URL address has the code ?pagewanted=all appended). I guess this has to do with the web redesign and only affects articles published before the redesign. So if that is the case, I don't think you need to worry about; because eventually all the articles fetched under the recursive option will have been edited using the new web technology and this problem will disappear.
Disclaimer: I am using Calibre v0.9.6 because I am using Fedora17 at my HTPC and I am too lazy to bother about compilations and don't want to worry about upgrading a system that has taken a lot of effort to get right.

By the way, Are you aware that David Pogue has left the NYTimes as columnist and has set a new venture with Yahoo? His column is really outdated nowadays. The New York Times has just hired a new Technology columnist who will be in charge of "State of the Art". He starts next month so I guess we won't know the new feed address until then.

Thanks all to paying attention to this recipe and fixing it. And THANKS Kovid for this outstanding recipe and specially for Calibre!!! I wish we had the same support for the recipes of the main newpapers in Spain!
pa_ubach is offline   Reply With Quote
Old 01-19-2014, 07:32 PM   #19
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,338
Karma: 5382313
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
The NYTimes doesn't need a subscription, since it uses a javascript paywall, which does not work for non-browser based download systems like calibre's recipe system.
kovidgoyal is offline   Reply With Quote
Old 01-20-2014, 11:03 AM   #20
gianfri
Connoisseur
gianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura aboutgianfri has a spectacular aura about
 
Posts: 59
Karma: 4212
Join Date: Feb 2010
Device: Sony
A few (minor) glitches left

1. It looks like the byline is only loaded for a few articles, mostly from the front page. Most articles are only listed with their title. Before the redesign I seem to remember that most articles had bylines.

2. At least on my iPad, most (all?) articles show a wide blank gap, about half way into the article. The text is still all there, there is just a gap that can be as much as a third of a page on my device.

Overall the recipe works great, though. Still one of my favorite. Thank you so much to all of you who are working to improve it!
gianfri is offline   Reply With Quote
Old 02-13-2014, 09:22 PM   #21
randomzombie
Enthusiast
randomzombie began at the beginning.
 
Posts: 32
Karma: 10
Join Date: Dec 2012
Device: kindle paperwhite
Hi Kovid...
Just wanted to thank you for a great service - these recipes are appreciated!
But also, a few questions:
a) How would I amend the recipe to preserve the "Today's Paper" format and organization style, a la:
http://www.nytimes.com/pages/todayspaper/index.html ?
b) What is the difference between your nytimes and nytimes_sub recipes? Is the latter for subscribers?
c) How would I incorporate other blogs instead of the Tech stories, examples such as Well (http://well.blogs.nytimes.com/) and The Stone (http://opinionator.blogs.nytimes.com...ory/the-stone/), without potentially upsetting the rest of your code?

Thanks again for the recipes as they stand!
randomzombie is offline   Reply With Quote
Old 02-13-2014, 10:22 PM   #22
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,338
Karma: 5382313
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
These aren't my recipes, you'd have to ask the recipe authors. I just tweaked thema little to keep up with ongoing site changes at nytimes.com
kovidgoyal is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
New York Times - Website redesign BobbyVan Recipes 0 03-12-2013 02:12 PM
The Independent : Updated recipe for 2011 site redesign NotTaken Recipes 22 12-14-2012 01:01 PM
New York Times Paywall? Starson17 Recipes 7 04-03-2011 09:33 PM
New York times about Kindle 2 Kris777 News 12 02-18-2009 09:51 AM
New Reader Ad in New York Times TadW Sony Reader 7 07-28-2007 02:11 PM


All times are GMT -4. The time now is 09:55 PM.


MobileRead.com is a privately owned, operated and funded community.