MobileRead Forums - View Single Post

pa_ubach · 01-19-2014, 06:27 PM

Hi Gianfri,

The recipe is valid for the full edition as well. You only need to set the options accordingly. I use the following:

Code:

headlinesOnly = False

and

Code:

webEdition = True

Kovid, I have seen that the needs_subscription variable is set to False in all cases. Is this correct? I would suspect that you actually need the subscription to get the full version of the NYTimes. I have set it to 'optional'.

Maybe you also need to include this fragment of code to the definition of get_browser(self):

Code:

if self.username is not None and self.password is not None:
            br.open('http://www.nytimes.com/auth/login')
            br.form = br.forms().next()
            br['userid']   = self.username
            br['password'] = self.password
            raw = br.submit().read()
            if 'Please try again' in raw:
                raise Exception('Your username and password are incorrect')

I have included it myself from a previous version of the recipe and works well.

Now, if you are a perfectionist, there is still a small glitch. When the recursions is set to a value different than zero, some fetched articles show the numbers "1" and "2" bulleted at the end, along with a "Next Page" would-be-button. Example (note that the website doesn't show multiple pages for the article and that the URL address has the code ?pagewanted=all appended). I guess this has to do with the web redesign and only affects articles published before the redesign. So if that is the case, I don't think you need to worry about; because eventually all the articles fetched under the recursive option will have been edited using the new web technology and this problem will disappear.
Disclaimer: I am using Calibre v0.9.6 because I am using Fedora17 at my HTPC and I am too lazy to bother about compilations and don't want to worry about upgrading a system that has taken a lot of effort to get right.

By the way, Are you aware that David Pogue has left the NYTimes as columnist and has set a new venture with Yahoo? His column is really outdated nowadays. The New York Times has just hired a new Technology columnist who will be in charge of "State of the Art". He starts next month so I guess we won't know the new feed address until then.

Thanks all to paying attention to this recipe and fixing it. And THANKS Kovid for this outstanding recipe and specially for Calibre!!! I wish we had the same support for the recipes of the main newpapers in Spain!

01-19-2014, 06:27 PM	#18
pa_ubach Junior Member Posts: 6 Karma: 10 Join Date: Jan 2014 Location: Sitges Device: Sony Reader PRS-T3	Hi Gianfri, The recipe is valid for the full edition as well. You only need to set the options accordingly. I use the following: Code: headlinesOnly = False and Code: webEdition = True Kovid, I have seen that the needs_subscription variable is set to False in all cases. Is this correct? I would suspect that you actually need the subscription to get the full version of the NYTimes. I have set it to 'optional'. Maybe you also need to include this fragment of code to the definition of get_browser(self): Code: if self.username is not None and self.password is not None: br.open('http://www.nytimes.com/auth/login') br.form = br.forms().next() br['userid'] = self.username br['password'] = self.password raw = br.submit().read() if 'Please try again' in raw: raise Exception('Your username and password are incorrect') I have included it myself from a previous version of the recipe and works well. Now, if you are a perfectionist, there is still a small glitch. When the recursions is set to a value different than zero, some fetched articles show the numbers "1" and "2" bulleted at the end, along with a "Next Page" would-be-button. Example (note that the website doesn't show multiple pages for the article and that the URL address has the code ?pagewanted=all appended). I guess this has to do with the web redesign and only affects articles published before the redesign. So if that is the case, I don't think you need to worry about; because eventually all the articles fetched under the recursive option will have been edited using the new web technology and this problem will disappear. Disclaimer: I am using Calibre v0.9.6 because I am using Fedora17 at my HTPC and I am too lazy to bother about compilations and don't want to worry about upgrading a system that has taken a lot of effort to get right. By the way, Are you aware that David Pogue has left the NYTimes as columnist and has set a new venture with Yahoo? His column is really outdated nowadays. The New York Times has just hired a new Technology columnist who will be in charge of "State of the Art". He starts next month so I guess we won't know the new feed address until then. Thanks all to paying attention to this recipe and fixing it. And THANKS Kovid for this outstanding recipe and specially for Calibre!!! I wish we had the same support for the recipes of the main newpapers in Spain!