View Full Version : New york times site login access


jhutsko
11-03-2002, 11:51 AM
I am glad for your site and service, very good stuff. A question: In trying to get the NY Times sites to work, I get errors regarding login. I am a NY Times user and have a user id and password, both of which I've entered for the NY Times URLs you've kindly provided. Is there some trick to making the pages download and work so I can read the top news, etc? Thanks in advance for your help. Joe

Alexander Turcic
11-03-2002, 05:16 PM
Hi Joe. When I tried NY Times about 24hrs ago; both links still worked fine and didn't ask me to login.

After reading your post I tried again. This time, like in your case, NY Times complained that I didn't login. Well, I tried again - 5 minutes later. What can I say... the page worked again. Try using the New York Times 2 (http://www10.nytimes.com/nytimes-partners/omnisky/main.html) link. Tell me if its ok for you too.

Edit: It seems that above url is only sometimes working. Does anyone know a better alternative?

wade
01-24-2003, 10:52 PM
The best way to get NY Times is to use a site downloader like plucker or a commercial version (which I like much better) such as Offline Explorer and then convert it with Isilo. You can get ANY part of the paper (or the whole thing) and filter out the crap you dont want. It also supports passwords and login in scripts(and much, much more).

As for the question, I used to have the problem where sometimes it would ask for the password and not d/l anything but the login screen. It turned out that on the NY Times theres a logout button on each page. Download that link and next time it wants u to login in again. It was a real problem. Thankfully, Offline Explorer (as I am sure the other same-type progs all do) allows you to filter out links. I filtered out http://www.nytimes.com/logout and never had the problem again.

Alexander Turcic
01-25-2003, 10:17 AM
Another good offline browser is HTTrack (http://www.httrack.com/) (unlike the Offline Explorer it is free).

Btw, channels like nytimes.com use cookies to store your login information. Because of that, you *can* use iSiloX alone to login through the member pages. Remember that iSiloX fully supports cookies! :cool:

Alexander Turcic
01-25-2003, 10:36 AM
Did I mention that the NYT-S cookie is the cookie in question? :D

Ronindvm
01-25-2003, 10:41 AM
I also was having problems with the NYT 1 link so I switched to the second one and I haven't had a problem since.
I have tried using IsiloX Cookie support to download the NYT magazine - thanks to help from Alexander, but every week I have to change the cookies. Does anyone have a way around that? Am I still doing something wrong?

Jon

Alexander Turcic
01-25-2003, 10:50 AM
Ronindvm,

What is the link of the NYT magazine that you are downloading? And what cookies are you using? Make sure you enable send/receive cookies in iSiloX as well.

When you give me the link, I will try to set it up myself and tell you what I've found.

sUnShInE
01-25-2003, 01:41 PM
Oooo. Yea, I'd love to get the NYT Magazine every week.


Though I think I read too much as is :)

Alexander Turcic
01-26-2003, 07:35 AM
Ok I played with it for a bit. If you want, try out the attached .ixl file. You must only insert your values for the two cookies NYT-S and RMID. I excluded images, resulting file is about 200k big. You might try to add images with resize and compress on.

Alex

Ronindvm
01-26-2003, 10:43 AM
I had 2 other cookies in my .ixl also, since I didn't know which ones were important. Maybe that's why it stopped working with each new issue. I'll try this and see what happens. Thanks.

btw, that was the url :) Sorry, I don't have internet access at home so I often get behind on weekends.

sUnShInE
01-30-2003, 01:55 PM
Hey Alexander,

Thanks for uploading this ixl attachment for the NYT Mag. Also, I haven't mentioned it yet, but GREAT JOB on the new WCC. Very cool!! :D

Ok. NYT Mag, I'm having two issues:

1.) I'm getting the stinkin' login screen, so obviously I've got a cookie issue. Is there any easy way for us mere mortals to fix this? Tips, tricks, advice?

2.) The destination tag came up as C:\isilo\converted (or something similar), so everyone needs to change/add the Hotsync path to their hotsync name...


Thanks again for all your hard work!

archituz
01-30-2003, 04:25 PM
I love the NYTimes Sunday Magazine link. Thanks
Does anyone have a link to the NYTimes daily Metro Section?
Marty

Alexander Turcic
01-31-2003, 01:13 AM
Originally posted by sUnShInE@Jan 30 2003, 07:55 PM
1.) I'm getting the stinkin' login screen, so obviously I've got a cookie issue. Is there any easy way for us mere mortals to fix this? Tips, tricks, advice?
Sunshine, did you replace the values for the cookies that I included in the ixl file?

sUnShInE
01-31-2003, 01:51 AM
Hmmm. Uhhh. Apparently not I guess. :blink:


Some instructions would be helpful.


TIA

Alexander Turcic
01-31-2003, 03:39 AM
Ok, I added a small tutorial on how to fish out cookies. You find it there:

http://www.turcic.com/forums/showthread.php?s=&threadid=258

Alexander Turcic
01-31-2003, 03:42 AM
Ok I am not sure if this is the NY Times Metro section, but try out the attached .ixl file. Only make sure you insert your values for the two cookies NYT-S and RMID (password authentication). See above for instructions.

Alex

Harpgliss
02-03-2003, 02:50 AM
Hi. i'm rather challenged by some of the finer points here regarding settings for isilox and am rather confused when you say to insert your values for NY Magazine to get it to work.I downloaded the file you have and when i run it,all i get back is that i need to sign in.Do i need to do this to get this or am i missing something that should be obvious to me.By the way,Great tweaking on the the new folder.i've only using isilo for almost three weeks but love it. David

Alexander Turcic
02-03-2003, 03:56 AM
When you login to NY Times with your Internet Explorer, you must enter a username and a password. Next time you login, NY Times remembers you and immediately lets you in. Why? Because it saves cookies on your harddrives. Exactly those cookies must be added to your iSiloX entries. How to do this I explained a few posts before (read the thread on how to add cookies). If you have persisting problems, you can also mail me your nytimes.com cookies (from your Internet Explorer cookie folder), and I will add the right values for you.

Harpgliss
02-04-2003, 09:08 AM
Hi,Alex. I Was able to figure out the value of the cookies for NY magazine but was not sure that I liked the format on my clie and was not sure if I could set the depth higher than it was so I could get information?I alsohave a related question.I would like to get the text version of the NY Times but all of my playing with it resulted in a 6K file size.I did the cookies as i did for the magazine and got the 6K file size.Is it possible to get the text version or am I just being greedy? David

Alexander Turcic
02-04-2003, 09:15 AM
David,

Can you give me the url of you the page that you want (of the text version)? I assume with text version you don't mean the Avantgo-version.

Harpgliss
02-04-2003, 10:01 AM
Hello again.I really hope I'm not being a pest.A38 year old man should not have this much problem figuring this stuff out.Thank you for your patience.Here is the URL that you requested http://www.nytimes.com/ref/membercenter/te...extversion.html (http://www.nytimes.com/ref/membercenter/textversion.html) .Now just a quick note on this,I can view this just fine on the pc but get zilch when I go to convert it. Thank you, David

Ronindvm
02-04-2003, 07:11 PM
I've been playing with the NYT sites for a while now and have been quite frustrated. I have found that I can get the site converted but the following week, I have to re-enter the cookies. I haven't had a chance to play with it this week but when I tried to convert the NYT magazine site on Sunday, I found that I could only download to a link depth of 1. When I tried 2, I got the login in page for all links deeper than 1. I doubt this helps anyone but at least y'all know your not alone with your problems :)

Alexander Turcic
02-05-2003, 02:00 PM
Ronindvm,

this is very strange :D I don't have any login problems myself. I think for successfully downloading nytimes.com content, it is very useful to play with the include/exclude settings (regular patterns, etc)...

if you need help - tell me.

Ronindvm
02-06-2003, 01:18 PM
I don't know what I was doing wrong before but it's working fine now. I reentered the cookies. Must have had one of them wrong. I LOVE Isilox 3.3. I had it exclude "nytimes" and include "magazine" and now I have a file a 3rd the size of what I used to have AND it is giving me the whole articles.

Now, I'll see if it still works next week.

Jon

Ronindvm
02-25-2003, 12:37 PM
The NYT is out to get me! So far, this site and Alexander have outsmarted them while they outsmart me.

I was really thrilled with being able to download the NYT magazine without an excessively large file and it worked great for 2 weeks except that I had to re-enter my cookies each week (I had made sure that they were checked to not expire).
This week, I did the same thing and it seemed to download fine, I have a 2.08 megabyte file on my computer but Isilo won't open it.
Any ideas? for any of the above problems?

Thanks

Jon

macsolo
03-21-2003, 02:33 PM
Okay, I edited the cookies and the download/conversion went fine, but when I try access some of the hyperlinks, I get pages of URLs. This also happens when I try to read more than the first page of an article. Any idea what's going on?

Alexander Turcic
03-21-2003, 02:50 PM
macsolo,

I just try myself and syncronized NYTimes The City. Works without problems. The thing is, for instance with NYTimes The City, that only the links to the The City Articles are followed. Did you try that?

Not all links are followed for obvious reasons. You don't want to download the entire NYTimes web site, but only the links that are part of the section you are interested in.

Alexander Turcic
03-21-2003, 02:56 PM
Originally posted by Ronindvm
The NYT is out to get me! So far, this site and Alexander have outsmarted them while they outsmart me.

I was really thrilled with being able to download the NYT magazine without an excessively large file and it worked great for 2 weeks except that I had to re-enter my cookies each week (I had made sure that they were checked to not expire).
This week, I did the same thing and it seemed to download fine, I have a 2.08 megabyte file on my computer but Isilo won't open it.
Any ideas? for any of the above problems?

Thanks

Jon

Jon, did you try again? What is the current status?

Ronindvm
03-24-2003, 12:00 PM
Yes, I tried again and get the same result. I was worried that I was excluding too much but if that were the case, the file wouldn't be 2meg. And it shouldn't be that my cookies are wrong, when that has been the problem, I get a file that I can look at but it just keeps telling me that I'm not a member.

I get a 2meg file, when I open it, it is a blank page and the status bar at the bottom reads 99%. I've gone through all my settings and I can't figure it out. I'm sure it's something simple since it used to work for me.

The url is: http://www.nytimes.com/library/magazine/home/

Thanks.

Jon

Alexander Turcic
03-24-2003, 12:26 PM
ronindvm,

I am almost perfectly sure that your problem is cookie related. I downloaded the iSiloX file for NYT Mag here (http://www.turcic.com/forums/showthread.php?postid=184#post184), then I inserted my two cookie values, and finally used iSiloX to download the web page. The result you find attached.

Are you sure that you used your NYT-S and RMID cookies?

Ronindvm
03-24-2003, 05:44 PM
Maybe it was a cookie but I don't know how. I did everyting the same today that I've been doing for the last month and it worked even though it hasn't worked for 4 weeks. The only thing that I changed was my inclusion and exclusion criteria. I can't see how that would cause the problem though since I had such large files.
Thanks for looking at it for me.

Jon

kstuart
03-26-2003, 04:59 PM
I hate to register for every web site, so I avoid doing so.

Thus, I was pleased to find that you can access the NY Times online by going through excite.com - without registering.

You can go to:

http://news.excite.com/provider/id/nyt.html

just to read online, I'll leave it as an exercise for NYT fans to figure out how to make this an Isilo link, since I haven't any desire to read NYT on my PDA.

However, just looking at the links they provide, they all start with:

http://rd.excite.com/rd?redir=

and end with:

&partner=EXCITE

and everything in between looks like a normal NYT story link.

Alexander Turcic
03-27-2003, 02:22 AM
kstuart,

this is a really great alternative. Not only does it avoid registration, but also is it less gfx-intensive, thus looking better on a PDA screen.

Thanks!

broth
03-29-2003, 06:52 PM
Thanks for the info on setting up the NYT here. It works for me. My qestion is how to get beyond a depth of one. When I select a section under the text page like International I get all the links but then I realized that some artciles went beyond one page. So I changed the depth to 3 and found that my file took forever and went from 300k to 2 meg. I had the inclusion filter set to only look at pages that had \/internationbal\/.

Any ideas on how to get around this issue?

thanks