JPluck & www.nytimes.com

T T · 04-26-2003, 12:57 AM

I'm trying to pluck the site www.nytimes.com using JPluck, because supposedly this application supports cookies.

I've enabled cookies and selected the "Internet Explorer" cookies file. Then I try to pluck the start page of www.nytimes.com (0 page deep). This seems to work fine. I can see that I am still logged in because my login name is displayed.

When I try to increase to 1 page deep, I get logged out for some reason. I've excluded links which I think might cause trouble, for example "www.nytimes.com/logout". Nothing I've tried works. The article pages only display a login prompt. Perhaps I've excluded too many links?

Has anyone had better luck with this?

I'm including my jxl file below. I had to change the extension to ixl in order to attach it. Please rename after you download it.

Any help would be much appreciated.

Alexander Turcic · 04-29-2003, 03:08 AM

Does anyone know more about Plucker Desktop's cookie handling? It sounds like a cookie problem to me.

T T · 04-29-2003, 09:08 PM

Hi,

Just to be clear, this is JPluck, the java app. Not Plucker Desktop.

The way JPluck handles cookies seems amazing. One only has to select which browser cookie file to use (IE, Netscape, etc) Then I guess, JPluck searches for the necessary cookies from this file.

Not sure how well the whole mechanizm works, but I know that it does work if I have only one download level.

Alexander Turcic · 04-30-2003, 03:13 AM

Well the thing is that cookies are sometimes not only read but also written - does JPluck automatically allow sites to write back to the browser cookie files?

Laurens · 05-07-2003, 07:18 AM

Answering all the questions at once.

The reason why NYTimes does not work with MSIE cookies is that JPluck does not write new cookies back to the cookie store. Apparently NYTimes sends a new cookie value during downloading that it wants to see when you download subpages.

However, you can pluck NYTimes correctly when you use a Mozilla/Netscape cookies.txt file. This uses a different cookiestore implementation that holds new cookies in RAM. Fortunately, MSIE lets you export its cookies to cookies.txt format. Simply point JPluck to the exported cookies.txt file. I tried this with the TT's JXL and it works fine.

JPluck never writes new cookies to disk. It only holds new cookies in memory while it's downloading the site. After the conversion is complete it discards the new cookies.

Until the MSIE cookie handling is fixed, the best solution would be to use Mozilla just to log in to sites and obtain a cookie. You can still use MSIE for normal browsing.

Alexander Turcic · 05-07-2003, 07:49 AM

Hey Laurens, seems my guess (as a non-Plucker user) wasn't so bad after all

T T · 05-10-2003, 02:40 PM

Thanks, Laurens. I tried to export the IE cookies file as you suggested, but now I'm getting the following error:

[Unhandled HTTP response] 302: Moved Temporarily

Do you get the same thing? In addition, when I click on the link from my brower, it tells me that the page was not downloaded. I have JPluck 0.9 RC4, which is the latest version I believe.

Thanks again for your help.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
iLiad & Accessory Official Pricing (from www.irexshop.com	Stuart Young	iRex	9	06-14-2006 10:47 AM
JPluck V2.1.1 released!	wumpi	Reading and Management	0	02-26-2004 01:34 PM
JPluck freezes . . . .	JWE	Reading and Management	3	01-22-2004 12:13 PM
how to try JPluck & Plucker Desktop?	jeffcarp	Reading and Management	3	11-10-2003 06:15 AM
JPluck 2.0 beta 3	Laurens	Reading and Management	4	09-23-2003 10:31 AM

04-29-2003, 03:08 AM	#2
Alexander Turcic Fully Converged Posts: 18,163 Karma: 14021202 Join Date: Oct 2002 Location: Switzerland Device: Too many to count here.	Does anyone know more about Plucker Desktop's cookie handling? It sounds like a cookie problem to me.

04-29-2003, 09:08 PM	#3
T T Junior Member Posts: 3 Karma: 10 Join Date: Apr 2003 Device: Sony T415	Hi, Just to be clear, this is JPluck, the java app. Not Plucker Desktop. The way JPluck handles cookies seems amazing. One only has to select which browser cookie file to use (IE, Netscape, etc) Then I guess, JPluck searches for the necessary cookies from this file. Not sure how well the whole mechanizm works, but I know that it does work if I have only one download level.

04-30-2003, 03:13 AM	#4
Alexander Turcic Fully Converged Posts: 18,163 Karma: 14021202 Join Date: Oct 2002 Location: Switzerland Device: Too many to count here.	Well the thing is that cookies are sometimes not only read but also written - does JPluck automatically allow sites to write back to the browser cookie files?

05-07-2003, 07:18 AM	#5
Laurens Jah Blessed Posts: 1,295 Karma: 1373 Join Date: Apr 2003 Location: The Netherlands Device: iPod Touch	Answering all the questions at once. The reason why NYTimes does not work with MSIE cookies is that JPluck does not write new cookies back to the cookie store. Apparently NYTimes sends a new cookie value during downloading that it wants to see when you download subpages. However, you can pluck NYTimes correctly when you use a Mozilla/Netscape cookies.txt file. This uses a different cookiestore implementation that holds new cookies in RAM. Fortunately, MSIE lets you export its cookies to cookies.txt format. Simply point JPluck to the exported cookies.txt file. I tried this with the TT's JXL and it works fine. JPluck never writes new cookies to disk. It only holds new cookies in memory while it's downloading the site. After the conversion is complete it discards the new cookies. Until the MSIE cookie handling is fixed, the best solution would be to use Mozilla just to log in to sites and obtain a cookie. You can still use MSIE for normal browsing.

05-07-2003, 07:49 AM	#6
Alexander Turcic Fully Converged Posts: 18,163 Karma: 14021202 Join Date: Oct 2002 Location: Switzerland Device: Too many to count here.	Hey Laurens, seems my guess (as a non-Plucker user) wasn't so bad after all

05-10-2003, 02:40 PM	#7
T T Junior Member Posts: 3 Karma: 10 Join Date: Apr 2003 Device: Sony T415	Thanks, Laurens. I tried to export the IE cookies file as you suggested, but now I'm getting the following error: [Unhandled HTTP response] 302: Moved Temporarily Do you get the same thing? In addition, when I click on the link from my brower, it tells me that the page was not downloaded. I have JPluck 0.9 RC4, which is the latest version I believe. Thanks again for your help.

Advert

Advert