Sunrise doesnt process 404

tovarish · 03-22-2006, 12:15 PM

Hi Laurens

There is an Indian news website that i read. The url of a sample article is
http://www.indianexpress.com/story/874.html
and the corresponding printer-friendly article is
http://www.indianexpress.com/printerFriendly/874.html

The tricky think that these guys have done is that the http response of the printer friendly article is a 404 not found

GET /printerFriendly/874.html HTTP/1.1
Host: www.indianexpress.com
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1
Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,*/*;q=0.5
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
Referer: http://www.indianexpress.com/story/874.html
Cache-Control: max-age=0

but most browsers show the resultant html page. How can i ask sunrise to process this page.

thanks
tovarish

Laurens · 03-22-2006, 01:30 PM

You can't.

tovarish · 03-23-2006, 03:14 AM

that is indeed a pity, it is a problem with the http client library. i could try and update your sources to include such a possiblity.

Laurens · 03-23-2006, 03:26 AM

Not a problem with the HTTP client. 404 means "not found" and should be treated as such. User agents may actually choose to display their own error page or some other message. Suppose 404 (or other 4xx or 5xx) pages were, indeed, processed: you would end up with a document full of wasted error pages.

This is just a bug on this particular site.

doogie68 · 03-23-2006, 12:31 PM

I notice that they have RSS feeds on that website. Have you tried using Sunrise to download the feeds? Try it, might work.

tovarish · 03-28-2006, 05:02 AM

Quote:

Originally Posted by Laurens

Not a problem with the HTTP client. 404 means "not found" and should be treated as such. User agents may actually choose to display their own error page or some other message. Suppose 404 (or other 4xx or 5xx) pages were, indeed, processed: you would end up with a document full of wasted error pages.

This is just a bug on this particular site.

i dont think it is a bug but they are purposely hiding their printerfriendly articles behind a 404 response. Maybe it is possible allow 404 processing only if an user asks to.

I agree that a 404 shouldnt be processed by default but it would be nice to be able to have the facility to do so when websites like these use tricks.

tovarish

Laurens · 03-28-2006, 04:43 PM

What makes you so sure it's a deliberate trick?

03-22-2006, 12:15 PM	#1
tovarish Enthusiast Posts: 34 Karma: 10 Join Date: Oct 2004 Device: HTC Touch Pro2	Sunrise doesnt process 404 Hi Laurens There is an Indian news website that i read. The url of a sample article is http://www.indianexpress.com/story/874.html and the corresponding printer-friendly article is http://www.indianexpress.com/printerFriendly/874.html The tricky think that these guys have done is that the http response of the printer friendly article is a 404 not found GET /printerFriendly/874.html HTTP/1.1 Host: www.indianexpress.com User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1 Accept: text/xml,application/xml,application/xhtml+xml,text/html;q=0.9,text/plain;q=0.8,image/png,/;q=0.5 Accept-Language: en-us,en;q=0.5 Accept-Encoding: gzip,deflate Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7 Keep-Alive: 300 Connection: keep-alive Referer: http://www.indianexpress.com/story/874.html Cache-Control: max-age=0 but most browsers show the resultant html page. How can i ask sunrise to process this page. thanks tovarish

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Sony 505, doesnt turn off, doesnt charge ,,help	kimshy	Sony Reader	1	02-07-2010 05:40 PM
usb doesnt work, want to use SD only	bookeenbart	Bookeen	8	02-04-2010 11:16 AM
new Cybook doesnt boot at all	bookiner	Bookeen	11	03-20-2009 06:29 PM
Dictionary look up doesnt work...	Chrikow	Bookeen	0	11-16-2008 08:01 PM
404 When Connecting to Store	MSWallack	Sony Reader	10	08-26-2008 03:35 PM

03-22-2006, 01:30 PM	#2
Laurens Jah Blessed Posts: 1,295 Karma: 1373 Join Date: Apr 2003 Location: The Netherlands Device: iPod Touch	You can't.

03-23-2006, 03:14 AM	#3
tovarish Enthusiast Posts: 34 Karma: 10 Join Date: Oct 2004 Device: HTC Touch Pro2	that is indeed a pity, it is a problem with the http client library. i could try and update your sources to include such a possiblity.

03-23-2006, 03:26 AM	#4
Laurens Jah Blessed Posts: 1,295 Karma: 1373 Join Date: Apr 2003 Location: The Netherlands Device: iPod Touch	Not a problem with the HTTP client. 404 means "not found" and should be treated as such. User agents may actually choose to display their own error page or some other message. Suppose 404 (or other 4xx or 5xx) pages were, indeed, processed: you would end up with a document full of wasted error pages. This is just a bug on this particular site.

03-23-2006, 12:31 PM	#5
doogie68 Connoisseur Posts: 78 Karma: 2260 Join Date: Jan 2006 Device: TX	I notice that they have RSS feeds on that website. Have you tried using Sunrise to download the feeds? Try it, might work.

03-28-2006, 04:43 PM	#7
Laurens Jah Blessed Posts: 1,295 Karma: 1373 Join Date: Apr 2003 Location: The Netherlands Device: iPod Touch	What makes you so sure it's a deliberate trick?