Error in the Fetch News

luck0602 · 07-08-2008, 03:35 PM

In the 'Fetch News', I came across an error message like this in the working progress 97% or 98%.

________________
Conversion Error

('UnicodeDecodeError', u"'ascii' codec can't decode byte 0xbc in position 2: ordinal not in range(128)"):
Failed to perform job: Fetch news from The Economist
Detailed traceback:
Traceback (most recent call last):
File "parallel.py", line 679, in worker
File "parallel.py", line 652, in work
File "D:\Program Files\calibre\library.zip\calibre\ebooks\lrf\feeds \convert_from.py", line 42, in main
File "D:\Program Files\calibre\library.zip\calibre\web\feeds\main.p y", line 134, in run_recipe
File "calibre\web\feeds\news.pyo", line 472, in download
File "calibre\web\feeds\news.pyo", line 645, in build_index
File "calibre\web\feeds\news.pyo", line 537, in feed2index
File "calibre\utils\genshi\core.pyo", line 179, in render
File "calibre\utils\genshi\output.pyo", line 60, in encode
File "calibre\utils\genshi\output.pyo", line 210, in __call__
File "calibre\utils\genshi\output.pyo", line 753, in __call__
File "calibre\utils\genshi\output.pyo", line 592, in __call__
File "calibre\utils\genshi\output.pyo", line 710, in __call__
File "calibre\utils\genshi\core.pyo", line 494, in escape
UnicodeDecodeError: 'ascii' codec can't decode byte 0xbc in position 2: ordinal not in range(128)
Log:
INFO: Downloading

DEBUG: Fetching http://www.economist.com/world/Print...ry_id=11671645
.
.
.
_____________________

It's so long that I can't copy it here.

I wonder why its error message appears in the program.

JSWolf · 07-19-2008, 09:48 PM

BUMP!

TheDude · 07-31-2008, 04:09 AM

I have the same problem. It seems to be a problem with decoding some characters in the newsfeed. For me it is usually the 0x9a character. An easy solution would be to set the unicode decoding errors to "replace"/"ignore" instead of "strict". The fetch process would just skip the problematic character. But that has to be changed somewhere in the code, which is beyond my skills/knowledge.

kovidgoyal · 07-31-2008, 06:46 AM

I'm afraid it's not that simple, which is why I haven't fixed it yet....it's on my TODO list when I get a block of time to look at it.

AprilHare · 08-01-2008, 09:16 PM

I've been having problems too, however I cannot bring up the list of jobs by clicking. I usually have no idea whats happening when fetching as it is anyway, however this makes things worse.

kovidgoyal · 08-01-2008, 10:56 PM

Open a terminal and type

Code:

feeds2lrf --dedug "Newsweek"

to see the output when fetching NEwsweek for example.

TheDude · 08-02-2008, 01:01 PM

Is there a way to change the standard News recipes? It would be nice if the user can make some changes in the way the fetched output looks like. Could be also very nice to just copy an existing recipe and use/adapt it for another similar news source.

kovidgoyal · 08-02-2008, 06:37 PM

Read the user manual there a long section on creating custom recipes.

TheDude · 08-03-2008, 09:32 AM

Yes, I read the menu. What I wanted to ask is if you can change the standard ones. Not write new ones from scratch, just change some parts of the fetching.

kovidgoyal · 08-03-2008, 10:16 AM

https://calibre.kovidgoyal.net/user_...urther-reading

There's a link to the source code of the built-in recipes. Modify away.

TheDude · 08-08-2008, 03:58 PM

Thanks for the info, did not see that section before

Started doing some recipes (and started to really appreciate how powerful Calibre is

keep up the good work

).

ntcareson · 08-11-2008, 03:11 AM

Can I get help on this. I'm not sure if its been discussed (but I can't seem to find it anywhere here)...

I tried to fetch Google Reader but keep getting zero data from the fetch. The process complete in Calibre but it shows no content just the headings.

Thanks Kovidgoyal! Your program rocks!

07-08-2008, 03:35 PM	#1
luck0602 Junior Member Posts: 1 Karma: 10 Join Date: Jul 2008 Device: prs-505	Error in the Fetch News In the 'Fetch News', I came across an error message like this in the working progress 97% or 98%. ________________ Conversion Error ('UnicodeDecodeError', u"'ascii' codec can't decode byte 0xbc in position 2: ordinal not in range(128)"): Failed to perform job: Fetch news from The Economist Detailed traceback: Traceback (most recent call last): File "parallel.py", line 679, in worker File "parallel.py", line 652, in work File "D:\Program Files\calibre\library.zip\calibre\ebooks\lrf\feeds \convert_from.py", line 42, in main File "D:\Program Files\calibre\library.zip\calibre\web\feeds\main.p y", line 134, in run_recipe File "calibre\web\feeds\news.pyo", line 472, in download File "calibre\web\feeds\news.pyo", line 645, in build_index File "calibre\web\feeds\news.pyo", line 537, in feed2index File "calibre\utils\genshi\core.pyo", line 179, in render File "calibre\utils\genshi\output.pyo", line 60, in encode File "calibre\utils\genshi\output.pyo", line 210, in __call__ File "calibre\utils\genshi\output.pyo", line 753, in __call__ File "calibre\utils\genshi\output.pyo", line 592, in __call__ File "calibre\utils\genshi\output.pyo", line 710, in __call__ File "calibre\utils\genshi\core.pyo", line 494, in escape UnicodeDecodeError: 'ascii' codec can't decode byte 0xbc in position 2: ordinal not in range(128) Log: INFO: Downloading DEBUG: Fetching http://www.economist.com/world/Print...ry_id=11671645 . . . _____________________ It's so long that I can't copy it here. I wonder why its error message appears in the program.

08-01-2008, 10:56 PM	#6
kovidgoyal creator of calibre Posts: 43,835 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Open a terminal and type Code: feeds2lrf --dedug "Newsweek" to see the output when fetching NEwsweek for example.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Conversion error in news fetch	kwolf	Calibre	3	08-23-2010 03:38 PM
Fetch News error CSSRuleList	rjaaa	Calibre	2	05-02-2010 07:23 PM
Can't Fetch News	Catew	Calibre	2	07-19-2009 07:46 PM
Fetch News	philipdavies	Calibre	5	10-08-2008 04:33 AM
Error in .91 Fetch news	Mitchll	Calibre	15	10-05-2008 04:52 PM

07-19-2008, 09:48 PM	#2
JSWolf Resident Curmudgeon Posts: 73,866 Karma: 128597114 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	BUMP!

07-31-2008, 04:09 AM	#3
TheDude Junior Member Posts: 4 Karma: 10 Join Date: Jul 2008 Device: PRS-505	I have the same problem. It seems to be a problem with decoding some characters in the newsfeed. For me it is usually the 0x9a character. An easy solution would be to set the unicode decoding errors to "replace"/"ignore" instead of "strict". The fetch process would just skip the problematic character. But that has to be changed somewhere in the code, which is beyond my skills/knowledge.

07-31-2008, 06:46 AM	#4
kovidgoyal creator of calibre Posts: 43,835 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	I'm afraid it's not that simple, which is why I haven't fixed it yet....it's on my TODO list when I get a block of time to look at it.

08-01-2008, 09:16 PM	#5
AprilHare Wizard Posts: 2,981 Karma: 11862367 Join Date: Apr 2008 Device: Sony Reader PRS-T2	I've been having problems too, however I cannot bring up the list of jobs by clicking. I usually have no idea whats happening when fetching as it is anyway, however this makes things worse.

08-02-2008, 01:01 PM	#7
TheDude Junior Member Posts: 4 Karma: 10 Join Date: Jul 2008 Device: PRS-505	Is there a way to change the standard News recipes? It would be nice if the user can make some changes in the way the fetched output looks like. Could be also very nice to just copy an existing recipe and use/adapt it for another similar news source.

08-02-2008, 06:37 PM	#8
kovidgoyal creator of calibre Posts: 43,835 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Read the user manual there a long section on creating custom recipes.

08-03-2008, 09:32 AM	#9
TheDude Junior Member Posts: 4 Karma: 10 Join Date: Jul 2008 Device: PRS-505	Yes, I read the menu. What I wanted to ask is if you can change the standard ones. Not write new ones from scratch, just change some parts of the fetching.

08-03-2008, 10:16 AM	#10
kovidgoyal creator of calibre Posts: 43,835 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	https://calibre.kovidgoyal.net/user_...urther-reading There's a link to the source code of the built-in recipes. Modify away.

08-08-2008, 03:58 PM	#11
TheDude Junior Member Posts: 4 Karma: 10 Join Date: Jul 2008 Device: PRS-505	Thanks for the info, did not see that section before Started doing some recipes (and started to really appreciate how powerful Calibre is keep up the good work ).

08-11-2008, 03:11 AM	#12
ntcareson Junior Member Posts: 1 Karma: 10 Join Date: Aug 2007 Device: Sony Reader	Can I get help on this. I'm not sure if its been discussed (but I can't seem to find it anywhere here)... I tried to fetch Google Reader but keep getting zero data from the fetch. The process complete in Calibre but it shows no content just the headings. Thanks Kovidgoyal! Your program rocks!

Advert

Advert