Errors on Command Line

drnkusv · 11-06-2008, 01:07 PM

I am sure I am doing something wrong, but I am having an odd problem:

Everything works fine for me from the GUI, but when I try to run feeds2epub from the command line, it starts up properly and grabs the feeds, but then it runs into a lot of errors as it goes along saying that it was not able to download specific articles. (I have tried this with WSJ and NY Times). I end up with an epub that has maybe 40% of the content that is generated when I run the same recipe with the GUI.

Anyone have any idea what the problem is?

This is the command I am running:

/Applications/calibre.app/Contents/Resources/loaders/feeds2epub -u username -p password "The Wall Street Journal" (obviously I replace username and password with my actual username and password)

As it runs, I get a whole bunch of error messages that look like this:

WARNING: Could not fetch link http://online.wsj.com/article/SB122598031749104947.html

ERROR: Failed to download article: Red Ink at Blackstone Gets Deeper from http://online.wsj.com/article/SB122598031749104947.html

kovidgoyal · 11-06-2008, 01:13 PM

You should run the commands as /usr/bin/feeds2epub

drnkusv · 11-06-2008, 01:18 PM

Thanks -- but exactly the same result (same error messages).

kovidgoyal · 11-06-2008, 01:57 PM

Run it with --debug to see why the errors are happening

drnkusv · 11-06-2008, 02:20 PM

Ran it with --debug. It is generating some explanatory information, but nothing that I can figure out. Output is attached, in case you have time to take a quick look.

Thanks.

kovidgoyal · 11-06-2008, 03:11 PM

Those are some very strange errors, it's almost like the connection to the remote host is being closed between the calls to open and read

I'll add a partial workaround that should make it more robust.

drnkusv · 11-06-2008, 04:12 PM

Thanks. The really strange part (at least to me) is that it works ok with the GUI and only causes these problems at the command line.

kovidgoyal · 11-06-2008, 04:24 PM

It's a multi-threading issue, those are never predictable

. I've fixed it in trunk.

drnkusv · 11-07-2008, 01:47 AM

Works great under 103. Thanks!

RoninTech · 11-07-2008, 02:54 PM

This might be related. Running calibredb from the command line with 103:

Quote:

C:\Program Files\calibre>calibredb list --fields=authors
idauthors
3 Homer
4 Edgar Rice Burroughs
5 Edgar Rice Burroughs
6 Edgar Rice Burroughs
7 Homer

Exception in thread Thread-1 (most likely raised during interpreter shutdown):
Traceback (most recent call last):
File "threading.pyo", line 486, in __bootstrap_inner
File "calibre\library\sqlite.pyo", line 74, in run
File "Queue.pyo", line 165, in get
File "threading.pyo", line 209, in wait
<type 'exceptions.TypeError'>: 'NoneType' object is not callable

Happens on many different calibredb commands.

Cheers,
Crazy

kovidgoyal · 11-07-2008, 03:25 PM

That exception can be ignored (it happens during interpreter shutdown)

RoninTech · 11-07-2008, 03:59 PM

Quote:

Originally Posted by kovidgoyal

That exception can be ignored (it happens during interpreter shutdown)

I just need to let my scripts know that

11-06-2008, 01:07 PM	#1
drnkusv Member Posts: 21 Karma: 10 Join Date: Nov 2008 Device: iPhone	Errors on Command Line I am sure I am doing something wrong, but I am having an odd problem: Everything works fine for me from the GUI, but when I try to run feeds2epub from the command line, it starts up properly and grabs the feeds, but then it runs into a lot of errors as it goes along saying that it was not able to download specific articles. (I have tried this with WSJ and NY Times). I end up with an epub that has maybe 40% of the content that is generated when I run the same recipe with the GUI. Anyone have any idea what the problem is? This is the command I am running: /Applications/calibre.app/Contents/Resources/loaders/feeds2epub -u username -p password "The Wall Street Journal" (obviously I replace username and password with my actual username and password) As it runs, I get a whole bunch of error messages that look like this: WARNING: Could not fetch link http://online.wsj.com/article/SB122598031749104947.html ERROR: Failed to download article: Red Ink at Blackstone Gets Deeper from http://online.wsj.com/article/SB122598031749104947.html

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Where are the command line tools?	PaulChernoch	Calibre	17	10-23-2009 01:08 PM
Adding books from the command line	edembowski	Calibre	1	08-29-2009 12:18 PM
Why use the command line?	slantybard	Calibre	6	07-22-2009 01:17 PM
Going completely command-line?	ewiplayer	Calibre	2	11-24-2008 06:15 AM

11-06-2008, 01:13 PM	#2
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	You should run the commands as /usr/bin/feeds2epub

11-06-2008, 01:18 PM	#3
drnkusv Member Posts: 21 Karma: 10 Join Date: Nov 2008 Device: iPhone	Thanks -- but exactly the same result (same error messages).

11-06-2008, 01:57 PM	#4
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Run it with --debug to see why the errors are happening

11-06-2008, 03:11 PM	#6
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Those are some very strange errors, it's almost like the connection to the remote host is being closed between the calls to open and read I'll add a partial workaround that should make it more robust.

11-06-2008, 04:12 PM	#7
drnkusv Member Posts: 21 Karma: 10 Join Date: Nov 2008 Device: iPhone	Thanks. The really strange part (at least to me) is that it works ok with the GUI and only causes these problems at the command line.

11-06-2008, 04:24 PM	#8
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	It's a multi-threading issue, those are never predictable . I've fixed it in trunk.

11-07-2008, 01:47 AM	#9
drnkusv Member Posts: 21 Karma: 10 Join Date: Nov 2008 Device: iPhone	Works great under 103. Thanks!

11-07-2008, 03:25 PM	#11
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	That exception can be ignored (it happens during interpreter shutdown)

Advert

Advert