web2lrf

[mazzeltjes]

Hi Kovid
Just installed 4.46
and trying to get newsweek I got this

TypeError: expected string or buffer
Failed to perform job: Fetch news from Newsweek
Detailed traceback:
Traceback (most recent call last):
File "parallel.py", line 139, in run_job
File "libprs500\ebooks\lrf\feeds\convert_from.pyo", line 40, in main
File "libprs500\web\feeds\main.pyo", line 132, in run_recipe
File "libprs500\web\feeds\news.pyo", line 464, in download
File "libprs500\web\feeds\news.pyo", line 567, in build_index
File "libprs500\web\feeds\recipes\newsweek.pyo", line 62, in parse_index
File "libprs500\web\feeds\news.pyo", line 307, in index_to_soup
File "re.pyo", line 129, in match
TypeError: expected string or buffer
Log:
Fetching feeds...
0% Fetching feeds...




edit
and this one

IndexError: list index out of range
Failed to perform job: Fetch news from Outlook India
Detailed traceback:
Traceback (most recent call last):
File "parallel.py", line 139, in run_job
File "libprs500\ebooks\lrf\feeds\convert_from.pyo", line 40, in main
File "libprs500\web\feeds\main.pyo", line 132, in run_recipe
File "libprs500\web\feeds\news.pyo", line 464, in download
File "libprs500\web\feeds\news.pyo", line 580, in build_index
IndexError: list index out of range
Log:
Fetching feeds...
0% Fetching feeds...
0% Got feeds from index page
0% Trying to download cover...

[kovidgoyal]

@mazzeltjes
Both problems are likely due to network errors. Try again in a little bit.

[kovidgoyal]

@DD
Because of a change in the way options are processed, you can't embed the username and password in a recipe anymore.

[kovidgoyal]

@DD
I've implemented a fix for the custom recipes, will be in the next release

[Rick C]

Originally Posted by kovidgoyal

@DD
I've implemented a fix for the custom recipes, will be in the next release

Will you be looking at Davec's Google Reader Recipe,Kovid?

[kovidgoyal]

Open a ticket for it, and I'll get around to it.

[Rick C]

done

[Deputy-Dawg]

Originally Posted by kovidgoyal

@DD
Because of a change in the way options are processed, you can't embed the username and password in a recipe anymore.

OK! But then I would think that the recipe should have prompted for the username and password since I had taken no action to embed them. I merely had entered them the first time I ran the profile cum recipe. It really doesn't bother me that much the question is just academic.

[megacoupe]

It's been quite a while since I've used libprs500, and it looks like it's come a long way. It looks beautiful! Anyways, trying to fetch nytimes.com gave me the following error:

IOError: [Errno 2] No such file or directory: 'c:\\docume~1\\admin\\locals~1\\temp\\html2lrf-verbose.html'
Failed to perform job: Fetch news from The New York Times
Detailed traceback:
Traceback (most recent call last):
  File "parallel.py", line 139, in run_job
  File "libprs500\ebooks\lrf\feeds\convert_from.pyo", line 55, in main
  File "libprs500\ebooks\lrf\html\convert_from.pyo", line 1796, in process_file
  File "libprs500\ebooks\lrf\html\convert_from.pyo", line 261, in __init__
  File "libprs500\ebooks\lrf\html\convert_from.pyo", line 363, in add_file
  File "libprs500\ebooks\lrf\html\convert_from.pyo", line 337, in preprocess
IOError: [Errno 2] No such file or directory: 'c:\\docume~1\\admin\\locals~1\\temp\\html2lrf-verbose.html'

I copied up until the "log" part because it was way too long to post the whole thing here. Same thing seems to have happened when attempting to get CNN.com and Wired.

[kovidgoyal]

Yeah slow and steady progress.

Looks like for some reason the directory
c:\docume~1\admin\locals~1\temp

doesn't exists. Create it and you should be fine.

[megacoupe]

Hmmmm, it seems that that folder DOES exist, and it has a "html2lrf-verbose.html" file in it as well (when I opened it, there was a single Wired article).

Now I'm really baffled...

[kovidgoyal]

Try running it from the command line

feeds2lrf Wired.com

then

feeds2lrf --verbose Wired.com

The second is what the GUI runs and causes the html2lrf-verbose files to be created.

[megacoupe]

Before trying out your suggestion, I rebooted my computer and tried the GUI again - and it worked!

Today, however, the GUI failed me with the same error. I don't want to have to reboot my computer every time I want to read the NYT...

Any ways, "feeds2lrf Wired.com" worked just fine and created the lrf file, but once "--verbose" was added, I got lines and lines of something being processed and then:

IOError: [Errno 2] No such file or directory: 'c:\\docume~1\\admin\\locals~1\\temp\\html2lrf-verbose.html'

Once again, I checked to make sure the directory exists and the html2lrf-verbose.html file had one Wired article in it.

Any ideas what's going on?

[kovidgoyal]

Hmm, that's just weird. At any rate, I've made some changes that should make future versions of libprs500 ignore that error and just keep going, since the html2lrf-verbose file is useful only for debugging anyway. Unfortunately, I am travelling for three weeks (getting married) so I will not be able to release a new version for a while. I'd suggest using the command line till then.

[ddavtian]

Congratulations on getting married!
We'll miss your releases here but current one does a good job.