web2lrf - Page 2

Platapie · 07-20-2007, 09:01 PM

Quote:

You only need convertlit if you plan on converting lit files. The rest of libprs500 will work just fine without it.

Ah, gotcha. For those who do wish to use converlit, I forgot to mention that you also need to update the makefile to aim it at the appropriate libtom file, or else it wont compile properly.

geekraver · 07-27-2007, 04:21 PM

Awesome job, Kovid. I have but one request - can you add an option to ignore font families? I'd like to always use the built-in Sans-Serif font, as it is fast and readable. That would be cool.

kovidgoyal · 07-27-2007, 04:42 PM

Thanks, open a ticket and I'll see to it when I get the time.

kovidgoyal · 08-17-2007, 12:20 AM

v 0.3.96 has a new improved nytimes feed with support for logging in (see first post)

kovidgoyal · 08-18-2007, 02:12 PM

v 0.3.99 has an improved BBC profile with a hierarchical TOC. See sample in first post.

Adrian · 08-23-2007, 08:40 PM

What a fantastic app! This is precisely what I wanted to use my Reader for - reading the New York Times. I don't suppose you could make another script from the NYT Sunday Magazine? The articles are particularly long in the magazine, and would really suit being on the reader.

Keep up the good work!

numindast · 09-04-2007, 10:43 PM

oh WOW!

I can get my beloved New York Times on my reader! oohh this makes me excited .. not quite excited-over-a-woman but boy oh boy!

Thanks much for this GREAT tool!

I had my expectations set too high -- I thought NYTimes.com would have a way to download their paper in ebook format, boy was I wrong. Still, I hope I can get this scripted out so that I can grab my Reader in the morning, head for the train, and read the news

(I am a subscriber, albeit just to the Sunday print edition.)

Thanks!!

avh · 09-16-2007, 03:15 AM

Hi kovidgoyal,

Thanks very much for this app. The 3 profiles that you provided are very nice. They are now on my list of daily lrf creation.

I have a website that I read daily, and would like to create a lrf output for it. After executing the command "web2lrf --url http://english.vietnamnet.vn", I got the "Downloading" echo, then the cursor in the command window would just keep blinking.

My thought now is to write a .NET program to download the top level articles in the Politics and Business sections of this website. The next step would be to create the lrf document with a TOC just like you did for the BBC, NY Times, and News Week. This is where I got stuck

. I don't know what is the best way to assemble the web pages into lrf with a TOC. Would you please advise on how best to achieve similar results as your outputs? And did I say they look very nice by the way

TIA

kovidgoyal · 09-16-2007, 12:09 PM

If you interrupt the LRF creation, the temporary files, will be preserved and you can look at them (they'll be in the temp directory in a subdirectory whose name starts with libprs500).

Also libprs500 contains functions that make this task easy. Take a look at
https://libprs500.kovidgoyal.net/bro...ebooks/lrf/web

paying special attention to profiles.py and the individual profile files. As you can see it takes only a few dozen lines of code to create an individual profile.

avh · 09-18-2007, 02:40 AM

Thanks kovidgoyal. I will study the profile files.

kovidgoyal · 10-13-2007, 02:27 PM

When i release 0.4.9 it will have a modified nytimes profile to only download articles from the previous two days. This should result in a smaller/faster loading LRF file. Let me know what you think of it.

JSWolf · 10-13-2007, 05:16 PM

Quote:

Originally Posted by kovidgoyal

When i release 0.4.9 it will have a modified nytimes profile to only download articles from the previous two days. This should result in a smaller/faster loading LRF file. Let me know what you think of it.

Can we have a profile to only download the current day's paper?

kovidgoyal · 10-13-2007, 05:25 PM

web2lrf uses RSS and there is no simple mapping from RSS publication dates to a "day's newspaper"

kovidgoyal · 10-26-2007, 10:05 PM

version 0.4.15 should hit the servers soon.
It has support for adding custom profiles to web2lrf. See https://libprs500.kovidgoyal.net/wiki/UserProfiles

StDo · 10-29-2007, 08:41 AM

Got a german RSS-newsfeed user-profile for FAZ.net

Check out faznet.py zipped as attachment.

Attention: it is an alpha version.

There are still some layout problems...

If anybody got some hints to get the layout a little bit smoother... let me know!

Greetings from germany,

StDo

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
web2lrf to capture blog archive?	Deputy-Dawg	Sony Reader Dev Corner	1	02-15-2008 12:41 AM
web2lrf: La Repubblica	alexxxm	Sony Reader	1	11-13-2007 01:27 PM

07-27-2007, 04:21 PM	#17
geekraver Addict Posts: 364 Karma: 1035291 Join Date: Jul 2006 Location: Redmond, WA Device: iPad Mini,Kindle Paperwhite	Awesome job, Kovid. I have but one request - can you add an option to ignore font families? I'd like to always use the built-in Sans-Serif font, as it is fast and readable. That would be cool.

07-27-2007, 04:42 PM	#18
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Thanks, open a ticket and I'll see to it when I get the time.

08-17-2007, 12:20 AM	#19
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	v 0.3.96 has a new improved nytimes feed with support for logging in (see first post)

08-18-2007, 02:12 PM	#20
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	v 0.3.99 has an improved BBC profile with a hierarchical TOC. See sample in first post.

08-23-2007, 08:40 PM	#21
Adrian Member Posts: 10 Karma: 10 Join Date: Jul 2007 Location: London Device: n/a	What a fantastic app! This is precisely what I wanted to use my Reader for - reading the New York Times. I don't suppose you could make another script from the NYT Sunday Magazine? The articles are particularly long in the magazine, and would really suit being on the reader. Keep up the good work!

09-04-2007, 10:43 PM	#22
numindast Enthusiast Posts: 34 Karma: 296 Join Date: Sep 2007 Location: Chicago Device: K2, DX (had PRS500, 505, 700)	oh WOW! I can get my beloved New York Times on my reader! oohh this makes me excited .. not quite excited-over-a-woman but boy oh boy! Thanks much for this GREAT tool! I had my expectations set too high -- I thought NYTimes.com would have a way to download their paper in ebook format, boy was I wrong. Still, I hope I can get this scripted out so that I can grab my Reader in the morning, head for the train, and read the news (I am a subscriber, albeit just to the Sunday print edition.) Thanks!!

09-16-2007, 03:15 AM	#23
avh Junior Member Posts: 4 Karma: 10 Join Date: Sep 2007 Device: Sony Portable Reader	Hi kovidgoyal, Thanks very much for this app. The 3 profiles that you provided are very nice. They are now on my list of daily lrf creation. I have a website that I read daily, and would like to create a lrf output for it. After executing the command "web2lrf --url http://english.vietnamnet.vn", I got the "Downloading" echo, then the cursor in the command window would just keep blinking. My thought now is to write a .NET program to download the top level articles in the Politics and Business sections of this website. The next step would be to create the lrf document with a TOC just like you did for the BBC, NY Times, and News Week. This is where I got stuck . I don't know what is the best way to assemble the web pages into lrf with a TOC. Would you please advise on how best to achieve similar results as your outputs? And did I say they look very nice by the way TIA

09-16-2007, 12:09 PM	#24
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	If you interrupt the LRF creation, the temporary files, will be preserved and you can look at them (they'll be in the temp directory in a subdirectory whose name starts with libprs500). Also libprs500 contains functions that make this task easy. Take a look at https://libprs500.kovidgoyal.net/bro...ebooks/lrf/web paying special attention to profiles.py and the individual profile files. As you can see it takes only a few dozen lines of code to create an individual profile.

09-18-2007, 02:40 AM	#25
avh Junior Member Posts: 4 Karma: 10 Join Date: Sep 2007 Device: Sony Portable Reader	Thanks kovidgoyal. I will study the profile files.

10-13-2007, 02:27 PM	#26
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	When i release 0.4.9 it will have a modified nytimes profile to only download articles from the previous two days. This should result in a smaller/faster loading LRF file. Let me know what you think of it.

10-13-2007, 05:25 PM	#28
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	web2lrf uses RSS and there is no simple mapping from RSS publication dates to a "day's newspaper"

10-26-2007, 10:05 PM	#29
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	version 0.4.15 should hit the servers soon. It has support for adding custom profiles to web2lrf. See https://libprs500.kovidgoyal.net/wiki/UserProfiles