Newspaper to iLiad

verbosus · 08-27-2006, 01:26 PM

(Before I start: I originally sent this as a private email to TadW, Matt Jadud and TomBolini, then TadW suggested reposting it here. He also mentioned the Sitescooper project, which I’ll be sure to check out right away).

I just finished another hack you guys might be interested in.

Basically it’s a shell script that downloads the contents of a mobile version of a newspaper, in this case the Italian La Repubblica, does a bit of cleanup and copies the contents over the the iLiad’s “newspapers” folder, for convenient offline reading. Currently it works on my Mac, and assumes you have wget and growlnotify (which is a command line client to the Growl notification system) installed on your machine under /usr/local/bin

I have set it up so that when I plug in my iLiad, through an app called Do Something When I fire a custom (one-liner) AppleScript app that fires up this script and updates my iLiad. The content of this one-liner AppleScript app is: do shell script "~/bin/repubblica-iliad.sh"

I’ve posted the source code to the shell script and the custom icon I created for that newspaper.

The shell script assumes you’ve copied it in ~/lib/misc, but you can tweak the paths as needed.

Of course this is not very useful in itself if you don’t happen to like Italian newspapers :-p

But with a bit of tweaking it should be a start in developing something geared towards your favourite newspaper.

I’m attaching also two pictures of the results as shown on the iLiad.

Tscherno · 08-29-2006, 01:52 AM

The only thing we need is something like "Do Something When" for Windows... The rest is a piece of cake

oliverbogler · 08-29-2006, 08:38 PM

Hi verbosus - nice post. Can I bug you for more information?

(Disclaimer: I think of myself as a power user, with the emphasis on user i.e. nor programmer. I write the odd automater thing, but that is it...)

First - what form is the newspaper in - are these html pages that you are converting to pdf, or is it a pdf download? Is it downloaded as part of the script process. I read the NY Times in html for example.

Second - can you put this script into a form that could be run from something like automater, so that non-programmers could use it.

Thanks - I dream of getting newspaper content onto the iLiad easily - this sounds very good!

verbosus · 08-31-2006, 01:20 PM

Hi Oliver: it’s the mobile version of a newspaper website, which is basically a stripped down HTML version (you can have a look at it here). And yes, my shell script downloads the whole thing locally, so you can read it offline on your iLiad. It’s not a very big download anyway, I think they are ~30 HTML files plus images.

As for putting it in a non-programmer friendly format. I’m looking into that at the moment. I talked about this a bit with Matt Jadud and TadW, and I think we’ll probably set up an open source project somewhere in the following weeks. The idea is to have some kind of GUI wrapper for this kinds of scripts that people can then tweak for their favourite newspaper.

Matt has done some work with OPML/RSS integration, whereas my approach has been a little bit more brutal (download everything right away). In other words, we’ll see :-)

Oh, and by the way: on the 19th of September I will be in Eindhoven with TomBolini, to meet the iRex guys. Maybe we’ll get to talk a bit about iLiad/newspapers integration.

I’ll try to keep you posted.

CommanderROR · 08-31-2006, 06:22 PM

Great work verbosus!

I've been asing for just this kind of software...I hope you get this up and running so we can get our greedy little hands on it.
About talking it through with iRex...be careful there. iRex is working together with several newspapers around the globe, and what you're doing is very much against what they are planning. If we can all get our favourite webnews onto our Iliads fast and easy, we won't go out there and buy their newspapers...^^

doctorow · 09-01-2006, 03:40 AM

There must be a reason why more and more newspapers offer "mobile" versions of their online edition. I think what verbosus worked on here is OK in the eyes of newspapers - as long as you keep the downloaded files to yourself ;-)

spock · 09-01-2006, 05:22 AM

Hi all,

As verbosus promised, we've opened a Google Code repository for contributing code and ideas to.

You can view the (mostly empty) repostiory at

http://iliad-fun.googlecode.com/svn/

I've checked in a README that provides a few quick guidelines, and the start of my own app for rendering OPML reading lists to the iLiad. That start represents my first Python programming effort.

The purpose here is to create cool stuff and have some fun, so drop a note if you're interested in having access and want to contribute. Details in the README.

Share and enjoy!

oliverbogler · 09-01-2006, 08:11 AM

Quote:

Originally Posted by verbosus

Hi Oliver: it’s the mobile version of a newspaper website, which is basically a stripped down HTML version (you can have a look at it here). ...

As for putting it in a non-programmer friendly format. I’m looking into that at the moment. I talked about this a bit with Matt Jadud and TadW, and I think we’ll probably set up an open source project somewhere in the following weeks. The idea is to have some kind of GUI wrapper for this kinds of scripts that people can then tweak for their favourite newspaper.

Matt has done some work with OPML/RSS integration, whereas my approach has been a little bit more brutal (download everything right away). In other words, we’ll see :-)

...

I’ll try to keep you posted.

Great -thanks. Matt did the nice work on the scrub-a-dub script for cleaning up the Mac files on the iLiad - see my blog (link below) for more details. So that sounds very promising. Thanks for your work on this, everyone.

gambarini · 03-27-2010, 08:52 AM

is there the possibly to DEBUG a recipe?

08-27-2006, 01:26 PM	#1
verbosus Unicoder Posts: 15 Karma: 10 Join Date: Aug 2006 Location: Sassuolo, Modena, Italy Device: iRex iLiad	Newspaper to iLiad (Before I start: I originally sent this as a private email to TadW, Matt Jadud and TomBolini, then TadW suggested reposting it here. He also mentioned the Sitescooper project, which I’ll be sure to check out right away). I just finished another hack you guys might be interested in. Basically it’s a shell script that downloads the contents of a mobile version of a newspaper, in this case the Italian La Repubblica, does a bit of cleanup and copies the contents over the the iLiad’s “newspapers” folder, for convenient offline reading. Currently it works on my Mac, and assumes you have wget and growlnotify (which is a command line client to the Growl notification system) installed on your machine under /usr/local/bin I have set it up so that when I plug in my iLiad, through an app called Do Something When I fire a custom (one-liner) AppleScript app that fires up this script and updates my iLiad. The content of this one-liner AppleScript app is: do shell script "~/bin/repubblica-iliad.sh" I’ve posted the source code to the shell script and the custom icon I created for that newspaper. The shell script assumes you’ve copied it in ~/lib/misc, but you can tweak the paths as needed. Of course this is not very useful in itself if you don’t happen to like Italian newspapers :-p But with a bit of tweaking it should be a start in developing something geared towards your favourite newspaper. I’m attaching also two pictures of the results as shown on the iLiad. Attached Thumbnails Last edited by verbosus; 08-31-2006 at 01:12 PM. Reason: Fixed missing quote

08-29-2006, 08:38 PM	#3
oliverbogler Connoisseur Posts: 81 Karma: 90 Join Date: May 2006 Location: Houston, TX Device: iLiad	More info, please Hi verbosus - nice post. Can I bug you for more information? (Disclaimer: I think of myself as a power user, with the emphasis on user i.e. nor programmer. I write the odd automater thing, but that is it...) First - what form is the newspaper in - are these html pages that you are converting to pdf, or is it a pdf download? Is it downloaded as part of the script process. I read the NY Times in html for example. Second - can you put this script into a form that could be run from something like automater, so that non-programmers could use it. Thanks - I dream of getting newspaper content onto the iLiad easily - this sounds very good!

09-01-2006, 05:22 AM	#7
spock Junior Member Posts: 1 Karma: 10 Join Date: Sep 2006 Device: iRex iLiad	Google Code Repository open Hi all, As verbosus promised, we've opened a Google Code repository for contributing code and ideas to. You can view the (mostly empty) repostiory at http://iliad-fun.googlecode.com/svn/ I've checked in a README that provides a few quick guidelines, and the start of my own app for rendering OPML reading lists to the iLiad. That start represents my first Python programming effort. The purpose here is to create cool stuff and have some fun, so drop a note if you're interested in having access and want to contribute. Details in the README. Share and enjoy!

03-27-2010, 08:52 AM	#9
gambarini Connoisseur Posts: 98 Karma: 22 Join Date: Mar 2010 Device: IRiver Story, Ipod Touch, Android SmartPhone	is there the possibly to DEBUG a recipe? Last edited by gambarini; 03-27-2010 at 09:35 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Dutch Newspaper on Iliad	harald	iRex	15	10-06-2008 03:25 AM
How do you download a newspaper onto my iLiad	trexcomp	iRex	4	09-26-2008 09:57 AM
der standard newspaper on iliad	harald	iRex	4	01-17-2008 04:00 PM
iLiad review in El Mundo (Spanish newspaper)	ElaHuguet	iRex	1	08-17-2007 10:15 AM
Chinese newspaper Yantai Daily on iLiad	yokos	iRex	6	10-28-2006 02:21 AM

08-29-2006, 01:52 AM	#2
Tscherno iLiad Geek Posts: 110 Karma: 10 Join Date: Jul 2006 Location: Regensburg / Germany Device: iLiad #505; Sony T1, Amazon Paperwhite first Gen & sec is coming!	The only thing we need is something like "Do Something When" for Windows... The rest is a piece of cake

08-31-2006, 01:20 PM	#4
verbosus Unicoder Posts: 15 Karma: 10 Join Date: Aug 2006 Location: Sassuolo, Modena, Italy Device: iRex iLiad	Hi Oliver: it’s the mobile version of a newspaper website, which is basically a stripped down HTML version (you can have a look at it here). And yes, my shell script downloads the whole thing locally, so you can read it offline on your iLiad. It’s not a very big download anyway, I think they are ~30 HTML files plus images. As for putting it in a non-programmer friendly format. I’m looking into that at the moment. I talked about this a bit with Matt Jadud and TadW, and I think we’ll probably set up an open source project somewhere in the following weeks. The idea is to have some kind of GUI wrapper for this kinds of scripts that people can then tweak for their favourite newspaper. Matt has done some work with OPML/RSS integration, whereas my approach has been a little bit more brutal (download everything right away). In other words, we’ll see :-) Oh, and by the way: on the 19th of September I will be in Eindhoven with TomBolini, to meet the iRex guys. Maybe we’ll get to talk a bit about iLiad/newspapers integration. I’ll try to keep you posted.

08-31-2006, 06:22 PM	#5
CommanderROR eink fanatic Posts: 2,022 Karma: 4924 Join Date: Mar 2006 Location: Germany Device: STAReBOOK, iRex Iliad, Sony 505, Kindle 2	Great work verbosus! I've been asing for just this kind of software...I hope you get this up and running so we can get our greedy little hands on it. About talking it through with iRex...be careful there. iRex is working together with several newspapers around the globe, and what you're doing is very much against what they are planning. If we can all get our favourite webnews onto our Iliads fast and easy, we won't go out there and buy their newspapers...^^

09-01-2006, 03:40 AM	#6
doctorow Guru Posts: 914 Karma: 3410461 Join Date: May 2004 Device: Kindle Touch	There must be a reason why more and more newspapers offer "mobile" versions of their online edition. I think what verbosus worked on here is OK in the eyes of newspapers - as long as you keep the downloaded files to yourself ;-)

Advert

Advert