iLiad I want wikipedia...

narve · 08-14-2007, 05:06 AM

... but how to do it?

http://www.softlab.ntua.gr/~ttsiod/b...iaOffline.html

is this possibly, oh mighty iLiad developers? 2.7 GB is a lot, but with modern 4 or 8 GB flash card I'd gladly reserve that space on my cf card. As long as you stay away from media files, storage is plentiful...

Nate the great · 08-14-2007, 06:38 AM

Quote:

Originally Posted by narve

... but how to do it?

http://www.softlab.ntua.gr/~ttsiod/b...iaOffline.html

is this possibly, oh mighty iLiad developers? 2.7 GB is a lot, but with modern 4 or 8 GB flash card I'd gladly reserve that space on my cf card. As long as you stay away from media files, storage is plentiful...

There already is one in Mobipocket format in German, and Tome Raider in English.

https://www.mobileread.com/forums/sho...line+wikipedia

Adam B. · 08-14-2007, 01:20 PM

Quote:

Originally Posted by narve

... but how to do it?

http://www.softlab.ntua.gr/~ttsiod/b...iaOffline.html

is this possibly, oh mighty iLiad developers? 2.7 GB is a lot, but with modern 4 or 8 GB flash card I'd gladly reserve that space on my cf card. As long as you stay away from media files, storage is plentiful...

I'm playing with that script now. I'll see what I can come up with for the iLiad.

The problem is distributing it... If I do make an iLiad specific version, it's way too big to host anywhere...

tribble · 08-14-2007, 02:23 PM

I would be willing to set up a host.

sammykrupa · 08-14-2007, 02:33 PM

A reader version would be very nice too, although I am wondering how easily one would be able to navigate such a thing.

Adam B. · 08-14-2007, 03:04 PM

Quote:

Originally Posted by sammykrupa

A reader version would be very nice too, although I am wondering how easily one would be able to navigate such a thing.

I'd say that without text or stylus entry, it'd be darn near impossible to even search for anything with it...

Robert Marquard · 08-15-2007, 01:04 AM

I doubt that anyone has the resources to do the english Wikipedia as Mobipocket ebook.
The german version at 500 MB took several days on several computers to generate.
It would also be over 2 GB which is the practical limit for SD cards.

HarryT · 08-15-2007, 03:31 AM

Quote:

Originally Posted by Robert Marquard

I doubt that anyone has the resources to do the english Wikipedia as Mobipocket ebook.
The german version at 500 MB took several days on several computers to generate.
It would also be over 2 GB which is the practical limit for SD cards.

The iLiad supports 4GB CF cards, but I'm not at all sure that the MobiPocket Reader (or any other) would be happy to load a 4GB file

.

Robert Marquard · 08-15-2007, 05:48 AM

It would be several files anyway. The real problem is that not all devices being able to show Mobipocket files can handle 4 GB SD cards. That means you have a device specific Mobipocket ebook. I am sure Mobipocket would frown upon this.

Adam B. · 08-15-2007, 08:22 AM

Well, I've got the posted solution working from the terminal. It required a port of php, perl, bzip2, and xapian. With the database, it uses almost my entire 4gb CF card.

Extracting from the bzip archive and generating the html is a bit slow (~12 seconds), but it's doable. If someone could write a gtk gui for it....we would have the wikipedia in the palm of our hands!

Code:

root@ereader:/mnt/cf/offline.wikipedia# ./mywiki.pl iliad
0: (abort)
1: (100%) Iliad
2: (72%) The Iliad
3: (72%) Little Iliad
4: (72%) Ambrosian Iliad
5: (63%) Category:Characters in the Iliad
6: (63%) Wikipedia:Articles for deletion/Ambrosian Iliad
7: (63%) Wikipedia:Votes for deletion/Ambrosian Iliad

Select a number: 1

This is the search program. It's case insensitive, so I think the article about the iRex iLiad is overwritten by the book...

Code:

Selected:
        Iliad
        rec00153enwiki-20070802-pages-articles.xml.bz2p

And now that the result html has been generated, I open it from the contentlister.

HarryT · 08-15-2007, 08:34 AM

Wow - that's impressive, Adam!

BKeeper · 08-15-2007, 09:11 AM

I'd be willing to set up a host too, even if it was just for for the initial seeding of the file. Afterwards we could generate a torrent and I'm sure people would help seed the file.

And for text entry:
Isn't it possible to develop a hook to provide "selection search" as an option while reading another book?
Hardcore users could use a usb keyboard anyway...

That said, I'm not sure how many people would be willing to dedicate a 4GB card just for wikipedia.

Adam B. · 08-15-2007, 09:16 AM

The problem is that right now, the only way to search is from the terminal... Perhaps I can get python running with that mini webserver posted in the original topic.

narve · 08-15-2007, 05:53 PM

As always adam ports faster than other people can follow the forum discussions

I can host it on my company's server. Well, unless lots of people keeps downloading it, but I don't think so - it is not _that_ useful for common users. Besides, there are plenty of filesharing portals, most of them are free.

But a quick-and-dirty gui would be needed, I guess... otherwise it is too cumbersome to use :S

Alexander Turcic · 08-16-2007, 07:14 AM

Quote:

Originally Posted by Adam B.

And now that the result html has been generated, I open it from the contentlister.

Adam, you never cease to amaze me!

08-14-2007, 05:06 AM	#1
narve iLiad fan Posts: 210 Karma: 3864 Join Date: Oct 2006 Device: iRex iLiad	I want wikipedia... ... but how to do it? http://www.softlab.ntua.gr/~ttsiod/b...iaOffline.html is this possibly, oh mighty iLiad developers? 2.7 GB is a lot, but with modern 4 or 8 GB flash card I'd gladly reserve that space on my cf card. As long as you stay away from media files, storage is plentiful...

08-14-2007, 02:33 PM	#5
sammykrupa Reader of the Reader Posts: 103 Karma: 107 Join Date: Apr 2006 Device: Sony Reader PRS-500	A reader version would be very nice too, although I am wondering how easily one would be able to navigate such a thing. Last edited by sammykrupa; 08-14-2007 at 02:48 PM.

08-15-2007, 08:22 AM	#10
Adam B. Addicted to Porting Posts: 1,697 Karma: 7194 Join Date: Oct 2006 Location: Indianapolis, IN Device: iRex iLiad, Nokia 770, Samsung i760	Well, I've got the posted solution working from the terminal. It required a port of php, perl, bzip2, and xapian. With the database, it uses almost my entire 4gb CF card. Extracting from the bzip archive and generating the html is a bit slow (~12 seconds), but it's doable. If someone could write a gtk gui for it....we would have the wikipedia in the palm of our hands! Code: root@ereader:/mnt/cf/offline.wikipedia# ./mywiki.pl iliad 0: (abort) 1: (100%) Iliad 2: (72%) The Iliad 3: (72%) Little Iliad 4: (72%) Ambrosian Iliad 5: (63%) Category:Characters in the Iliad 6: (63%) Wikipedia:Articles for deletion/Ambrosian Iliad 7: (63%) Wikipedia:Votes for deletion/Ambrosian Iliad Select a number: 1 This is the search program. It's case insensitive, so I think the article about the iRex iLiad is overwritten by the book... Code: Selected: Iliad rec00153enwiki-20070802-pages-articles.xml.bz2p And now that the result html has been generated, I open it from the contentlister. Attached Thumbnails

08-15-2007, 09:11 AM	#12
BKeeper Groupie Posts: 186 Karma: 728 Join Date: Jul 2006 Device: Kindle PW	I'd be willing to set up a host too, even if it was just for for the initial seeding of the file. Afterwards we could generate a torrent and I'm sure people would help seed the file. And for text entry: Isn't it possible to develop a hook to provide "selection search" as an option while reading another book? Hardcore users could use a usb keyboard anyway... That said, I'm not sure how many people would be willing to dedicate a 4GB card just for wikipedia. Last edited by BKeeper; 08-15-2007 at 09:14 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
wikipedia	bo-kai	Sony Reader	4	09-23-2010 06:32 PM
Wikipedia	omro	Astak EZReader	0	12-09-2009 10:42 AM
Wikipedia with 2.12?	Gogolo	iRex	20	04-29-2008 07:17 PM
iLiad Wikipedia	smoogle	iRex Developer's Corner	8	03-28-2008 10:59 AM
Reference Wikipedia: SOS Children 2006 Wikipedia CD	hn_88	BBeB/LRF Books	0	01-29-2008 12:23 PM

08-14-2007, 02:23 PM	#4
tribble iLiad Maniac Posts: 1,382 Karma: 2369 Join Date: Apr 2006 Location: Germany Device: Bookeen Opus (i love that thing) and iPad (what an irony)	I would be willing to set up a host.

08-15-2007, 01:04 AM	#7
Robert Marquard Delphi-Guy Posts: 285 Karma: 1151 Join Date: May 2006 Location: Berlin, Germany Device: iLiad, Palm T3	I doubt that anyone has the resources to do the english Wikipedia as Mobipocket ebook. The german version at 500 MB took several days on several computers to generate. It would also be over 2 GB which is the practical limit for SD cards.

08-15-2007, 05:48 AM	#9
Robert Marquard Delphi-Guy Posts: 285 Karma: 1151 Join Date: May 2006 Location: Berlin, Germany Device: iLiad, Palm T3	It would be several files anyway. The real problem is that not all devices being able to show Mobipocket files can handle 4 GB SD cards. That means you have a device specific Mobipocket ebook. I am sure Mobipocket would frown upon this.

08-15-2007, 08:34 AM	#11
HarryT eBook Enthusiast Posts: 85,560 Karma: 93980341 Join Date: Nov 2006 Location: UK Device: Kindle Oasis 2, iPad Pro 10.5", iPhone 6	Wow - that's impressive, Adam!

08-15-2007, 09:16 AM	#13
Adam B. Addicted to Porting Posts: 1,697 Karma: 7194 Join Date: Oct 2006 Location: Indianapolis, IN Device: iRex iLiad, Nokia 770, Samsung i760	The problem is that right now, the only way to search is from the terminal... Perhaps I can get python running with that mini webserver posted in the original topic.

08-15-2007, 05:53 PM	#14
narve iLiad fan Posts: 210 Karma: 3864 Join Date: Oct 2006 Device: iRex iLiad	As always adam ports faster than other people can follow the forum discussions I can host it on my company's server. Well, unless lots of people keeps downloading it, but I don't think so - it is not _that_ useful for common users. Besides, there are plenty of filesharing portals, most of them are free. But a quick-and-dirty gui would be needed, I guess... otherwise it is too cumbersome to use :S