Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Readers > More E-Book Readers > iRex > iRex Developer's Corner

Notices

Reply
 
Thread Tools Search this Thread
Old 08-14-2007, 06:06 AM   #1
narve
iLiad fan
narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.
 
Posts: 210
Karma: 3864
Join Date: Oct 2006
Device: iRex iLiad
I want wikipedia...

... but how to do it?

http://www.softlab.ntua.gr/~ttsiod/b...iaOffline.html

is this possibly, oh mighty iLiad developers? 2.7 GB is a lot, but with modern 4 or 8 GB flash card I'd gladly reserve that space on my cf card. As long as you stay away from media files, storage is plentiful...
narve is offline   Reply With Quote
Old 08-14-2007, 07:38 AM   #2
Nate the great
Sir Penguin of Edinburgh
Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.Nate the great ought to be getting tired of karma fortunes by now.
 
Nate the great's Avatar
 
Posts: 10,605
Karma: 3586209
Join Date: Apr 2007
Location: DC Metro area
Device: Shake a stick plus 1
Quote:
Originally Posted by narve View Post
... but how to do it?

http://www.softlab.ntua.gr/~ttsiod/b...iaOffline.html

is this possibly, oh mighty iLiad developers? 2.7 GB is a lot, but with modern 4 or 8 GB flash card I'd gladly reserve that space on my cf card. As long as you stay away from media files, storage is plentiful...

There already is one in Mobipocket format in German, and Tome Raider in English.


http://www.mobileread.com/forums/sho...line+wikipedia
Nate the great is online now   Reply With Quote
Old 08-14-2007, 02:20 PM   #3
Adam B.
Addicted to Porting
Adam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the rough
 
Adam B.'s Avatar
 
Posts: 1,695
Karma: 7194
Join Date: Oct 2006
Location: Indianapolis, IN
Device: iRex iLiad, Nokia 770, Samsung i760
Quote:
Originally Posted by narve View Post
... but how to do it?

http://www.softlab.ntua.gr/~ttsiod/b...iaOffline.html

is this possibly, oh mighty iLiad developers? 2.7 GB is a lot, but with modern 4 or 8 GB flash card I'd gladly reserve that space on my cf card. As long as you stay away from media files, storage is plentiful...
I'm playing with that script now. I'll see what I can come up with for the iLiad.

The problem is distributing it... If I do make an iLiad specific version, it's way too big to host anywhere...
Adam B. is offline   Reply With Quote
Old 08-14-2007, 03:23 PM   #4
tribble
iLiad Maniac
tribble knows what time it istribble knows what time it istribble knows what time it istribble knows what time it istribble knows what time it istribble knows what time it istribble knows what time it istribble knows what time it istribble knows what time it istribble knows what time it istribble knows what time it is
 
tribble's Avatar
 
Posts: 1,382
Karma: 2369
Join Date: Apr 2006
Location: Germany
Device: Bookeen Opus (i love that thing) and iPad (what an irony)
I would be willing to set up a host.
tribble is offline   Reply With Quote
Old 08-14-2007, 03:33 PM   #5
sammykrupa
Reader of the Reader
sammykrupa doesn't littersammykrupa doesn't litter
 
Posts: 103
Karma: 107
Join Date: Apr 2006
Device: Sony Reader PRS-500
A reader version would be very nice too, although I am wondering how easily one would be able to navigate such a thing.

Last edited by sammykrupa; 08-14-2007 at 03:48 PM.
sammykrupa is offline   Reply With Quote
Old 08-14-2007, 04:04 PM   #6
Adam B.
Addicted to Porting
Adam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the rough
 
Adam B.'s Avatar
 
Posts: 1,695
Karma: 7194
Join Date: Oct 2006
Location: Indianapolis, IN
Device: iRex iLiad, Nokia 770, Samsung i760
Quote:
Originally Posted by sammykrupa View Post
A reader version would be very nice too, although I am wondering how easily one would be able to navigate such a thing.
I'd say that without text or stylus entry, it'd be darn near impossible to even search for anything with it...
Adam B. is offline   Reply With Quote
Old 08-15-2007, 02:04 AM   #7
Robert Marquard
Delphi-Guy
Robert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheese
 
Robert Marquard's Avatar
 
Posts: 285
Karma: 1151
Join Date: May 2006
Location: Berlin, Germany
Device: iLiad, Palm T3
I doubt that anyone has the resources to do the english Wikipedia as Mobipocket ebook.
The german version at 500 MB took several days on several computers to generate.
It would also be over 2 GB which is the practical limit for SD cards.
Robert Marquard is offline   Reply With Quote
Old 08-15-2007, 04:31 AM   #8
HarryT
eBook Enthusiast
HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.
 
HarryT's Avatar
 
Posts: 65,452
Karma: 43770933
Join Date: Nov 2006
Location: UK
Device: Kindle Voyage, iPad Mini, iPhone 4, MS Surface Pro, N7
Quote:
Originally Posted by Robert Marquard View Post
I doubt that anyone has the resources to do the english Wikipedia as Mobipocket ebook.
The german version at 500 MB took several days on several computers to generate.
It would also be over 2 GB which is the practical limit for SD cards.
The iLiad supports 4GB CF cards, but I'm not at all sure that the MobiPocket Reader (or any other) would be happy to load a 4GB file .
HarryT is offline   Reply With Quote
Old 08-15-2007, 06:48 AM   #9
Robert Marquard
Delphi-Guy
Robert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheeseRobert Marquard can extract oil from cheese
 
Robert Marquard's Avatar
 
Posts: 285
Karma: 1151
Join Date: May 2006
Location: Berlin, Germany
Device: iLiad, Palm T3
It would be several files anyway. The real problem is that not all devices being able to show Mobipocket files can handle 4 GB SD cards. That means you have a device specific Mobipocket ebook. I am sure Mobipocket would frown upon this.
Robert Marquard is offline   Reply With Quote
Old 08-15-2007, 09:22 AM   #10
Adam B.
Addicted to Porting
Adam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the rough
 
Adam B.'s Avatar
 
Posts: 1,695
Karma: 7194
Join Date: Oct 2006
Location: Indianapolis, IN
Device: iRex iLiad, Nokia 770, Samsung i760
Well, I've got the posted solution working from the terminal. It required a port of php, perl, bzip2, and xapian. With the database, it uses almost my entire 4gb CF card.

Extracting from the bzip archive and generating the html is a bit slow (~12 seconds), but it's doable. If someone could write a gtk gui for it....we would have the wikipedia in the palm of our hands!

Code:
root@ereader:/mnt/cf/offline.wikipedia# ./mywiki.pl iliad
0: (abort)
1: (100%) Iliad
2: (72%) The Iliad
3: (72%) Little Iliad
4: (72%) Ambrosian Iliad
5: (63%) Category:Characters in the Iliad
6: (63%) Wikipedia:Articles for deletion/Ambrosian Iliad
7: (63%) Wikipedia:Votes for deletion/Ambrosian Iliad

Select a number: 1
This is the search program. It's case insensitive, so I think the article about the iRex iLiad is overwritten by the book...

Code:
Selected:
        Iliad
        rec00153enwiki-20070802-pages-articles.xml.bz2p
And now that the result html has been generated, I open it from the contentlister.
Attached Thumbnails
Click image for larger version

Name:	wikipedia.png
Views:	328
Size:	124.6 KB
ID:	4876  
Adam B. is offline   Reply With Quote
Old 08-15-2007, 09:34 AM   #11
HarryT
eBook Enthusiast
HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.HarryT ought to be getting tired of karma fortunes by now.
 
HarryT's Avatar
 
Posts: 65,452
Karma: 43770933
Join Date: Nov 2006
Location: UK
Device: Kindle Voyage, iPad Mini, iPhone 4, MS Surface Pro, N7
Wow - that's impressive, Adam!
HarryT is offline   Reply With Quote
Old 08-15-2007, 10:11 AM   #12
BKeeper
Groupie
BKeeper will become famous soon enoughBKeeper will become famous soon enoughBKeeper will become famous soon enoughBKeeper will become famous soon enoughBKeeper will become famous soon enoughBKeeper will become famous soon enoughBKeeper will become famous soon enough
 
BKeeper's Avatar
 
Posts: 174
Karma: 728
Join Date: Jul 2006
Device: Cybook, iPad
I'd be willing to set up a host too, even if it was just for for the initial seeding of the file. Afterwards we could generate a torrent and I'm sure people would help seed the file.

And for text entry:
Isn't it possible to develop a hook to provide "selection search" as an option while reading another book?
Hardcore users could use a usb keyboard anyway...

That said, I'm not sure how many people would be willing to dedicate a 4GB card just for wikipedia.

Last edited by BKeeper; 08-15-2007 at 10:14 AM.
BKeeper is offline   Reply With Quote
Old 08-15-2007, 10:16 AM   #13
Adam B.
Addicted to Porting
Adam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the roughAdam B. is a jewel in the rough
 
Adam B.'s Avatar
 
Posts: 1,695
Karma: 7194
Join Date: Oct 2006
Location: Indianapolis, IN
Device: iRex iLiad, Nokia 770, Samsung i760
The problem is that right now, the only way to search is from the terminal... Perhaps I can get python running with that mini webserver posted in the original topic.
Adam B. is offline   Reply With Quote
Old 08-15-2007, 06:53 PM   #14
narve
iLiad fan
narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.narve can teach chickens to fly.
 
Posts: 210
Karma: 3864
Join Date: Oct 2006
Device: iRex iLiad
As always adam ports faster than other people can follow the forum discussions

I can host it on my company's server. Well, unless lots of people keeps downloading it, but I don't think so - it is not _that_ useful for common users. Besides, there are plenty of filesharing portals, most of them are free.

But a quick-and-dirty gui would be needed, I guess... otherwise it is too cumbersome to use :S
narve is offline   Reply With Quote
Old 08-16-2007, 08:14 AM   #15
Alexander Turcic
Fully Converged
Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.Alexander Turcic ought to be getting tired of karma fortunes by now.
 
Alexander Turcic's Avatar
 
Posts: 17,455
Karma: 10995944
Join Date: Oct 2002
Location: Switzerland
Device: Sony PRS-650 / Nexus 7 / Kindle PW
Quote:
Originally Posted by Adam B. View Post
And now that the result html has been generated, I open it from the contentlister.
Adam, you never cease to amaze me!
Alexander Turcic is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
wikipedia bo-kai Sony Reader 4 09-23-2010 07:32 PM
Wikipedia omro Astak EZReader 0 12-09-2009 11:42 AM
Wikipedia with 2.12? Gogolo iRex 20 04-29-2008 08:17 PM
iLiad Wikipedia smoogle iRex Developer's Corner 8 03-28-2008 11:59 AM
Reference Wikipedia: SOS Children 2006 Wikipedia CD hn_88 BBeB/LRF Books 0 01-29-2008 01:23 PM


All times are GMT -4. The time now is 10:49 PM.


MobileRead.com is a privately owned, operated and funded community.