Wikipedia Encyclopedia on your handheld

Colin Dunstan · 04-25-2005, 04:30 AM

jkOnTheRun is pointing this morning to a website that offers detailed step-by-step instruction how to convert the complete Wikipedia to TomeRaider 2 or 3 format.

Be aware that currently image support in TomeRaider is still buggy so even after a successfull compilation many images may not show up.

hacker · 04-25-2005, 11:44 AM

I've seen this site before and tried it scripts, they don't work. The instructions do not work.

Soo... I decided to do it myself:

Wikiquote in Plucker format
Wikipedia in Plucker format (this one is HUGE)
Wiktionary in Plucker format

Below are some screenshots.. I'm working on cleaning it up quite a bit, and I might add some iSilo versions as well, but you get the idea. I have non-image and with-image versions, but with images its so prohibitively large to download, I'm going to be selling those on either CD/DVD or on SD cards directly.

You saw it here first! <grin>

Alexander Turcic · 04-25-2005, 12:42 PM

David these screenshots look gorgeous!

encycloPlucker 2005? Cannot wait to put my hands on it.

sUnShInE · 04-25-2005, 01:19 PM

Seriously gorgeous.

But I have to ask: How big are the files? (gulp)

SirOops · 06-04-2005, 10:06 AM

TomeRaider image support is now stable.

English and German Wikipedias with images are now available for PPC and Palm.
File sizes for the English version range from 1 Gb to 2.6 Gb, depending on size and number of images.

More at http://infodisiac.com/Wikipedia/

Colin Dunstan · 06-04-2005, 10:11 AM

Thank you for the heads up and the link, SirOops!

hacker · 08-26-2007, 10:59 PM

There's NO WAY that the TomeRaider version of Wikipedia is including images, not unless they're excluding 99% of those images from their version.

I have the full archive of Wikipedia mirrored here and the images from 2005 alone are 70 gigabytes uncompressed. Even if you could compress every single image by 99%, that's still an enormous archive, not including the text of each article..

The 2007 version of Wikipedia's images is 300 gigabytes alone.

It simply can't be done, not on current Palm devices with current storage. Even an 8gb SDHC card won't hold text+images.

There are some ways to do it (Plucker can do inter-pdb links for example, so you can have one-letter-per-pdb and link between them), but its still a problem.

HarryT · 08-27-2007, 01:23 PM

I would guess that, in April 2005, Wiki was somewhat smaller than it is today.

SirOops · 08-27-2007, 05:36 PM

> There's NO WAY that the TomeRaider version of Wikipedia is including images,> not unless they're excluding 99% of those images from their version.

Thanks to a recent breakthrough in information technology images can now be resized.

DMcCunney · 08-27-2007, 06:56 PM

Quote:

Originally Posted by SirOops

> There's NO WAY that the TomeRaider version of Wikipedia is including images,> not unless they're excluding 99% of those images from their version.

Thanks to a recent breakthrough in information technology images can now be resized.

Sure can, but not enough to have them usable and get even a small fraction of the total number into anything that can be read on a handheld device. See David's comments about the total size of the images on Wikipedia back in 2005, and assume it's much bigger now...
______
Dennis

HarryT · 08-28-2007, 02:39 AM

One can, however, fit the whole of the text of the current Wikipedia onto a 4GB memory card. See the recent thread on the subject on the iLiad forum.

hacker · 12-01-2007, 01:51 PM

Quote:

Originally Posted by DMcCunney

See David's comments about the total size of the images on Wikipedia back in 2005, and assume it's much bigger now...

Just a minor update... those images come in at 2.5TB now, for the English version of Wikipedia.

I've committed to get the Wikimedia Foundation a storage server once this project takes off a little bit, to help alleviate their strain with creating image dumps, and give them some thanks for allowing me to create this product for everyone who wants to buy a copy.

Even if it were possible to compress 99% of the size out of those images, we're still looking at 250 gigabytes just for images, not including page content itself.

That being said... Now that I've found myself with some more spare time on my hands, I've rebuilt the Wikipedia and am going to be rolling out versions very soon (once I figure out the best/most cost-effective distribution mechanism).

There's some minor issues with Greek fonts and some obscure encodings, but it does work, and looks great! See attachments below for the current version's output so far...

Adam B. · 12-03-2007, 08:45 AM

Since Plucker is supported by FBReader, I'm very interested in this.

Even a text only version without images would be great on the iLiad...

04-25-2005, 04:30 AM	#1
Colin Dunstan Is papyrophobic! Posts: 1,926 Karma: 1009999 Join Date: Aug 2003 Location: USA Device: Dell Axim	Wikipedia Encyclopedia on your handheld jkOnTheRun is pointing this morning to a website that offers detailed step-by-step instruction how to convert the complete Wikipedia to TomeRaider 2 or 3 format. Be aware that currently image support in TomeRaider is still buggy so even after a successfull compilation many images may not show up.

04-25-2005, 11:44 AM	#2
hacker Technology Mercenary Posts: 617 Karma: 2561 Join Date: Feb 2003 Location: East Lyme, CT Device: Direct Neural Implant	I've seen this site before and tried it scripts, they don't work. The instructions do not work. Soo... I decided to do it myself: Wikiquote in Plucker format Wikipedia in Plucker format (this one is HUGE) Wiktionary in Plucker format Below are some screenshots.. I'm working on cleaning it up quite a bit, and I might add some iSilo versions as well, but you get the idea. I have non-image and with-image versions, but with images its so prohibitively large to download, I'm going to be selling those on either CD/DVD or on SD cards directly. You saw it here first! <grin> Attached Thumbnails

06-04-2005, 10:06 AM	#5
SirOops Junior Member Posts: 3 Karma: 10 Join Date: Jul 2003 Location: Netherlands Device: Dell Axim Pocket PC	TomeRaider image support is now stable. English and German Wikipedias with images are now available for PPC and Palm. File sizes for the English version range from 1 Gb to 2.6 Gb, depending on size and number of images. More at http://infodisiac.com/Wikipedia/ Last edited by SirOops; 01-02-2006 at 09:13 PM. Reason: site moved

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
The Encyclopedia of Life	desertgrandma	Lounge	13	11-09-2009 01:17 PM
Encyclopedia Universalis	Mistralain	E-Books	1	10-16-2009 01:25 AM
Reference Wikipedia: SOS Children 2006 Wikipedia CD	hn_88	BBeB/LRF Books	0	01-29-2008 12:23 PM
looking for a decent encyclopedia	exvaxman	Sony Reader	8	05-14-2007 11:29 AM
Wikipedia may be more accurate than Encyclopedia Britannica	Bob Russell	Lounge	2	12-16-2005 07:47 PM

04-25-2005, 12:42 PM	#3
Alexander Turcic Fully Converged Posts: 18,163 Karma: 14021202 Join Date: Oct 2002 Location: Switzerland Device: Too many to count here.	David these screenshots look gorgeous! encycloPlucker 2005? Cannot wait to put my hands on it.

04-25-2005, 01:19 PM	#4
sUnShInE Drama Queen Posts: 784 Karma: 11712 Join Date: Nov 2002 Location: United States Device: Palm Tungsten T\|T3	Seriously gorgeous. But I have to ask: How big are the files? (gulp)

06-04-2005, 10:11 AM	#6
Colin Dunstan Is papyrophobic! Posts: 1,926 Karma: 1009999 Join Date: Aug 2003 Location: USA Device: Dell Axim	Thank you for the heads up and the link, SirOops!

08-26-2007, 10:59 PM	#7
hacker Technology Mercenary Posts: 617 Karma: 2561 Join Date: Feb 2003 Location: East Lyme, CT Device: Direct Neural Implant	There's NO WAY that the TomeRaider version of Wikipedia is including images, not unless they're excluding 99% of those images from their version. I have the full archive of Wikipedia mirrored here and the images from 2005 alone are 70 gigabytes uncompressed. Even if you could compress every single image by 99%, that's still an enormous archive, not including the text of each article.. The 2007 version of Wikipedia's images is 300 gigabytes alone. It simply can't be done, not on current Palm devices with current storage. Even an 8gb SDHC card won't hold text+images. There are some ways to do it (Plucker can do inter-pdb links for example, so you can have one-letter-per-pdb and link between them), but its still a problem.

08-27-2007, 01:23 PM	#8
HarryT eBook Enthusiast Posts: 85,544 Karma: 93383043 Join Date: Nov 2006 Location: UK Device: Kindle Oasis 2, iPad Pro 10.5", iPhone 6	I would guess that, in April 2005, Wiki was somewhat smaller than it is today.

08-27-2007, 05:36 PM	#9
SirOops Junior Member Posts: 3 Karma: 10 Join Date: Jul 2003 Location: Netherlands Device: Dell Axim Pocket PC	> There's NO WAY that the TomeRaider version of Wikipedia is including images,> not unless they're excluding 99% of those images from their version. Thanks to a recent breakthrough in information technology images can now be resized.

08-28-2007, 02:39 AM	#11
HarryT eBook Enthusiast Posts: 85,544 Karma: 93383043 Join Date: Nov 2006 Location: UK Device: Kindle Oasis 2, iPad Pro 10.5", iPhone 6	One can, however, fit the whole of the text of the current Wikipedia onto a 4GB memory card. See the recent thread on the subject on the iLiad forum.

12-03-2007, 08:45 AM	#13
Adam B. Addicted to Porting Posts: 1,697 Karma: 7194 Join Date: Oct 2006 Location: Indianapolis, IN Device: iRex iLiad, Nokia 770, Samsung i760	Since Plucker is supported by FBReader, I'm very interested in this. Even a text only version without images would be great on the iLiad...

Advert

Advert