MobiPocket English Wikipedia

sammykrupa · 05-10-2006, 11:58 AM

What would it take to convert all of the english Wikipedia to MobiPocket format?

I know you can download XML versions of all the Wikipedia pages from here:
http://download.wikimedia.org/

It looks like it would be about 100GBs of data (uncompressed).

Put this on your iRex iLiad or PocketPC and you have your own Hitch Hiker's Guide to the Galaxy!

The only problems I see are:

1. How well does MobiPocket compress? There are no 100GB memory cards yet!

2. Is the searching of a 1.5 million page document feasible for a mobile device?

doctorow · 05-10-2006, 12:53 PM

Well, it's feasible. For instance, there is a reader called TomeRaider for which you can get pre-compiled Wikipedia files. The full English edition 12/2004 was about 500MB compressed.

Check out this thread for more:
https://www.mobileread.com/forums/showthread.php?t=3129

I think MobiPocket has a fairly decent compression ratio as well. You might want to use one of their desktop applications to convert html to Mobipocket.

Rainer · 07-03-2006, 10:16 AM

hi
there is a german version wikipedia without images that is less than 70 mb i think; it is converted in mobipocket format. i tried it and it functions! but, alas, it is only in german!

i dont know the method they used to convert in mobipocket format, but it can be done with english too.

please someone try !!

MatYadabyte · 07-03-2006, 11:55 AM

The TomeRaider version of the wiki took an absolute age to do because of the various different article structures. Its no easy task, and it gave Eric, they guy who did it as a labour of love very sore hands

FYI: Im not being biased but I dont think Mobipocket can hadle a file of that size, but Id be interested to see. I know we designed TR3 format to be able to handle multi gig files from the off.

Mat

Rainer · 07-04-2006, 04:39 AM

hello

probably tomeraider is the BEST one out there (i have seen mobipocket and isilo on the s60) BUT there is NO s60 version of Tomeraider!!

Rainer · 07-05-2006, 12:22 PM

MatYadabyte are they going to make a s60 version of tomeraider?

MatYadabyte · 07-06-2006, 01:51 PM

Im sorry, we dont have plans to do an S60 version. Largley because Nokia are very unhelpful. But plans change

Mat

Rainer · 07-10-2006, 12:16 PM

"Im sorry, we dont have plans to do an S60 version. Largley because Nokia are very unhelpful. But plans change"

But you have a symbian uiq version already made...
isn't it easiest to convert it to symbian s60?
thx

CommanderROR · 07-10-2006, 05:42 PM

Well as long as you make Tomeraider for the iRex Iliad...^^

I used the program on my P800 and it was really great. One of the VERY few porgrams I bought and didn't regret.

VillageReader · 07-11-2006, 12:18 PM

Quote:

Originally Posted by MatYadabyte

The TomeRaider version of the wiki took an absolute age to do because of the various different article structures. Its no easy task, and it gave Eric, they guy who did it as a labour of love very sore hands

FYI: Im not being biased but I dont think Mobipocket can hadle a file of that size, but Id be interested to see. I know we designed TR3 format to be able to handle multi gig files from the off.

Mat

I don't know how they would do with Wikipedia, but I know there was (is?) a TomeRaider version of imdb (internet movie database). Worked reasonably well. I seem to recall that the number of items you could search on was the limitation.

MatYadabyte · 07-12-2006, 04:33 AM

We actually have the FULL file of the IMDB but its an absolute whopper. And we are looking to get movie posters in it.

Currently the live version is Englih movies since 1888 and a smaller one since 2002.

Mat Ripley

Rainer · 07-12-2006, 09:11 AM

hi in what format is imdb? (mobipocket, tomerider or isilo?)
and how many mb is that?...

VillageReader · 07-12-2006, 09:17 AM

Quote:

Originally Posted by Rainer

hi in what format is imdb? (mobipocket, tomerider or isilo?)
and how many mb is that?...

Tomeraider only as far as I can tell. Size varies depending on what you select. Go to www.memoware.com and search on imdb.

MatYadabyte · 07-13-2006, 03:12 AM

Quote:

Originally Posted by Rainer

hi in what format is imdb? (mobipocket, tomerider or isilo?)
and how many mb is that?...

Yes its in TomeRaider format. It has full database aspects to, eg you can filter on all movies made between 1960 and 1990 that Are not comedies and ........
etc

Its my favorite TR3 file

Mat

05-10-2006, 11:58 AM	#1
sammykrupa Reader of the Reader Posts: 103 Karma: 107 Join Date: Apr 2006 Device: Sony Reader PRS-500	MobiPocket English Wikipedia What would it take to convert all of the english Wikipedia to MobiPocket format? I know you can download XML versions of all the Wikipedia pages from here: http://download.wikimedia.org/ It looks like it would be about 100GBs of data (uncompressed). Put this on your iRex iLiad or PocketPC and you have your own Hitch Hiker's Guide to the Galaxy! The only problems I see are: 1. How well does MobiPocket compress? There are no 100GB memory cards yet! 2. Is the searching of a 1.5 million page document feasible for a mobile device?

07-03-2006, 10:16 AM	#3
Rainer Junior Member Posts: 8 Karma: 10 Join Date: Jul 2006 Device: ngage qd (s60 vers. 1)	s60 offline wikipedia hi there is a german version wikipedia without images that is less than 70 mb i think; it is converted in mobipocket format. i tried it and it functions! but, alas, it is only in german! i dont know the method they used to convert in mobipocket format, but it can be done with english too. please someone try !!

07-04-2006, 04:39 AM	#5
Rainer Junior Member Posts: 8 Karma: 10 Join Date: Jul 2006 Device: ngage qd (s60 vers. 1)	i would like to have tomeraider on my s60... hello probably tomeraider is the BEST one out there (i have seen mobipocket and isilo on the s60) BUT there is NO s60 version of Tomeraider!!

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Converting PWN Oxford Polish-English dictionary to Mobipocket	owl123	Workshop	1	05-24-2010 07:07 AM
Wikipedia in Mobipocket format -- for Kindle Too?	berniej	Kindle Formats	2	11-13-2009 09:16 AM
Converting Oxford Dictionary of English for iPhone to Mobipocket	owl123	Workshop	3	07-24-2009 08:13 AM
Brand New Wikipedia TomeRadier English File	MatYadabyte	News	0	03-12-2008 01:28 PM
the Concise Oxford English Dictionary available in Mobipocket format	Mobipocket	Deals and Resources (No Self-Promotion or Affiliate Links)	7	07-17-2007 07:25 PM

05-10-2006, 12:53 PM	#2
doctorow Guru Posts: 914 Karma: 3410461 Join Date: May 2004 Device: Kindle Touch	Well, it's feasible. For instance, there is a reader called TomeRaider for which you can get pre-compiled Wikipedia files. The full English edition 12/2004 was about 500MB compressed. Check out this thread for more: https://www.mobileread.com/forums/showthread.php?t=3129 I think MobiPocket has a fairly decent compression ratio as well. You might want to use one of their desktop applications to convert html to Mobipocket.

07-03-2006, 11:55 AM	#4
MatYadabyte Zealot Posts: 111 Karma: 1013536 Join Date: Aug 2005	The TomeRaider version of the wiki took an absolute age to do because of the various different article structures. Its no easy task, and it gave Eric, they guy who did it as a labour of love very sore hands FYI: Im not being biased but I dont think Mobipocket can hadle a file of that size, but Id be interested to see. I know we designed TR3 format to be able to handle multi gig files from the off. Mat

07-05-2006, 12:22 PM	#6
Rainer Junior Member Posts: 8 Karma: 10 Join Date: Jul 2006 Device: ngage qd (s60 vers. 1)	MatYadabyte are they going to make a s60 version of tomeraider?

07-06-2006, 01:51 PM	#7
MatYadabyte Zealot Posts: 111 Karma: 1013536 Join Date: Aug 2005	Im sorry, we dont have plans to do an S60 version. Largley because Nokia are very unhelpful. But plans change Mat

07-10-2006, 12:16 PM	#8
Rainer Junior Member Posts: 8 Karma: 10 Join Date: Jul 2006 Device: ngage qd (s60 vers. 1)	"Im sorry, we dont have plans to do an S60 version. Largley because Nokia are very unhelpful. But plans change" But you have a symbian uiq version already made... isn't it easiest to convert it to symbian s60? thx

07-10-2006, 05:42 PM	#9
CommanderROR eink fanatic Posts: 2,022 Karma: 4924 Join Date: Mar 2006 Location: Germany Device: STAReBOOK, iRex Iliad, Sony 505, Kindle 2	Well as long as you make Tomeraider for the iRex Iliad...^^ I used the program on my P800 and it was really great. One of the VERY few porgrams I bought and didn't regret.

07-12-2006, 04:33 AM	#11
MatYadabyte Zealot Posts: 111 Karma: 1013536 Join Date: Aug 2005	We actually have the FULL file of the IMDB but its an absolute whopper. And we are looking to get movie posters in it. Currently the live version is Englih movies since 1888 and a smaller one since 2002. Mat Ripley

07-12-2006, 09:11 AM	#12
Rainer Junior Member Posts: 8 Karma: 10 Join Date: Jul 2006 Device: ngage qd (s60 vers. 1)	hi in what format is imdb? (mobipocket, tomerider or isilo?) and how many mb is that?...

Advert

Advert