Wikipedia Epubs?

nhedgehog · 10-31-2020, 05:01 AM

I found some hints that Koreader was optimized to read Wikipedia Epubs.
https://fransdejonge.com/2020/10/kor...drops/#respond
I guess those are offline epubs created out of wiki pages.
Is there a source to download or create them, I couldn't find any other hint regarding this information.

Edit: Some afterthoughts later a second guess: Is it to support the online wikipedia feature to export articles as epub? I guess I was too greedy hoping, that there are some wiki exported fully as epub.

Galunid · 10-31-2020, 09:15 AM

There is. After you go to wikipedia page -> Wikipedia full -> Save as EPUB.

EDIT: There used to be option to download wiki articles on PC, but I guess it got removed.
https://ebooks.stackexchange.com/que...ctions-to-epub

NiLuJe · 10-31-2020, 12:24 PM

In case that wasn't clear, @Galunid's first § is talking about the in-KOReader Wikipedia lookup option, which does indeed allow you to save the full article as an ePub document

.

Which is probably what @Frenzie's blog post was referring to

.

nhedgehog · 10-31-2020, 01:51 PM

Thank you booth, I wasn't aware of that, since I'm more the offline type.

binaryhermit · 10-31-2020, 02:09 PM

There's a calibre plugin called Wiki Reader that converts wikipedia pages to ebooks, as well.

Frenzie · 11-04-2020, 04:02 PM

Quote:

Originally Posted by nhedgehog

Edit: Some afterthoughts later a second guess: Is it to support the online wikipedia feature to export articles as epub? I guess I was too greedy hoping, that there are some wiki exported fully as epub.

Wikipedia as a 60 GB EPUB? You'd be waiting a century for that to load, assuming your device doesn't run out of memory.

For a slightly better approach (not implemented in KOReader), also see https://github.com/koreader/koreader/issues/2333

nhedgehog · 11-05-2020, 04:30 AM

Thanks for the link. It is a pity that Mobipocket was bought by Amazon and the Mobi format reduced to the pityful azw thingy. It would have been an alternative to the epub format which isn't really made for big datasets.

binaryhermit · 11-05-2020, 02:10 PM

I find the idea that "isn't reallty made for big datasets" doesn't apply to MOBI as well kinda questionable from a (not entirely informed) guess I'm making.

I mean, are there even any major eReaders with 60 GB of usable space?

nhedgehog · 11-05-2020, 02:22 PM

Sure, most of the reader which support an external MicroSD.

binaryhermit · 11-05-2020, 02:41 PM

does such an eReader exist from a manufacturer with as much market share as, say, B&N has in the US?
(limiting eReader to devices with an eInk screen here)
If you include tablets, obviously, there are iPad Pros (iPads Pro?) with 1 TB of storage. Or Android devices with MicroSD slots and/or at least 128 GB of storage. But once you get a less crippled OS with more app support you can have an app with a solution purpose-built for that sort of thing

pazos · 11-05-2020, 03:39 PM

For big datasets (from a few hundred MB to many GB) zim is the way to go. It can be adapted to KO with minimal effort using libzim. See https://github.com/openzim/zim-tools.../zimsearch.cpp for example.

binaryhermit · 11-05-2020, 04:42 PM

I'm not informed enough to know what exactly the right tool for the job is, but I strongly suspect it's not an eBook format here and is something more like a database solution

Quoth · 11-06-2020, 10:52 AM

Though I find the result is better to copy and paste (often unformatted) into a Wordprocessor and make an epub after editing (docx-> Calibre). But then I might need a few related articles as one ebook, with perhaps stuff from elsewhere.

Quoth · 11-06-2020, 10:58 AM

It doesn't make sense to have ALL of Wikipedia as a single ebook. Also many devices, even some brand new tablets and phones have an SD card limit of 32 G.

My tablet does have a 256 G SD card. These are now under £28.

However a single ebook makes no sense. Volumes by Subject or Alphabetical with a separate top level Index book with summaries makes more sense.

I agree that Amazon should never have been permitted to buy Mobipocket. But Mobi can't manage big stuff any better than epub2 and is a bit inferior. That's why AZW3/KF8 is closer to epub2 than to mobi. The azw1 is pretty much mobi with different DRM?

nhedgehog · 11-07-2020, 06:39 AM

Quote:

Originally Posted by Quoth

But Mobi can't manage big stuff any better than epub2 and is a bit inferior. That's why AZW3/KF8 is closer to epub2 than to mobi. The azw1 is pretty much mobi with different DRM?

This seems to be a widespread consent. I don't know where this comes from.
Somewhere in my backups I have Wikipedia files from years ago (mobi format), beeing about 1 GB large or more. The trick was creating it as a dictionary. Those were created by tools mobipocket provided and worked on WinCE devices with 32MB or 64MB RAM. Try this with epub or epub2, it is beyond compare.

@Pazos
Zim (via Kiwix) is working quite well on my Pocketbooks. The problem I have is that the browser is used to show the entries and it refuses to start without online access. And ... Koreader can't use it.

10-31-2020, 05:01 AM	#1
nhedgehog Guru Posts: 800 Karma: 628976 Join Date: Sep 2013 Device: EnergySistemEreaderPro, Nook STG, Pocketbook 622, Bookeen Cybooks ...	Wikipedia Epubs? I found some hints that Koreader was optimized to read Wikipedia Epubs. https://fransdejonge.com/2020/10/kor...drops/#respond I guess those are offline epubs created out of wiki pages. Is there a source to download or create them, I couldn't find any other hint regarding this information. Edit: Some afterthoughts later a second guess: Is it to support the online wikipedia feature to export articles as epub? I guess I was too greedy hoping, that there are some wiki exported fully as epub. Last edited by nhedgehog; 10-31-2020 at 05:07 AM.

10-31-2020, 09:15 AM	#2
Galunid Zealot Posts: 122 Karma: 43580 Join Date: Apr 2016 Device: KPW3, Kobo Clara HD, Onyx Boox Nova 2	There is. After you go to wikipedia page -> Wikipedia full -> Save as EPUB. EDIT: There used to be option to download wiki articles on PC, but I guess it got removed. https://ebooks.stackexchange.com/que...ctions-to-epub Last edited by Galunid; 10-31-2020 at 09:30 AM.

11-05-2020, 04:30 AM	#7
nhedgehog Guru Posts: 800 Karma: 628976 Join Date: Sep 2013 Device: EnergySistemEreaderPro, Nook STG, Pocketbook 622, Bookeen Cybooks ...	Thanks for the link. It is a pity that Mobipocket was bought by Amazon and the Mobi format reduced to the pityful azw thingy. It would have been an alternative to the epub format which isn't really made for big datasets. Last edited by nhedgehog; 11-05-2020 at 02:23 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Aura H2O Font size mismatch (downloaded epubs via Calibre vs. Kobo epubs & articles)	Oolong	Kobo Reader	36	01-25-2019 06:00 AM
kepubify - A standalone tool to convert ePubs into Kobo ePubs	geek1011	Kobo Reader	114	03-04-2018 10:30 AM
Redirection en.wikipedia to es.wikipedia	IndioB	Calibre	4	01-16-2016 10:53 AM
Reference Wikipedia: Wikipedia articals on universe and astronomy, V1.0, 04 May 2013	ghero	ePub Books	10	05-05-2013 04:03 PM
Reference Wikipedia: SOS Children 2006 Wikipedia CD	hn_88	BBeB/LRF Books	0	01-29-2008 12:23 PM

10-31-2020, 12:24 PM	#3
NiLuJe BLAM! Posts: 13,506 Karma: 26047202 Join Date: Jun 2010 Location: Paris, France Device: Kindle 2i, 3g, 4, 5w, PW, PW2, PW5; Kobo H2O, Forma, Elipsa, Sage, C2E	In case that wasn't clear, @Galunid's first § is talking about the in-KOReader Wikipedia lookup option, which does indeed allow you to save the full article as an ePub document . Which is probably what @Frenzie's blog post was referring to .

10-31-2020, 01:51 PM	#4
nhedgehog Guru Posts: 800 Karma: 628976 Join Date: Sep 2013 Device: EnergySistemEreaderPro, Nook STG, Pocketbook 622, Bookeen Cybooks ...	Thank you booth, I wasn't aware of that, since I'm more the offline type.

10-31-2020, 02:09 PM	#5
binaryhermit Grand Sorcerer Posts: 5,732 Karma: 20469902 Join Date: Oct 2014 Location: Lockport, IL Device: Kindle PW4, Kindle Paperwhite Signature Edition	There's a calibre plugin called Wiki Reader that converts wikipedia pages to ebooks, as well.

11-05-2020, 02:10 PM	#8
binaryhermit Grand Sorcerer Posts: 5,732 Karma: 20469902 Join Date: Oct 2014 Location: Lockport, IL Device: Kindle PW4, Kindle Paperwhite Signature Edition	I find the idea that "isn't reallty made for big datasets" doesn't apply to MOBI as well kinda questionable from a (not entirely informed) guess I'm making. I mean, are there even any major eReaders with 60 GB of usable space?

11-05-2020, 02:22 PM	#9
nhedgehog Guru Posts: 800 Karma: 628976 Join Date: Sep 2013 Device: EnergySistemEreaderPro, Nook STG, Pocketbook 622, Bookeen Cybooks ...	Sure, most of the reader which support an external MicroSD.

11-05-2020, 02:41 PM	#10
binaryhermit Grand Sorcerer Posts: 5,732 Karma: 20469902 Join Date: Oct 2014 Location: Lockport, IL Device: Kindle PW4, Kindle Paperwhite Signature Edition	does such an eReader exist from a manufacturer with as much market share as, say, B&N has in the US? (limiting eReader to devices with an eInk screen here) If you include tablets, obviously, there are iPad Pros (iPads Pro?) with 1 TB of storage. Or Android devices with MicroSD slots and/or at least 128 GB of storage. But once you get a less crippled OS with more app support you can have an app with a solution purpose-built for that sort of thing

11-05-2020, 03:39 PM	#11
pazos cosiñeiro Posts: 1,406 Karma: 2451781 Join Date: Apr 2014 Device: BQ Cervantes 4	For big datasets (from a few hundred MB to many GB) zim is the way to go. It can be adapted to KO with minimal effort using libzim. See https://github.com/openzim/zim-tools.../zimsearch.cpp for example.

11-05-2020, 04:42 PM	#12
binaryhermit Grand Sorcerer Posts: 5,732 Karma: 20469902 Join Date: Oct 2014 Location: Lockport, IL Device: Kindle PW4, Kindle Paperwhite Signature Edition	I'm not informed enough to know what exactly the right tool for the job is, but I strongly suspect it's not an eBook format here and is something more like a database solution

11-06-2020, 10:52 AM	#13
Quoth Still reading Posts: 14,025 Karma: 105092227 Join Date: Jun 2017 Location: Ireland Device: All 4 Kinds: epub eink, Kindle, android eink, NxtPaper	Though I find the result is better to copy and paste (often unformatted) into a Wordprocessor and make an epub after editing (docx-> Calibre). But then I might need a few related articles as one ebook, with perhaps stuff from elsewhere.

11-06-2020, 10:58 AM	#14
Quoth Still reading Posts: 14,025 Karma: 105092227 Join Date: Jun 2017 Location: Ireland Device: All 4 Kinds: epub eink, Kindle, android eink, NxtPaper	It doesn't make sense to have ALL of Wikipedia as a single ebook. Also many devices, even some brand new tablets and phones have an SD card limit of 32 G. My tablet does have a 256 G SD card. These are now under £28. However a single ebook makes no sense. Volumes by Subject or Alphabetical with a separate top level Index book with summaries makes more sense. I agree that Amazon should never have been permitted to buy Mobipocket. But Mobi can't manage big stuff any better than epub2 and is a bit inferior. That's why AZW3/KF8 is closer to epub2 than to mobi. The azw1 is pretty much mobi with different DRM?