gutenberg?

jlutes · 08-14-2011, 05:18 PM

Would anyone be interested in the majority of the Gutenberg collection loaded in a Calibre library? If so, would you have suggestions on distribution? I'm considering torrent but if someone else has a better idea...

havant · 08-14-2011, 07:15 PM

I would be interested but I have no idea as to how it could be distributed.

theducks · 08-14-2011, 09:01 PM

I see a couple of issues

What (book) format will your 'repackaged' Gutenberg be in?
Does your Library contain improved metadata, covers, books layout?
There are many former PG books that have been lovingly polished by loyal MR members in the MR Uploads section

jlutes · 08-14-2011, 11:29 PM

Perhaps it's just waaay to late at night but I have no idea what you said theducks! "former PG books"? "loyal MR members"? "MR uploads section"?

My repackaged Gutenberg sits at at 25,693 books in either txt or epub format. It appears txt is slightly smaller than epub so I left ,those as-is. All of the pdf and rtf are converted to epub.
As for metadata, there isn't a huge amount. Title, author, and the ebook number assigned by Gutenberg in the ID. There are also a number of duplicate titles because they are filed under different ebook numbers. Find Duplicates sees 731 titles but I'm still doing some polishing.
The primary reason I am offering it is it took over 4 days of downloading following their robot rules (1 download per 2 seconds) and it contained a lot of misc...and I mean a LOT of misc. They are now, contrary to the description on their website, including audio books compressed in the stream so there is no way to filter them before download. All of the scanned books, audio books, etc. were removed which cut the total size down considerably.

PeterT · 08-14-2011, 11:41 PM

Former PG books --> Books that came from Gutenburg
MR Uploads Sections --> Check out the eBooks link at the top or https://www.mobileread.com/forums/ebo...&sort=dateline

theducks · 08-15-2011, 11:32 AM

Quote:

Originally Posted by PeterT

Former PG books --> Books that came from Gutenburg
MR Uploads Sections --> Check out the eBooks link at the top or https://www.mobileread.com/forums/ebo...&sort=dateline

ficbot · 08-15-2011, 02:35 PM

If it had nice covers and good tagging and full summaries, then I would be interested. If it's just a bulk download, no. I can just download the books I want from Gutenberg myself. Yours doesn't sound 'cleaned up' enough to be of interest to me personally.

maartencoertjens · 08-20-2011, 11:22 AM

I would be very interested. I had the DVD torrent downloaded but calibre made them all into books with only the number as title. I.e. not very useful.
So if you upload on torrent, I'll be happy to seed it for a long time

jlutes · 08-20-2011, 08:49 PM

The torrent should be active.
Even with max compression, it's still over 3gb. Yes, the Gutenberg file naming system leaves a lot to be desired.

http://dl.btjunkie.org/torrent/Guten...wnload.torrent

maartencoertjens · 08-22-2011, 10:49 AM

Thanks! Am downloading it but doesn't go faster than 25k/s. So don't switch your comp off too soon

Will seed endlessly!

jlutes · 08-22-2011, 03:53 PM

I added a second seed machine on a different network. Someone was getting up to 200kbps through it so hopefully download speeds should be increased.

maartencoertjens · 08-23-2011, 09:01 PM

Thanks! It works and is a lot better than the gutenberg DVD.
Just a question, there didn't seem to be metadata.db file in the rar so I had to add all books to a new library. Which took a couple of hours

Would it not be easier to add the metadata file so that calibre can immediately open it?

PeterT · 08-23-2011, 10:16 PM

What I have seen done for other eBook collections is a full RAR or ZIP of the entire Library directory structure; this way one can have an entire extra library of just that material, and only copy (via Calibre) the distinct books you do want in your main library.

DoctorOhh · 08-23-2011, 10:28 PM

Quote:

Originally Posted by maartencoertjens

Quote:

Originally Posted by jlutes

The torrent should be active.
Even with max compression, it's still over 3gb. Yes, the Gutenberg file naming system leaves a lot to be desired.

http://dl.btjunkie.org/torrent/Guten...wnload.torrent

Thanks! It works and is a lot better than the gutenberg DVD.
Just a question, there didn't seem to be metadata.db file in the rar so I had to add all books to a new library. Which took a couple of hours

Would it not be easier to add the metadata file so that calibre can immediately open it?

I agree, you can't call it the Gutenberg Calibre Library if it doesn't have the metadata.db file. Without that file it isn't a calibre library.

theducks · 08-23-2011, 10:32 PM

Quote:

Originally Posted by maartencoertjens

Thanks! It works and is a lot better than the gutenberg DVD.
Just a question, there didn't seem to be metadata.db file in the rar so I had to add all books to a new library. Which took a couple of hours

Would it not be easier to add the metadata file so that calibre can immediately open it?

You can't leave metadata.db (and the matching books) on read only media and open it.

Calibre expects to be able to write to the DB.

08-14-2011, 05:18 PM	#1
jlutes Connoisseur Posts: 52 Karma: 12 Join Date: Jul 2011 Device: none	gutenberg? Would anyone be interested in the majority of the Gutenberg collection loaded in a Calibre library? If so, would you have suggestions on distribution? I'm considering torrent but if someone else has a better idea...

08-14-2011, 07:15 PM	#2
havant Junior Member Posts: 9 Karma: 10 Join Date: Feb 2009 Location: La Crescenta, Calif Device: Sony PRS-505, Kindle 3, Paper White	I'm interested I would be interested but I have no idea as to how it could be distributed.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Where is Gutenberg	reb1	News	5	01-22-2011 07:14 PM
Gutenberg CD	reymund	Lounge	3	03-30-2010 05:30 AM
Gutenberg	scpo	Reading and Management	8	02-08-2009 08:41 AM
gutenberg.com is not gutenberg.org	ProDigit	News	2	11-21-2008 12:39 PM
Gutenberg and Epub	charlieperry	ePub	11	08-03-2008 10:24 PM

08-14-2011, 09:01 PM	#3
theducks Well trained by Cats Posts: 29,804 Karma: 54830978 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	I see a couple of issues What (book) format will your 'repackaged' Gutenberg be in? Does your Library contain improved metadata, covers, books layout? There are many former PG books that have been lovingly polished by loyal MR members in the MR Uploads section

08-14-2011, 11:29 PM	#4
jlutes Connoisseur Posts: 52 Karma: 12 Join Date: Jul 2011 Device: none	Perhaps it's just waaay to late at night but I have no idea what you said theducks! "former PG books"? "loyal MR members"? "MR uploads section"? My repackaged Gutenberg sits at at 25,693 books in either txt or epub format. It appears txt is slightly smaller than epub so I left ,those as-is. All of the pdf and rtf are converted to epub. As for metadata, there isn't a huge amount. Title, author, and the ebook number assigned by Gutenberg in the ID. There are also a number of duplicate titles because they are filed under different ebook numbers. Find Duplicates sees 731 titles but I'm still doing some polishing. The primary reason I am offering it is it took over 4 days of downloading following their robot rules (1 download per 2 seconds) and it contained a lot of misc...and I mean a LOT of misc. They are now, contrary to the description on their website, including audio books compressed in the stream so there is no way to filter them before download. All of the scanned books, audio books, etc. were removed which cut the total size down considerably.

08-14-2011, 11:41 PM	#5
PeterT Grand Sorcerer Posts: 12,167 Karma: 73448616 Join Date: Nov 2007 Location: Toronto Device: Nexus 7, Clara, Touch, Tolino EPOS	Former PG books --> Books that came from Gutenburg MR Uploads Sections --> Check out the eBooks link at the top or https://www.mobileread.com/forums/ebo...&sort=dateline

08-15-2011, 02:35 PM	#7
ficbot Wizard Posts: 2,409 Karma: 4132096 Join Date: Sep 2008 Device: Kindle Paperwhite/iOS Kindle App	If it had nice covers and good tagging and full summaries, then I would be interested. If it's just a bulk download, no. I can just download the books I want from Gutenberg myself. Yours doesn't sound 'cleaned up' enough to be of interest to me personally.

08-20-2011, 11:22 AM	#8
maartencoertjens Member Posts: 10 Karma: 10 Join Date: Aug 2011 Device: Kindle	I would be very interested. I had the DVD torrent downloaded but calibre made them all into books with only the number as title. I.e. not very useful. So if you upload on torrent, I'll be happy to seed it for a long time

08-20-2011, 08:49 PM	#9
jlutes Connoisseur Posts: 52 Karma: 12 Join Date: Jul 2011 Device: none	The torrent should be active. Even with max compression, it's still over 3gb. Yes, the Gutenberg file naming system leaves a lot to be desired. http://dl.btjunkie.org/torrent/Guten...wnload.torrent

08-22-2011, 10:49 AM	#10
maartencoertjens Member Posts: 10 Karma: 10 Join Date: Aug 2011 Device: Kindle	Thanks! Am downloading it but doesn't go faster than 25k/s. So don't switch your comp off too soon Will seed endlessly!

08-22-2011, 03:53 PM	#11
jlutes Connoisseur Posts: 52 Karma: 12 Join Date: Jul 2011 Device: none	I added a second seed machine on a different network. Someone was getting up to 200kbps through it so hopefully download speeds should be increased.

08-23-2011, 09:01 PM	#12
maartencoertjens Member Posts: 10 Karma: 10 Join Date: Aug 2011 Device: Kindle	Thanks! It works and is a lot better than the gutenberg DVD. Just a question, there didn't seem to be metadata.db file in the rar so I had to add all books to a new library. Which took a couple of hours Would it not be easier to add the metadata file so that calibre can immediately open it?

08-23-2011, 10:16 PM	#13
PeterT Grand Sorcerer Posts: 12,167 Karma: 73448616 Join Date: Nov 2007 Location: Toronto Device: Nexus 7, Clara, Touch, Tolino EPOS	What I have seen done for other eBook collections is a full RAR or ZIP of the entire Library directory structure; this way one can have an entire extra library of just that material, and only copy (via Calibre) the distinct books you do want in your main library.

Advert

Advert