Verifying all books in library

VelvetElvis · 12-17-2018, 04:09 PM

Had a hard drive start developing bad clusters, which didn't give me a lot of warning. As a result, my backup (and original library) contain some bad/unreadable epubs. I think I caught most of them, but more may be lurking.

The "Check Library" Calibre function doesn't indicate any issues, as I'm sure this issue is not within its purvue.

Is there any way to bulk validate that all the books in my library are readable/able to be opened? Downloaded Pagina epub Checker, but it only works on individual files. It's a large library, so checking them one at a time would be a nightmare I'd like to avoid.

TIA.

davidfor · 12-17-2018, 07:17 PM

You could do a conversion of all the books. That opens each book and should give an error if the files are corrupt. Polish books, Embed Metadata and the Modify ePub plugin might also work depending on the format. Or for epubs, as they are just zip files, using a zip validator should also work

VelvetElvis · 12-17-2018, 11:56 PM

Quote:

Originally Posted by davidfor

You could do a conversion of all the books. That opens each book and should give an error if the files are corrupt. Polish books, Embed Metadata and the Modify ePub plugin might also work depending on the format. Or for epubs, as they are just zip files, using a zip validator should also work

Converting is out of the question, but the zip validation sounds promising. I just need to find a way to implement it.
Thanks for the ideas. :-)

mbovenka · 12-18-2018, 10:00 AM

I use a side effect of the 'Count Pages' plugin for this. If the ebook file is corrupt in some way (I include DRM-infected in this

) it won't be able to compute a value for it.

Still not very fast, but faster than a conversion.

ilovejedd · 12-18-2018, 10:52 AM

Assuming you're on Windows and they're all epub (basically zip) files, what I'd do is:

find all epub using Windows Explorer
select all (Ctrl+A) then right click
7-Zip -> Test archive

Obviously, 7-Zip needs to be installed and Test archive needs to be added to the context menu.

On Linux, I'm sure there's some way to do something similar natively via shell script. Dunno about Mac.

VelvetElvis · 12-18-2018, 01:00 PM

Quote:

Originally Posted by ilovejedd

Assuming you're on Windows and they're all epub (basically zip) files, what I'd do is:

find all epub using Windows Explorer
select all (Ctrl+A) then right click
7-Zip -> Test archive

Obviously, 7-Zip needs to be installed and Test archive needs to be added to the context menu.

On Linux, I'm sure there's some way to do something similar natively via shell script. Dunno about Mac.

Bingo!
Had WinRAR installed, but despite having the "Test Archive" context menu item, it wouldn't appear with epubs. 7-Zip however did the trick. Thank you.

Thanks too, to Davidfor and mbovenka for some great suggestions!

BetterRed · 12-18-2018, 04:09 PM

Quote:

Originally Posted by VelvetElvis

Bingo!
Had WinRAR installed, but despite having the "Test Archive" context menu item, it wouldn't appear with epubs. 7-Zip however did the trick. Thank you.

Thanks too, to Davidfor and mbovenka for some great suggestions!

FTR - to get WinRAR to process EPUBs or any other re-typed archive (e.g. DOCX, CBZ, CBR etc) you need to put it in the User defined archive extensions list at the bottom of the Integration settings.

BR

VelvetElvis · 12-18-2018, 05:30 PM

Quote:

Originally Posted by BetterRed

FTR - to get WinRAR to process EPUBs or any other re-typed archive (e.g. DOCX, CBZ, CBR etc) you need to put it in the User defined archive extensions list at the bottom of the Integration settings.

BR

Ah nuts. I had set it in the "Viewer" tab.
Thank you for the heads up.

12-17-2018, 04:09 PM	#1
VelvetElvis Addict Posts: 259 Karma: 20028 Join Date: Jan 2011 Location: Canada Device: Fire HD8, Asus, Sony (T1, PRS-300), Kobo (Glo, Touch, Wireless)	Verifying all books in library Had a hard drive start developing bad clusters, which didn't give me a lot of warning. As a result, my backup (and original library) contain some bad/unreadable epubs. I think I caught most of them, but more may be lurking. The "Check Library" Calibre function doesn't indicate any issues, as I'm sure this issue is not within its purvue. Is there any way to bulk validate that all the books in my library are readable/able to be opened? Downloaded Pagina epub Checker, but it only works on individual files. It's a large library, so checking them one at a time would be a nightmare I'd like to avoid. TIA.

12-18-2018, 10:52 AM	#5
ilovejedd hopeless n00b Posts: 5,126 Karma: 19597086 Join Date: Jan 2009 Location: in the middle of nowhere Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9	Assuming you're on Windows and they're all epub (basically zip) files, what I'd do is: find all epub using Windows Explorer select all (Ctrl+A) then right click 7-Zip -> Test archive Obviously, 7-Zip needs to be installed and Test archive needs to be added to the context menu. On Linux, I'm sure there's some way to do something similar natively via shell script. Dunno about Mac. Attached Thumbnails

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Just verifying lack of options... And other questions	Naloomi	Amazon Kindle	48	08-13-2015 04:26 PM
Verifying Calibre - Identity of Developer not recognized	chilady1	Calibre	2	09-19-2014 07:54 PM
Verifying Document/Fragment Identifier	Schlutek	ePub	6	09-09-2011 02:22 PM
verifying html	JaneFancher	ePub	23	08-30-2010 11:02 PM
How to direct Library books to Calibre instead of Sony Reader Library	onebookie	Calibre	3	07-19-2010 12:31 PM

12-17-2018, 07:17 PM	#2
davidfor Grand Sorcerer Posts: 24,905 Karma: 47303824 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	You could do a conversion of all the books. That opens each book and should give an error if the files are corrupt. Polish books, Embed Metadata and the Modify ePub plugin might also work depending on the format. Or for epubs, as they are just zip files, using a zip validator should also work

12-18-2018, 10:00 AM	#4
mbovenka Wizard Posts: 2,086 Karma: 14079267 Join Date: Oct 2007 Location: Almere, The Netherlands Device: Kobo Sage	I use a side effect of the 'Count Pages' plugin for this. If the ebook file is corrupt in some way (I include DRM-infected in this ) it won't be able to compute a value for it. Still not very fast, but faster than a conversion.