Calibre import library on Raspberry Pi

[Runnerbeen]

Originally Posted by chaley

As long as you still have your library on your Mac, trying things on your Pi can't mess things up beyond repair. If something you try doesn't work to your satisfaction then try something else. You can always get a clean copy of the library and start over.

Things become iffy only once you start actually using the Pi to change things, in which case the Mac and the Pi are no longer in sync.

Thanks for the reassurance. I'm going to set up the Pi Calibre library from scratch and see how I get on. Thank you.

[mbovenka]

Originally Posted by Runnerbeen

Thanks for the reassurance. I'm going to set up the Pi Calibre library from scratch and see how I get on. Thank you.

You can import from a Calibre library by using 'Add books -> Add books from folders and sub-folders -> All files in directory are different versions of the same book' (I'm not 100% sure of the wording of the last bit). That will also read the metadata from the existing OPF files.

[Wiggo]

Originally Posted by Runnerbeen

Will let you know. I’m a bit nervous about it as I don’t want to mess it up! My ultimate aim is to get Calibre web on there. I’ll keep you posted.

I once had Calibre-Web in Docker on my NAS. The Calibre library for this was a copy that was always kept in sync from PC to NAS (one way) - no problems at all.

[Runnerbeen]

Originally Posted by mbovenka

You can import from a Calibre library by using 'Add books -> Add books from folders and sub-folders -> All files in directory are different versions of the same book' (I'm not 100% sure of the wording of the last bit). That will also read the metadata from the existing OPF files.

Thanks I've tried this but a lot of the books are failing to convert and I'm receiving messages like the below:
File "calibre/ebooks/metadata/epub.py", line 181, in get_zip_reader
File "calibre/utils/zipfile.py", line 774, in __init__
File "calibre/utils/zipfile.py", line 809, in _GetContents
File "calibre/utils/zipfile.py", line 824, in _RealGetContents
calibre.utils.zipfile.BadZipfile: File is not a zip file

I'm not trying to add a zip file so I'm not sure what it means. Any halp gratefully received. Thank you.

[Quoth]

I have Calibre on a Linux (not the Rasparian) on a 2G RAM Pi4. I have copied the library from my x86-64 Linux Mint. But I forget if I used Export & Import (reliable) or simply copied, or Add books. Single 512 G byte micro SD card. A 2.5K / QHD USB-C powered display that looks like a tablet. It does work with video and power from laptop, but on Pi I use the HDMI ports. I have 2 x 3A USB-C adaptors that run off 12V (nominal) or 2x mains PSUs or 2x power banks. The USB power adaptors are on a portable 14V 24 Ah LiFePO4 solar charged power pack. The solar panels fit in car boot.

About 8500 ebooks, most PD. There should be NO CONVERSION, if you are added ebooks from an existing Calibre Library, no matter which method is used.


I installed Calibre from the official Web site and made sure the same version as I'm running on the source library.

I don't actually use it for Calibre, it was just to make sure it worked.

[chaley]

Originally Posted by Runnerbeen

Thanks I've tried this but a lot of the books are failing to convert and I'm receiving messages like the below:
File "calibre/ebooks/metadata/epub.py", line 181, in get_zip_reader
File "calibre/utils/zipfile.py", line 774, in __init__
File "calibre/utils/zipfile.py", line 809, in _GetContents
File "calibre/utils/zipfile.py", line 824, in _RealGetContents
calibre.utils.zipfile.BadZipfile: File is not a zip file

I'm not trying to add a zip file so I'm not sure what it means. Any halp gratefully received. Thank you.

I'm starting to think that the memory in your Pi is broken. You got corrupted export files and now you are getting corrupted epub files (which are really zip files). Are you using a high-quality memory card in the Pi?

[Runnerbeen]

Originally Posted by chaley

I'm starting to think that the memory in your Pi is broken. You got corrupted export files and now you are getting corrupted epub files (which are really zip files). Are you using a high-quality memory card in the Pi?

I think so - it's a Sandisk Ultra 256GB. Do you know how I could check if this is the case please? Thank you.

[chaley]

Originally Posted by Runnerbeen

I think so - it's a Sandisk Ultra 256GB. Do you know how I could check if this is the case please? Thank you.

The only thing I can suggest is to look for memory test software that can run on a Pi.

[PeterT]

Originally Posted by chaley

The only thing I can suggest is to look for memory test software that can run on a Pi.

Any possibility that a full file system could cause these issues?

[DNSB]

Originally Posted by Runnerbeen

Thanks I've tried this but a lot of the books are failing to convert and I'm receiving messages like the below:
File "calibre/ebooks/metadata/epub.py", line 181, in get_zip_reader
File "calibre/utils/zipfile.py", line 774, in __init__
File "calibre/utils/zipfile.py", line 809, in _GetContents
File "calibre/utils/zipfile.py", line 824, in _RealGetContents
calibre.utils.zipfile.BadZipfile: File is not a zip file

I'm not trying to add a zip file so I'm not sure what it means. Any halp gratefully received. Thank you.

An ePub file is a .zip file. This seems to indicate that you have corrupted files.

[DNSB]

Originally Posted by Runnerbeen

I think so - it's a Sandisk Ultra 256GB. Do you know how I could check if this is the case please? Thank you.

It's quite possible that what you have is not a SanDisk Ultra 256GB. Even reputable sources have been burned by counterfeiters. At one time, I had an issues with a µSD card purchased from Best Buy. After using it for a while, I started getting masses of errors. When I ran H2TestW (for a Mac, you could use F3 instead) on it, the result showed multiple errors. Basically, I had a slower 64GB µSD card instead of the 256GB card I had purchased and as soon as I used the 64GB, my data started to get overwritten.

[Runnerbeen]

Thanks to everyone for their suggestions. I've ended up recreating the library from scratch. The memory card seems ok so I'm not sure what the issue was. Some awz files were showing as 0mb as were some epubs and cbzs. There didn't seem to be any rhyme or reason to which books were transferring ok and which weren't. Thanks all.

[Runnerbeen]

Originally Posted by Wiggo

I once had Calibre-Web in Docker on my NAS. The Calibre library for this was a copy that was always kept in sync from PC to NAS (one way) - no problems at all.

Well it seems to be running pretty well so far, fingers crossed. In the end I decided to keep my main library on my Mac and am mirroring it to my Pi on which I’m running Calibre Web Automated.

I did have a play at using the Pi for the main Calibre library and it was pretty smooth. It did freeze a couple of times but otherwise I’d be happy to use it as my main repository.