Help - transfer between PCs

[Bookerblood]

I have amassed a very large ebook library over the years - about 90,000 books - up to 160,000 if you include duplicate formats.

My PC is on its last legs and I'm trying to transfer the library to a new PC. The old one is Windows 7 the new one Windows 10.

After quite a few export errors due to memory out fails, I managed to transfer 253 data files to the new PC. When I try to import I get the error message calibre, version 3.17.0
ERROR: Not valid: The folder E:\Programs\Calibre\Calibre Library is not valid: The exported data in part-0211.calibre-data is not valid, version (1819501834) is higher than maximum supported version. You might need to upgrade calibre first.

Traceback (most recent call last):
File "site-packages\calibre\gui2\dialogs\exim.py", line 257, in select_import_folder
File "site-packages\calibre\utils\exim.py", line 256, in __init__
ValueError: The exported data in part-0211.calibre-data is not valid, version (1819501834) is higher than maximum supported version. You might need to upgrade calibre first.

Both PCs have 3.17.0.

Can anybody help? I'm starting to cry.

Thanks

Booker

[chaley]

Moderator Notice
I think you meant to post this in the calibre forum instead of the calibre companion forum. I will move it.

[kovidgoyal]

Out of memory errors can typically be remedies by using a 64bit version, or you can simply copy over the library folder, as described in the note here: https://manual.calibre-ebook.com/faq...ter-to-another

[Divingduck]

This usually happen when your system is blocking access.

E:\Programs\Calibre\Calibre Library is not valid:

You really should not copy a library into Windows PROGRAM directory. User data should copy in a user directory.

If you want make a manual copy, copy the complete directory including all sub directories and files in your user directory (this is something like c:\users\YOUR_USERNAME\... at your new PC. Take care to copy your calibre preference directory too to the correct place (usually c:\Users\YOUR_USERNAME\AppData\Roaming\calibre\

You will find all information's regarding backup in calibre's manual: https://manual.calibre-ebook.com/faq...backup-calibre


Edit: had't update the window and not seen Kovid already gave you a answer

[dwig]

Originally Posted by Bookerblood

...
My PC is on its last legs and I'm trying to transfer the library to a new PC. ...

EXACTLY how?

In times past, I've encountered issues when copying things like the calibre library across a network. The issue is not with calibre, but with the network, primarily the drivers for the network interfaces/cards in one or both of the machines. Copying a massive number of small files creates additional network traffic and that can expose flaws in the drivers' use of buffers and caches. Files would get lost, transfer would get interupted, and/or files would get corrupted.

My old "fix" for this was to create a single ZIP file containing the complete folder tree of the collection of small files (e.g. calibre library, large collection of small JPEGs, ...) and then transfer that ZIP over the network, unZIPing it on the target machine after the transfer completes. I still do this for some things since the ZIPping and unZIPping on modern machines is efficient and the network transfer of one thousand 1mb files takes substantially longer than transferring a single 1gb file.

[Bookerblood]

Thanks for the replies but to clarify I followed the export process instructions.

The last time I tried I didn't get an out of memory error, and I ended with 253 data files in the newly created folder. This folder was then copied to the new PC (via an external hard drive)and the import previously exported data clicked and pointed to the newly created folder containing the transferred data files. This produced the error message about the latest version of Calibre (which I have).

When an export completes correctly does this produce "data files" or does that suggest has the export has not completed correctly?

I'm not very techie but I've spent untold man hours creating and tidying up the library over the last seven years or so. I don't really want to have to add all the individual books and merge and edit them again.

Thanks

Booker

[Bookerblood]

Please see my message posted lower down in this thread.

[theducks]

Originally Posted by Bookerblood

Thanks for the replies but to clarify I followed the export process instructions.

The last time I tried I didn't get an out of memory error, and I ended with 253 data files in the newly created folder. This folder was then copied to the new PC (via an external hard drive)and the import previously exported data clicked and pointed to the newly created folder containing the transferred data files. This produced the error message about the latest version of Calibre (which I have).

When an export completes correctly does this produce "data files" or does that suggest has the export has not completed correctly?

I'm not very techie but I've spent untold man hours creating and tidying up the library over the last seven years or so. I don't really want to have to add all the individual books and merge and edit them again.

Thanks

Booker

you have 253 'part' files
What size (count) was the old Library? Are these mostly Manga or other image rich documents?

(FWIW I back up 4 text Libraries (w/covers) and only get 16 'part' files )

[Bookerblood]

Hi theducks,

It's a big library - close on 90,000 entries on Calibre - but with most titles having duplicate formats closer to 160,000 books and of course all had been correctly added / edited so had cover images and supporting " blurb" text. The size of the library folder is about 253GB.

[theducks]

Originally Posted by Bookerblood

Hi theducks,

It's a big library - close on 90,000 entries on Calibre - but with most titles having duplicate formats closer to 160,000 books and of course all had been correctly added / edited so had cover images and supporting " blurb" text. The size of the library folder is about 253GB.

Well, that explains it.

Personally, I would get a USB <> drive cable (or cabinet) and just pop out the old drive, then use the cable to copy to your new PC (drive)
<and prepare to WAIT, 253 G >

[Adoby]

* Make sure you run the latest 64-bit Calibre on the new machine.
* Create a new test library with one or two books on the old machine.
* Migrate the test library and check that every thing works correctly and you can access the test library.
* Make sure you use reasonable paths. With that many books I would think that shallow paths could be important. Make sure the Calibre library is located in a sub folder in the root folder of the HDD and not among any program folders.
* Migrate the main Calibre library like you did the test library. You can for instance restore a backup of the old library on the new computer, using an external HDD.
* Make sure you can access the library correctly on the new computer.
* Run "Check library" and fix any problems.

You can also simply remove the old HDD and attach it (possibly using an USB3 HDD dock) to the new PC and copy over the files. Keep the old HDD as backup.

Then consider splitting your library in several parts. For instance periodicals, fiction, nonfiction, garbage, new. Make sure that everything not in the garbage or new libraries is pristine without any duplicates and with perfect meta data and covers and is fully readable without any further fixes, conversions or editing.

Optional: Seek help for your hoarding disorder.

[dwig]

Originally Posted by theducks

Well, that explains it.

Personally, I would get a USB <> drive cable (or cabinet) and just pop out the old drive, then use the cable to copy to your new PC (drive)
<and prepare to WAIT, 253 G >

+1.

Alternately, get a new external drive to use:
1.Copy library and config files from the old machine to the new external drive
2.Install calibre on the new machine and quit calibre (all components).
3.Connect external drive to new machine
4. Copy library and config files to new machine letting the copied files replace those created by the new machine's calibre installation.

Once you've verified the transfer went properly, the new external drive can be reused as a backup drive, which you of course need to have.

[BetterRed]

BR

[Bookerblood]

p.s just feel I need to say, after a night out, that the 90,000 books have been carefully curated and I'd read (lifetimes permitting) 95% of them. In other words for each of the 90,000 another 10/20 possible additions have been binned.

Thanks for the suggestions - shall try and try them tomorrow.

[Bookerblood]

Thanks, Guys - I shall try what is suggested. I understand the Library file. Are the configuration files all the folders and applications within the program files?