Diff two libraries?

drawson1 · 03-12-2023, 08:37 AM

Is there any built-in way to diff two libraries? I can obviously use the standard diff tools to compare the file structures ...

Thanks!

Dan

ownedbycats · 03-12-2023, 09:07 AM

This may be of some use.
https://www.mobileread.com/forums/sh...d.php?t=265947

theducks · 03-12-2023, 12:49 PM

If you are just interested in: Is it in the other Library .
Find Duplicates (plugin):Find Library Duplicates

The log show what if found (format)
My main Library has Empty Books. FD reports the entry with [No Formats], which is expected

drawson1 · 03-14-2023, 10:24 AM

Ahh, thanks! These both look like they'll help . . .

What prompted this was trying to figure out "Two computers and two readers" sync.

Normally I manage my library on my desktop with a single Calibre library and a single (Kobo) reader. But when I'm on a road trip (which sometimes extends to months), I'd like to have the library on my laptop, and still be able to add books to THAT library while I'm on the road, then figure out what to sync back to the desktop when I return home . . . .

And to complicate this, I sometimes read on my tablet when I'm on the road :-) But that's easy enough because Calibre will sync with both devices.

mbovenka · 03-14-2023, 10:40 AM

Quote:

Originally Posted by drawson1

Normally I manage my library on my desktop with a single Calibre library and a single (Kobo) reader. But when I'm on a road trip (which sometimes extends to months), I'd like to have the library on my laptop, and still be able to add books to THAT library while I'm on the road, then figure out what to sync back to the desktop when I return home

That sounds like a job for a directory compare tool like FreeFileSync, Synctoy or the like. If you have added/deleted books in the copy of the library you have on your laptop, you'd need to run a 'mirror' copy from the library on the laptop to your base library to make them identical.

theducks · 03-14-2023, 10:55 AM

Quote:

Originally Posted by mbovenka

That sounds like a job for a directory compare tool like FreeFileSync, Synctoy or the like. If you have added/deleted books in the copy of the library you have on your laptop, you'd need to run a 'mirror' copy from the library on the laptop to your base library to make them identical.

Caution: The FFS method should only be considered if you can 100%:
1) No activity (ZERO USE) on the desktop (master).

2) Only 1 remote will be Mirroring (the updates).

Remember a DB entry may not change the book files (it should update a metadata.opf, but there is no way to use just that for a single book)

You get this wrong and you can have a real mess.

If you read on any remote device while away. Update the away master (laptop) first

drawson1 · 03-14-2023, 04:08 PM

I sort of thought that a straight file sync was a good choice ...

Actually I'd probably do the sync with rsync (since I have it on all the relevant machines and OS's) . . . . but I'm not entirely clear on which files (if any) should be excluded from the rsync.

Under the most common circumstances, I'm the ONLY one who uses the desktop, so there would be not updates to the desktop when I'm on the road - all the updates would happen on the laptop. So in theory:

Do my thing on the desktop
Shut down calibre on the desktop
rsync to the laptop
Road Trip!
Add / delete as needed on the road
Shut down calibre on the laptop
rsync to the desktop, including the --delete flag

In this type of scenario, do I need specifically include (or exclude!) metadata.db? Any other files? Backup/restore the database? Note that my rsync test scripting is already set up to abort if calibre is running on either machine.

It's really a "best practices" question for making the road-trip as painless as possible :-)

Thanks!

Dan

theducks · 03-14-2023, 04:25 PM

The issue is Metadata .db MUST MATCH the set of files.
Add a book, change metadata, delete a book ALL affect metadata.db (and the books folder)
Why not take the Calibre Library drive with you? (leave a backup at home)
Or just run as Portable Calibre?

(rotating)Drives with decent speed fit in a pocket. IMHO a flash drive is too slow.

drawson1 · 03-15-2023, 06:48 AM

Well . . . . the desktop is running Linux so portable Calibre isn't an option AFAIK (and the drive is an internal 3.5").

It sounds like the sequence I proposed will technically work (and I need to include metadata.db in any rsync process), but I need to be VERY careful about the sync. In particular, I need to ensure that there are no changes on the desktop while I'm on a road trip or I'm going to be doing manual updates for every book that changed

In the end, I'm letting rsync answer my original question about how to diff the libraries - doing it at the file level.

theducks · 03-15-2023, 10:23 AM

Why not make a 'roady', second library on your laptop for the additions?
The 'Main' is just a straight copy.

Simply use the built in Copy to Library: <realMain> delete after copy
Switching between Libraries is fast

JSWolf · 03-15-2023, 01:02 PM

IMHO, the best program for syncing is FreeFileSync.

03-12-2023, 08:37 AM	#1
drawson1 Connoisseur Posts: 96 Karma: 10 Join Date: Mar 2014 Device: Libra H20, Clara 2E	Diff two libraries? Is there any built-in way to diff two libraries? I can obviously use the standard diff tools to compare the file structures ... Thanks! Dan

03-14-2023, 04:08 PM	#7
drawson1 Connoisseur Posts: 96 Karma: 10 Join Date: Mar 2014 Device: Libra H20, Clara 2E	I sort of thought that a straight file sync was a good choice ... Actually I'd probably do the sync with rsync (since I have it on all the relevant machines and OS's) . . . . but I'm not entirely clear on which files (if any) should be excluded from the rsync. Under the most common circumstances, I'm the ONLY one who uses the desktop, so there would be not updates to the desktop when I'm on the road - all the updates would happen on the laptop. So in theory: Do my thing on the desktop Shut down calibre on the desktop rsync to the laptop Road Trip! Add / delete as needed on the road Shut down calibre on the laptop rsync to the desktop, including the --delete flag In this type of scenario, do I need specifically include (or exclude!) metadata.db? Any other files? Backup/restore the database? Note that my rsync test scripting is already set up to abort if calibre is running on either machine. It's really a "best practices" question for making the road-trip as painless as possible :-) Thanks! Dan

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Epub v Sony format, whats the diff?	Cyclops	General Discussions	11	09-04-2010 10:15 AM
JetBook or Libre... what's the Practical Diff Anyway?	cancelx	Ectaco jetBook	35	03-07-2010 02:52 PM
Device List Diff View	gatapia	Calibre	0	11-09-2009 04:13 AM
Diff in Discontinued and New M-Edge Cover?	rjfarrell	Sony Reader	19	10-13-2009 10:29 PM
Which Diff/Merge/Patch/Updater tool?	pdurrant	Kindle Formats	10	12-17-2008 08:38 PM

03-12-2023, 09:07 AM	#2
ownedbycats Custom User Title Posts: 10,927 Karma: 74801041 Join Date: Oct 2018 Location: Canada Device: Kobo Libra H2O, formerly Aura HD	This may be of some use. https://www.mobileread.com/forums/sh...d.php?t=265947

03-12-2023, 12:49 PM	#3
theducks Well trained by Cats Posts: 31,021 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	If you are just interested in: Is it in the other Library . Find Duplicates (plugin):Find Library Duplicates The log show what if found (format) My main Library has Empty Books. FD reports the entry with [No Formats], which is expected

03-14-2023, 10:24 AM	#4
drawson1 Connoisseur Posts: 96 Karma: 10 Join Date: Mar 2014 Device: Libra H20, Clara 2E	Ahh, thanks! These both look like they'll help . . . What prompted this was trying to figure out "Two computers and two readers" sync. Normally I manage my library on my desktop with a single Calibre library and a single (Kobo) reader. But when I'm on a road trip (which sometimes extends to months), I'd like to have the library on my laptop, and still be able to add books to THAT library while I'm on the road, then figure out what to sync back to the desktop when I return home . . . . And to complicate this, I sometimes read on my tablet when I'm on the road :-) But that's easy enough because Calibre will sync with both devices.

03-14-2023, 04:25 PM	#8
theducks Well trained by Cats Posts: 31,021 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	The issue is Metadata .db MUST MATCH the set of files. Add a book, change metadata, delete a book ALL affect metadata.db (and the books folder) Why not take the Calibre Library drive with you? (leave a backup at home) Or just run as Portable Calibre? (rotating)Drives with decent speed fit in a pocket. IMHO a flash drive is too slow.

03-15-2023, 06:48 AM	#9
drawson1 Connoisseur Posts: 96 Karma: 10 Join Date: Mar 2014 Device: Libra H20, Clara 2E	Well . . . . the desktop is running Linux so portable Calibre isn't an option AFAIK (and the drive is an internal 3.5"). It sounds like the sequence I proposed will technically work (and I need to include metadata.db in any rsync process), but I need to be VERY careful about the sync. In particular, I need to ensure that there are no changes on the desktop while I'm on a road trip or I'm going to be doing manual updates for every book that changed In the end, I'm letting rsync answer my original question about how to diff the libraries - doing it at the file level.

03-15-2023, 10:23 AM	#10
theducks Well trained by Cats Posts: 31,021 Karma: 60358908 Join Date: Aug 2009 Location: The Central Coast of California Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A	Why not make a 'roady', second library on your laptop for the additions? The 'Main' is just a straight copy. Simply use the built in Copy to Library: <realMain> delete after copy Switching between Libraries is fast

03-15-2023, 01:02 PM	#11
JSWolf Resident Curmudgeon Posts: 79,670 Karma: 145864619 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	IMHO, the best program for syncing is FreeFileSync.

Advert

Advert