Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 05-07-2024, 12:44 PM   #31
haertig
Wizard
haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.
 
Posts: 1,758
Karma: 26012554
Join Date: Sep 2017
Device: PW3, Fire HD8 Gen7, Moto G7, Sansa Clip v2, Ruizu X26
Quote:
Originally Posted by Cactus Chef View Post
Otherwise, I probably need to do one more rsync and turn off --ignore-existing just to make sure I'm truly getting everything. If I'm remembering my rsync-fu, even if it flags my entire library as needing to copy, it should basically skip the files and transfer 0/0 bytes on each one when it determines that the hashes between the source and destination of each EPUB are the same, right?
I don't know about rsync ports to other OS'es, but from the Linux perspective, by default rsync selects which files to copy based on a changed timestamp or a changed file size. Related to this, I can envision potential issues determining what needs to be copied or not if you are rsync'ing from one OS to a different OS that doesn't manage timestamps in the same manner. Or if using CIFS or Samba or something like that. Rsync does not automatically use a hash of file contents to determine if a copy is required or not - you have to tell it that is what you want it to do with the --checksum option.

You definitely want to turn off --ignore-existing. Permanently. That kills the majority of the purpose for the backup in this case where things are changing (e.g., metadata.db)
haertig is offline   Reply With Quote
Old 05-08-2024, 01:57 PM   #32
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 74,669
Karma: 130140792
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by haertig View Post
You definitely want to turn off --ignore-existing. Permanently. That kills the majority of the purpose for the backup in this case where things are changing (e.g., metadata.db)
yes you do want to turn off --ignore-existing. You want to let rsync add or remove content as needed. based on the fast that the file have a different date and/or file size.

Last edited by JSWolf; 05-09-2024 at 05:47 AM.
JSWolf is offline   Reply With Quote
Old 05-08-2024, 08:20 PM   #33
haertig
Wizard
haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.haertig ought to be getting tired of karma fortunes by now.
 
Posts: 1,758
Karma: 26012554
Join Date: Sep 2017
Device: PW3, Fire HD8 Gen7, Moto G7, Sansa Clip v2, Ruizu X26
--ignore-existing will cause rsync to NOT copy a modified file over an earlier version of itself that is already on the backup side. This behavior would be a disaster when copying Calibre via rsync, as the metadata files can change frequently. You would want the newest one, not the oldest.

It is rare that you want this "prefer older version over newer version" behavior. The usual reason is when you want to keep a historical chain of all versions of the file. This is typical for sophisticated backup systems that use advanced rsync capabilities like linking. But it is not that common for simple rsync invocations for non-experts.
haertig is offline   Reply With Quote
Old 05-09-2024, 07:24 AM   #34
Quoth
the rook, bossing Never.
Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.Quoth ought to be getting tired of karma fortunes by now.
 
Quoth's Avatar
 
Posts: 11,699
Karma: 87663461
Join Date: Jun 2017
Location: Ireland
Device: All 4 Kinds: epub eink, Kindle, android eink, NxtPaper11
Quote:
Originally Posted by haertig View Post
--ignore-existing will cause rsync to NOT copy a modified file over an earlier version of itself that is already on the backup side. This behavior would be a disaster when copying Calibre via rsync, as the metadata files can change frequently. You would want the newest one, not the oldest.

It is rare that you want this "prefer older version over newer version" behavior.
I've never seen the option being used. Basically you only get entirely new files sent and no updates at all.
Quoth is offline   Reply With Quote
Reply

Tags
linux, rsync

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
KOReader and rsync dmpop KOReader 3 04-23-2022 10:37 AM
rsync PC to Kobo Lo2 Kobo Developer's Corner 3 03-25-2019 06:06 PM
Rsync on Kindle Touch leonardo84 Kindle Developer's Corner 11 10-31-2012 05:31 PM
Request Geek Tools for moving files to/from the Library: ssh/sftp/rsync/samba kenjennings enTourage Archive 6 04-06-2010 11:36 PM
rsync thetechnobear iRex 1 03-05-2008 01:57 PM


All times are GMT -4. The time now is 11:54 PM.


MobileRead.com is a privately owned, operated and funded community.