New simple command line sideloading tool

[rupor]

This is fresh from the press: https://github.com/rupor-github/sync2kindle, but i have been using it in my own workflow for a while, so some folks could find it useful...

[JSWolf]

Another simple tool for side loading to a Kindle is calibre.

[rupor]

Man, who would dare to call calibre command line tool is a brave one... And I am afraid our definitions of "simple" are very different.

[Quoth]

Calibre isn't really simple, but once understood, it's easier than a command line to copy and manage ebooks.
Every OS I've ever used has a simple file copy command line that will work for any ereader that uses mass storage. Mac OS might need something extra for MTP, but Windows and Linux can copy to MTP devices in a console (command line).

I've not looked at the Git offering because Windows & Linux already have command line for any ereader (reMarkable uses network over USB, so is different) and GUI file manager support.

[Quoth]

Example

Windows command line
Copy the contents of a file to another file
copy sourceFile destinationFile
Example: To copy a file from c:\data\file1.doc to D:\backup\file2.doc

copy c:\data\file1.doc D:\backup\file2.doc

https://www.windows-commandline.com/...ntax-examples/

The kindle could be any letter from D to Z.

Linux (or UNIX) console
Using the -v option, we can get the cp command to tell us what it is doing in the background so we can see it in action. In the example below, we’ll show you how to use the syntax in your Linux terminal to get this output.
$ cp -v file02 file02-copy

There are no driver letters on UNIX, Linux or MacOS, so you need to know where the Kindle has mounted. That's pretty simple.

On Linux and Windows there is built in help:

Linux

user@machine:~$ cp --h
Usage: cp [OPTION]... [-T] SOURCE DEST
or: cp [OPTION]... SOURCE... DIRECTORY
or: cp [OPTION]... -t DIRECTORY SOURCE...
Copy SOURCE to DEST, or multiple SOURCE(s) to DIRECTORY.

Mandatory arguments to long options are mandatory for short options too.
-a, --archive same as -dR --preserve=all
--attributes-only don't copy the file data, just the attributes
--backup[=CONTROL] make a backup of each existing destination file
-b like --backup but does not accept an argument
--copy-contents copy contents of special files when recursive
-d same as --no-dereference --preserve=links
-f, --force if an existing destination file cannot be
opened, remove it and try again (this option
is ignored when the -n option is also used)
-i, --interactive prompt before overwrite (overrides a previous -n
option)
-H follow command-line symbolic links in SOURCE
-l, --link hard link files instead of copying
-L, --dereference always follow symbolic links in SOURCE
-n, --no-clobber do not overwrite an existing file (overrides
a previous -i option)
-P, --no-dereference never follow symbolic links in SOURCE
-p same as --preserve=mode,ownership,timestamps
--preserve[=ATTR_LIST] preserve the specified attributes (default:
mode,ownership,timestamps), if possible
additional attributes: context, links, xattr,
all
--no-preserve=ATTR_LIST don't preserve the specified attributes
--parents use full source file name under DIRECTORY
-R, -r, --recursive copy directories recursively
--reflink[=WHEN] control clone/CoW copies. See below
--remove-destination remove each existing destination file before
attempting to open it (contrast with --force)
--sparse=WHEN control creation of sparse files. See below
--strip-trailing-slashes remove any trailing slashes from each SOURCE
argument
-s, --symbolic-link make symbolic links instead of copying
-S, --suffix=SUFFIX override the usual backup suffix
-t, --target-directory=DIRECTORY copy all SOURCE arguments into DIRECTORY
-T, --no-target-directory treat DEST as a normal file
-u, --update copy only when the SOURCE file is newer
than the destination file or when the
destination file is missing
-v, --verbose explain what is being done
-x, --one-file-system stay on this file system
-Z set SELinux security context of destination
file to default type
--context[=CTX] like -Z, or if CTX is specified then set the
SELinux or SMACK security context to CTX
--help display this help and exit
--version output version information and exit

By default, sparse SOURCE files are detected by a crude heuristic and the
corresponding DEST file is made sparse as well. That is the behaviour
selected by --sparse=auto. Specify --sparse=always to create a sparse DEST
file whenever the SOURCE file contains a long enough sequence of zero bytes.
Use --sparse=never to inhibit creation of sparse files.

When --reflink[=always] is specified, perform a lightweight copy, where the
data blocks are copied only when modified. If this is not possible the copy
fails, or if --reflink=auto is specified, fall back to a standard copy.
Use --reflink=never to ensure a standard copy is performed.

The backup suffix is '~', unless set with --suffix or SIMPLE_BACKUP_SUFFIX.
The version control method may be selected via the --backup option or through
the VERSION_CONTROL environment variable. Here are the values:

none, off never make backups (even if --backup is given)
numbered, t make numbered backups
existing, nil numbered if numbered backups exist, simple otherwise
simple, never always make simple backups

As a special case, cp makes a backup of SOURCE when the force and backup
options are given and SOURCE and DEST are the same name for an existing,
regular file.

GNU coreutils online help: <https://www.gnu.org/software/coreutils/>
Full documentation <https://www.gnu.org/software/coreutils/cp>
or available locally via: info '(coreutils) cp invocation'

[rupor]

Originally Posted by Quoth

Calibre isn't really simple, but once understood, it's easier than a command line to copy and manage ebooks.
Every OS I've ever used has a simple file copy command line that will work for any ereader that uses mass storage. Mac OS might need something extra for MTP, but Windows and Linux can copy to MTP devices in a console (command line).

Looks like you are either did not read what the tool does or missing a point a bit: none of the tools you describe keep meaningful history which could be used on the next step. None of the tools you mentioned is a content specific bidirectional sync as none of them knows about page indexes or thumbnails. Each requires knowledge of where device is mounted. And MTP support on Windows in powershell from command line is not for the faint hearted.

Getting a bit defensive here, sorry: I did not suggest that other tools are bad, I did not call folks to abandon what they do, I merely suggested that for some this tool may be useful. No more, no less.

A person capable of implementing MTP initiator for bidirectional sync on at least 2 platforms surely knows how to use other tools, thank you very much. I was expecting complete ignore (fair), satisfied with my day to day (also fair), but not lectures on how to use copy in posix shell...

[Quoth]

You don't need powershell to copy to MTP on Windows.
Most Kindles are not MTP.

Page indexes and thumbnails? History? Then Calibre.

Also few people will want to sync a kindle with local directory. Calibre is a better solution.

The builtin command line / console copy is simple or GUI file manager. More than that, the best tool is Calibre.

I have now looked at it on Github.
This github tool is not simple.
Unless you think rsync is simple.

The most useful platform for the MTP aspect might be MacOS, but I only see Windows and Linux. No Linux user needs it. It's of dubious value for Windows.

If you want more complex than copy (Windows) or cp (Linux), then Calibre is a far better solution. I manage multiple ereaders* and MTP devices and about 8500 titles (mostly PD). About 8 makes of eReader. Calibre doesn't work with the reMarkable (unless they have recently changed the FW), but does work with all Kindles

I can't recommend the sync2kindle tool.


[*Only Mass Storage Kindles as I won't be buying a Scribe or 2024 model]

Edit: I see this tool is only AMD64. The commands copy / cp / rsync are native. Calibre runs on MacOS, Windows, Linux and has AMD64 and ARM. Works on my 2G RAM Raspberry Pi (ARM). There are older versions for Calibre x86 32bit (XP, Win7, Linux etc) and some have newer ereaders backported to them. Calibre also supports "simple" command line opration.

Sync with a Kindle is of dubious value as any files via Whispernet from Amazon are likely no use on any other device or PC. The only copying from a Kindle (except Scribe) of any value is annotations, and if that is the main activity then a Kobo is better. A Kindle Scribe really needs Amazon "sync", as the sticky & "PDF" system is tricky & complex outside of the Amazon ecosystem.

[rupor]

Thanks for sharing those very informative and useful comments

It is not really clear to me why anybody will read Kindle forum if one is not going to buy new devices, but whatever...

Now, getting back where I started - may be there are some folks here with different workflow, like I do, I am sure they exist somewhere. And may be somebody will actually try and run this tool...

Not interested in any unsolicited advices on what platform is better or why everybody should use Calibre (an excellent tool for what it was designed).

[Quoth]

Originally Posted by rupor

It is not really clear to me why anybody will read Kindle forum if one is not going to buy new devices, but whatever...

Because it's got the best support in the world for existing Kindles and the best info on new ones. We have four Kindles here and I help out relatives that have 3 other models of Kindle. Who knows, Amazon might produce a new model that is much more suitable.


If you don't want unsolicited advice, then don't advertise a very niche product on a general Kindle support forum.

It's also self promotion.

[rupor]

Originally Posted by Quoth

If you don't want unsolicited advice, then don't advertise a very niche product on a general Kindle support forum.

It's also self promotion.

This is deep, and I mean it. Sharing free software, hoping that it could be useful to other people is advertisement and self promotion here?

I am sorry you feel this way. Certainly sharing your pearls of wisdom from manuals on an open Kindle forum is so much more useful...

But thank you for your advice, i will see if i should remove my post.

[Quoth]

I don't think you need to remove it (because the self promotion rules are really about books), but it is misleading. It gives the impression it's a simple tool to copy via usb in a console. Also Mac users have the most difficulty with MTP on USB (though there is now a Kindle program) and Windows users have the least difficulty and are least likely to use a command line tool.

You are blowing your own trumpet.

[JSWolf]

Originally Posted by Quoth

Calibre isn't really simple, but once understood, it's easier than a command line to copy and manage ebooks.
Every OS I've ever used has a simple file copy command line that will work for any ereader that uses mass storage. Mac OS might need something extra for MTP, but Windows and Linux can copy to MTP devices in a console (command line).

I've not looked at the Git offering because Windows & Linux already have command line for any ereader (reMarkable uses network over USB, so is different) and GUI file manager support.

It's a lot easier to use Windows Explorer to copy a directory full of eBooks to your Reader. A lot of people don't have all that much experience with a command line.

calibre is not that difficult to use if you do the basic of adding books and sending them to your Reader. And cleaning up the metadata is also easy. Yes calibre can be more complex. But that's because it does so much.

This copy/paste command line tool (should be GUI based) is for those who do not use calibre but still collect eBooks. But if you don't use calibre, most eBooks will have DRM (as long as they are legal).

[rupor]

It is a simple tool to copy via usb in a console.

You could go and use Windows explorer or whatever - it is totally up to you, but there are people who prefer to go otherwise. Why you are trying to force your way on everybody?

I am not really sure why you are calling it a product, I am not trying to sell anything. If you look down the readme you'd see that at the moment I have no Macs and hence I cannot release it for Mac (or for Windows arm for this matter), but it is reasonably simple to do (I hope) and with enough interest we could make it useful. Or not.

I am not sure who made you an expert on all the things you are saying but is there a way for you to ignore this post completely? And possibly all future posts from me too?

Because the way it is going there would be no collaborators on any open source projects, no open discussions of niche products or whatever, only endless dick measuring contests and flame wars and you'd have nothing to brag about in the future.

[John F]

Originally Posted by rupor

This is fresh from the press: https://github.com/rupor-github/sync2kindle, but i have been using it in my own workflow for a while, so some folks could find it useful...

Thank you sharing.

[hondabf]

Hey, thanks for sharing this tool. It's always great to have a tool with a different workflow other than Calibre. Don't listen to the other two posters. Apparently, they think Calibre is the only software that should be allowed for anything ebooks, ever.