CC Cloud & Google Drive

[chaley]

Originally Posted by Agama

I'll write a command script to identify new and changed folders/files and then simply upload them. I wonder if Google Drive has an API that's callable from Windows scripting?

TBH that seems like the hard way to do it. A good sync program like synctoy etc will only copy things that have changed or things that are new, and it will also delete things that are no longer valid. The Google Drive sync program will take care of updating the cloud library. You could add a windows "task" that runs the sync program once per day (or hour or whatever) so that your cloud library is automatically kept up to date. Of course this means that you have a copy of your library on your computer, which might be a problem if you short on disc space.

And perhaps writing that script would be fun. I do things like that from time to time simply because I want to know how something works.

[Dhevi]

Originally Posted by chaley

Good!No. It shows everything. I was hoping that adding field selection wasn't necessary because implementing it would be a pain.

I will look at it again.

Not a big deal, more curiosity than a real need.

Originally Posted by chaley

I am not sure what happened, but it sounds like you and CC tolerated the error. Did CC do something strange or did it nicely tell you that you needed to re-authenticate?

CC simply ran through the prompting to re-connect/authenticate google drive. I think I can duplicate the error, and I'll report back.

[Dhevi]

A curious problem...

I keep several books on-device, wirelessly transferred from Calibre.

In downloading books from the Cloud connection I would direct that the files would adhere to the sorting settings for CC.

The following images need more details.

I downloaded several books from the cloud.

Sleeping Beauty - Broken Empire [0.50]


All books on-device sorted by Series, ascending order.


The results by series:

Blue: Dresden Files
Yellow: Broken Empire [0.50]
Green: Night Angel [1]
Pink: Gears of War


The books downloaded from the cloud connection (Yellow and Green) are sorted, but appear out of position, in relation to the rest of the library which was not downloaded from the cloud, almost as if being contained in a library, within a library. And after downloading several more books from the cloud, I am seeing that the cloud downloaded books are not respecting the Sort setting at all.

Debug log emailed, though I'm not sure if this will show up in it.

[chaley]

@Dhevi: is the order fixed if you connect as a wireless device? It should update the metadata for the books that were downloaded via the cloud connection. If the sort order is indeed fixed then I think I know what is happening.

[Dhevi]

@Chaley: You were spot on! After connecting as a wireless device the books were then properly sorted. Thus shears to be needed after every cloud download. Which is peculiar, the metadata.db file in googledrive and in calibre should be identical.

A new issue has reared it's head.

I briefly received a message about "1 new book located" and after calibre was done connecting wirelessly there was a new "book" in my library.





I've deleted the book from Book Details and relaunched CC and tried connecting wirelessly but cannot replicate on any of my devices.

Debug log sent.

Will report further, but calling it a night presently.

[eschwartz]

Originally Posted by Agama

I'll write a command script to identify new and changed folders/files and then simply upload them. I wonder if Google Drive has an API that's callable from Windows scripting?

Seeing as you're curious...

There is of course drive, but it is stated to not run on Windows. That would've been the easy way.
This shows some promise though: PyDrive.


Personally, for my own use, I would rather rant at Google for not providing a linux desktop client. Syncing is soooo much easier. That's why I prefer Dropbox.

[chaley]

Originally Posted by Dhevi

@Chaley: You were spot on! After connecting as a wireless device the books were then properly sorted. Thus shears to be needed after every cloud download. Which is peculiar, the metadata.db file in googledrive and in calibre should be identical.

They are. The problem arises because I made a mistake in CC when extracting the series_sort metadata from the db. The series_sort value is an odd duck. It isn't in the database. Instead calibre computes it on demand using a rather complex system of article detection. CC cannot do that calculation, and my work-around was incorrect. It now works better.

It is worth noting that if all of the following are true:

• you download a book using the cloud connection
• that book has a series beginning with an article calibre would match (the, a, ...), for example "The Magician"
• no other book with that series is already in CC

then CC will sort the series with the article in the front (for the example, in the "T"s). If subsequently you connect as a wireless device, calibre (via CC) will change the sort so that the article is moved to the end, changing where the series appears in the sort (for the example, to the "M"s). This problem (if it is a problem) can be avoided by setting the tweak save_template_title_series_sorting to strictly_alphabetic, but that might have side effects if you use other devices.

A new issue has reared it's head.

I briefly received a message about "1 new book located" and after calibre was done connecting wirelessly there was a new "book" in my library.

This was caused by the failed download. I created the book file to receive the download but didn't delete it when the download failed.

There are several significant bug fixes queued up so I am going to make a release. It should be offered to you (and to @Agama) in the normal way by the Play store.

[frankdw16]

Hi,
if you could use another tester,...
I'm a long time user of calibre on linux and the companion on droid. I just cloned my library to google drive. I'm on a rooted Note3.
I do embedded software and electronics for a living, but, like the person helping you already, I'm not a pro tester.

Let me know if I can help.
Frank

Ps Intended to post this in the google drive thread from the same author, but weirdly it ended up here. No idea how to change that, sorry.

[chaley]

Originally Posted by frankdw16

Hi,
if you could use another tester,...
I'm a long time user of calibre on linux and the companion on droid. I just cloned my library to google drive. I'm on a rooted Note3.
I do embedded software and electronics for a living, but, like the person helping you already, I'm not a pro tester.

Let me know if I can help.
Frank

Sure. Thanks!

I just released CC V4.1.2 that has Google Drive support, so there isn't any need for me to send you an APK. If you (or others) find problems then we will work out then how to send an APK.

Ps Intended to post this in the google drive thread from the same author, but weirdly it ended up here. No idea how to change that, sorry.

No worries. This thread is where your post belongs.

[Agama]

Originally Posted by chaley

The Google Drive sync program will take care of updating the cloud library.

And perhaps writing that script would be fun. I do things like that from time to time simply because I want to know how something works.

My reading suggested that the Google Drive Sync only worked with Google Documents but maybe my info is out of date so this could be an easy route.

Yes! Script writing would be fun. I might be able to use a RoboCopy script that I use for differential PC backups as the log from this would show the necessary updates. I don't suppose RoboCopy can talk to Google Drive.

Maybe one day cloud space will integrate seamlessly into other storage space so that simple copy/paste syncing will be trivial.

[Agama]

Originally Posted by eschwartz

Seeing as you're curious...

There is of course drive, but it is stated to not run on Windows. That would've been the easy way.
This shows some promise though: PyDrive.

PyDrive looks interesting and pretty straight forward. (I dabbled in Python for a while with some calibre editing plugins but this was before Kovid provided us with his rather nice editor, so my Python's gone a bit rusty since then). Looks as though it could be incorporated as a calibre plugin.

[eschwartz]

Originally Posted by Agama

Maybe one day cloud space will integrate seamlessly into other storage space so that simple copy/paste syncing will be trivial.

Does fuse-mounting (another linuxy thing) count? If so, we are already there...


P.S. Thanks for the karma.