CC alpha release 3.4.4b

[chaley]

CC alpha release 3.4.4a has been published and will be available to people in the alpha test program.

Changes since V3.4.4a (see this thread for details on V3.4.4a):

• [BUG FIX]Fix "groupnull"
• [BUG FIX]Various fixes for autosorting when not grouping.
• [BUG FIX]Make auto-sort when not grouping work when using the back button
• [BUG FIX]Add the word "Samsung " to the reader name in the choose reader dialog

[chaley]

Google Play has offered me this release, so all you testers should have it as well.

[Purple Lady]

Auto-sort when not grouping works much better now.

Optionally sync book files
- Menu says Calibre 2.2 or newer
- How do you tell if copy in Calibre is newer? I just tried this and it sent a shit load of books before I killed it. I could tell by the book name that it was books I hadn't touched for a while, and the modified date in Calibre was 7-27.

The books that it did send now have no covers. I turned the option off and connected wirelessly again and it didn't resend the covers. All the tags still appear to be there though. The connect seemed to be too quick so I tried connecting again and it took a while before it came back and tried to send metadata for all 884 of my books. I then got a connection error in Calibre - CC thought I was still connected.

I am going to restore my backup so I will send you the debug log before I do since I think it's stored where my backup will overwrite.

[jackie_w]

Originally Posted by chaley

[BUG FIX]Add the word "Samsung " to the reader name in the choose reader dialog

Close, but not quite there yet. It's now labelled 'Samsumg Kindle' It does still work correctly, though.

[kaufman]

The issues I was having with the back button are not occurring in the new version. Perhaps it was something to do with the bugs you fixed.

I did notice two settings that we not restored when I loaded the saved settings. "Auto-sort when Groups is chosen" and "Move Disconnect to Menu".

Lastly (so far). I think "Auto-sort when Groups is chosen" might be a bit confusing. Particularly because it is right under "Auto-sort when choosing a group". They sound very similar. How about instead call it "Auto-sort when no group is chosen"?

[chaley]

Originally Posted by Purple Lady

Optionally sync book files
- Menu says Calibre 2.2 or newer
- How do you tell if copy in Calibre is newer? I just tried this and it sent a shit load of books before I killed it. I could tell by the book name that it was books I hadn't touched for a while, and the modified date in Calibre was 7-27.

CC sends the date the book was last changed on the device to calibre. Calibre compares that date to the one for the book (actually the format) in the library. If the date of the format is newer, calibre sends the book.

There are several ways a format's date can be changed. Any of polish, modify epub, edit cover, or the editor can do it. Some plugins like fanfic do it.

The books that it did send now have no covers. I turned the option off and connected wirelessly again and it didn't resend the covers. All the tags still appear to be there though. The connect seemed to be too quick so I tried connecting again and it took a while before it came back and tried to send metadata for all 884 of my books. I then got a connection error in Calibre - CC thought I was still connected.

Hmmm... I probably have an order dependency when job is cancelled. I might update the cache even though the metadata was not sent to the device. This would result in what you are seeing.

I am going to restore my backup so I will send you the debug log before I do since I think it's stored where my backup will overwrite.

Thanks. I will look at it. However, I suspect that the problems with syncing, if there are indeed problems, are on the calibre side, in which case I actually need a calibre debug log.

EDIT: you did give me a calibre debug log. Excellent!

[chaley]

Originally Posted by jackie_w

Close, but not quite there yet. It's now labelled 'Samsumg Kindle' It does still work correctly, though.

Piffle. Who wants a Samsung device anyway.

[chaley]

Originally Posted by kaufman

The issues I was having with the back button are not occurring in the new version. Perhaps it was something to do with the bugs you fixed.

Hope so.

I did notice two settings that we not restored when I loaded the saved settings. "Auto-sort when Groups is chosen" and "Move Disconnect to Menu".

Were they actually in the backup?

I just did the following test and those settings were restored.

1. Make a settings backup
2. "Clear data" for CC
3. Restart CC
4. Restore the settings backup I just made

Lastly (so far). I think "Auto-sort when Groups is chosen" might be a bit confusing. Particularly because it is right under "Auto-sort when choosing a group". They sound very similar. How about instead call it "Auto-sort when no group is chosen"?

Good point. That string is a little longer so might have more problems on small screens with larger fonts.

What about moving all the autosort options to their own major category? I haven't been happy about me putting the "Show autosorts" in the grouping section and the other two in the sorting section. If I make a new category, perhaps "Automatic sorting when grouping" then the preferences could become

• When tapping a group
• When "Groups" line is tapped
• Show sorts on group lines

Order and titles in settings has no effect on internal storage so a change like this would not affect existing preferences or backups.

[a_daley]

I think putting the auto sort int their own category certainly would be easier to navigate to and also make changes easier

[chaley]

Originally Posted by Purple Lady

- How do you tell if copy in Calibre is newer? I just tried this and it sent a shit load of books before I killed it. I could tell by the book name that it was books I hadn't touched for a while, and the modified date in Calibre was 7-27.

Calibre sent 40 books. You killed it at the last book.

The books that it did send now have no covers. I turned the option off and connected wirelessly again and it didn't resend the covers.

When calibre sends a book, it includes all the metadata except the cover. The cover is sent as a second step when "syncing metadata".

Unfortunately, the last_modified date in the metadata that comes with the book is the right one, so in later connects calibre doesn't know that it must resend metadata. I have fixed this so that when CC receives a book it sets the last_mod date to long ago. It will get reset back during the sync metadata, if that happens, or the next connect if it doesn't happen.

All the tags still appear to be there though. The connect seemed to be too quick so I tried connecting again and it took a while before it came back and tried to send metadata for all 884 of my books. I then got a connection error in Calibre - CC thought I was still connected.

I see the network failure in CC's debug log. Unfortunately the calibre debug log has no useful information, so I don't know what happened from calibre's side. From CC's side something closed the network connection.

One very strange thing in the log. In the middle of negotiating with calibre during the second connect, you went to look at some book details. I didn't think this was possible and I can't see how to do it. Do you remember anything about what you did or what happened?

[jackie_w]

Now I'm testing the correct v3.4.4b not the old one... The inconsistencies I reported in the v3.4.4a thread still exist.

'Groups from custom columns': date (date)
'Groups to show': date
'Sorts to show in menu': date (date) and Date (calibre) # duplication?
'Sorts displayed on book list': date (date) and Date (calibre)# duplication?

... or maybe I'm misunderstanding. Are date and Date (calibre) 2 different fields?

Similarly for Date published

'Groups from custom columns': Published pubdate) # missing open bracket
'Groups to show': Published
'Sorts to show in menu': Published pubdate) and Date published # duplication?
'Sorts displayed on book list': Published pubdate) and Date published # duplication?

And a minor inconsistency

'Groups to show': Read
'Sorts to show in menu': Is read
'Sorts displayed on book list': Is read

Is the field for Group Read the same as the one for Sort Is read, or is this me confusing 2 items?

[chaley]

Originally Posted by jackie_w

Now I'm testing the correct v3.4.4b not the old one... The inconsistencies I reported in the v3.4.4a thread still exist.

'Groups from custom columns': date (date)
'Groups to show': date
'Sorts to show in menu': date (date) and Date (calibre) # duplication?
'Sorts displayed on book list': date (date) and Date (calibre)# duplication?

... or maybe I'm misunderstanding. Are date and Date (calibre) 2 different fields?

This is indeed a bug. It never occurred to me to test having added "date" to the grouped-by columns. I didn't prune duplicates. I also messed up the column name for "date" when it was used as a grouped column because its real calibre lookup name is "timestamp".

Similarly for Date published

'Groups from custom columns': Published pubdate) # missing open bracket
'Groups to show': Published
'Sorts to show in menu': Published pubdate) and Date published # duplication?
'Sorts displayed on book list': Published pubdate) and Date published # duplication?

Same (or similar) bug. Fixed.

And a minor inconsistency

'Groups to show': Read
'Sorts to show in menu': Is read
'Sorts displayed on book list': Is read

Is the field for Group Read the same as the one for Sort Is read, or is this me confusing 2 items?

Same item, two names. I changed the name for sorting to "Read".

[kaufman]

Originally Posted by chaley

What about moving all the autosort options to their own major category? I haven't been happy about me putting the "Show autosorts" in the grouping section and the other two in the sorting section. If I make a new category, perhaps "Automatic sorting when grouping" then the preferences could become

• When tapping a group
• When "Groups" line is tapped
• Show sorts on group lines

Order and titles in settings has no effect on internal storage so a change like this would not affect existing preferences or backups.

I think its perfect.

[Purple Lady]

Originally Posted by chaley

CC sends the date the book was last changed on the device to calibre. Calibre compares that date to the one for the book (actually the format) in the library. If the date of the format is newer, calibre sends the book.

There are several ways a format's date can be changed. Any of polish, modify epub, edit cover, or the editor can do it. Some plugins like fanfic do it.
Hmmm... I probably have an order dependency when job is cancelled. I might update the cache even though the metadata was not sent to the device. This would result in what you are seeing.
Thanks. I will look at it. However, I suspect that the problems with syncing, if there are indeed problems, are on the calibre side, in which case I actually need a calibre debug log.

EDIT: you did give me a calibre debug log. Excellent!

I checked the dates on three books and the date in book details of date 'added to cc' and 'updated' were both later than the date of the epub file looking at the file in Calibre's folders. Is there somewhere else I should look for those dates?

Originally Posted by chaley

Calibre sent 40 books. You killed it at the last book.
When calibre sends a book, it includes all the metadata except the cover. The cover is sent as a second step when "syncing metadata".

Unfortunately, the last_modified date in the metadata that comes with the book is the right one, so in later connects calibre doesn't know that it must resend metadata. I have fixed this so that when CC receives a book it sets the last_mod date to long ago. It will get reset back during the sync metadata, if that happens, or the next connect if it doesn't happen.

Well, yeah, the last book that was sent when I killed it would be the last book.

The 40 books that were sent were all older books that I don't think had anything changed. I also did not see the book that should have been sent - I had just finished a library book so I deleted the epub in Calibre and replaced it with an empty epub so I could still have the book details in CC. This is all I expected to see sent, although I wouldn't have been surprised to see a few stragglers. Maybe you could show a message of how many books will be sent so there will be no surprises?

I see the network failure in CC's debug log. Unfortunately the calibre debug log has no useful information, so I don't know what happened from calibre's side. From CC's side something closed the network connection.

One very strange thing in the log. In the middle of negotiating with calibre during the second connect, you went to look at some book details. I didn't think this was possible and I can't see how to do it. Do you remember anything about what you did or what happened?

When I went to look at book details was when I was surprised to see that the synching was done so quickly. The message that CC was doing something had disappeared so I assumed synching was complete even though it seemed to me I missed seeing one the the standard messages while synching.

[chaley]

Originally Posted by Purple Lady

I checked the dates on three books and the date in book details of date 'added to cc' and 'updated' were both later than the date of the epub file looking at the file in Calibre's folders. Is there somewhere else I should look for those dates?

On the calibre side, the date is the "modification time" of the book format file itself. None of the dates in the database play a role. On CC's side it is the same thing, the modification time of the book file.

Well, yeah, the last book that was sent when I killed it would be the last book.

I was serious. Calibre said it was sending a total of 40 books. You killed it when calibre had just sent book 39.

The 40 books that were sent were all older books that I don't think had anything changed. I also did not see the book that should have been sent - I had just finished a library book so I deleted the epub in Calibre and replaced it with an empty epub so I could still have the book details in CC. This is all I expected to see sent, although I wouldn't have been surprised to see a few stragglers. Maybe you could show a message of how many books will be sent so there will be no surprises?

The number of books is displayed in calibre as part of the job info. The progress bar in CC shows how far along the process is. At one point we showed numbers there but for some reason we removed them. IIRC it was because the numbers changed very quickly.

I don't know why the new epub wasn't sent. If you run calibre in debug mode it tells you on a book-by-book basis the values of the time stamps being compared.

When I went to look at book details was when I was surprised to see that the synching was done so quickly. The message that CC was doing something had disappeared so I assumed synching was complete even though it seemed to me I missed seeing one the the standard messages while synching.

It sounds like there is a situation where no progress dialog is shown even though CC and calibre are still "talking". I need to find that.