CC not updating virutal libaries

mobamoba · 12-30-2014, 11:37 PM

I noticed what I think is a bug in CC (I'm a paid user and am using the most recent version of CC, Calibre, and am on Android KitKat). I have a number of virtual libraries setup in Calibre which I've set up so they also show up in CC. However, when I update a book in Calibre so it is no longer part of a virtual library, CC still shows it as being part of that library.

This might be easier to explain by example. I have a virtual library called Unread Fiction which is based on a search for Genre and Read status and - as the name implies - shows me a shelf of my unread fiction when I click on it (showing me only ebooks and filtering out books in my library that I don't own yet). Here's the search in case it matters:

((#read:no and not #unbought:yes and not #tags:"=Physical") and (#genre:"=Fiction"))

When I mark a book as read, Calibre removes the book from my Unread Fiction virtual library since it no longer meets the search criteria (since #read would now be yes). CC, however, leaves the book there and continues to list the book as being in the Unread Fiction virtual library on the book's property page. In other words, Calibre updates the book's virtual library location but CC doesn't.

I've tried cleaning the database and resyncing but it still won't update it. Any suggestions? Thanks.

chaley · 12-31-2014, 06:13 AM

I can't repeat this problem.

My setup for testing:

Create a "Virtual libs" column in calibre with template "{:'virtual_libraries()'}" as described in this FAQ answer.
Connect CC to calibre so CC knows about the column. Disconnect.
In CC's grouping settings, add the new column to the grouping drawer. (This is optional.)
On a book in some virtual library, look at book details. The column contains the list of VLs containing the book.
In calibre, change a book's metadata so that it is not part of a VL.
Connect CC to calibre. Let it sync. Disconnect.
Check book details for the changed book. The VL is gone.
Open the grouping drawer (assuming you added the column to the grouping drawer above) and choose the VL that no longer contains the book. The book is not listed.

What are you doing that is different from the above?

mobamoba · 12-31-2014, 08:44 AM

I did exactly the same thing and can reproduce the error. I've attached two screenshots of the exact same book. In the Calibre screenshot, you can see it's not part of any virtual libraries. In the CC screenshot, you can see it is. It also didn't update the "read" checkbox, which may have something to do with it.

chaley · 12-31-2014, 09:11 AM

It sounds like the book on CC is not connected with the book in calibre, so its metadata is not being updated. This can happen if you use multiple calibre libraries (real, not virtual), if you have more than one format (e.g., mobi, epub) for a book on your device, if the same format exists in CC with different file names, or if you created a new calibre library containing the same books and connected CC to that library.

When you connect CC to calibre, does that book have a check mark in the on-device column? Are there any books that show more than one matching book? Are there any books in calibre's device view that don't have in-library checked?

What happens if you resend that book to the device?

It is probably worth sending me debug logs. Instructions are in this FAQ answer. Please send the logs (only) to cc_debug_logs at charles dot haleys dot org. Please do the following:

Start calibre in debug mode.
Connect CC. Let it stabilize.
Send the book you mentioned in your post to CC.
Quit calibre. Save the debug log somewhere.
In CC, email me the debug log.
Email me the calibre log you saved above.

mobamoba · 12-31-2014, 09:34 AM

The book shows up as On Device. All books in my library show up as on device (I only have one library). Resending did nothing. It was with a fresh install and empty library on CC. A few hours after setting it up, I marked a book as read and saw it wasn't updating when I synced. Actually, I marked 3 books as read - one of them synced properly and the others didn't. The difference between the two is that the first one I marked as read and gave a Completed Date. The other two I marked as read and gave no completed date, i.e. left that field as empty.

Since that's the only difference between them, could that difference have something to do with all this? It's difficult to imagine that this is an issue as I have 124 other books in my library with exactly the same thing (marked as read but with no completed date) and CC handles those just fine. Perhaps CC can handle first-sync books marked read with no date but books marked newly read must have a completed date? I don't know. I'm speculating because it's the only difference between these books.

I'll email the debug logs in a moment.

mobamoba · 12-31-2014, 09:57 AM

As an experiment, I tried a different way of putting in the same data. The books I marked as read but for which I have no completed date are books in my library I'm never going to read. I created a new yes/no column called #notreading; I marked all books of this sort as "yes" with that column then marked my #read column as no. I then added "not #notreading:yes" to my virtual libraries.

This didn't work at all. It works perfectly fine in Calibre (shows the proper books in the virtual library) but shows the wrong books in CC.

chaley · 12-31-2014, 10:00 AM

The logs aren't showing anything odd.

Can you verify that in calibre the #virtlib column is of type "column built from other columns, acts like tags"?

What happens if you delete the book from CC (in CC's book details) then resend the book?

mobamoba · 12-31-2014, 10:27 AM

Yes, the virtual library column is setup properly.

After a bit more experimenting, I think the problem is that CC really doesn't like a book marked as read with no date. When I went back in and gave a fake completed date to those dateless but marked read books, the libraries on CC worked more or less as they should.

chaley · 12-31-2014, 10:48 AM

Quote:

Originally Posted by mobamoba

After a bit more experimenting, I think the problem is that CC really doesn't like a book marked as read with no date. When I went back in and gave a fake completed date to those dateless but marked read books, the libraries on CC worked more or less as they should.

The booked marked read with the read date set or not set makes no difference for me, but I will keep chasing that to see if I can find something.

mobamoba · 12-31-2014, 10:58 AM

It's the only thing I can think of because, when I added the fake date to the books, it all updated fine.

chaley · 12-31-2014, 11:18 AM

Would you be willing to run a special APK that has extra logging in it? If so, I can send it to the email address you used to send me the logs.

mobamoba · 12-31-2014, 12:16 PM

Sure. You want me to wipe CC and start clean after install then try to reproduce error again?

chaley · 12-31-2014, 01:13 PM

Quote:

Originally Posted by mobamoba

Sure. You want me to wipe CC and start clean after install then try to reproduce error again?

I emailed the APK. It should install over the top of the one you are running without requiring a wipe.

When book metadata is added/updated, the extra logging displays the custom columns in the grouping drawer and their associated data. This should tell us if the data is arriving in CC and getting lost or if it isn't coming from calibre. At least I hope so.

EDIT: Once you have installed this version, do the experiment described in post 4.

It is frustrating doing remote debugging. I really appreciate your patience.

12-30-2014, 11:37 PM	#1
mobamoba Enthusiast Posts: 38 Karma: 44 Join Date: Dec 2014 Device: Kobo Glo	CC not updating virutal libaries I noticed what I think is a bug in CC (I'm a paid user and am using the most recent version of CC, Calibre, and am on Android KitKat). I have a number of virtual libraries setup in Calibre which I've set up so they also show up in CC. However, when I update a book in Calibre so it is no longer part of a virtual library, CC still shows it as being part of that library. This might be easier to explain by example. I have a virtual library called Unread Fiction which is based on a search for Genre and Read status and - as the name implies - shows me a shelf of my unread fiction when I click on it (showing me only ebooks and filtering out books in my library that I don't own yet). Here's the search in case it matters: ((#read:no and not #unbought:yes and not #tags:"=Physical") and (#genre:"=Fiction")) When I mark a book as read, Calibre removes the book from my Unread Fiction virtual library since it no longer meets the search criteria (since #read would now be yes). CC, however, leaves the book there and continues to list the book as being in the Unread Fiction virtual library on the book's property page. In other words, Calibre updates the book's virtual library location but CC doesn't. I've tried cleaning the database and resyncing but it still won't update it. Any suggestions? Thanks. Last edited by mobamoba; 12-30-2014 at 11:45 PM.

12-31-2014, 06:13 AM	#2
chaley Grand Sorcerer Posts: 12,444 Karma: 8012886 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	I can't repeat this problem. My setup for testing: Create a "Virtual libs" column in calibre with template "{:'virtual_libraries()'}" as described in this FAQ answer. Connect CC to calibre so CC knows about the column. Disconnect. In CC's grouping settings, add the new column to the grouping drawer. (This is optional.) On a book in some virtual library, look at book details. The column contains the list of VLs containing the book. In calibre, change a book's metadata so that it is not part of a VL. Connect CC to calibre. Let it sync. Disconnect. Check book details for the changed book. The VL is gone. Open the grouping drawer (assuming you added the column to the grouping drawer above) and choose the VL that no longer contains the book. The book is not listed. What are you doing that is different from the above?

12-31-2014, 08:44 AM	#3
mobamoba Enthusiast Posts: 38 Karma: 44 Join Date: Dec 2014 Device: Kobo Glo	I did exactly the same thing and can reproduce the error. I've attached two screenshots of the exact same book. In the Calibre screenshot, you can see it's not part of any virtual libraries. In the CC screenshot, you can see it is. It also didn't update the "read" checkbox, which may have something to do with it. Attached Thumbnails Last edited by mobamoba; 12-31-2014 at 08:48 AM.

12-31-2014, 09:11 AM	#4
chaley Grand Sorcerer Posts: 12,444 Karma: 8012886 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	It sounds like the book on CC is not connected with the book in calibre, so its metadata is not being updated. This can happen if you use multiple calibre libraries (real, not virtual), if you have more than one format (e.g., mobi, epub) for a book on your device, if the same format exists in CC with different file names, or if you created a new calibre library containing the same books and connected CC to that library. When you connect CC to calibre, does that book have a check mark in the on-device column? Are there any books that show more than one matching book? Are there any books in calibre's device view that don't have in-library checked? What happens if you resend that book to the device? It is probably worth sending me debug logs. Instructions are in this FAQ answer. Please send the logs (only) to cc_debug_logs at charles dot haleys dot org. Please do the following: Start calibre in debug mode. Connect CC. Let it stabilize. Send the book you mentioned in your post to CC. Quit calibre. Save the debug log somewhere. In CC, email me the debug log. Email me the calibre log you saved above.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Updating from 0.7.47 to 0.8.60	Lady Fitzgerald	Calibre	3	07-17-2012 10:14 PM
Help! Updating	GlutinFreeMan	enTourage eDGe	7	10-29-2011 10:18 PM
Help updating to PE	bfewell	enTourage eDGe	1	09-20-2011 02:56 AM
Combine Calibre libaries	Peter Swallow	Library Management	4	02-01-2011 01:50 PM
Electronic libaries are hard to browse	Bob Russell	News	10	05-09-2006 03:26 PM

12-31-2014, 09:34 AM	#5
mobamoba Enthusiast Posts: 38 Karma: 44 Join Date: Dec 2014 Device: Kobo Glo	The book shows up as On Device. All books in my library show up as on device (I only have one library). Resending did nothing. It was with a fresh install and empty library on CC. A few hours after setting it up, I marked a book as read and saw it wasn't updating when I synced. Actually, I marked 3 books as read - one of them synced properly and the others didn't. The difference between the two is that the first one I marked as read and gave a Completed Date. The other two I marked as read and gave no completed date, i.e. left that field as empty. Since that's the only difference between them, could that difference have something to do with all this? It's difficult to imagine that this is an issue as I have 124 other books in my library with exactly the same thing (marked as read but with no completed date) and CC handles those just fine. Perhaps CC can handle first-sync books marked read with no date but books marked newly read must have a completed date? I don't know. I'm speculating because it's the only difference between these books. I'll email the debug logs in a moment.

12-31-2014, 09:57 AM	#6
mobamoba Enthusiast Posts: 38 Karma: 44 Join Date: Dec 2014 Device: Kobo Glo	As an experiment, I tried a different way of putting in the same data. The books I marked as read but for which I have no completed date are books in my library I'm never going to read. I created a new yes/no column called #notreading; I marked all books of this sort as "yes" with that column then marked my #read column as no. I then added "not #notreading:yes" to my virtual libraries. This didn't work at all. It works perfectly fine in Calibre (shows the proper books in the virtual library) but shows the wrong books in CC.

12-31-2014, 10:00 AM	#7
chaley Grand Sorcerer Posts: 12,444 Karma: 8012886 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	The logs aren't showing anything odd. Can you verify that in calibre the #virtlib column is of type "column built from other columns, acts like tags"? What happens if you delete the book from CC (in CC's book details) then resend the book?

12-31-2014, 10:27 AM	#8
mobamoba Enthusiast Posts: 38 Karma: 44 Join Date: Dec 2014 Device: Kobo Glo	Yes, the virtual library column is setup properly. After a bit more experimenting, I think the problem is that CC really doesn't like a book marked as read with no date. When I went back in and gave a fake completed date to those dateless but marked read books, the libraries on CC worked more or less as they should.

12-31-2014, 10:58 AM	#10
mobamoba Enthusiast Posts: 38 Karma: 44 Join Date: Dec 2014 Device: Kobo Glo	It's the only thing I can think of because, when I added the fake date to the books, it all updated fine.

12-31-2014, 11:18 AM	#11
chaley Grand Sorcerer Posts: 12,444 Karma: 8012886 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	Would you be willing to run a special APK that has extra logging in it? If so, I can send it to the email address you used to send me the logs.

12-31-2014, 12:16 PM	#12
mobamoba Enthusiast Posts: 38 Karma: 44 Join Date: Dec 2014 Device: Kobo Glo	Sure. You want me to wipe CC and start clean after install then try to reproduce error again?

Advert

Advert