[GUI Plugin] Reading List

[chaley]

Originally Posted by nikoski

But now i wanted to edit a bit the plugin settings and noticed that my devices are not shown as connected and i cannot add the new one.

Works fine for me. Steps I tried:

1. I deleted all devices in Reading List
2. In CC's (Settings / Connecting to calibre / Wireless device connection / Device name shown by calibre) I checked that the device had a name I wanted to use.
3. I connected CC. Calibre says it is connected, showing the device name set in CC's settings.
4. In Reading List I pressed "Add Connected Device". My device appeared in the list.

If that doesn't work for you then I don't know where the problem might be.

This calibre log shows the sequence of events. I marked the Reading List interactions in bold

Spoiler:

SMART_DEV ( 6.11: 4.028) run received broadcast (b'localhost', ('192.168.120.69', 54982)) calibre wireless device client (on wallaby);8080,9090
SMART_DEV ( 8.12: 2.011) run attempt to open device socket
SMART_DEV ( 9.52: 1.387) open
SMART_DEV ( 9.52: 0.001) _call_client GET_INITIALIZATION_INFO wfr True
SMART_DEV ( 9.62: 0.100) open Device can stream books True
SMART_DEV ( 9.63: 0.000) open Device can stream metadata True
SMART_DEV ( 9.64: 0.000) open Device can receive book binary True
SMART_DEV ( 9.65: 0.001) open Device can delete multiple books True
SMART_DEV ( 9.65: 0.000) open Device can use cached metadata True
SMART_DEV ( 9.65: 0.000) open Cache uses lpaths True
SMART_DEV ( 9.66: 0.000) open Can send OK to sendbook True
SMART_DEV ( 9.66: 0.000) open Can accept library info True
SMART_DEV ( 9.66: 0.000) open Will ask for update books False
SMART_DEV ( 9.67: 0.000) open Will set temp mark when syncing read False
SMART_DEV ( 9.67: 0.000) open Client device kind ONEPLUS A5000
SMART_DEV ( 9.67: 0.000) open Client device name CBH ONEPLUS
SMART_DEV ( 9.68: 0.000) open Client app name CalibreCompanion
SMART_DEV ( 9.68: 0.000) open App version #: 392
SMART_DEV ( 9.68: 0.000) open max_book_packet_len 4096
SMART_DEV ( 9.68: 0.000) open Device wants UUID file names False
SMART_DEV ( 9.69: 0.001) open selected formats ['epub', 'mobi', 'pdf', 'm4b', 'zip']
SMART_DEV ( 9.69: 0.000) open extension path lengths {'epub': 38, 'mobi': 38, 'pdf': 38, 'm4b': 38, 'zip': 38}
SMART_DEV ( 9.69: 0.000) open cover height 480
SMART_DEV ( 9.70: 0.000) open Device is_read sync col #cbhread
SMART_DEV ( 9.70: 0.000) open Device is_read_date sync col #cbhdr
SMART_DEV ( 9.70: 0.001) card_prefix
SaveVirtualLibrariesToColumnGUI device connected True
SMART_DEV ( 9.71: 0.007) set_progress_reporter
Job: 0 Get device information started
SMART_DEV ( 9.72: 0.001) get_device_information
SMART_DEV ( 9.72: 0.001) _call_client GET_DEVICE_INFORMATION wfr True
SMART_DEV ( 9.79: 0.069) _call_client SET_CALIBRE_DEVICE_INFO wfr True
SMART_DEV ( 9.86: 0.058) _read_metadata_cache device uuid dbd6d9b6-ed74-46ed-a585-613f415f736c
SMART_DEV ( 9.87: 0.004) card_prefix
SMART_DEV ( 9.87: 0.000) free_space
SMART_DEV ( 9.87: 0.000) _call_client FREE_SPACE wfr True
SMART_DEV ( 9.93: 0.060) free_space free space: 843460608
DeviceJob: 0 Get device information done, calling callback
DeviceJob: 0 Get device information callback returned
SMART_DEV ( 9.95: 0.006) set_progress_reporter
Job: 1 Set library information started
SMART_DEV ( 9.95: 0.000) set_library_info Library.test_small b997a7e9-4600-4c33-9fa3-b7ee4f0118b5
SMART_DEV ( 9.96: 0.000) _call_client SET_LIBRARY_INFO wfr True
DeviceJob: 1 Set library information done, calling callback
DeviceJob: 1 Set library information callback returned
SMART_DEV ( 10.09: 0.128) set_progress_reporter
Job: 2 Get list of books on device started
SMART_DEV ( 10.10: 0.000) books None
SMART_DEV ( 10.10: 0.000) _call_client GET_BOOK_COUNT wfr True
SMART_DEV ( 10.14: 0.043) books caching. count= 101
SMART_DEV ( 10.25: 0.097) books received all books. count= 101
SMART_DEV ( 10.26: 0.009) books processed cache. count= 101
SMART_DEV ( 10.26: 0.000) books removed 0 books from caches
SMART_DEV ( 10.27: 0.000) books caching. Need count from device 101
SMART_DEV ( 10.30: 0.025) books getting book metadata. Done 0 of 101
Job: 0 Get device information finished
No details available.
Job: 1 Set library information finished
No details available.
SMART_DEV ( 12.81: 2.515) books getting book metadata. Done 100 of 101
SMART_DEV ( 12.83: 0.011) books finished getting book metadata
SMART_DEV ( 12.83: 0.000) books carda
SMART_DEV ( 12.83: 0.000) books cardb
DeviceJob: 2 Get list of books on device done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 101
SMART_DEV ( 12.84: 0.006) synchronize_with_db is_read_sync_col not in field_metadata
SMART_DEV ( 12.85: 0.000) _call_client DISPLAY_MESSAGE wfr True
SMART_DEV ( 12.90: 0.046) synchronize_with_db is_read_date_sync_col not in field_metadata
SMART_DEV ( 12.91: 0.000) _call_client DISPLAY_MESSAGE wfr True
SMART_DEV ( 12.97: 0.058) set_plugboards
DeviceJob: set_books_in_library finished: time= 0.14099884033203125
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
READING LIST: Metadata available: {'main': {'last_library_uuid': 'b997a7e9-4600-4c33-9fa3-b7ee4f0118b5', 'prefix': '', 'calibre_version': '5.2.0', 'device_name': 'CBH ONEPLUS', 'date_last_connected': '2020-10-10T11:48:38.129819+00:00', 'device_store_uuid': 'dbd6d9b6-ed74-46ed-a585-613f415f736c', 'location_code': 'main'}}
READING LIST: Sync Now - force_sync= False
READING LIST: Device found to sync to: ONEPLUS A5000 dbd6d9b6-ed74-46ed-a585-613f415f736c
DeviceJob: 2 Get list of books on device callback returned
SMART_DEV ( 13.01: 0.028) set_progress_reporter
Job: 3 Send metadata to device started
SMART_DEV ( 13.01: 0.001) sync_booklists collection attributes ['series', 'rating']
DEBUG: 0.0 Starting get_collections: on_connect
DEBUG: 0.0 Renaming rules: {}
DEBUG: 0.0 Formatting template: {value}{category:| (|)}
DEBUG: 0.0 Sorting rules: [[['%abs'], '#rights']]
SMART_DEV ( 13.02: 0.008) _call_client SEND_BOOKLISTS wfr False
SMART_DEV ( 13.03: 0.000) _write_metadata_cache
SMART_DEV ( 13.29: 0.255) _write_metadata_cache wrote 101 entries, purged 0 entries
SMART_DEV ( 13.30: 0.005) card_prefix
SMART_DEV ( 13.30: 0.000) free_space
SMART_DEV ( 13.30: 0.001) _call_client FREE_SPACE wfr True
Job: 2 Get list of books on device finished
No details available.
SMART_DEV ( 13.38: 0.077) free_space free space: 843468800
DeviceJob: 3 Send metadata to device done, calling callback
DeviceJob: 3 Send metadata to device callback returned
SMART_DEV ( 13.40: 0.010) _call_client NOOP wfr True
Job: 3 Send metadata to device finished
No details available.
SMART_DEV ( 15.47: 2.056) _call_client NOOP wfr True
SMART_DEV ( 17.66: 2.186) _call_client NOOP wfr True
SMART_DEV ( 19.81: 2.152) _call_client NOOP wfr True
SMART_DEV ( 21.95: 2.140) _call_client NOOP wfr True
SMART_DEV ( 21.96: 0.000) _receive_from_client protocol error -- empty json string
SMART_DEV ( 21.96: 0.000) _call_client other exception
Traceback (most recent call last):
File "C:\CBH_Data\calibre.git\calibre_dev\src\calibre\d evices\smart_device_app\driver.py", line 652, in _call_client
File "C:\CBH_Data\calibre.git\calibre_dev\src\calibre\d evices\smart_device_app\driver.py", line 694, in _receive_from_client
calibre.devices.errors.ControlError: Device responded with incorrect information
SMART_DEV ( 21.96: 0.000) _write_metadata_cache
SMART_DEV ( 22.20: 0.239) _write_metadata_cache wrote 101 entries, purged 0 entries
SMART_DEV ( 22.22: 0.007) post_yank_cleanup
SaveVirtualLibrariesToColumnGUI device connected False
READING LIST: Device disconnected

[JimmXinu]

I regularly use CC connected by wifi (aka wireless device driver) myself. However, I did already have my android phone (Samsung Galaxy S10e) configured in RL. (I use RL to delete new books from CC now due to the problem described here. I doubt that makes any difference to this.)

I also see the 'Add Device' button in RL disabled, but I assumed that's because it's already added... I agree that RL's config is not showing my phone as 'Connected' like it does my Kindle Voyage.

Given your report, I hesitate to remove the device entry for my phone and try to re-add it. I'll try to dig out another phone to test it with.

[chaley]

Originally Posted by JimmXinu

I also see the 'Add Device' button in RL disabled, but I assumed that's because it's already added... I agree that RL's config is not showing my phone as 'Connected' like it does my Kindle Voyage.

Given your report, I hesitate to remove the device entry for my phone and try to re-add it. I'll try to dig out another phone to test it with.

After more testing, it seems that Reading List uses the device's assigned UUID to do list syncing, but uses the device name to indicate "connected".

I tested this as follows:

1. Connecting. RL showed the device as connected and the debug log indicates that it will sync.
   

   READING LIST: Device found to sync to: CBH dbd6d9b6-ed74-46ed-a585-613f415f736c

2. Disconnected.
3. Renamed the device in CC
4. Connected. RL didn't show the device as connected but did show that it would sync with it (same message as above, UUID match).
5. Disconnected. Deleted the device from RL.
6. Connected. This time RL didn't find the UUID to sync. (no "Device found to sync" message in the debug log.)
7. In RL, added the device.
8. Disconnected and reconnected.
9. RL indicated the device is connected and is available to sync.

Thus it seems that if the device name changes, perhaps because of an OS upgrade, RL will still sync but not indicate connected. I think this is a bug -- RL should use the UUID instead of the name.

Also note that the UUID will change if CC is uninstalled then reinstalled without using a database backup. At this point the only choice is to remove and re-add the device in RL.

[JimmXinu]

I found my retired Samsung Galaxy S7 and tried a few things. This is what I found:

1. After installing CC, I was able to connect to Calibre as a wireless device.
2. RL's 'Add Device' button was enabled, clicking it, the device was added with Samsung's technical name for it: SM-G930V.
3. The SM-G930V device did show as connected in RL config.
4. Disconnected, reconnected, still showed as connected in RL config.
5. Changed name of device to 'Old Galaxy S7',
6. Disconnected, reconnected, now 'Old Galaxy S7' is connected, but isn't shown as connected in RL config.
7. Removed 'Old Galaxy S7' in RL device config.
8. RL's 'Add Device' button was enabled, clicking it, the device was added with previously set name, 'Old Galaxy S7' and is shown as connected now.
9. Disconnected, reconnected, 'Old Galaxy S7' is connected, and is shown as connected in RL config.

I see chaley was following the same path and both got farther and posted faster than me. I'll look into changing RL for that.

[JimmXinu]

New Test Version Attached

2020-10-10
- Don't check device type, only uuid when determining connected devices.

What happened is that the customized device name is included in the field device type when it's a Wireless Device; and that RL also checks device_type to determine status display. (Kindle, at least, does not add the customized name to device type.)

We're going to instead assume uuid is a universal unique identifer.

I believe that the disabled Add Device button issue is just because it's already connected. At least, I can't make it happen. If you can, please let me know.

[nikoski]

Thanks a lot for all your hints and testing the issue!

Android 10 devices:
My issue seems that my 2 android 10 / CC-by-WiFi devices are "seen" by RL as the same device although they have different names set in CC.

After updating RL to the yesterday's v.10.10.2020 i deleted my devices, but was able to add only 1 of them, because my 2 devices show now as connected under the name of the first added device as follows:

- i connect device with the name X in CC, add it in RL and it shows as connected under "status"
- i disconnect device X
- i connect device with the name Y in CC, but i cannot add it in RL because it show as already connected in RL under the name X

USB devices:
I also have a third USB-device, a "Sony Reader", this one connected by USB cable shows in RL as a different connected device with the correct name: "Sony Reader".

[JimmXinu]

Originally Posted by nikoski

Android 10 devices:
My issue seems that my 2 android 10 / CC-by-WiFi devices are "seen" by RL as the same device although they have different names set in CC.
...

Did you copy your CC files from one device to the other?

Because that's the only way I can think of that two devices will have the same universal unique identifier(uuid). Which is the only way that would happen.

[nikoski]

Originally Posted by JimmXinu

Did you copy your CC files from one device to the other?

Because that's the only way I can think of that two devices will have the same universal unique identifier(uuid). Which is the only way that would happen.

Yes i did
Where ist this uuid placed at? Or what do i have to do to change it?

[JimmXinu]

Originally Posted by nikoski

Yes i did
Where ist this uuid placed at? Or what do i have to do to change it?

I believe it is assigned by Calibre.

I have no idea how you'd change it in an existing CC install, or if it would be safe to do so. chaley?

[chaley]

Originally Posted by JimmXinu

I believe it is assigned by Calibre.

I have no idea how you'd change it in an existing CC install, or if it would be safe to do so. chaley?

There is no mechanism in CC or the calibre wireless device driver to change the UUID. After all, it isn't supposed to be changed.

The only way I know to get a new UUID is to reset CC, either by uninstall and reinstall or in Android Settings / Apps / Calibre Companion / Clear Storage. Both do the same thing -- completely reinitialize CC, including CC's book database. You should be able to recover the book database and the Formats & Folders settings. You must not restore the CC settings because that will restore the UUID.

The steps should be:

1. In CC, go to Settings / Backup and restore and do a backup choosing all three items.
2. Make a note of all the CC settings you want to keep. In your case the other device might be the best source for this.
3. In Android, go to Settings / Apps / CC and clear storage. Exactly how you do this depends on which version of Android you have.
4. Start CC. You will have an empty library.
5. In CC, go to Settings / Backup and restore and restore the settings and storage folder locations.
6. Reapply the other settings you want.
7. Connect to calibre as a wireless device. A new UUID will be set.
8. For completeness, disconnect and reconnect.
9. You should now be able to add the device in RL.

Although I know no reason this won't work, I cannot guarantee that it will.

[JimmXinu]

New Test Version Attached

2020-10-11
- New optional list features: Put any List's View action in the PI top menu and an option to not sort the books in list order on view. Thanks to kiwidude himself for these changes.

[Bigo2]

Hi I was looking for a feature, something like Favorites, but it doesn't exist. However I have found the Reading List Plugin which would work for me.
Now I would like to create a Column in Preferences -> Add your own columns, called View Default list, but I'm not sure how to do it. Please help me. Thanks

[JimmXinu]

Maybe you want a series type custom column and then set your reading list to update that series column?

Otherwise, I've no idea what you're asking for.

[Bigo2]

If I click any column it will organize itself from the top alphabetically according to its purpose - Title, Author(s), Series, Tags, Publisher, Date etc. Some columns organize according to the date etc...
I would like to have a column called Default list, which when clicked it would reorganize all titles alphabetically, according to the Default list, so I would not have to go to Main Toolbar - Reading List - View Default list.
I don' know if it is possible and how exactly I will create such a Column.

[BetterRed]

Originally Posted by Bigo2

If I click any column it will organize itself from the top alphabetically according to its purpose - Title, Author(s), Series, Tags, Publisher, Date etc. Some columns organize according to the date etc...
I would like to have a column called Default list, which when clicked it would reorganize all titles alphabetically, according to the Default list, so I would not have to go to Main Toolbar - Reading List - View Default list.
I don' know if it is possible and how exactly I will create such a Column.

A simpler way would be to assign a keyboard shortcut to Preferences->Shortcuts->Reading list->View books in the "Default" list, viz:



BR