Guide to Collections Management with calibre (Touch / Glo / Mini /Aura)

[davidfor]

If you have the collection column set correctly, and the collection options set, then the most likely problem is the most likely the metadata management option.

In the calibre preferences, on the "Sending books to devices", make sure the the "Metadata management" option is set to "Automatic management". With this, the collection management will be done when you connect the device.

If that doesn't work, I need to see a debug log. That is created by restarting calibre in debug mode (right-click on the preferences button and select "Restart in debug mode"). Then, connect the device, let the initial jobs run and then close calibre. The debug log will be displayed. Post the full contents of the log.

[WendyTJ]

TOTAL LOG
calibre Debug log
calibre 2.66 embedded-python: True is64bit: False
Windows-8-6.2.9200 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: Kobo Utilities (2, 4, 1) && KoboTouchExtended (2, 8, 0) && KoboBooks (1, 0, 0)
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 81.5518394649 x 81.6428571429
Starting up...
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 2.4 No Kobo Touch, Glo or Mini appears to be connected
DEBUG: 2.4 rebuild_menus - self.supports_ratings=None, self.supports_tiles=None
DEBUG: 2.4 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 2.4 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Driver: KoboTouchExtended'
Started up in 5.50 seconds with 931 books


On a side note, the series information doesnt update till I load another book, so the series information appears to be one 'load' behind
thanks

[davidfor]

Originally Posted by WendyTJ

TOTAL LOG
calibre Debug log
calibre 2.66 embedded-python: True is64bit: False
Windows-8-6.2.9200 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: Kobo Utilities (2, 4, 1) && KoboTouchExtended (2, 8, 0) && KoboBooks (1, 0, 0)
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 81.5518394649 x 81.6428571429
Starting up...
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 2.4 No Kobo Touch, Glo or Mini appears to be connected
DEBUG: 2.4 rebuild_menus - self.supports_ratings=None, self.supports_tiles=None
DEBUG: 2.4 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 2.4 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Driver: KoboTouchExtended'
Started up in 5.50 seconds with 931 books

That's just calibre starting without a device connected. I need the log with the device connected. The collection management is done by the jobs that are run when the device is connected.

On a side note, the series information doesnt update till I load another book, so the series information appears to be one 'load' behind

No, the series information can only be set for books that have been processed into the database on the device. This means that you need send the book to the device and disconnect and let it process the book. Then, when you connect again, the series information will be set during the initial jobs.

[WendyTJ]

This time hope I have the right log. Definitely appreciate your time and explanations
calibre Debug log

USE SPOILER TAGS FOR LONG POSTS - MODERATOR]

Spoiler:

calibre 2.66 embedded-python: True is64bit: False
Windows-8-6.2.9200 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: KoboBooks (1, 0, 0) && Kobo Utilities (2, 4, 1) && KoboTouchExtended (2, 8, 0)
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 81.5518394649 x 81.6428571429
Starting up...
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations
DEBUG: 0.1 KoboUtilites::action.py - loading translations
DEBUG: 2.7 No Kobo Touch, Glo or Mini appears to be connected
DEBUG: 2.7 rebuild_menus - self.supports_ratings=None, self.supports_tiles=None
DEBUG: 2.7 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 2.7 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Driver: KoboTouchExtended'
Started up in 8.03 seconds with 932 books
Storage number map:
{(7L, 0L): [(3L, 'C'), (5L, 'D')],
(7L, 1L): [(1L, 'F')],
(7L, 2L): [(1L, 'H')],
(7L, 3L): [(1L, 'G')],
(7L, 4L): [(1L, 'I')]}
Storage number for USBSTOR\DISK&VEN_KOBO&PROD_EREADER-3.14.0&REV_0110\8&19684240&0: StorageDeviceNumber(type=7L, number=4L, partition_number=0L)
Drive letters for USBDevice(vendor_id=0x2237 product_id=0x4223 bcd=0x110 devid=usb\vid_2237&pid_4223&rev_0110 devinst=10)
{u'drive_letters': ['I'],
u'pnp_id_map': {'I': u'\\\\?\\usbstor#disk&ven_kobo&prod_ereader-3.14.0&rev_0110#8&19684240&0#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}'},
u'readonly_drives': set([]),
u'sort_map': {'I': (4L, 1L)}}
DEBUG: 7.8 KoboUtilities:_on_device_connection_changed - self.plugin_device_connection_changed.__class__: <type 'PyQt5.QtCore.pyqtBoundSignal'>
DEBUG: 7.8 Methods for self.plugin_device_connection_changed: ['__call__', '__class__', '__delattr__', '__doc__', '__format__', '__getattribute__', '__getitem__', '__hash__', '__init__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__str__', '__subclasshook__', 'connect', 'disconnect', 'emit', 'signal']
DEBUG: 7.8 Have a Kobo device connected connected
DEBUG: 7.8 BEGIN Get Device Path
DEBUG: 7.8 Root path of device: I:\
DEBUG: 7.8 END Get Device Path
DEBUG: 7.8 KoboUtilities:get_device - self.device_path="I:\"
DEBUG: 7.8 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 7.8 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Driver: KoboTouchExtended'
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1Job: 1 Get device information callback returnedGet device information
finished
No details available.Job:
2 Set library information started
DeviceJob: 2 Set library information done, calling callback
DeviceJob: 2 Set library information callback returned
Job: 3 Get list of books on device started
DEBUG: 0.0 KoboTouch:books - oncard='None'
DEBUG: 0.1 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x0C70C090>
DEBUG: 0.1 KoboTouch:books - oncard='None', prefix='I:\'
DEBUG: 0.1 Kobo device: Kobo Glo HD
DEBUG: 0.1 Version of driver: (2, 8, 0) Has kepubs: True
DEBUG: 0.1 Version of firmware: (3, 14, 0) Has kepubs: True
DEBUG: 0.1 Firmware supports cover image tree: True
DEBUG: 0.3 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x0C70C070>
DEBUG: 0.3 KoboTouch:books - opts.extra_customization= []
DEBUG: 0.3 KoboTouch:books - driver options= Driver:KoboTouchExtended, Options - format_map: ['kepub', 'epub', 'cbr', 'cbz', 'pdf', 'txt'], use_subdirs: True, read_metadata: True, use_author_sort: False, save_template: {author_sort}/{title} - {authors}, extra_customization: [], manage_collections: True, collections_columns: , create_collections: False, delete_empty_collections: False, ignore_collections_names: , upload_covers: False, keep_cover_aspect: False, upload_grayscale: False, show_archived_books: False, show_previews: False, show_recommendations: False, update_series: True, update_device_metadata: True, modify_css: False, support_newer_firmware: False, debugging_title: , driver_version: , extra_features: True, upload_encumbered: False, skip_failed: False, hyphenate: False, replace_lang: False, smarten_punctuation: False, clean_markup: False, full_page_numbers: False, disable_hyphenation: False, file_copy_dir:
DEBUG: 0.4 KoboTouch:books - prefs['manage_device_metadata']= on_connect
DEBUG: 0.4 KoboTouch:books - set_debugging_title to ''
DEBUG: 0.4 KoboTouch:books - length bl=0
Job: 2 Set library information finished
No details available.
Job: 1 Get device information finished
No details available.
DEBUG: 1.5 KoboTouch:books - length bl after sync=722
DEBUG: 1.5 KoboTouch:books - reading device database
DEBUG: 1.5 Database Version: 115
DEBUG: 1.5 KoboTouch:books - shelf list: [u'Weather Warden', u'Underworld Detection Agency', u'Outcast Season']
DEBUG: 1.5 KoboTouch:books - query= SELECT Title, Attribution, DateCreated, ContentID, MimeType, ContentType, ImageID, ReadStatus, ___ExpirationStatus, FavouritesIndex, Accessibility, IsDownloaded, Series, SeriesNumber, ___UserID, ExternalId FROM content where BookID is Null and ((Accessibility = -1 and IsDownloaded in ('true', 1 )) or (Accessibility in (1,2) and IsDownloaded in ('true', 1)) ) and not ((___ExpirationStatus=3 or ___ExpirationStatus is Null) and ContentType = 6) AND (externalId IS NULL OR externalId = '') AND contentId NOT LIKE 'file:///mnt/sd/%'
DEBUG: 4.2 KoboTouch:books - automatically managing metadata
DEBUG: 4.2 KoboTouch:books - about to sync_booklists
DEBUG: 4.2 USBMS: starting sync_booklists
DEBUG: 7.0 USBMS: finished sync_booklists
DEBUG: 7.0 KoboTouch:books - have done sync_booklists
DEBUG: 7.0 KoboTouch:books - end - oncard='None'
DEBUG: 7.0 KoboTouch:books - oncard='carda'
DEBUG: 7.0 KoboTouch:books - Asked to process 'carda', but do not have one!
DEBUG: 7.0 KoboTouch:books - oncard='cardb'
DEBUG: 7.0 KoboTouch:books - Asked to process 'cardb', but do not have one!
DeviceJob: 3 Get list of books on device done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 722
DeviceJob: set_books_in_library finished: time= 0.450999975204
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DEBUG: 7.8 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x0CB83B50>
DEBUG: 8.0 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x0CB83D90>
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
DEBUG: 16.6 KoboUtilites:_on_device_metadata_available - Start
DEBUG: 16.6 Have a Kobo device connected connected
DEBUG: 16.6 BEGIN Get Device Path
DEBUG: 16.6 Root path of device: I:\
DEBUG: 16.6 END Get Device Path
DEBUG: 16.6 KoboUtilities:get_device - self.device_path="I:\"
DEBUG: 16.6 KoboUtilities:get_device - drive_info: {'main': {u'device_name': u'Kobo Glo HD', u'device_store_uuid': u'8c9664bb-8ade-49c4-a764-a329eac978a8', u'location_code': 'main', u'date_last_connected': u'2016-09-06T08:54:02.628000+00:00', u'calibre_version': u'2.66.0', u'last_library_uuid': None, u'prefix': 'I:/'}}
DEBUG: 16.6 migrate_library_config_if_required - start
DEBUG: 16.6 get_library_config - library_config: {u'profiles': {u'Default': {u'forDevice': None, u'storeOptionsStore': {u'storeOnConnect': False, u'storeIfMoreRecent': False, u'doNotStoreIfReopened': False, u'promptToStore': True}, u'updateOptionsStore': {u'doEarlyFirmwareUpdate': False, u'doFirmwareUpdateCheck': False, u'firmwareUpdateCheckLastTime': 0}}}, u'SchemaVersion': 0.1}
DEBUG: 16.6 get_plugin_pref - start - store_name='commonOptionsStore', option='individualDeviceOptions'
DEBUG: 16.6 get_prefs - start - store_name='backupOptionsStore'
DEBUG: 16.6 get_prefs - start - store_name='updateOptionsStore'
DEBUG: 16.6 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 16.6 KoboUtilities:set_toolbar_button_tooltip - device connected. self.device.fwversion= (3, 14, 0)
DEBUG: 16.6 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Connected Device: Kobo Glo HD
Firmware version: 3.14.0
Driver: KoboTouchExtended'
DEBUG: 16.6 KoboUtilites:_on_device_metadata_available - self.current_device_profile: None
DEBUG: 16.6 KoboUtilites:_on_device_metadata_available - self.current_backup_config: {u'doDailyBackp': False, u'backupDestDirectory': u'', u'backupEachCOnnection': False, u'backupCopiesToKeepSpin': 5, u'backupZipDatabase': True}
DEBUG: 16.6 Have a Kobo device connected connected
DEBUG: 16.6 BEGIN Get Device Path
DEBUG: 16.6 Root path of device: I:\
DEBUG: 16.6 END Get Device Path
DEBUG: 16.6 KoboUtilities:get_device - self.device_path="I:\"
DEBUG: 16.6 KoboUtilities:get_device - drive_info: {'main': {u'device_name': u'Kobo Glo HD', u'device_store_uuid': u'8c9664bb-8ade-49c4-a764-a329eac978a8', u'location_code': 'main', u'date_last_connected': u'2016-09-06T08:54:02.628000+00:00', u'calibre_version': u'2.66.0', u'last_library_uuid': None, u'prefix': 'I:/'}}
DEBUG: 16.6 migrate_library_config_if_required - start
DEBUG: 16.6 get_library_config - library_config: {u'profiles': {u'Default': {u'forDevice': None, u'storeOptionsStore': {u'storeOnConnect': False, u'storeIfMoreRecent': False, u'doNotStoreIfReopened': False, u'promptToStore': True}, u'updateOptionsStore': {u'doEarlyFirmwareUpdate': False, u'doFirmwareUpdateCheck': False, u'firmwareUpdateCheckLastTime': 0}}}, u'SchemaVersion': 0.1}
DEBUG: 16.6 get_plugin_pref - start - store_name='commonOptionsStore', option='individualDeviceOptions'
DEBUG: 16.6 get_prefs - start - store_name='backupOptionsStore'
DEBUG: 16.6 get_prefs - start - store_name='updateOptionsStore'
DEBUG: 16.6 rebuild_menus - self.supports_ratings=True, self.supports_tiles=True
DEBUG: 16.6 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 16.6 KoboUtilities:set_toolbar_button_tooltip - device connected. self.device.fwversion= (3, 14, 0)
DEBUG: 16.6 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Connected Device: Kobo Glo HD
Firmware version: 3.14.0
Driver: KoboTouchExtended'
DEBUG: 16.6 rebuild_menus - have device.
DeviceJob: 3 Get list of books on device callback returned
Job: 4 Send metadata to device started
DEBUG: 8.3 KOBO:sync_booklists - start
DEBUG: 8.3 KoboTouch:update_device_database_collections - oncard='main'
DEBUG: 8.3 KoboTouch::is_supported_fwversion - self.fwversion[:2] (3, 14)
DEBUG: 8.3 KoboTouch:update_device_database_collections - set_debugging_title to ''
DEBUG: 8.3 KTCollectionsBookList:get_collections - start - collection_attributes= ['']
DEBUG: 8.3 KTCollectionsBookList:get_collections - collection_attributes= ['']
Job: 3 Get list of books on device finished
No details available.
DEBUG: 8.4 KTCollectionsBookList:get_collections - end
DEBUG: 8.5 No Collections - reseting ReadStatus
DEBUG: 8.5 KoboTouch:update_device_database_collections - managing bookshelves and series.
DEBUG: 8.5 KoboTouch:update_device_database_collections - Number of series set=0 Number of books=722
DEBUG: 8.5 KoboTouch:update_device_database_collections - Finished
DEBUG: 8.5 USBMS: starting sync_booklists
DEBUG: 11.5 USBMS: finished sync_booklists
DEBUG: 11.5 KOBO:sync_booklists - end
DeviceJob: 4 Send metadata to device done, calling callback
DeviceJob: 4 Send metadata to device callback returned
Job: 4 Send metadata to device finished
No details available.

[davidfor]

Originally Posted by WendyTJ

DEBUG: 0.3 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x0C70C070>
DEBUG: 0.3 KoboTouch:books - opts.extra_customization= []
DEBUG: 0.3 KoboTouch:books - driver options= Driver:KoboTouchExtended, Options - format_map: ['kepub', 'epub', 'cbr', 'cbz', 'pdf', 'txt'], use_subdirs: True, read_metadata: True, use_author_sort: False, save_template: {author_sort}/{title} - {authors}, extra_customization: [], manage_collections: True, collections_columns: , create_collections: False, delete_empty_collections: False, ignore_collections_names: , upload_covers: False, keep_cover_aspect: False, upload_grayscale: False, show_archived_books: False, show_previews: False, show_recommendations: False, update_series: True, update_device_metadata: True, modify_css: False, support_newer_firmware: False, debugging_title: , driver_version: , extra_features: True, upload_encumbered: False, skip_failed: False, hyphenate: False, replace_lang: False, smarten_punctuation: False, clean_markup: False, full_page_numbers: False, disable_hyphenation: False, file_copy_dir:
DEBUG: 0.4 KoboTouch:books - prefs['manage_device_metadata']= on_connect
DEBUG: 0.4 KoboTouch:books - set_debugging_title to ''

According to the log, you have not configured the collection management in the driver. Hence, not The highlighted parts show that you have turned collection management on, but not configure any collection columns and not selected the option that allows collections to be created.

You might have configured the KoboTouch driver. But, as you are using the KoboTouchExtended, you need to configure that.

[WendyTJ]

Thank you for your assistance. It worked, your instructions are Wendy proof which is saying something. I do appreciate all my shelves on my Kobo

[Paul Crompton]

Hi,

As the instructions are very old, I am not sure I am getting it right.

When I click on the plugin 'KoboTouch 2.3.2', in the 'Save Template' box at the bottom I have put

'#myshelves, series'

on the next tab 'Collections' in the 'Collections columns' Box I have put

'#myshelves'

However whenever I try to add a group of books to my kobo it only adds one of them. If I add a second book, the first one is erased, so in effect in the new kobo I just bought I can only transfer one book to it, as each time I add a book, the previous one is erased.

It all worked fine until I tried to add the collections!

Any help? Any way of resetting the plugin back to its original set up?

Cheers

Paul

[Paul Crompton]

and here is the full debug log....

Please have the courtesy to use spolier quotes for such a long post - MODERATOR]

Spoiler:

calibre Debug log
calibre 2.74 [64bit] embedded-python: True is64bit: True
Windows-8-6.2.9200 Windows ('64bit', 'WindowsPE')
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 95.8113948919 x 95.9160839161
Starting up...
Failed to get storage number for drive: C with error: [Error 1] Incorrect function.
Failed to get storage number for drive: D with error: [Error 1] Incorrect function.
Failed to get storage number for drive: E with error: [Error 1] Incorrect function.
Failed to get storage number for drive: F with error: [Error 1] Incorrect function.
Failed to get storage number for drive: K with error: [Error 1] Incorrect function.
Failed to get storage number for drive: P with error: [Error 1] Incorrect function.
Storage number map:
{(7L, 1L): [(1L, 'T')],
(7L, 2L): [(1L, 'G')],
(7L, 3L): [(1L, 'H')],
(7L, 4L): [(1L, 'I')],
(7L, 5L): [(1L, 'L')]}
Storage number for USBSTOR\DISK&VEN_KOBO&PROD_EREADER-3.19.576&REV_0110\N437585909652&0: StorageDeviceNumber(type=7L, number=5L, partition_number=0L)
Drive letters for USBDevice(vendor_id=0x2237 product_id=0x4223 bcd=0x110 devid=usb\vid_2237&pid_4223&rev_0110 devinst=11)
{u'drive_letters': ['L'],
u'pnp_id_map': {'L': u'\\\\?\\usbstor#disk&ven_kobo&prod_ereader-3.19.576&rev_0110#n437585909652&0#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}'},
u'readonly_drives': set([]),
u'sort_map': {'L': (5L, 1L)}}
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1 Get device information callback returned
Job: 2 Set library information started
DeviceJob: 2 Set library information done, calling callback
Job: 1 Get device information finished
No details available.
Job: 2 Set library information finished
No details available.
DeviceJob: 2 Set library information callback returned
Job: 3 Get list of books on device started
DEBUG: 0.0 KoboTouch:books - oncard='None'
DEBUG: 0.0 KoboTouch:books - oncard='None', prefix='L:\'
DEBUG: 0.0 Kobo device: Kobo Glo HD
DEBUG: 0.0 Version of driver: (2, 3, 2) Has kepubs: True
DEBUG: 0.0 Version of firmware: (3, 19, 5761) Has kepubs: True
DEBUG: 0.0 Firmware supports cover image tree: True
DEBUG: 0.0 KoboTouch:books - opts.extra_customization= []
DEBUG: 0.0 KoboTouch:books - driver options= Driver:KoboTouch, Options - format_map: [u'epub', u'pdf', u'txt', u'cbz', u'cbr', u'kepub'], use_subdirs: True, read_metadata: True, use_author_sort: False, save_template: #myshelves, series, extra_customization: [], manage_collections: True, collections_columns: #myshelves, create_collections: True, delete_empty_collections: True, ignore_collections_names: , upload_covers: False, keep_cover_aspect: False, upload_grayscale: False, show_archived_books: False, show_previews: False, show_recommendations: False, update_series: True, update_device_metadata: True, modify_css: False, support_newer_firmware: True, debugging_title: , driver_version: 2.3.2
DEBUG: 0.0 KoboTouch:books - prefs['manage_device_metadata']= on_connect
DEBUG: 0.0 KoboTouch:books - set_debugging_title to ''
DEBUG: 0.0 KoboTouch:books - length bl=0
DEBUG: 0.1 KoboTouch:books - length bl after sync=65
DEBUG: 0.1 KoboTouch:books - reading device database
DEBUG: 0.1 Database Version: 131
DEBUG: 0.1 KoboTouch:books - shelf list: []
DEBUG: 0.1 KoboTouch:books - query= SELECT Title, Attribution, DateCreated, ContentID, MimeType, ContentType, ImageID, ReadStatus, ___ExpirationStatus, FavouritesIndex, Accessibility, IsDownloaded, Series, SeriesNumber, ___UserID, ExternalId FROM content WHERE BookID IS NULL AND ((Accessibility = -1 AND IsDownloaded in ('true', 1 )) OR (Accessibility IN (1,2) and IsDownloaded in ('true', 1)) ) AND (externalId IS NULL OR externalId = '') AND contentId NOT LIKE 'file:///mnt/sd/%'
DEBUG: 0.1 KoboTouch:books - automatically managing metadata
DEBUG: 0.1 KoboTouch:books - about to sync_booklists
DEBUG: 0.1 USBMS: starting sync_booklists
DEBUG: 0.5 USBMS: finished sync_booklists
DEBUG: 0.5 KoboTouch:books - have done sync_booklists
DEBUG: 0.5 KoboTouch:books - end - oncard='None'
DEBUG: 0.5 KoboTouch:books - oncard='carda'
DEBUG: 0.5 KoboTouch:books - Asked to process 'carda', but do not have one!
DEBUG: 0.5 KoboTouch:books - oncard='cardb'
DEBUG: 0.5 KoboTouch:books - Asked to process 'cardb', but do not have one!
DeviceJob: 3 Get list of books on device done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 65
DeviceJob: set_books_in_library finished: time= 0.0260000228882
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
DeviceJob: 3 Get list of books on device callback returned
Job: 4 Send metadata to device started
DEBUG: 0.7 KOBO:sync_booklists - start
DEBUG: 0.7 KoboTouch:update_device_database_collections - oncard='main'
DEBUG: 0.7 KoboTouch:update_device_database_collections - set_debugging_title to ''
DEBUG: 0.7 KTCollectionsBookList:get_collections - start - collection_attributes= [u'#myshelves']
DEBUG: 0.7 KTCollectionsBookList:get_collections - collection_attributes= [u'#myshelves']
DEBUG: 0.8 KTCollectionsBookList:get_collections - end
DEBUG: 0.8 KoboTouch:update_device_database_collections - category='Shardlake' books=1
DEBUG: 0.9 KoboTouch:update_device_database_collections - end for category='Shardlake'
DEBUG: 0.9 KoboTouch:update_device_database_collections - managing bookshelves and series.
Job: 3 Get list of books on device finished
No details available.
Job: 2 Set library information finished
No details available.
DEBUG: 1.0 KoboTouch:update_device_database_collections - about to clear empty bookshelves
DEBUG: 1.0 KoboTouch:delete_empty_bookshelves - start
DEBUG: 1.0 KoboTouch:delete_empty_bookshelves - end
DEBUG: 1.0 KoboTouch:update_device_database_collections - Number of series set=1 Number of books=64
DEBUG: 1.0 KoboTouch:update_device_database_collections - Finished
DEBUG: 1.0 USBMS: starting sync_booklists
DEBUG: 1.2 USBMS: finished sync_booklists
DEBUG: 1.2 KOBO:sync_booklists - end
DeviceJob: 4 Send metadata to device done, calling callback
DeviceJob: 4 Send metadata to device callback returned
Job: 4 Send metadata to device finished
No details available.
Started up in 12.89 seconds with 1462 books
Job: 5 Upload one book to the device:Speaks the Nightbird started
Device using plugboard epub KOBOTOUCH [[u'{series_index:0>2s|| - }{title}', u'title']]
Setting metadata in: Speaks the Nightbird at: C:\Users\Paul\AppData\Local\Temp\calibre_vs1byh\1n lgpacaltmpfmt.epub
DEBUG: 15.4 KoboTouch:upload_books - 1 books
DEBUG: 15.4 KoboTouch:upload_books - files= [u'C:\\Users\\Paul\\AppData\\Local\\Temp\\calibre_v s1byh\\1nlgpacaltmpfmt.epub']
DEBUG: 15.4 USBMS: uploading 1 books
DEBUG: 16.8 KoboTouch:upload_cover - path='L:\' filename='#myshelves, series'
DEBUG: 16.8 filepath='L:\#myshelves, series.epub'
DEBUG: 16.8 USBMS: finished uploading 1 books
DEBUG: 17.0 KoboTouch:delete_images - ImageID= file____mnt_onboard_#myshelves,_series_epub
DEBUG: 17.0 KoboTouch:delete_images - path=L:\.kobo-images/18\197\file____mnt_onboard_#myshelves,_series_epub
DEBUG: 17.0 KoboTouch:delete_images - fpath=L:\.kobo-images\18\197\file____mnt_onboard_#myshelves,_seri es_epub - N3_LIBRARY_GRID.parsed
DEBUG: 17.0 KoboTouch:delete_images - fpath=L:\.kobo-images\18\197\file____mnt_onboard_#myshelves,_seri es_epub - N3_LIBRARY_FULL.parsed
DEBUG: 17.0 KoboTouch:delete_images - fpath=L:\.kobo-images\18\197\file____mnt_onboard_#myshelves,_seri es_epub - AndroidBookLoadTablet_Aspect.parsed
DEBUG: 17.0 KoboTouch:delete_images - fpath=L:\.kobo-images\18\197\file____mnt_onboard_#myshelves,_seri es_epub - N3_FULL.parsed
DeviceJob: 5 Upload one book to the device:Speaks the Nightbird done, calling callback
DeviceJob: set_books_in_library: books to process= 65
Job: 5 Upload one book to the device:Speaks the Nightbird finished
No details available.
DeviceJob: set_books_in_library finished: time= 0.00699996948242
DeviceJob: 5 Upload one book to the device:Speaks the Nightbird callback returned
Job: 6 Send metadata to device started
DEBUG: 17.2 KOBO:sync_booklists - start
DEBUG: 17.2 KoboTouch:update_device_database_collections - oncard='main'
DEBUG: 17.2 KoboTouch:update_device_database_collections - set_debugging_title to ''
DEBUG: 17.2 KTCollectionsBookList:get_collections - start - collection_attributes= [u'#myshelves']
DEBUG: 17.2 KTCollectionsBookList:get_collections - collection_attributes= [u'#myshelves']
DEBUG: 17.3 KTCollectionsBookList:get_collections - end
DEBUG: 17.3 KoboTouch:update_device_database_collections - category='Matthew Corbett' books=1
DEBUG: 17.4 KoboTouch:update_device_database_collections - end for category='Matthew Corbett'
DEBUG: 17.4 KoboTouch:update_device_database_collections - category='Shardlake' books=1
DEBUG: 17.4 KoboTouch:update_device_database_collections - end for category='Shardlake'
DEBUG: 17.4 KoboTouch:update_device_database_collections - managing bookshelves and series.
DEBUG: 17.5 KoboTouch:update_device_database_collections - about to clear empty bookshelves
DEBUG: 17.5 KoboTouch:delete_empty_bookshelves - start
DEBUG: 17.5 KoboTouch:delete_empty_bookshelves - end
DEBUG: 17.5 KoboTouch:update_device_database_collections - Number of series set=1 Number of books=64
DEBUG: 17.5 KoboTouch:update_device_database_collections - Finished
DEBUG: 17.5 USBMS: starting sync_booklists
DEBUG: 17.8 USBMS: finished sync_booklists
DEBUG: 17.8 KOBO:sync_booklists - end
DeviceJob: 6 Send metadata to device done, calling callback
DeviceJob: 6 Send metadata to device callback returned
Job: 6 Send metadata to device finished
No details available.
Job: 5 Upload one book to the device:Speaks the Nightbird finished
No details available.
Job: 7 Upload one book to the device:The Queen of Bedlam started
Device using plugboard epub KOBOTOUCH [[u'{series_index:0>2s|| - }{title}', u'title']]
Setting metadata in: The Queen of Bedlam at: C:\Users\Paul\AppData\Local\Temp\calibre_vs1byh\y9 tjvhcaltmpfmt.epub
DEBUG: 21.9 KoboTouch:upload_books - 1 books
DEBUG: 21.9 KoboTouch:upload_books - files= [u'C:\\Users\\Paul\\AppData\\Local\\Temp\\calibre_v s1byh\\y9tjvhcaltmpfmt.epub']
DEBUG: 21.9 USBMS: uploading 1 books
DEBUG: 23.5 KoboTouch:upload_cover - path='L:\' filename='#myshelves, series'
DEBUG: 23.5 filepath='L:\#myshelves, series.epub'
DEBUG: 23.5 USBMS: finished uploading 1 books
DEBUG: 23.7 KoboTouch:delete_images - ImageID= file____mnt_onboard_#myshelves,_series_epub
DEBUG: 23.7 KoboTouch:delete_images - path=L:\.kobo-images/18\197\file____mnt_onboard_#myshelves,_series_epub
DEBUG: 23.7 KoboTouch:delete_images - fpath=L:\.kobo-images\18\197\file____mnt_onboard_#myshelves,_seri es_epub - N3_LIBRARY_GRID.parsed
DEBUG: 23.7 KoboTouch:delete_images - fpath=L:\.kobo-images\18\197\file____mnt_onboard_#myshelves,_seri es_epub - N3_LIBRARY_FULL.parsed
DEBUG: 23.7 KoboTouch:delete_images - fpath=L:\.kobo-images\18\197\file____mnt_onboard_#myshelves,_seri es_epub - AndroidBookLoadTablet_Aspect.parsed
DEBUG: 23.7 KoboTouch:delete_images - fpath=L:\.kobo-images\18\197\file____mnt_onboard_#myshelves,_seri es_epub - N3_FULL.parsed
DeviceJob: 7 Upload one book to the device:The Queen of Bedlam done, calling callback
DeviceJob: set_books_in_library: books to process= 65
DeviceJob: set_books_in_library finished: time= 0.00499987602234
DeviceJob: 7 Upload one book to the device:The Queen of Bedlam callback returned
Job: 8 Send metadata to device started
DEBUG: 24.0 KOBO:sync_booklists - start
DEBUG: 24.0 KoboTouch:update_device_database_collections - oncard='main'
DEBUG: 24.0 KoboTouch:update_device_database_collections - set_debugging_title to ''
DEBUG: 24.0 KTCollectionsBookList:get_collections - start - collection_attributes= [u'#myshelves']
DEBUG: 24.0 KTCollectionsBookList:get_collections - collection_attributes= [u'#myshelves']
Job: 7 Upload one book to the device:The Queen of Bedlam finished
No details available.
DEBUG: 24.0 KTCollectionsBookList:get_collections - end
DEBUG: 24.0 KoboTouch:update_device_database_collections - category='Matthew Corbett' books=1
DEBUG: 24.0 KoboTouch:update_device_database_collections - end for category='Matthew Corbett'
DEBUG: 24.0 KoboTouch:update_device_database_collections - category='Shardlake' books=1
DEBUG: 24.0 KoboTouch:update_device_database_collections - end for category='Shardlake'
DEBUG: 24.0 KoboTouch:update_device_database_collections - managing bookshelves and series.
DEBUG: 24.1 KoboTouch:update_device_database_collections - about to clear empty bookshelves
DEBUG: 24.1 KoboTouch:delete_empty_bookshelves - start
DEBUG: 24.1 KoboTouch:delete_empty_bookshelves - end
DEBUG: 24.1 KoboTouch:update_device_database_collections - Number of series set=1 Number of books=64
DEBUG: 24.1 KoboTouch:update_device_database_collections - Finished
DEBUG: 24.1 USBMS: starting sync_booklists
DEBUG: 24.3 USBMS: finished sync_booklists
DEBUG: 24.3 KOBO:sync_booklists - end
DeviceJob: 8 Send metadata to device done, calling callback
DeviceJob: 8 Send metadata to device callback returned
Job: 8 Send metadata to device finished
No details available.

[PeterT]

There is NO NEED to change the save template. This is used to control the name / directory structure used to save your books on the device. What you have done is to specify a fixed name for all books you send to the device, thus each book will overwrite the previous book sent


I'm not at a computer now but you do at least want to have {title} in the save template, which would ensure a book is saved to a filename based on its title

[Paul Crompton]

PeterT, what a hero, thank you. I could not work out what was wrong and it worked instantly following your direction above.

Thank you!

[iostrym]

hello, I did a synchro of my kobo glo and firmware was updated. And after update, all my epub and pdf are out from my collection. all my collection are emtpy. is there an option in calibre to reconfigure quickly all my books correctly in the collection as before ?

thanks a lot

[PeterT]

As long as calibre is configured with the required info to manage collections (ie metadata management automatic, the columns you use to contain the collections / shelf names) the next time you connect your Kobo the shelves will be recreated.

[iostrym]

thanks, it doesn't work. I add 2 new book and all other book stays in empty collection.

I re-add a book that is already in the kobo and it seems it is added correctly in the collection. does calibre replace the previous identical file ? or does it duplicate the file ?

[PeterT]

Please verify the configuration of calibre. As long as metadata management is set to automatic, shelves will be reloaded on next sync. There is NO NEED to readd books.

[iostrym]

thanks, i have it in french, I activate the option "update metadata on the device" but it doesn't change anything. it seems that re-add the book is working but in fact no : in calibre it is said that there are two book of each in the device......

how to remove only the secondly added book ? how to force calibre or the kobo to restore the collections ?

[edit] => I sucessfully removed only the newly added books... but impossible to force calibre to refresh the metadata. Is there a way to check or to force the metadata resyn process ?