[tempest@de]

Happy New Year!

it seems the year is going to end better then what I had expected kobowhise, I had another go with the glo and calibre, to make sure I had done everything I could I decided to follow the steps David listed above one more time, and guess what? All the empty collections (both the recent ones and the old ones stored in the kobo server) are now gone. So I might have done something wrong the first time.

Now I still have books in the device that have no collections assigned but since I’m tired of tinkering I’ll just delete everything and send all the books again.

I did run calibre on debug mode, not sure if it really maters now since the problem is fixed, but I’ll leave it here just in case.

Spoiler:

calibre 2.76 [64bit] embedded-python: True is64bit: True
Windows-8-6.2.9200 Windows ('64bit', 'WindowsPE')
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM (6, 0, 8) && Open With (1, 5, 10) && KePub Output (2, 7, 1) && EpubSplit (2, 2, 0) && Goodreads (1, 1, 11) && KoboTouchExtended (2, 8, 2) && Manage Series (1, 2, 8) && Kobo Utilities (2, 4, 1)
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 100.569275362 x 100.55257732
Starting up...
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 3.6 No Kobo Touch, Glo or Mini appears to be connected
DEBUG: 3.6 rebuild_menus - self.supports_ratings=None, self.supports_tiles=None
DEBUG: 3.6 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 3.6 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Driver: KoboTouchExtended'
C:\Program Files\Calibre2\pylib.zip\dateutil\parser.py:339: UnicodeWarning: Unicode equal comparison failed to convert both arguments to Unicode - interpreting them as being unequal
Storage number map:
{(7L, 0L): [(4L, 'C'), (6L, 'X'), (7L, 'D')], (7L, 1L): [(1L, 'F')]}
Storage number for USBSTOR\DISK&VEN_KOBO&PROD_EREADER-3.19.576&REV_0110\613A294014995&0: StorageDeviceNumber(type=7L, number=1L, partition_number=0L)
Drive letters for USBDevice(vendor_id=0x2237 product_id=0x4173 bcd=0x110 devid=usb\vid_2237&pid_4173&rev_0110 devinst=5)
{u'drive_letters': ['F'],
u'pnp_id_map': {'F': u'\\\\?\\usbstor#disk&ven_kobo&prod_ereader-3.19.576&rev_0110#613a294014995&0#{53f56307-b6bf-11d0-94f2-00a0c91efb8b}'},
u'readonly_drives': set([]),
u'sort_map': {'F': (1L, 1L)}}
DEBUG: 6.2 KoboUtilities:_on_device_connection_changed - self.plugin_device_connection_changed.__class__: <type 'PyQt5.QtCore.pyqtBoundSignal'>
DEBUG: 6.2 Methods for self.plugin_device_connection_changed: ['__call__', '__class__', '__delattr__', '__doc__', '__format__', '__getattribute__', '__getitem__', '__hash__', '__init__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__str__', '__subclasshook__', 'connect', 'disconnect', 'emit', 'signal']
DEBUG: 6.2 Have a Kobo device connected connected
DEBUG: 6.2 BEGIN Get Device Path
DEBUG: 6.2 Root path of device: F:\
DEBUG: 6.2 END Get Device Path
DEBUG: 6.2 KoboUtilities:get_device - self.device_path="F:\"
DEBUG: 6.2 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 6.2 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Driver: KoboTouchExtended'
Job: 1 Obter informação sobre o dispositivo started
DeviceJob: 1 Obter informação sobre o dispositivo done, calling callback
DeviceJob: 1 Obter informação sobre o dispositivo callback returned
Job: 2 Definir informação da biblioteca started
DeviceJob: 2 Definir informação da biblioteca done, calling callback
DeviceJob: 2 Definir informação da biblioteca callback returned
Job: 3 Listar os livros presentes no dispositivo started
DEBUG: 0.0 KoboTouch:books - oncard='None'
DEBUG: 0.0 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x000000000BA54F60>
DEBUG: 0.0 KoboTouch:books - oncard='None', prefix='F:\'
DEBUG: 0.0 Kobo device: Kobo Glo
DEBUG: 0.0 Version of driver: (2, 8, 2) Has kepubs: True
DEBUG: 0.0 Version of firmware: (3, 19, 5761) Has kepubs: True
DEBUG: 0.0 Firmware supports cover image tree: True
DEBUG: 0.1 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x000000000BA54F98>
DEBUG: 0.1 KoboTouch:books - opts.extra_customization= []
DEBUG: 0.1 KoboTouch:books - driver options= Driver:KoboTouchExtended, Options - format_map: [u'kepub', u'epub', u'cbr', u'cbz', u'pdf', u'txt'], use_subdirs: True, read_metadata: True, use_author_sort: False, save_template: {author_sort}/{title} - {authors}, extra_customization: [], manage_collections: True, collections_columns: #prateleiras, create_collections: True, delete_empty_collections: True, ignore_collections_names: , upload_covers: True, keep_cover_aspect: False, upload_grayscale: False, show_archived_books: False, show_previews: False, show_recommendations: False, update_series: True, update_device_metadata: True, modify_css: False, support_newer_firmware: True, debugging_title: , driver_version: 2.8.2, extra_features: True, upload_encumbered: False, skip_failed: False, hyphenate: False, replace_lang: False, smarten_punctuation: False, clean_markup: False, full_page_numbers: False, disable_hyphenation: False, file_copy_dir:
DEBUG: 0.1 KoboTouch:books - prefs['manage_device_metadata']= manual
DEBUG: 0.1 KoboTouch:books - set_debugging_title to ''
DEBUG: 0.1 KoboTouch:books - length bl=0
Job: 2 Definir informação da biblioteca finished
Sem detalhes disponíveis.
Job: 1 Obter informação sobre o dispositivo finished
Sem detalhes disponíveis.
DEBUG: 1.0 KoboTouch:books - length bl after sync=319
DEBUG: 1.0 KoboTouch:books - reading device database
DEBUG: 1.0 Database Version: 131
DEBUG: 1.0 KoboTouch:books - shelf list: [u'Suspense: Rom\xe2ntico', u'Romance M: Hist\xf3rico', u'Hammer', u'Romance: Policial', u'Romance M: BD', u'Romance M', u'Romance: Militar', u'Romance M: E', u'Romance', u'Romance: Ac\xe7\xe3o', u'In Death', u'Romance M: Paranormal', u'Suspense', u'Romance: Hist\xf3rico', u'Romance M: Militar', u'Suspense M', u'Thriller', u'Suspense M: Rom\xe2ntico', u'Chick Lit', u'Policial', u'Velvet Glove', u'Romance M: Policial', u'ReadingList']
DEBUG: 1.0 KoboTouch:books - query= SELECT Title, Attribution, DateCreated, ContentID, MimeType, ContentType, ImageID, ReadStatus, ___ExpirationStatus, FavouritesIndex, Accessibility, IsDownloaded, Series, SeriesNumber, ___UserID, ExternalId FROM content WHERE BookID IS NULL AND ((Accessibility = -1 AND IsDownloaded in ('true', 1 )) OR (Accessibility IN (1,2) and IsDownloaded in ('true', 1)) ) AND (externalId IS NULL OR externalId = '') AND contentId NOT LIKE 'file:///mnt/sd/%'
DEBUG: 1.3 KoboTouch:books - about to sync_booklists
DEBUG: 1.3 USBMS: starting sync_booklists
DEBUG: 1.8 USBMS: finished sync_booklists
DEBUG: 1.8 KoboTouch:books - have done sync_booklists
DEBUG: 1.8 KoboTouch:books - end - oncard='None'
DEBUG: 1.8 KoboTouch:books - oncard='carda'
DEBUG: 1.8 KoboTouch:books - Asked to process 'carda', but do not have one!
DEBUG: 1.8 KoboTouch:books - oncard='cardb'
DEBUG: 1.8 KoboTouch:books - Asked to process 'cardb', but do not have one!
DeviceJob: 3 Listar os livros presentes no dispositivo done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 319
DeviceJob: set_books_in_library finished: time= 0.0250000953674
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DEBUG: 2.4 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x000000000F37E4E0>
DEBUG: 2.4 KoboTouchExtended:settings: settings= <calibre.utils.config_base.OptionValues object at 0x000000000F37E4A8>
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
DEBUG: 8.8 KoboUtilites:_on_device_metadata_available - Start
DEBUG: 8.8 Have a Kobo device connected connected
DEBUG: 8.8 BEGIN Get Device Path
DEBUG: 8.8 Root path of device: F:\
DEBUG: 8.8 END Get Device Path
DEBUG: 8.8 KoboUtilities:get_device - self.device_path="F:\"
DEBUG: 8.8 KoboUtilities:get_device - drive_info: {'main': {u'calibre_version': u'2.76.0', u'device_name': u'Kobo Glo', u'device_store_uuid': u'6f0eb90c-bd11-4d4e-8eae-c1649fcece5f', u'date_last_connected': u'2016-12-31T15:24:27.734000+00:00', u'last_library_uuid': None, u'prefix': 'F:/', u'location_code': 'main'}}
DEBUG: 8.8 migrate_library_config_if_required - start
DEBUG: 8.8 get_library_config - library_config: {u'profiles': {u'Migrated': {u'forDevice': u'*Any Device', u'storeOptionsStore': {u'storeOnConnect': True, u'promptToStore': False, u'doNotStoreIfReopened': True, u'storeIfMoreRecent': False}, u'customColumnOptions': {u'currentReadingLocationColumn': u'#koboreadloc', u'percentReadColumn': u'#koboreadpct', u'lastReadColumn': u'#kobolastread', u'ratingColumn': u'#koborating'}, u'profileName': u'Migrated'}}, u'SchemaVersion': 0.1}
DEBUG: 8.8 get_prefs - start - store_name='storeOptionsStore'
DEBUG: 8.8 get_plugin_pref - start - store_name='commonOptionsStore', option='individualDeviceOptions'
DEBUG: 8.8 get_prefs - start - store_name='backupOptionsStore'
DEBUG: 8.8 get_prefs - start - store_name='updateOptionsStore'
DEBUG: 8.8 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 8.8 KoboUtilities:set_toolbar_button_tooltip - device connected. self.device.fwversion= (3, 19, 5761)
DEBUG: 8.8 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Connected Device: Kobo Glo
Firmware version: 3.19.5761
Driver: KoboTouchExtended'
DEBUG: 8.8 KoboUtilites:_on_device_metadata_available - self.current_device_profile: {u'forDevice': u'*Any Device', u'storeOptionsStore': {u'storeIfMoreRecent': False, u'promptToStore': False, u'doNotStoreIfReopened': True, u'storeOnConnect': True}, u'customColumnOptions': {u'currentReadingLocationColumn': u'#koboreadloc', u'percentReadColumn': u'#koboreadpct', u'lastReadColumn': u'#kobolastread', u'ratingColumn': u'#koborating'}, u'profileName': u'Migrated'}
DEBUG: 8.8 KoboUtilites:_on_device_metadata_available - self.current_backup_config: {u'doDailyBackp': True, u'backupEachCOnnection': False, u'backupDestDirectory': u'X:/Livros/Kobo Glo/Base de dados', u'backupCopiesToKeepSpin': 5, u'backupZipDatabase': True}
DEBUG: 8.8 KoboUtilites:_on_device_metadata_available - About to start auto backup
DEBUG: 8.8 auto_backup_device_database - start
DEBUG: 8.8 BEGIN Get Device Path
DEBUG: 8.8 Root path of device: F:\
DEBUG: 8.8 END Get Device Path
DEBUG: 8.8 auto_backup_device_database - destination directory= X:/Livros/Kobo Glo/Base de dados
DEBUG: 8.8 auto_backup_device_database - about to get version info from device...
DEBUG: 8.8 auto_backup_device_database - version_info= ['613A294014995', '2.6.35.3', '3.19.5761', '2.6.35.3', '2.6.35.3', '00000000-0000-0000-0000-000000000330']
DEBUG: 8.9 auto_backup_device_database - device_information= ('Kobo Glo', '', '', '', {'main': {u'date_last_connected': u'2016-12-31T15:24:30.360000+00:00', u'device_name': u'Kobo Glo', u'device_store_uuid': u'6f0eb90c-bd11-4d4e-8eae-c1649fcece5f', u'calibre_version': u'2.76.0', u'last_library_uuid': None, u'prefix': 'F:/', u'location_code': 'main'}})
DEBUG: 8.9 auto_backup_device_database - device_name= KoboGlo
DEBUG: 8.9 auto_backup_device_database - backup_file_template= KoboReader-KoboGlo-613A294014995-
DEBUG: 8.9 auto_backup_device_database - backup_options= {u'doDailyBackp': True, u'backupDestDirectory': u'X:/Livros/Kobo Glo/Base de dados', 'serial_number': '613A294014995', 'device_name': 'KoboGlo', u'backupZipDatabase': True, 'backup_file_template': 'KoboReader-{0}-{1}-{2}', 'device_path': 'F:\\', 'database_file': u'F:\\.kobo\\KoboReader.sqlite', u'backupEachCOnnection': False, u'backupCopiesToKeepSpin': 5}
DEBUG: 8.9 KoboUtilitiesAction::_firmware_update
DEBUG: 9.2 auto_backup_device_database - end
DEBUG: 9.2 KoboUtilites:_on_device_metadata_available - About to start auto store
DEBUG: 9.2 auto_store_current_bookmark - start
DEBUG: 9.2 Have a Kobo device connected connected
DEBUG: 9.2 BEGIN Get Device Path
DEBUG: 9.2 Root path of device: F:\
DEBUG: 9.2 END Get Device Path
DEBUG: 9.2 KoboUtilities:get_device - self.device_path="F:\"
DEBUG: 9.2 KoboUtilities:get_device - drive_info: {'main': {u'calibre_version': u'2.76.0', u'device_name': u'Kobo Glo', u'device_store_uuid': u'6f0eb90c-bd11-4d4e-8eae-c1649fcece5f', u'date_last_connected': u'2016-12-31T15:24:27.734000+00:00', u'last_library_uuid': None, u'prefix': 'F:/', u'location_code': 'main'}}
DEBUG: 9.2 migrate_library_config_if_required - start
DEBUG: 9.2 get_library_config - library_config: {u'profiles': {u'Migrated': {u'forDevice': u'*Any Device', u'storeOptionsStore': {u'storeIfMoreRecent': False, u'promptToStore': False, u'doNotStoreIfReopened': True, u'storeOnConnect': True}, u'customColumnOptions': {u'currentReadingLocationColumn': u'#koboreadloc', u'percentReadColumn': u'#koboreadpct', u'lastReadColumn': u'#kobolastread', u'ratingColumn': u'#koborating'}, u'profileName': u'Migrated'}}, u'SchemaVersion': 0.1}
DEBUG: 9.2 get_prefs - start - store_name='storeOptionsStore'
DEBUG: 9.2 get_plugin_pref - start - store_name='commonOptionsStore', option='individualDeviceOptions'
DEBUG: 9.2 get_prefs - start - store_name='backupOptionsStore'
DEBUG: 9.2 get_prefs - start - store_name='updateOptionsStore'
DEBUG: 9.2 BEGIN Get Device Path
DEBUG: 9.2 Root path of device: F:\
DEBUG: 9.2 END Get Device Path
DEBUG: 9.2 QueueProgressDialog::__init__
DEBUG: 9.2 QueueProgressDialog::do_books - Start
DEBUG: 9.2 get_column_names - columns_config: {u'currentReadingLocationColumn': u'#koboreadloc', u'percentReadColumn': u'#koboreadpct', u'lastReadColumn': u'#kobolastread', u'ratingColumn': u'#koborating'}
DEBUG: 9.2 QueueProgressDialog::do_books - kobo_percentRead_column='#koboreadpct'
DEBUG: 9.2 QueueProgressDialog::do_books - search_condition= ondevice:True and (#koboreadpct:false or #koboreadpct:<100)
DEBUG: 15.7 QueueProgressDialog::do_books - Finish
DEBUG: 15.7 QueueProgressDialog::do_queue
DEBUG: 15.7 KoboUtilitiesAction::_store_queue_job
DEBUG: 15.7 Have a Kobo device connected connected
DEBUG: 15.7 BEGIN Get Device Path
DEBUG: 15.7 Root path of device: F:\
DEBUG: 15.7 END Get Device Path
DEBUG: 15.7 KoboUtilities:get_device - self.device_path="F:\"
DEBUG: 15.7 KoboUtilities:get_device - drive_info: {'main': {u'calibre_version': u'2.76.0', u'device_name': u'Kobo Glo', u'device_store_uuid': u'6f0eb90c-bd11-4d4e-8eae-c1649fcece5f', u'date_last_connected': u'2016-12-31T15:24:27.734000+00:00', u'last_library_uuid': None, u'prefix': 'F:/', u'location_code': 'main'}}
DEBUG: 15.7 migrate_library_config_if_required - start
DEBUG: 15.7 get_library_config - library_config: {u'profiles': {u'Migrated': {u'forDevice': u'*Any Device', u'storeOptionsStore': {u'storeIfMoreRecent': False, u'promptToStore': False, u'doNotStoreIfReopened': True, u'storeOnConnect': True}, u'customColumnOptions': {u'currentReadingLocationColumn': u'#koboreadloc', u'percentReadColumn': u'#koboreadpct', u'lastReadColumn': u'#kobolastread', u'ratingColumn': u'#koborating'}, u'profileName': u'Migrated'}}, u'SchemaVersion': 0.1}
DEBUG: 15.7 get_prefs - start - store_name='storeOptionsStore'
DEBUG: 15.7 get_plugin_pref - start - store_name='commonOptionsStore', option='individualDeviceOptions'
DEBUG: 15.7 get_prefs - start - store_name='backupOptionsStore'
DEBUG: 15.7 get_prefs - start - store_name='updateOptionsStore'
DEBUG: 15.7 rebuild_menus - self.supports_ratings=True, self.supports_tiles=True
DEBUG: 15.7 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG: 15.7 KoboUtilities:set_toolbar_button_tooltip - device connected. self.device.fwversion= (3, 19, 5761)
DEBUG: 15.7 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Connected Device: Kobo Glo
Firmware version: 3.19.5761
Driver: KoboTouchExtended'
DEBUG: 15.7 rebuild_menus - have device.
DeviceJob: 3 Listar os livros presentes no dispositivo callback returned
Job: 4 Backing up Kobo device database started
DEBUG: 0.0 do_device_database_backup - start
logger - do_device_database_backup - start
Job: 3 DEBUG: 0.0 Listar os livros presentes no dispositivo do_device_database_backup - backup_options=finished
{u'doDailyBackp': True, u'backupDestDirectory': u'X:/Livros/Kobo Glo/Base de dados', 'serial_number': '613A294014995', 'device_name': 'KoboGlo', u'backupZipDatabase': True, 'backup_file_template': 'KoboReader-{0}-{1}-{2}', 'device_path': 'F:\\', 'database_file': u'F:\\.kobo\\KoboReader.sqlite', u'backupEachCOnnection': False, u'backupCopiesToKeepSpin': 5}Sem detalhes disponíveis.

DEBUG: 0.0 do_device_database_backup - copies_to_keep= 5
DEBUG: 0.0 do_device_database_backup - backup_file_search= KoboReader-KoboGlo-613A294014995-20161231-[0-9][0-9][0-9][0-9][0-9][0-9].*
DEBUG: 0.0 do_device_database_backup - backup_file_search= X:/Livros/Kobo Glo/Base de dados\KoboReader-KoboGlo-613A294014995-20161231-[0-9][0-9][0-9][0-9][0-9][0-9].*
DEBUG: 0.0 do_device_database_backup - backup_files= [u'X:/Livros/Kobo Glo/Base de dados\\KoboReader-KoboGlo-613A294014995-20161231-145805.zip']
DEBUG: 0.0 auto_backup_device_database - Backup already done today
DeviceJob: 4 Backing up Kobo device database done, calling callback
DeviceJob: 4 Backing up Kobo device database callback returned
Job: 5 Storing reading positions for 275 books started
DEBUG: 0.0 do_store_locations - start
DEBUG: 0.0 do_store_locations - options={'job_function': 'store_current_bookmark', u'count_selected_books': 0, u'promptToStore': False, u'readingStatus': False, 'device_database_path': u'F:\\.kobo\\KoboReader.sqlite', u'doNotStoreIfReopened': True, u'rating': False, u'storeIfMoreRecent': False, u'clearIfUnread': False, 'allOnDevice': True, u'storeBookmarks': True, u'backgroundJob': True, u'setDateToNow': False, 'supports_ratings': True}
DEBUG: 0.0 do_store_locations - len(books_to_scan)=275
Worker Launch took: 0.671000003815
DEBUG: 0.7 do_store_locations - Job not finished
Job: 4 Backing up Kobo device database finished
Sem detalhes disponíveis.
Job: 6 Store locations finished
Store locations

DEBUG: 5.1 Stored_location count=0
DEBUG: 5.1 Store locations

DEBUG: 5.3 do_store_locations - finished
DeviceJob: 5 Storing reading positions for 275 books done, calling callback
DeviceJob: 5 Storing reading positions for 275 books callback returnedDEBUG: 21.1
KoboUtilitiesAction::_store_completed - options {'job_function': 'store_current_bookmark', u'count_selected_books': 0, u'promptToStore': False, u'readingStatus': False, 'device_database_path': u'F:\\.kobo\\KoboReader.sqlite', u'doNotStoreIfReopened': True, u'rating': False, u'storeIfMoreRecent': False, u'clearIfUnread': False, 'allOnDevice': True, u'storeBookmarks': True, u'backgroundJob': True, u'setDateToNow': False, 'supports_ratings': True}
Job: 5 Storing reading positions for 275 books finished
Sem detalhes disponíveis.
Started up in 60.61 seconds with 1518 books