[GUI Plugin] Kobo Utilities

[Majutsushi]

Originally Posted by JDesat

This is what I think is the relevant section of the log file going by what it says is going on at that point. Also, it's the only point where there is any gaps at all in what I'm guessing is a time code of some kind (the [114.07] or whatever at the start of some lines). After the end point of this there was no freeze, and the freeze happens after it gets the list of books on the device.

Spoiler:

Connected device: Kobo Clara Colour
Firmware version: 4.44.23552
Driver: KoboTouch'
DeviceJob: 2 Get list of books on device callback returned
Job: 3 Backing up Kobo device database started
[114.28] [DEBUG] [koboutilities.features.backup:device_database_back up_job:151] start
[114.28] [DEBUG] [koboutilities.features.backup:device_database_back up_job:154] backup_options= DatabaseBackupJobOptions(backup_store_config={
"backupCopiesToKeepSpin": 4,
"backupDestDirectory": "C:\\Users\\jdesa\\Desktop\\Calibre Library\\Database Backups",
"backupEachCOnnection": true,
"backupZipDatabase": false,
"doDailyBackp": false
}, device_name='KoboClaraColour', serial_number='N3674C0315968', db_path='D:\\.kobo\\KoboReader.sqlite', device_path=WindowsPath('D:/'))
[114.28] [DEBUG] [koboutilities.features.backup:device_database_back up_job:174] tmpdir=C:\Users\jdesa\AppData\Local\Temp\calibre-ascrjv5b\koboutilities-backup-chsnpm0q
[132.46] [DEBUG] [koboutilities.features.backup:device_database_back up_job:189] src_path=D:\.adobe-digital-editions
[132.46] [DEBUG] [koboutilities.features.backup:device_database_back up_job:191] dst_path=C:\Users\jdesa\AppData\Local\Temp\calibre-ascrjv5b\koboutilities-backup-chsnpm0q\.adobe-digital-editions
[132.51] [DEBUG] [koboutilities.features.backup:device_database_back up_job:189] src_path=D:\.kobo\Kobo\Kobo eReader.conf
[132.51] [DEBUG] [koboutilities.features.backup:device_database_back up_job:191] dst_path=C:\Users\jdesa\AppData\Local\Temp\calibre-ascrjv5b\koboutilities-backup-chsnpm0q\.kobo\Kobo\Kobo eReader.conf
Job: 2 Get list of books on device finished
No details available.
[132.52] [DEBUG] [koboutilities.features.backup:device_database_back up_job:189] src_path=D:\.kobo\BookReader.sqlite
[132.52] [DEBUG] [koboutilities.features.backup:device_database_back up_job:191] dst_path=C:\Users\jdesa\AppData\Local\Temp\calibre-ascrjv5b\koboutilities-backup-chsnpm0q\.kobo\BookReader.sqlite
[147.00] [DEBUG] [koboutilities.features.backup:device_database_back up_job:189] src_path=D:\.kobo\affiliate.conf
[147.00] [DEBUG] [koboutilities.features.backup:device_database_back up_job:191] dst_path=C:\Users\jdesa\AppData\Local\Temp\calibre-ascrjv5b\koboutilities-backup-chsnpm0q\.kobo\affiliate.conf
[147.01] [DEBUG] [koboutilities.features.backup:device_database_back up_job:189] src_path=D:\.kobo\version
[147.01] [DEBUG] [koboutilities.features.backup:device_database_back up_job:191] dst_path=C:\Users\jdesa\AppData\Local\Temp\calibre-ascrjv5b\koboutilities-backup-chsnpm0q\.kobo\version
[154.02] [DEBUG] [koboutilities.utils:check_device_database:223] result line= ('ok',)
[154.02] [DEBUG] [koboutilities.features.backup:device_database_back up_job:209] backup_file_path=C:\Users\jdesa\Desktop\Calibre Library\Database Backups\KoboReader-KoboClaraColour-N3674C0315968-20260227-102254.zip
[159.43] [DEBUG] [koboutilities.features.backup:remove_old_backups:2 24] copies to keep:4
[159.43] [DEBUG] [koboutilities.features.backup:remove_old_backups:2 30] backup_file_search= KoboReader-KoboClaraColour-N3674C0315968-[0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]-[0-9][0-9][0-9][0-9][0-9][0-9].zip
[159.43] [DEBUG] [koboutilities.features.backup:remove_old_backups:2 33] backup_file_search_path= C:\Users\jdesa\Desktop\Calibre Library\Database Backups\KoboReader-KoboClaraColour-N3674C0315968-[0-9][0-9][0-9][0-9][0-9][0-9][0-9][0-9]-[0-9][0-9][0-9][0-9][0-9][0-9].zip
[159.43] [DEBUG] [koboutilities.features.backup:remove_old_backups:2 35] backup_files= ['C:\\Users\\jdesa\\Desktop\\Calibre Library\\Database Backups\\KoboReader-KoboClaraColour-N3674C0315968-20260225-192338.zip']
[159.43] [DEBUG] [koboutilities.features.backup:remove_old_backups:2 36] len(backup_files) - copies_to_keep= 1
[159.43] [DEBUG] [koboutilities.features.backup:remove_old_backups:2 40] removing backup file: C:\Users\jdesa\Desktop\Calibre Library\Database Backups\KoboReader-KoboClaraColour-N3674C0315968-20260225-192338.zip
[159.44] [DEBUG] [koboutilities.features.backup:remove_old_backups:2 43] Removing old backups - finished
DeviceJob: 3 Backing up Kobo device database done, calling callback
DeviceJob: 3 Backing up Kobo device database callback returned
Job: 4 Storing reading positions for 3819 books started
[159.47] [DEBUG] [koboutilities.features.locations:do_read_locations :2254] start
[159.47] [DEBUG] [koboutilities.features.locations:do_read_locations :2257] options=ReadLocationsJobOptions(bookmark_options={
"backgroundJob": true,
"clearIfUnread": false,
"doNotStoreIfReopened": false,
"rating": true,
"readingStatus": true,
"setDateToNow": true,
"storeBookmarks": true,
"storeIfMoreRecent": true
}, epub_location_like_kepub=True, fetch_queries=FetchQueries(kepub='SELECT c1.ChapterIDBookmarked, c1.adobe_location, c1.ReadStatus, c1.___PercentRead, c1.Attribution, c1.DateLastRead, c1.Title, c1.MimeType, r.rating, c1.contentId, c1.TimeSpentReading, c1.RestOfBookEstimate FROM content c1 LEFT OUTER JOIN ratings r ON c1.ContentID = r.ContentID WHERE c1.ContentID = ?', epub='SELECT c1.ChapterIDBookmarked, c1.adobe_location, c1.ReadStatus, c1.___PercentRead, c1.Attribution, c1.DateLastRead, c1.Title, c1.MimeType, r.rating, c1.contentId, c1.TimeSpentReading, c1.RestOfBookEstimate FROM content c1 LEFT OUTER JOIN ratings r ON c1.ContentID = r.ContentID WHERE c1.ContentID = ?'), database_path='D:\\.kobo\\KoboReader.sqlite', device_database_path='D:\\.kobo\\KoboReader.sqlite ', is_db_copied=False, profile_name='Default', custom_columns=CustomColumns(current_location='#lo cation', percent_read='#percent', rating=None, last_read='#lastread', time_spent_reading=None, rest_of_book_estimate=None), supports_ratings=True, allOnDevice=True, prompt_to_store=True)
[159.47] [DEBUG] [koboutilities.features.locations:do_read_locations :2265] len(books_to_scan)=3819
Worker Launch took: 0.01 seconds
[159.56] [DEBUG] [koboutilities.features.locations:do_read_locations :2283] Job not finished
Job: 3 Backing up Kobo device database finished
No details available.
Job: 6 Read locations finished
Read locations

[160.57] [DEBUG] [koboutilities.features.locations:do_read_locations :2290] count=1
[160.57] [DEBUG] [koboutilities.features.locations:do_read_locations :2291] Read locations

Thanks for the log! I'm a bit unsure how the plugin could freeze Calibre itself since the backup runs in background job, and I don't see any smoking guns in the log, but it would be interesting to know how big the files ".kobo/KoboReader.sqlite" and ".kobo/BookReader.sqlite" are on your device. I'm also wondering if using the "Database → Compress the device database" menu option of the plugin makes any difference.

[JDesat]

Originally Posted by Majutsushi

Thanks for the log! I'm a bit unsure how the plugin could freeze Calibre itself since the backup runs in background job, and I don't see any smoking guns in the log, but it would be interesting to know how big the files ".kobo/KoboReader.sqlite" and ".kobo/BookReader.sqlite" are on your device. I'm also wondering if using the "Database → Compress the device database" menu option of the plugin makes any difference.

KoboReader is 632,155 KB
BookReader is 527,193 KB

Also, I just noticed that the freeze happens IMMEDIATELY after the 'queuing books for...' scroll thing ends where it's getting the list of books or whatever.

After running the compress database tool, KoboReader is 604,725 KB.

[enuddleyarbl]

I'm not knowledgeable about this, but my BookReader.sqlite is just 48 KB. I don't think that file is supposed to get as big as yours. According to:

https://www.mobileread.com/forums/sh...d.php?t=341536

davidfor said "BookReader.sqlite is largely used for some of the information related to Kobo Plus and library borrowing. I understand it gets used for other things, but, I don't know what they are. From my experience, it should be fairly small. I would only expect a large size like that if you are borrowing books from Kobo Plus...."

Based on that thread, I'll ask what the time stamp of your BookReader.sqlite file is and if you also have files like BookReader.sqlite-shm and BookReader.sqlite-wal?

[palaran]

Originally Posted by enuddleyarbl

I'm not knowledgeable about this, but my BookReader.sqlite is just 48 KB. I don't think that file is supposed to get as big as yours.

Just had a look at the latest one I had un-RARed to do a reinstall and mine is only 22KB.