Problem syncing Kobo with calibre-web

[johnmcd]

Hi all,

I'm playing around with calibre-web (v0.6.13) to sync with my Kobo Clara HD (firmware v4.28.18220) and I think I'm missing something obvious. I successfully installed and configured calibre, built a decent library, successfully installed and configured calibre-web, and made the required change to the 'Kobo eReader.conf' file to point to my calibre-web server/token. I had previously synced my Kobo directly with calibre by connecting it via USB, so kobo content=calibre content initially. I then successfully imported a new ebook into Calibre (.epub), and when I clicked 'Books' on calibre-web the new book showed up there (sorted newest to oldest). I then tried to sync from my Kobo to calibre-web and the new ebook didn't download to my Kobo. I checked the calibre-web logs and it showed a 'Kobo library sync request received' but nothing else, so I turned on debug logging on calibre-web. I tried the sync again and got the logs below, but I have no idea how to interpret them. Could someone provide a hint as to what I could be doing wrong? Note: I turned on devmodeon on the Kobo and enabled logging before syncing and hit 'save' after it was done, but I can't figure out where the log is actually stored on the device to download it

Thanks

John

Spoiler:

2021-10-27 15:33:37,504] DEBUG {cps.updater:303} Stable version: {'version': '0.6.13'}
[2021-10-27 15:36:54,314] DEBUG {cps.ub:78} Found stored session: 96381ec139676dcea6a572a1fce370362dbd7ce6553111f458 0816b867cf4c9be906a5c924771b3d6144f1edf4a2111ed928 7897a2f0706d8fadf8d6f12cc9c5
[2021-10-27 15:36:54,314] INFO {cps.kobo:1026} Init
[2021-10-27 15:36:54,314] DEBUG {cps.kobo:1041} Kobo: Received unproxied request, changed request port to external server port
[2021-10-27 15:36:54,314] DEBUG {cps.kobo:1051} Kobo: Received unproxied request, changed request url to http://192.168.1.9:8083
[2021-10-27 15:36:54,379] DEBUG {cps.kobo:974} Unimplemented User Request received: http://192.168.1.9/kobo/1120dc9b69a3...1/user/profile
[2021-10-27 15:36:54,417] DEBUG {cps.kobo:974} Unimplemented User Request received: http://192.168.1.9/kobo/1120dc9b69a3...yalty/benefits
[2021-10-27 15:36:54,516] DEBUG {cps.kobo:974} Unimplemented User Request received: http://192.168.1.9/kobo/1120dc9b69a3...ytics/gettests
[2021-10-27 15:36:54,593] DEBUG {cps.ub:78} Found stored session: 96381ec139676dcea6a572a1fce370362dbd7ce6553111f458 0816b867cf4c9be906a5c924771b3d6144f1edf4a2111ed928 7897a2f0706d8fadf8d6f12cc9c5
[2021-10-27 15:36:54,595] INFO {cps.kobo:140} Kobo library sync request received.
[2021-10-27 15:36:54,595] DEBUG {cps.kobo:141} SyncToken: eyJ...blah...blah...blah...HNlfQ,2014-07-16 18:44:51.657000,2021-10-24 15:18:14.843545,0001-01-01 00:00:00,2021-10-27 18:10:33.617333,0001-01-01 00:00:00,-1
[2021-10-27 15:36:54,595] DEBUG {cps.kobo:143} Kobo: Received unproxied request, changed request port to external server port
[2021-10-27 15:36:57,560] DEBUG {cps.ub:78} Found stored session: 96381ec139676dcea6a572a1fce370362dbd7ce6553111f458 0816b867cf4c9be906a5c924771b3d6144f1edf4a2111ed928 7897a2f0706d8fadf8d6f12cc9c5
[2021-10-27 15:36:57,561] INFO {cps.kobo:140} Kobo library sync request received.
[2021-10-27 15:36:57,561] DEBUG {cps.kobo:141} SyncToken: eyJ...blah...blah...blah...HNlfQ,2014-07-16 18:44:51.657000,2021-10-24 15:18:14.843545,0001-01-01 00:00:00,2021-10-27 18:10:33.617333,0001-01-01 00:00:00,11155
[2021-10-27 15:36:57,562] DEBUG {cps.kobo:143} Kobo: Received unproxied request, changed request port to external server port
[2021-10-27 15:36:57,636] DEBUG {cps.kobo:333} Kobo Sync Content: []
[2021-10-27 15:36:57,964] DEBUG {cps.kobo:974} Unimplemented User Request received: http://192.168.1.9/kobo/1120dc9b69a3.../user/wishlist
[2021-10-27 15:37:02,560] DEBUG {cps.kobo:974} Unimplemented User Request received: http://192.168.1.9/kobo/1120dc9b69a3...ecommendations
[2021-10-27 15:37:03,627] DEBUG {cps.kobo:974} Unimplemented User Request received: http://192.168.1.9/kobo/1120dc9b69a3...nalytics/event
[2021-10-27 15:37:04,378] DEBUG {cps.kobo:988} Unimplemented Products Request received: http://192.168.1.9/kobo/1120dc9b69a3...b0444/nextread
[2021-10-27 15:37:04,446] DEBUG {cps.kobo:988} Unimplemented Products Request received: http://192.168.1.9/kobo/1120dc9b69a3...294ad/nextread
[2021-10-27 15:37:04,536] DEBUG {cps.kobo:988} Unimplemented Products Request received: http://192.168.1.9/kobo/1120dc9b69a3...e49da/nextread
[2021-10-27 15:37:07,412] DEBUG {cps.updater:303} Stable version: {'version': '0.6.13'}

[johnmcd]

If it helps, here's a summary of the packet capture between my Kobo and calibre-web. I also have the full packet capture file (.cap) if that would be useful. .48 is my Kobo, .9 is the calibre-web server.

Spoiler:

722 9:09:18 AM 10/28/2021 4.3512540 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/initialization , Using Bearer Authorization {HTTP:11, TCP:10, IPv4:9}
781 9:09:18 AM 10/28/2021 4.4426621 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Ok, URL: /kobo/[My Token]/v1/initialization {HTTP:11, TCP:10, IPv4:9}
798 9:09:18 AM 10/28/2021 4.5039718 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/user/profile {HTTP:11, TCP:10, IPv4:9}
799 9:09:18 AM 10/28/2021 4.5087670 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Temporary Redirect, URL: /kobo/[My Token]/v1/user/profile {HTTP:11, TCP:10, IPv4:9}
898 9:09:18 AM 10/28/2021 4.7150752 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/user/loyalty/benefits {HTTP:11, TCP:10, IPv4:9}
899 9:09:18 AM 10/28/2021 4.7195149 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Temporary Redirect, URL: /kobo/[My Token]/v1/user/loyalty/benefits {HTTP:11, TCP:10, IPv4:9}
901 9:09:18 AM 10/28/2021 4.8119118 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, POST /kobo/[My Token]/v1/analytics/gettests {HTTP:11, TCP:10, IPv4:9}
904 9:09:18 AM 10/28/2021 4.8569004 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:HTTP Payload, URL: /kobo/[My Token]/v1/analytics/gettests {HTTP:11, TCP:10, IPv4:9}
954 9:09:18 AM 10/28/2021 4.9651597 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Ok, URL: /kobo/[My Token]/v1/analytics/gettests {HTTP:11, TCP:10, IPv4:9}
959 9:09:19 AM 10/28/2021 5.0568158 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/library/sync, Query:Filter=ALL&DownloadUrlFilter=Generic,Android &PrioritizeRecentReads=true {HTTP:11, TCP:10, IPv4:9}
1174 9:09:20 AM 10/28/2021 6.1553325 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Ok, URL: /kobo/[My Token]/v1/library/sync {HTTP:11, TCP:10, IPv4:9}
1336 9:09:20 AM 10/28/2021 6.3467979 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:HTTP Payload, URL: /kobo/[My Token]/v1/library/sync {HTTP:11, TCP:10, IPv4:9}
1521 9:09:20 AM 10/28/2021 6.6028569 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:HTTP Payload, URL: /kobo/[My Token]/v1/library/sync {HTTP:11, TCP:10, IPv4:9}
1861 9:09:21 AM 10/28/2021 7.8503052 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/library/sync, Query:Filter=ALL&DownloadUrlFilter=Generic,Android &PrioritizeRecentReads=true {HTTP:11, TCP:10, IPv4:9}
1929 9:09:22 AM 10/28/2021 8.1018368 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Ok, URL: /kobo/[My Token]/v1/library/sync {HTTP:11, TCP:10, IPv4:9}
1970 9:09:22 AM 10/28/2021 8.3955523 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/user/wishlist, Query:PageSize=30&PageIndex=0 {HTTP:11, TCP:10, IPv4:9}
1971 9:09:22 AM 10/28/2021 8.4015573 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Temporary Redirect, URL: /kobo/[My Token]/v1/user/wishlist {HTTP:11, TCP:10, IPv4:9}
2875 9:09:26 AM 10/28/2021 12.7603175 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/user/recommendations, Queryage_index=0&page_size=50&Filters=%7B%7D {HTTP:11, TCP:10, IPv4:9}
2876 9:09:26 AM 10/28/2021 12.7647879 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Temporary Redirect, URL: /kobo/[My Token]/v1/user/recommendations {HTTP:11, TCP:10, IPv4:9}
3043 9:09:27 AM 10/28/2021 13.9710581 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, POST /kobo/[My Token]/v1/analytics/event {HTTP:11, TCP:10, IPv4:9}
3044 9:09:27 AM 10/28/2021 13.9732088 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:HTTP Payload, URL: /kobo/[My Token]/v1/analytics/event {HTTP:11, TCP:10, IPv4:9}
3110 9:09:28 AM 10/28/2021 14.1173510 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Ok, URL: /kobo/[My Token]/v1/analytics/event {HTTP:11, TCP:10, IPv4:9}
3256 9:09:28 AM 10/28/2021 14.8954777 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/products/6df6d1e2-d9f1-44d9-bbf0-a278d61b4c1f/nextread {HTTP:11, TCP:10, IPv4:9}
3257 9:09:28 AM 10/28/2021 14.9000989 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Temporary Redirect, URL: /kobo/[My Token]/v1/products/6df6d1e2-d9f1-44d9-bbf0-a278d61b4c1f/nextread {HTTP:11, TCP:10, IPv4:9}
3302 9:09:29 AM 10/28/2021 15.1344416 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/products/00b014a9-0abf-48e0-9c4a-e6bfa9925e2b/nextread {HTTP:11, TCP:10, IPv4:9}
3303 9:09:29 AM 10/28/2021 15.1395643 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Temporary Redirect, URL: /kobo/[My Token]/v1/products/00b014a9-0abf-48e0-9c4a-e6bfa9925e2b/nextread {HTTP:11, TCP:10, IPv4:9}
3339 9:09:29 AM 10/28/2021 15.3119037 python.exe 192.168.1.48 192.168.1.9 HTTP HTTP:Request, GET /kobo/[My Token]/v1/products/05e618d7-0ba1-44fa-bb19-412164bb0444/nextread {HTTP:11, TCP:10, IPv4:9}
3341 9:09:29 AM 10/28/2021 15.3166258 python.exe 192.168.1.9 192.168.1.48 HTTP HTTP:Response, HTTP/1.1, Status: Temporary Redirect, URL: /kobo/[My Token]/v1/products/05e618d7-0ba1-44fa-bb19-412164bb0444/nextread {HTTP:11, TCP:10, IPv4:9}

[CharlesCohen53]

Now this seems pretty complicated. I've found a link to github that mentions your issue and I'm not sure if you looked at it.
https://github.com/janeczku/calibre-web/issues/1627

If you didn't, try it out. They should help you out there for sure. If not, then maybe someone else here will know how to deal with this issue.