MobileRead Forums - View Single Post

davidfor · 12-13-2014, 02:37 AM

I don't understand what any of you are complaining about. What's wrong with 650 pages of collections?

Well, that explains why the overnight sync was still running when I got up this morning. It it looks like if finished at 9:44am, so it took well over two hours.

For those who haven't been through this before, the problem isn't actually duplicates. For some reason, the Kobo server is recreating deleted shelves. When you create a shelf and sync, it is recorded on the server. When you then delete the shelf and sync, that fact is recorded. If you use calibre to manage the shelves, each time you add and remove books, shelves might get created or deleted. Then a sync to the server will update the shelves there. Unfortunately, somewhere along the way an id is generated. This is used rather than the shelf name for matching. It seems to work well if there is very little change in the shelves. But, when the server messes up, this fails.

I've had a look at the database PeterT send and mine. This time something new has happened. The reason why I said above that the server was recreating the shelves is because the timestamps on the duplicates were different. The creation timestamp of each where different and that agreed with reanimating the deleted shelves. This time, the database shows all the timestamps as "1970-01-01T00:00:00Z". And that explains why the utilities plugin is not fixing it. It marks all except on shelf as deleted and it uses the timestamp, either the oldest or newest depending on the option selected, to work out which to keep. With them all having the same timestamp, that doesn't work. I can do something with the ids to handle this. I should have something out later in the evening.

12-13-2014, 02:37 AM	#20
davidfor Grand Sorcerer Posts: 24,905 Karma: 47303824 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	I don't understand what any of you are complaining about. What's wrong with 650 pages of collections? Well, that explains why the overnight sync was still running when I got up this morning. It it looks like if finished at 9:44am, so it took well over two hours. For those who haven't been through this before, the problem isn't actually duplicates. For some reason, the Kobo server is recreating deleted shelves. When you create a shelf and sync, it is recorded on the server. When you then delete the shelf and sync, that fact is recorded. If you use calibre to manage the shelves, each time you add and remove books, shelves might get created or deleted. Then a sync to the server will update the shelves there. Unfortunately, somewhere along the way an id is generated. This is used rather than the shelf name for matching. It seems to work well if there is very little change in the shelves. But, when the server messes up, this fails. I've had a look at the database PeterT send and mine. This time something new has happened. The reason why I said above that the server was recreating the shelves is because the timestamps on the duplicates were different. The creation timestamp of each where different and that agreed with reanimating the deleted shelves. This time, the database shows all the timestamps as "1970-01-01T00:00:00Z". And that explains why the utilities plugin is not fixing it. It marks all except on shelf as deleted and it uses the timestamp, either the oldest or newest depending on the option selected, to work out which to keep. With them all having the same timestamp, that doesn't work. I can do something with the ids to handle this. I should have something out later in the evening.