Sideloaded Duplicate Shelves on the Glo, and a simple solution...

TechniSol · 01-14-2013, 12:30 AM

While I realize others have experienced duplicate shelves on their readers and have expressed belief that it is a Kobo server issue, I have encountered the problem with side loaded epubs via Calibre which is being used to create shelves. I do not have any Kobo books on my reader, all my books are without DRM, and yet on one series of three I experienced multiple shelves after transferring the epubs to my Glo.

I noted the duplicate shelf, reconnected to Calibre, deleted the titles, sent them again, and then found myself with two duplicate shelves for the same series! I tried again and got the second duplicate to go away, but had no luck with rinse and repeat as far as the first duplicate was concerned.

My ultimate solution, while far from inspired, was to delete the epubs from the reader, change the contents of the metadata series field for the three titles in Calibre, send them to the reader one last time and watch my problem disappear. I cheated, by merely changing the series information to a slightly different shelf name.

Far from an awe inspiring feat of legerdemain, but it worked.

I suspect that there may be a Kobo firmware issue or database issue that may be contributing to this whole duplicate shelves issue, and am not quite sure it is really a Kobo server side issue. I think it far more likely that it is a firmware issue, since multiple shelves can apparently be created without so much as a sync to the Kobo servers of any kind.

davidfor · 01-14-2013, 01:34 AM

Was this with your new Glo? If so, did the Touch get synced to the Kobo server before you setup the Glo? And did the shelves get created on the Glo when you did the setup?

The shelves being duplicated by the Kobo server has nothing to do with kepubs being on the shelves. The existence of the shelves will get synced to the server even if they are empty or have no kepubs on them. The only books on shelves that get synced are the kepubs. Because if this, shelves are being duplicated at sync time.

But, it could be a driver issue. One problem with shelves is case and leading and trailing spaces. The shelves can be created with leading and trailing spaces and "AAA" and "aaa" are considered different. The calibre driver treats these as separate shelves. If there are leading or trailing spaces in the name of a shelf already on the device, the driver considers these to be different shelves. I think case is handled the same (but I've have to check the code). Any shelf created by the driver will have exactly the value set in the calibre library: same case, no leading or trailing spaces.

If you see this again, I would be interested in a debug log so that I can see what is happening.

TechniSol · 01-14-2013, 05:21 PM

David,

This was with the new Glo as I wrote above. When I set up the reader the only thing it did was update the firmware and download/attempt to download some epubs from Kobo. I'm 99% sure no shelves appeared post sync -I recall checking, but I could be remembering incorrectly as I wasn't exactly in dispassionate observer mode, more like big kid with a new toy mode.

However, if the shelves were created then I'm pretty sure I would have noticed duplicates.

I was out, having just bought the ereader, and having some cheddar mushroom soup so thick the spoon would almost stand up and a steak sandwich in a bar/restaurant that had WiFi so I could update the firmware and log in. I transferred a few books via Calibre from my X41 tablet/convertible and read a bit while eating.

Later that evening, I sideloaded the rest of my library via Calibre, everything went fine for all but one shelf/series which created a dupe when I checked after disconnecting the Glo from Usb. I did not do a Kobo sync either wirelessly or through a pc, WiFi was off.

I had one duplicate shelf, erased the three books on the shelf via Calibre, and it went away. I reconnected and sent via Calibre again and had the shelf back and two duplicates. I did the delete again and was left with the original shelf and one duplicate. I gave up for a few days, then deleted the three titles, renamed the series in the metadata and transferred the books back to the Glo and now I have 10 shelves with varying numbers of titles and no duplicates on the Glo exactly as I had on the touch..

Subsequently, I've synced wirelessly and experienced no more duplicates... so if it's a server issue, why the 9 shelves with no problems and no more problems with the renamed shelf? Or is the issue only when the shelves are created? Then why no dupes when they first appeared? I'm clueless.

davidfor · 01-14-2013, 07:04 PM

That does make it sound like it was the driver rather than the Kobo server. As you have cleaned it up, it is probably to late to investigate. If you see it again, can you run calibre in debug mode and send me the log?

TechniSol · 01-14-2013, 07:36 PM

Sure, always happy to assist the man from Terminix.

Hey, is it possible the shelves got created w/o duplicates, that I didn't notice, but the dupes somehow only show up when the shelves were populated by the USB transfer via Calibre?)

davidfor · 01-14-2013, 11:56 PM

Yes, it is

I was thinking that it depends on how Kobo are reading the database. But, I just thought of something in the calibre driver that might have done something. It still needs for something to happen on the server to create the duplicates in the database, but this might cause more to appear.

I will have to do some investigation. Now, I just need the Kobo server to send me all the duplicates.

PeterT · 01-15-2013, 12:05 AM

You mean you don't have a backup from when you had the error???

davidfor · 01-15-2013, 12:46 AM

You would think so. Especially if I had a nice easy way to make a backup of the database

I have a lot of backups, but not one from just after a multiple shelf sync. I did find one that I think proves my theory. And I know how to fake it, so I will be able to test it.

TechniSol · 01-15-2013, 01:41 AM

Good Hunting!

I don't know about you, but no matter how much I hate finding a bug in my own stuff, there is always a feeling of accomplishment once you find it and blow it away.

01-14-2013, 12:30 AM	#1
TechniSol GranPohbah-Fezzes r cool! Posts: 1,056 Karma: 3151024 Join Date: Jul 2010 Device: Nook STRs, Kobo Touch, Kobo Glo	Sideloaded Duplicate Shelves on the Glo, and a simple solution... While I realize others have experienced duplicate shelves on their readers and have expressed belief that it is a Kobo server issue, I have encountered the problem with side loaded epubs via Calibre which is being used to create shelves. I do not have any Kobo books on my reader, all my books are without DRM, and yet on one series of three I experienced multiple shelves after transferring the epubs to my Glo. I noted the duplicate shelf, reconnected to Calibre, deleted the titles, sent them again, and then found myself with two duplicate shelves for the same series! I tried again and got the second duplicate to go away, but had no luck with rinse and repeat as far as the first duplicate was concerned. My ultimate solution, while far from inspired, was to delete the epubs from the reader, change the contents of the metadata series field for the three titles in Calibre, send them to the reader one last time and watch my problem disappear. I cheated, by merely changing the series information to a slightly different shelf name. Far from an awe inspiring feat of legerdemain, but it worked. I suspect that there may be a Kobo firmware issue or database issue that may be contributing to this whole duplicate shelves issue, and am not quite sure it is really a Kobo server side issue. I think it far more likely that it is a firmware issue, since multiple shelves can apparently be created without so much as a sync to the Kobo servers of any kind.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Simple Solution for Converting Devnagari (Sanskrit/Hindi) or other font book to epub	Sanjay Agnihotri	ePub	4	05-01-2020 06:44 PM
Classic B&N Nook Simple Touch - Chinese Fonts Solution	ioioioiooioo	Barnes & Noble NOOK	0	12-04-2012 02:03 AM
help on nook simple touch glo light.	jolfc	Barnes & Noble NOOK	3	12-04-2012 12:41 AM
Sideloaded book on homescreen solution for Rooted NC	mad5427	Nook Developer's Corner	17	03-14-2011 08:20 AM
USB cable connection not recognized: Simple solution	paula-t	enTourage Archive	0	03-04-2011 07:48 AM

01-14-2013, 01:34 AM	#2
davidfor Grand Sorcerer Posts: 24,907 Karma: 47303748 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Was this with your new Glo? If so, did the Touch get synced to the Kobo server before you setup the Glo? And did the shelves get created on the Glo when you did the setup? The shelves being duplicated by the Kobo server has nothing to do with kepubs being on the shelves. The existence of the shelves will get synced to the server even if they are empty or have no kepubs on them. The only books on shelves that get synced are the kepubs. Because if this, shelves are being duplicated at sync time. But, it could be a driver issue. One problem with shelves is case and leading and trailing spaces. The shelves can be created with leading and trailing spaces and "AAA" and "aaa" are considered different. The calibre driver treats these as separate shelves. If there are leading or trailing spaces in the name of a shelf already on the device, the driver considers these to be different shelves. I think case is handled the same (but I've have to check the code). Any shelf created by the driver will have exactly the value set in the calibre library: same case, no leading or trailing spaces. If you see this again, I would be interested in a debug log so that I can see what is happening.

01-14-2013, 05:21 PM	#3
TechniSol GranPohbah-Fezzes r cool! Posts: 1,056 Karma: 3151024 Join Date: Jul 2010 Device: Nook STRs, Kobo Touch, Kobo Glo	David, This was with the new Glo as I wrote above. When I set up the reader the only thing it did was update the firmware and download/attempt to download some epubs from Kobo. I'm 99% sure no shelves appeared post sync -I recall checking, but I could be remembering incorrectly as I wasn't exactly in dispassionate observer mode, more like big kid with a new toy mode. However, if the shelves were created then I'm pretty sure I would have noticed duplicates. I was out, having just bought the ereader, and having some cheddar mushroom soup so thick the spoon would almost stand up and a steak sandwich in a bar/restaurant that had WiFi so I could update the firmware and log in. I transferred a few books via Calibre from my X41 tablet/convertible and read a bit while eating. Later that evening, I sideloaded the rest of my library via Calibre, everything went fine for all but one shelf/series which created a dupe when I checked after disconnecting the Glo from Usb. I did not do a Kobo sync either wirelessly or through a pc, WiFi was off. I had one duplicate shelf, erased the three books on the shelf via Calibre, and it went away. I reconnected and sent via Calibre again and had the shelf back and two duplicates. I did the delete again and was left with the original shelf and one duplicate. I gave up for a few days, then deleted the three titles, renamed the series in the metadata and transferred the books back to the Glo and now I have 10 shelves with varying numbers of titles and no duplicates on the Glo exactly as I had on the touch.. Subsequently, I've synced wirelessly and experienced no more duplicates... so if it's a server issue, why the 9 shelves with no problems and no more problems with the renamed shelf? Or is the issue only when the shelves are created? Then why no dupes when they first appeared? I'm clueless.

01-14-2013, 07:04 PM	#4
davidfor Grand Sorcerer Posts: 24,907 Karma: 47303748 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	That does make it sound like it was the driver rather than the Kobo server. As you have cleaned it up, it is probably to late to investigate. If you see it again, can you run calibre in debug mode and send me the log?

01-14-2013, 07:36 PM	#5
TechniSol GranPohbah-Fezzes r cool! Posts: 1,056 Karma: 3151024 Join Date: Jul 2010 Device: Nook STRs, Kobo Touch, Kobo Glo	Sure, always happy to assist the man from Terminix. Hey, is it possible the shelves got created w/o duplicates, that I didn't notice, but the dupes somehow only show up when the shelves were populated by the USB transfer via Calibre?)

01-14-2013, 11:56 PM	#6
davidfor Grand Sorcerer Posts: 24,907 Karma: 47303748 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Yes, it is I was thinking that it depends on how Kobo are reading the database. But, I just thought of something in the calibre driver that might have done something. It still needs for something to happen on the server to create the duplicates in the database, but this might cause more to appear. I will have to do some investigation. Now, I just need the Kobo server to send me all the duplicates.

01-15-2013, 12:05 AM	#7
PeterT Grand Sorcerer Posts: 12,154 Karma: 73448616 Join Date: Nov 2007 Location: Toronto Device: Nexus 7, Clara, Touch, Tolino EPOS	You mean you don't have a backup from when you had the error???

01-15-2013, 12:46 AM	#8
davidfor Grand Sorcerer Posts: 24,907 Karma: 47303748 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	You would think so. Especially if I had a nice easy way to make a backup of the database I have a lot of backups, but not one from just after a multiple shelf sync. I did find one that I think proves my theory. And I know how to fake it, so I will be able to test it.

01-15-2013, 01:41 AM	#9
TechniSol GranPohbah-Fezzes r cool! Posts: 1,056 Karma: 3151024 Join Date: Jul 2010 Device: Nook STRs, Kobo Touch, Kobo Glo	Good Hunting! I don't know about you, but no matter how much I hate finding a bug in my own stuff, there is always a feeling of accomplishment once you find it and blow it away.

Advert

Advert