[Device Plugin] Kobo Touch Extended Driver - Page 99

davidfor · 11-18-2015, 08:00 AM

Quote:

Originally Posted by incumbent

I have a koboExtStorage directory on my SD card and a metadata.calibre and a driveinfo.calibre file on the SD card as well.

My main storage (internal) has a "koboExtStorage" directory, and contains a metadata.calibre, and a driveinfo.calibre file as well.

A "koboExtStorage" directory in the main memory is wrong. It is only supposed to get created on the external card. The other files are created by calibre to help with handling the device and books. What is in the driveinfo.calibre that is on the main memory.

Quote:

Anything is possible. Before I do that, here's some debug output (the tl;dr version):

Code:

Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
2015-11-16 23:14:00.539 Calibre[90009:3928351] deliverNotificationWithTitle()
DeviceJob: 1 Get device information callback returned
Job: 2 Set library information started
DeviceJob: 2 Set library information done, calling callback
DeviceJob: 2 Set library information callback returned
Job: 3 Get list of books on device started
DEBUG:    0.0 KoboTouch:books - oncard='None'
DEBUG:    0.0 KoboTouch:books - oncard='None', prefix='/Volumes/KOBO16/'
DEBUG:    0.0 Kobo device: Kobo Aura HD
DEBUG:    0.0 Version of driver: (2, 5, 3) Has kepubs: True
DEBUG:    0.0 Version of firmware: (0, 0, 0) Has kepubs: True
DEBUG:    0.0 Firmware supports cover image tree: False
DEBUG:    0.0 KoboTouch:books - opts.extra_customization= [u'#koboshelves', True, True, True, True, True, False, True, True, True, False, True, u'', True, False, True, False, False, False, False, u'', False, False]
DEBUG:    0.0 KoboTouch:books - prefs['manage_device_metadata']= on_connect
DEBUG:    0.0 KoboTouch:books - set_debugging_title to ''
DEBUG:    0.0 KoboTouch:books - length bl=0
* Notification delivered.
Job: 1 Get device information finished
No details available.
Job: 2 Set library information finished
No details available.
DEBUG:   13.7 KoboTouch:books - length bl after sync=1586
DeviceJob: 3 Get list of books on device done, calling callback
unable to open database file

And now, after I whack the two calibre files from the SD card it still doesn't fly:

Code:

Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
2015-11-16 23:26:20.881 Calibre[90786:3946744] deliverNotificationWithTitle()
DeviceJob: 1 Get device information callback returned
Job: 2 Set library information started
DeviceJob: 2 Set library information done, calling callback
DeviceJob: 2 Set library information callback returned
Job: 3 Get list of books on device started
DEBUG:    0.0 KoboTouch:books - oncard='None'
DEBUG:    0.0 KoboTouch:books - oncard='None', prefix='/Volumes/KOBO16/'
DEBUG:    0.0 Kobo device: Kobo Aura HD
DEBUG:    0.0 Version of driver: (2, 5, 3) Has kepubs: True
DEBUG:    0.0 Version of firmware: (0, 0, 0) Has kepubs: True
DEBUG:    0.0 Firmware supports cover image tree: False
DEBUG:    0.0 KoboTouch:books - opts.extra_customization= [u'#koboshelves', True, True, True, True, True, False, True, True, True, False, True, u'', True, False, True, False, False, False, False, u'', False, False]
DEBUG:    0.0 KoboTouch:books - prefs['manage_device_metadata']= on_connect
DEBUG:    0.0 KoboTouch:books - set_debugging_title to ''
DEBUG:    0.0 KoboTouch:books - length bl=0
DEBUG:    0.0 KoboTouch:books - length bl after sync=0
DeviceJob: 3 Get list of books on device done, calling callback
* Notification delivered.
unable to open database file

I don't immediately see anything. Can I have the complete log?

Quote:

For whatever reason, a combination of running the desktop Kobo application, reboot/logout or some other shenanigans influences the outcome. Sometimes it works, sometimes it doesn't. It isn't 100% reproducible until it happens once, then I can reliably replicate it until I can't.

When calibre stops seeing the database, does the Kobo desktop work properly?

lesuisse007 · 01-10-2016, 02:56 AM

Quote:

Originally Posted by ilicitanosoy

That always happens to me with books that are not kepub . I tried it with other books already converted and no problem to pass .

If I use "calibre" gives me the following error.

Spoiler:

I have the same problem converting an ebook on "kepub" with a user account containing an e acute. I create a user account without an accent, and the problem is no longer present.
Hope this can help someone.

ilicitanosoy · 01-15-2016, 03:11 AM

Quote:

Originally Posted by lesuisse007

I have the same problem converting an ebook on "kepub" with a user account containing an e acute. I create a user account without an accent, and the problem is no longer present.
Hope this can help someone.

New user account without an accent?

I imagine you're referring to the account on the web kobo but without accent where...

- In first and last name account
- In e-mail

where? because I still have the problem

davidfor · 01-15-2016, 06:14 AM

Quote:

Originally Posted by ilicitanosoy

New user account without an accent?

I imagine you're referring to the account on the web kobo but without accent where...

- In first and last name account
- In e-mail

where? because I still have the problem

I think lesuisse007 meant the Windows account. From the error message, it is a problem with where temporary files are stored. As Windows usually puts the temporary directory under the user directory, using an account without accents in the name would prevent this problem. Or you can point the Windows temporary directory elsewhere, or set the environment variable CALIBRE_TEMP_DIR to point to a suitable directory for calibre to use.

oren64 · 01-18-2016, 01:48 PM

How can i add a icon to the toolbar, that open Customize KoboTouchExtended ?

jgoguen · 01-18-2016, 03:02 PM

It's the Device icon that's on the toolbar by default when you plug in a Kobo device. You click the arrow beside the icon and I think the menu option is "Customize Device". Without a device plugged in, you need to go through calibre options, Plugins, Device Interface Plugins, KoboTouchExtended.

davidfor · 01-18-2016, 05:05 PM

The latest beta of my Kobo Utilities plugin adds some menu options for the drivers. One of them is to open the driver when the device isn't connected. It doesn't explicitly open the extended driver, but opens whichever of the extended driver and the main driver is enabled.

incumbent · 03-26-2016, 07:51 PM

Quote:

Originally Posted by davidfor

A "koboExtStorage" directory in the main memory is wrong. It is only supposed to get created on the external card. The other files are created by calibre to help with handling the device and books. What is in the driveinfo.calibre that is on the main memory.

I've recently re-imaged the device and it still does this.

Code:

{"device_store_uuid": "1c0c2058-1d50-4b24-8f5a-e5f0dba320cb", "last_library_uuid": null, "prefix": "/Volumes/KOBOeReader/", "date_last_connected": "2016-03-26T23:38:04.827633+00:00", "location_code": "A", "device_name": "Kobo Aura HD", "calibre_version": "2.53.0"}%

That last bit looks like a control character in my terminal.

External storage version:

Code:

{"device_store_uuid": "61295f8e-241c-4c71-955a-8e2ab380ee6f", "last_library_uuid": null, "prefix": "/Volumes/KOBO16/", "date_last_connected": "2016-03-26T23:38:04.820323+00:00", "location_code": "main", "device_name": "Kobo Aura HD", "calibre_version": "2.53.0"}%

Quote:

Originally Posted by davidfor

I don't immediately see anything. Can I have the complete log?

Yes. Which one; the verbose output from a calibre run or a plugin log or all of the above?

Quote:

Originally Posted by davidfor

When calibre stops seeing the database, does the Kobo desktop work properly?

Appears to? Sometimes that is what causes a refreshing contents loop where I'm not sure the database isn't mangled. Since the time of this posting there has been an update to Kobo Desktop and I haven't done it yet, but I'm about to anyway.

davidfor · 03-26-2016, 09:28 PM

Quote:

Originally Posted by incumbent

I've recently re-imaged the device and it still does this.

Is there anything inside the "koboExtStorage" directory? If you delete it, does it come back?

Quote:

Code:

{"device_store_uuid": "1c0c2058-1d50-4b24-8f5a-e5f0dba320cb", "last_library_uuid": null, "prefix": "/Volumes/KOBOeReader/", "date_last_connected": "2016-03-26T23:38:04.827633+00:00", "location_code": "A", "device_name": "Kobo Aura HD", "calibre_version": "2.53.0"}%

That last bit looks like a control character in my terminal.

External storage version:

Code:

{"device_store_uuid": "61295f8e-241c-4c71-955a-8e2ab380ee6f", "last_library_uuid": null, "prefix": "/Volumes/KOBO16/", "date_last_connected": "2016-03-26T23:38:04.820323+00:00", "location_code": "main", "device_name": "Kobo Aura HD", "calibre_version": "2.53.0"}%

Both of those look OK. The % on the end is a bit strange, but it is probably the editor you are using representing some control character. I don't see it when I look at the files with Notepad++ under Windows.

Quote:

Yes. Which one; the verbose output from a calibre run or a plugin log or all of the above?

The full debug log. Every single line.

Quote:

Appears to? Sometimes that is what causes a refreshing contents loop where I'm not sure the database isn't mangled.

When does this loop hit? In the library list or are you talking about somewhere else?

Quote:

Since the time of this posting there has been an update to Kobo Desktop and I haven't done it yet, but I'm about to anyway.

The Kobo Desktop application isn't needed unless you want to sync book from Kobo and don't want to use the WiFi on the device.

patrik · 04-05-2016, 04:40 PM

Ever since i got my Aura HD I have had problems doing (a lot of) high lights. I wrote about it here, and even made a report to Kobo about it.

What happens is that all works well for a while, but then the highlights I do, doesn't stick. I can make the highlight, but when the screen refreshes it's not there. When it has started, it almost always continues for a while, but may work on another page, etc.

Tonight thinking about a trip and some things i would like to do during it, I was reminded of this. I haven't done any highlights with the current firmware, so I opened a book and started to read and make highlights. All worked well until maybe the 20th highlight or so. Same behavior as before.

But for some reason I started to think about if there would be any difference using the other reader-engine in the Kobo. I opened an epub, and started to highlight.... and so far it works perfectly.

I got a bit curious and openened a book bought from kobo (a kepub). And it seems to work perfectly there as well.

So, could it be that my highlightproblems is in some way related to the kepub conversion that the extended plugin does? I know it's a master piece of reverse engineering and never made any claim of doing it "perfectly". (I'm really happy it exists, I tend to prefer kepub.)

Jgoguen, David and al, do you have any idea if this could be? And if so, if there is something that we can test and hopefully make it work?

jgoguen · 04-05-2016, 05:48 PM

If it works in purchased KePubs and not in converted ones, I'd say there's a good chance it's related to the conversion

I recently bought a book from Kobo, when I get a chance I'll unpack it and a converted book and look for differences again. One thing it could be is the database-level differences for KePubs from Kobo and from the conversion. There's a bunch of stuff that wasn't available for a while, like detailed in-book reading stats, if you use a converted KePub. I did a lot of digging and it came down to changes in the database being different for KePubs from Kobo and from sideloading. The work to make the database updates equivalent causes problems such that you can never allow the device to connect to Kobo without causing a lot of problems with your sideloaded books, so if that's what it is then highlights will just have to remain broken.

davidfor · 04-05-2016, 08:36 PM

It's been a while since I have tried making a lot of annotations in a sideloaded kepub. I don't think I have anything suitable on the device at the moment, so I'll add one tonight and test.

But, just in case it is something about the annotations you are making:

What are your annotations like? Single words, sentences or across sentence boundaries. Long ones that go across paragraph boundaries or other tags.

Are the all in one chapter or spread over the book?

Does it matter if they have annotations or are just highlights? Are you annotations long?

What if you just bookmark 20-odd pages? By that I mean tap the top-right corner for a dog-ear bookmark. (Which makes me think of https://www.mobileread.com/forums/sho...postcount=7087).

Are the books likely to have complex markup? Novels are usually simple, though some book creators seem to go out of their way to make their life hard. Text books are more likely to have complex markup. They will probably have more tags and are likely to have nested tags.

Have you checked the annotations list? There is one circumstance for epubs where the highlight for the annotation isn't displayed after making it, but the annotation is in the list. Because of why the problem happens, changing the reading settings will usually cause it them to be drawn properly.

davidfor · 04-05-2016, 11:49 PM

I realised I did have something suitable on my Glo HD. So, I opened it while reading something on the computer.

First, I just tapped the top right corner, turned the page and repeated. After 37 bookmarks, there was no problems.

Then I went to the first chapter, selected a word and saved a highlight. And repeated for ever second word. After 20+ of these, still no problems.

Then I highlighted a few words in the first line of each paragraph and saved them. About 20 of these with no problems. There were a few accidental annotations in this as I hit the wrong menu item.

Then I started doing actual annotations. This was just select some text, press "Add note" and randomly hit the keyboard. Again no problems.

I now have a sideloaded kepub with 37 bookmarks, 49 highlights and 23 annotations with no errors. I haven't done anything that went across a tag boundary. Though some went across sentences, so there is some crossing of the Kobo spans. I'll do some other tests later, but, at the moment, it doesn't feel like there is a limit to the annotations.

The test book is a novel. The code in it is clean. The paragraphs are just "p" tags with no attributes. For the font I use Georgia with a size about a quarter of the way from the left. The line spacing and margins are at the minimum and the justification is off. The device is Glo HD with firmware 3.19.5761. I don't use any patches.

About the only thing I can think that might be different is that the kepub was probably the result of a conversion rather than a send using the extended driver. I've looked at the results of both and I'd be very surprised if this was a factor.

patrik · 04-06-2016, 06:28 PM

jgoguen, thanks, it will be very interesting to see what you get from the comparison.

David, I only did highlights, no annotations or bookmarks. The highlights are typically 2-4 lines each (sometimes just a word, sometimes half a page), usually within a sentence (if you mean a paragraph, with no white space between).

I just did a quick test and noticed something interesting. My plan was to either do a screengrab or take photo/video so you can see how/what I have highlighted. In order to make it easier (as in fewer pages needed), I decreased the font 3 times. What happened was that if I now did the highlight, it orked!

So, I spent 5 minutes reading, highlighting every now and then, and when it stoped to work, I change the font size, now it worked, changed it back, continued to read, etc.

It would seem something happens when decreasing the font size.... hmm... (I tested increase font size, to see if any change did it, but only a decrease works.)

I hope I get more time to test tomorrow, or maybe the font size thing triggers something for you?

Thanks :-)

davidfor · 04-06-2016, 09:27 PM

Quote:

Originally Posted by patrik

jgoguen, thanks, it will be very interesting to see what you get from the comparison.

David, I only did highlights, no annotations or bookmarks. The highlights are typically 2-4 lines each (sometimes just a word, sometimes half a page), usually within a sentence (if you mean a paragraph, with no white space between).

That does match with my testing: various lengths of highlighting and saving. And I did get 49 of them without problems.

Quote:

I just did a quick test and noticed something interesting. My plan was to either do a screengrab or take photo/video so you can see how/what I have highlighted. In order to make it easier (as in fewer pages needed), I decreased the font 3 times. What happened was that if I now did the highlight, it orked!

So, I spent 5 minutes reading, highlighting every now and then, and when it stoped to work, I change the font size, now it worked, changed it back, continued to read, etc.

It would seem something happens when decreasing the font size.... hmm... (I tested increase font size, to see if any change did it, but only a decrease works.)

I hope I get more time to test tomorrow, or maybe the font size thing triggers something for you?

Changing the font size or any other of the settings will trigger a render of at least the current chapter. If something was preventing a highlight from being shown on the screen, this might fix it.

What is actually not working. If I make a highlight, I do the following:

Touch the screen and drag it. While that happens, the text is underlined.
Take my finger off the screen. Handles are added to the end of the underline and the menu is displayed.
Tap "Highlight" on the menu. The menu closes and the underlines change to grey background on the text.
The annotations list now has an entry for the highlighted text.

At which point does it stop? I assumed the third step, and that the last wasn't done, but I am not completely sure.

And some more questions:

As you are seeing a change when you change font settings, what font and size are you using?
If you close the book and reopen it, does the highlighting start working again?
After changing the font size and the highlighting starts to work again, how many highlights can you get? About 20 again? Or less?

01-18-2016, 01:48 PM	#1475
oren64 I need a chapter break Posts: 4,042 Karma: 56058267 Join Date: Mar 2015 Location: Israel Device: Kobo Glo	How can i add a icon to the toolbar, that open Customize KoboTouchExtended ? Last edited by oren64; 01-18-2016 at 01:53 PM.

01-18-2016, 05:05 PM	#1477
davidfor Grand Sorcerer Posts: 24,905 Karma: 47303824 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	The latest beta of my Kobo Utilities plugin adds some menu options for the drivers. One of them is to open the driver when the device isn't connected. It doesn't explicitly open the extended driver, but opens whichever of the extended driver and the main driver is enabled. Last edited by davidfor; 01-19-2016 at 05:01 PM. Reason: Fixed link

04-05-2016, 04:40 PM	#1480
patrik Guru Posts: 682 Karma: 4568205 Join Date: Jan 2010 Location: Sweden Device: Kobo Forma	Possible bug in highlighting kepub-converted books? Ever since i got my Aura HD I have had problems doing (a lot of) high lights. I wrote about it here, and even made a report to Kobo about it. What happens is that all works well for a while, but then the highlights I do, doesn't stick. I can make the highlight, but when the screen refreshes it's not there. When it has started, it almost always continues for a while, but may work on another page, etc. Tonight thinking about a trip and some things i would like to do during it, I was reminded of this. I haven't done any highlights with the current firmware, so I opened a book and started to read and make highlights. All worked well until maybe the 20th highlight or so. Same behavior as before. But for some reason I started to think about if there would be any difference using the other reader-engine in the Kobo. I opened an epub, and started to highlight.... and so far it works perfectly. I got a bit curious and openened a book bought from kobo (a kepub). And it seems to work perfectly there as well. So, could it be that my highlightproblems is in some way related to the kepub conversion that the extended plugin does? I know it's a master piece of reverse engineering and never made any claim of doing it "perfectly". (I'm really happy it exists, I tend to prefer kepub.) Jgoguen, David and al, do you have any idea if this could be? And if so, if there is something that we can test and hopefully make it work?

04-05-2016, 05:48 PM	#1481
jgoguen Generally Awesome Person Posts: 1,100 Karma: 2191133 Join Date: Jan 2013 Location: /dev/kmem Device: Kobo Clara HD, Kindle Oasis	If it works in purchased KePubs and not in converted ones, I'd say there's a good chance it's related to the conversion I recently bought a book from Kobo, when I get a chance I'll unpack it and a converted book and look for differences again. One thing it could be is the database-level differences for KePubs from Kobo and from the conversion. There's a bunch of stuff that wasn't available for a while, like detailed in-book reading stats, if you use a converted KePub. I did a lot of digging and it came down to changes in the database being different for KePubs from Kobo and from sideloading. The work to make the database updates equivalent causes problems such that you can never allow the device to connect to Kobo without causing a lot of problems with your sideloaded books, so if that's what it is then highlights will just have to remain broken. Last edited by jgoguen; 04-05-2016 at 05:53 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Kobo Device Driver Update	davidfor	Devices	284	05-24-2019 05:24 PM
[Device Plugin] Kindle 2, 3, 4, Touch Device Interface MBP Update Mod	cryzed	Plugins	7	10-28-2012 04:58 PM
[Device Interface Plugin] Update for Nook Color Driver	jmricker	Plugins	0	10-22-2011 10:11 AM
Touch Kobo Touch Extended 2 Year Warranty - Is it worth the $34.99?	EverC	Kobo Reader	11	08-31-2011 11:47 PM
Touch Kobo Touch Extended Warranty Program	SensualPoet	Kobo Reader	1	07-17-2011 04:08 AM

01-18-2016, 03:02 PM	#1476
jgoguen Generally Awesome Person Posts: 1,100 Karma: 2191133 Join Date: Jan 2013 Location: /dev/kmem Device: Kobo Clara HD, Kindle Oasis	It's the Device icon that's on the toolbar by default when you plug in a Kobo device. You click the arrow beside the icon and I think the menu option is "Customize Device". Without a device plugged in, you need to go through calibre options, Plugins, Device Interface Plugins, KoboTouchExtended.

04-05-2016, 08:36 PM	#1482
davidfor Grand Sorcerer Posts: 24,905 Karma: 47303824 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	It's been a while since I have tried making a lot of annotations in a sideloaded kepub. I don't think I have anything suitable on the device at the moment, so I'll add one tonight and test. But, just in case it is something about the annotations you are making: What are your annotations like? Single words, sentences or across sentence boundaries. Long ones that go across paragraph boundaries or other tags. Are the all in one chapter or spread over the book? Does it matter if they have annotations or are just highlights? Are you annotations long? What if you just bookmark 20-odd pages? By that I mean tap the top-right corner for a dog-ear bookmark. (Which makes me think of https://www.mobileread.com/forums/sho...postcount=7087). Are the books likely to have complex markup? Novels are usually simple, though some book creators seem to go out of their way to make their life hard. Text books are more likely to have complex markup. They will probably have more tags and are likely to have nested tags. Have you checked the annotations list? There is one circumstance for epubs where the highlight for the annotation isn't displayed after making it, but the annotation is in the list. Because of why the problem happens, changing the reading settings will usually cause it them to be drawn properly.

04-05-2016, 11:49 PM	#1483
davidfor Grand Sorcerer Posts: 24,905 Karma: 47303824 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	I realised I did have something suitable on my Glo HD. So, I opened it while reading something on the computer. First, I just tapped the top right corner, turned the page and repeated. After 37 bookmarks, there was no problems. Then I went to the first chapter, selected a word and saved a highlight. And repeated for ever second word. After 20+ of these, still no problems. Then I highlighted a few words in the first line of each paragraph and saved them. About 20 of these with no problems. There were a few accidental annotations in this as I hit the wrong menu item. Then I started doing actual annotations. This was just select some text, press "Add note" and randomly hit the keyboard. Again no problems. I now have a sideloaded kepub with 37 bookmarks, 49 highlights and 23 annotations with no errors. I haven't done anything that went across a tag boundary. Though some went across sentences, so there is some crossing of the Kobo spans. I'll do some other tests later, but, at the moment, it doesn't feel like there is a limit to the annotations. The test book is a novel. The code in it is clean. The paragraphs are just "p" tags with no attributes. For the font I use Georgia with a size about a quarter of the way from the left. The line spacing and margins are at the minimum and the justification is off. The device is Glo HD with firmware 3.19.5761. I don't use any patches. About the only thing I can think that might be different is that the kepub was probably the result of a conversion rather than a send using the extended driver. I've looked at the results of both and I'd be very surprised if this was a factor.

04-06-2016, 06:28 PM	#1484
patrik Guru Posts: 682 Karma: 4568205 Join Date: Jan 2010 Location: Sweden Device: Kobo Forma	jgoguen, thanks, it will be very interesting to see what you get from the comparison. David, I only did highlights, no annotations or bookmarks. The highlights are typically 2-4 lines each (sometimes just a word, sometimes half a page), usually within a sentence (if you mean a paragraph, with no white space between). I just did a quick test and noticed something interesting. My plan was to either do a screengrab or take photo/video so you can see how/what I have highlighted. In order to make it easier (as in fewer pages needed), I decreased the font 3 times. What happened was that if I now did the highlight, it orked! So, I spent 5 minutes reading, highlighting every now and then, and when it stoped to work, I change the font size, now it worked, changed it back, continued to read, etc. It would seem something happens when decreasing the font size.... hmm... (I tested increase font size, to see if any change did it, but only a decrease works.) I hope I get more time to test tomorrow, or maybe the font size thing triggers something for you? Thanks :-)

Advert

Advert