Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 03-31-2015, 06:20 AM   #916
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 6,844
Karma: 6677573
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo: Touch, Glo, Aura H2O, Glo HD
When you disconnect the Kobo ereader from the PC, it looks for changes in the books. Any new books will be processed into the internal database and hence the library. Any books that have been deleted, will have nearly all evidence of them removed from the database. Any changed books will be removed from the database and then processed as a new book.

The behaviour of the last one has changed over time. Early firmware didn't do anything. Current firmware does the above.

For this, what the firmware considers as changed is the file size. That means you could unpack an epub and repack it without any other changes and get a different size. Or open it, change one letter somewhere in the text and repack it and the device will see it as a new book.

Because of this, when you send a book to a Kobo device that is already on the device, the driver will update the files size stored in the database. I chose to do this in the driver because that kept older behaviour, and my impression from discussion here is that how people wanted it to work. And to be honest, it is how I wanted it to work. I frequently edit books I read to fix spelling and layout. As long as I don't fiddle with the internal file structure or the ToC, everything will work OK.

If you make changes to the ToC or the internal file structure, the book can probably still be read, but, there might be problems. One of the things that the processing of the book does is to store the ToC in the database. If you open the ToC when reading the book, the database is used. If it doesn't match the book, selecting an entry will probably take you to the start of the book.

If the file structure changes, again the book can probably be read. But, the ToC won't work and the reading position won't be stored properly. That means it will probably reopen to the start of the book.

None of this has anything to do with the utilities plugin. It's how the device works and how the driver works.
davidfor is offline   Reply With Quote
Old 03-31-2015, 11:41 AM   #917
iostrym
Member
iostrym began at the beginning.
 
Posts: 15
Karma: 10
Join Date: Mar 2015
Device: kobo
Hi, thanks for your precise answer.

you said :

" I chose to do this in the driver because that kept older behaviour, and my impression from discussion here is that how people wanted it to work."

If this is not related to kobo utilities plug-in, then why are you implicated in the driver ? What driver are we talking about ? windows driver ? calibre driver to access kobo ?
iostrym is offline   Reply With Quote
Old 03-31-2015, 02:10 PM   #918
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
PeterT's Avatar
 
Posts: 8,067
Karma: 50766665
Join Date: Nov 2007
Location: Toronto
Device: Wife: Touch, Arc, Vox Me: Nexus 7, Glo
davidfor is both one of the co-authors of the Kobo calibre device driver, the author of Kobo Utilities, and is involved with a myriad of other plugins too.

Probably he has more knowledge of the Kobos and their database than anyone outside of Kobo itself.
PeterT is online now   Reply With Quote
Old 03-31-2015, 04:07 PM   #919
iostrym
Member
iostrym began at the beginning.
 
Posts: 15
Karma: 10
Join Date: Mar 2015
Device: kobo
OK it was what i was thinking about but wasn't sure. Thanks for explanation. So we are talking about calibre kobo driver :-)

But there is one point that I'm missing and I'm sorry because it is then no more related to kobo utilities. Why it is important that kobo don't refresh it database when the same (modified or not) epub is loaded. For processing time ? Or for another purpose ?

And big question, Is the behavior you described with epub the same with PDF ?
iostrym is offline   Reply With Quote
Old 03-31-2015, 05:46 PM   #920
jackie_w
Wizard
jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.jackie_w ought to be getting tired of karma fortunes by now.
 
Posts: 3,082
Karma: 4410252
Join Date: Sep 2009
Location: UK
Device: Sony PRS-350, PB360, Kobo Glo/AuraHD/Aura6"/AuraH2O
Quote:
Originally Posted by PeterT View Post
...Probably he has more knowledge of the Kobos and their database than anyone outside of Kobo itself...
... I wouldn't be surprised if it was also many inside Kobo itself
jackie_w is offline   Reply With Quote
Old 03-31-2015, 07:23 PM   #921
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 6,844
Karma: 6677573
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo: Touch, Glo, Aura H2O, Glo HD
Quote:
Originally Posted by iostrym View Post
OK it was what i was thinking about but wasn't sure. Thanks for explanation. So we are talking about calibre kobo driver :-)
Yes, this is about the KoboTouch driver plugin that is part of calibre.
Quote:
But there is one point that I'm missing and I'm sorry because it is then no more related to kobo utilities. Why it is important that kobo don't refresh it database when the same (modified or not) epub is loaded. For processing time ? Or for another purpose ?
Strictly, there is no reason to reprocess unchanged books and because it takes a long time. If you add 100 books to the device, it takes at least ten minutes. If you have 100 books on the device and add 1 more but all the the books get reprocessed, then you have ten wasted minutes until the device is ready to use. I have about 1400 books on my H2O, so don't want all of them reprocessed each time I add a book. Especially if I'm disconnecting the H2O intending to read for a little bit before bed.
Quote:
And big question, Is the behavior you described with epub the same with PDF ?
It is the same for all book types.
davidfor is offline   Reply With Quote
Old 04-01-2015, 03:51 AM   #922
iostrym
Member
iostrym began at the beginning.
 
Posts: 15
Karma: 10
Join Date: Mar 2015
Device: kobo
Thanks a lot.

So, kobo driver modifie filesize so that kobo don't see the epub/pdf as modified to save kobo processing time. But what if epub is really modified, kobo driver can't know it so we have to remove it manually from kobo, disconnect and then reconnect and add the new one. right ?
And what if the new modified epub is added in calibre as the new epub (with same title and author as the old one, toc may be modified, and metadata that indicate version number), is the behavior the same ? Because I do modification in pdf and epub outside calibre and then add the new modified file in calibre.
do you prefer me to ask those question in private messages so that this thread is not "polluted" ?
iostrym is offline   Reply With Quote
Old 04-01-2015, 07:18 AM   #923
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 6,844
Karma: 6677573
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo: Touch, Glo, Aura H2O, Glo HD
Quote:
Originally Posted by iostrym View Post
So, kobo driver modifie filesize so that kobo don't see the epub/pdf as modified to save kobo processing time. But what if epub is really modified, kobo driver can't know it so we have to remove it manually from kobo, disconnect and then reconnect and add the new one. right ?
And what if the new modified epub is added in calibre as the new epub (with same title and author as the old one, toc may be modified, and metadata that indicate version number), is the behavior the same ? Because I do modification in pdf and epub outside calibre and then add the new modified file in calibre.
It's a choice. The firmware uses the full file path to identify a book. If there is a file there, it is assumed to be the same book. But, if the file size changes the book is reprocessed. It doesn't matter where the replacement copy comes from and it doesn't matter what is in the file. If it is the same size as in the database, it's left alone. If the file size is changed, it is completely reprocessed.

The driver updates the file size when the book is replaced so that it won't be removed. It doesn't matter what was done with the book. It could have been edited using the calibre editor, Sigil or something else. Or a new copy downloaded from somewhere. Doing this is a risk. If the book has changed to much, then it could cause problems. But, if it isn't done, there is no way to replace a book and not lose the reading status, bookmarks and collections. You can get around this by removing the book first.
Quote:
do you prefer me to ask those question in private messages so that this thread is not "polluted" ?
This is much better in the forum where others can see it and join in if they want to. Though it would be more appropriate for the KoboTouch driver thread.
davidfor is offline   Reply With Quote
Old 04-01-2015, 12:37 PM   #924
iostrym
Member
iostrym began at the beginning.
 
Posts: 15
Karma: 10
Join Date: Mar 2015
Device: kobo
Hi, thanks a lot this is pretty clear.
So concerning books that are not modified but only tags modified in calibre, If i want the creation in kobo of collection for new tag, I only have to reload to the kobo all books. I will have a to wait USB transfer (lot of PDF) but maybe no processing time in the kobo and no reading status deletion. Right ? There is nothing in kobo driver that detect that Filesize is the same in database and in calibre so there is no need to send the file again ?
By the way where is the thread concerning kobo driver? In this forum ? In another one ? I believe I must check kobo driver support somewhere before upgrading kobo firmeware...
iostrym is offline   Reply With Quote
Old 04-01-2015, 08:12 PM   #925
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 6,844
Karma: 6677573
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo: Touch, Glo, Aura H2O, Glo HD
Quote:
Originally Posted by iostrym View Post
Hi, thanks a lot this is pretty clear.
So concerning books that are not modified but only tags modified in calibre, If i want the creation in kobo of collection for new tag, I only have to reload to the kobo all books.
The driver does the management of collections independently of sending books. Assuming the configuration is correct, each time you connect, it checks and updates the collections as appropriate. So, if you are using tags for the collections and change them in the library, they will automatically be created or deleted on the device at the next connection.
Quote:
I will have a to wait USB transfer (lot of PDF) but maybe no processing time in the kobo and no reading status deletion. Right ? There is nothing in kobo driver that detect that Filesize is the same in database and in calibre so there is no need to send the file again ?
Comparing the file size of the book in the library with that on the device doesn't really work. One of the things that calibre does when a book is sent to the device is to update the metadata to the latest in the library. This means that the file size will probably change during the send. All the KoboTouch driver does is update the file size in the database to the same as the file after it has been copied to the device.
Quote:
By the way where is the thread concerning kobo driver? In this forum ? In another one ? I believe I must check kobo driver support somewhere before upgrading kobo firmeware...
The driver thread is http://www.mobileread.com/forums/sho...d.php?t=192863. It doesn't get much action as most of the discussion happens elsewhere when someone is having a problem. I usually only push things there that are very specific to the driver. Plus any announcements of changes in function.

As to firmware upgrades, I keep the driver up to date and will announce anything problems as soon as possible after the firmware is released. That usually happens on the same day of the release. Part of why I can do this is that I am on the firmware beta testing list and get them to test. I test this with calibre and look for anything new we might want to use. The other reason is that Kobo hasn't made many changes recently that affect how calibre interacts with the device. Generally, I test and bump the supported firmware version number in the driver and that's it.
davidfor is offline   Reply With Quote
Old 04-06-2015, 06:31 PM   #926
iostrym
Member
iostrym began at the beginning.
 
Posts: 15
Karma: 10
Join Date: Mar 2015
Device: kobo
thanks a lot for so much details.
iostrym is offline   Reply With Quote
Old Yesterday, 06:28 AM   #927
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 6,844
Karma: 6677573
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo: Touch, Glo, Aura H2O, Glo HD
Update to Kobo Utilities plugin - V2.0.6 - Fix a backup problem and add Select/Clear

I have just updated the plugin to version 2.0.6. This has two small changes
  • Fix: Handle missing files in the backup properly.
  • Change: Add select/clear all buttons to reading status update dialog.

As usual, calibre will notify you of the update in the next hour or so. And if there are any problems, please report them here.
davidfor is offline   Reply With Quote
Reply

Tags
kobo

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 317 04-21-2015 09:45 PM
[GUI Plugin] Wordpress frescogamba Plugins 11 04-06-2015 09:09 PM
[GUI Plugin] Hyphenate This! SauliusP. Plugins 224 03-18-2015 02:51 PM
[GUI Plugin] EpubSplit JimmXinu Plugins 152 03-18-2015 11:16 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 12:13 AM.


MobileRead.com is a privately owned, operated and funded community.