Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 06-15-2011, 08:05 AM   #61
beckywc
Addict
beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.
 
beckywc's Avatar
 
Posts: 270
Karma: 1050426
Join Date: Feb 2010
Location: California
Device: iPad Mini w/Retina, Kindle 3, Kindle Fire HDX 8.9, & Asus Transformer
I'm still receiving this error ever since upgrading to 1.1.1

Count ePub/Mobi Statistics
-------------------------------
Logfile for book ID 1929 (Orion 01: Tyger, Tyger Burning Bryght - MOBI)
FAILED TO COUNT PAGES
FAILED TO COUNT WORDS
1929
Traceback (most recent call last):
File "calibre_plugins.count_pages.jobs", line 92, in do_statistics_for_book
File "calibre_plugins.count_pages.statistics", line 31, in get_word_count
File "calibre_plugins.count_pages.statistics", line 141, in get_mobi_standard_word_count
File "calibre_plugins.count_pages.statistics", line 182, in _read_mobi_file
UnicodeDecodeError: 'utf8' codec can't decode byte 0x92 in position 1142: invalid start byte

I've tried removing the plugin and installing it and still get this error.
beckywc is offline   Reply With Quote
Old 06-15-2011, 08:25 AM   #62
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,230
Karma: 1345754
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
My response is the same as I posted previously. You appear alone in experiencing this problem and I can't do anything without your mobi file to try to replicate it. Upload it to somewhere and pm me a link to it.
kiwidude is offline   Reply With Quote
 
Advertisement
Old 06-15-2011, 11:15 AM   #63
CWatkinsNash
IOC Chief Archivist
CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.
 
CWatkinsNash's Avatar
 
Posts: 3,485
Karma: 32762584
Join Date: Dec 2010
Location: Nashville, TN, USA
Device: Nook STR Glowlight, Sony T1, Acer Iconia A200
Quote:
Originally Posted by beckywc View Post
I'm still receiving this error ever since upgrading to 1.1.1

Spoiler:
Count ePub/Mobi Statistics
-------------------------------
Logfile for book ID 1929 (Orion 01: Tyger, Tyger Burning Bryght - MOBI)
FAILED TO COUNT PAGES
FAILED TO COUNT WORDS
1929
Traceback (most recent call last):
File "calibre_plugins.count_pages.jobs", line 92, in do_statistics_for_book
File "calibre_plugins.count_pages.statistics", line 31, in get_word_count
File "calibre_plugins.count_pages.statistics", line 141, in get_mobi_standard_word_count
File "calibre_plugins.count_pages.statistics", line 182, in _read_mobi_file
UnicodeDecodeError: 'utf8' codec can't decode byte 0x92 in position 1142: invalid start byte


I've tried removing the plugin and installing it and still get this error.
Quote:
Originally Posted by kiwidude View Post
My response is the same as I posted previously. You appear alone in experiencing this problem and I can't do anything without your mobi file to try to replicate it. Upload it to somewhere and pm me a link to it.
Chin up, Becky - you are not alone!

I just download the same book - same error. It's currently free for UK according to this post in Bargains.

I also got the Smashwords horror offerings from a post this past weekend, all from the same publisher, and all with the same error.

I can confirm that a mobi-mobi conversion fixes the problem in every instance so far, but that obviously only works for DRM-free books (like the Smashwords books) or Alfers.
CWatkinsNash is offline   Reply With Quote
Old 06-15-2011, 02:46 PM   #64
Nyssa
Series Addict
Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.
 
Nyssa's Avatar
 
Posts: 5,607
Karma: 62034347
Join Date: Dec 2010
Location: Florida, USA
Device: Kindle Paperwhite (2nd Gen)
Oooh its not just me!!! I'm having the same issue with the same book.

I was trying to find the old plugins as well. I guess the issue is that particular book?

Edit to Add: converting Mobi to Mobi worked! Thanks

Last edited by Nyssa; 06-15-2011 at 02:50 PM.
Nyssa is offline   Reply With Quote
Old 06-15-2011, 03:23 PM   #65
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,230
Karma: 1345754
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Thx CWatkinsNash for the details on a book, I've managed to replicate the issue and will see if there is anything I can do about it.
kiwidude is offline   Reply With Quote
Old 06-15-2011, 03:38 PM   #66
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,230
Karma: 1345754
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
v1.1.2 Released

Changes in this release:
  • No longer allow text custom columns
  • Address issue of unicode character conversion with some MOBI books for count words

@beckywc, CWatkinsNash and Nyssa - this will fix the issue you found with some MOBI files.
kiwidude is offline   Reply With Quote
Old 06-15-2011, 03:50 PM   #67
Nyssa
Series Addict
Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.Nyssa ought to be getting tired of karma fortunes by now.
 
Nyssa's Avatar
 
Posts: 5,607
Karma: 62034347
Join Date: Dec 2010
Location: Florida, USA
Device: Kindle Paperwhite (2nd Gen)
Awesome! I found another book with the same issue (from Smashwords) and the update worked like a charm! Thank You!!!
Nyssa is offline   Reply With Quote
Old 06-15-2011, 04:28 PM   #68
CWatkinsNash
IOC Chief Archivist
CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.
 
CWatkinsNash's Avatar
 
Posts: 3,485
Karma: 32762584
Join Date: Dec 2010
Location: Nashville, TN, USA
Device: Nook STR Glowlight, Sony T1, Acer Iconia A200
Quote:
Originally Posted by kiwidude View Post
Thx CWatkinsNash for the details on a book, I've managed to replicate the issue and will see if there is anything I can do about it.
Quote:
Originally Posted by kiwidude View Post
Changes in this release:
  • No longer allow text custom columns
  • Address issue of unicode character conversion with some MOBI books for count words

@beckywc, CWatkinsNash and Nyssa - this will fix the issue you found with some MOBI files.
15 minutes between "I'll see if I can fix it" and "I fixed it". You're awesome!
CWatkinsNash is offline   Reply With Quote
Old 06-15-2011, 05:39 PM   #69
beckywc
Addict
beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.beckywc ought to be getting tired of karma fortunes by now.
 
beckywc's Avatar
 
Posts: 270
Karma: 1050426
Join Date: Feb 2010
Location: California
Device: iPad Mini w/Retina, Kindle 3, Kindle Fire HDX 8.9, & Asus Transformer
Thanks so much
beckywc is offline   Reply With Quote
Old 06-18-2011, 02:36 PM   #70
capnm
Groupie
capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'capnm knows the difference between 'who' and 'whom'
 
Posts: 150
Karma: 10001
Join Date: Feb 2011
Device: sony
Should I expect the 'updating metadata' part of this to be slow?

I just threw it at a several hundred book test library and it took a while to count (not surprising), but then updating the metadata took a looong time (several times as long as counting took) ...

(Using an integer type custom column)
capnm is offline   Reply With Quote
Old 06-18-2011, 02:47 PM   #71
CWatkinsNash
IOC Chief Archivist
CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.
 
CWatkinsNash's Avatar
 
Posts: 3,485
Karma: 32762584
Join Date: Dec 2010
Location: Nashville, TN, USA
Device: Nook STR Glowlight, Sony T1, Acer Iconia A200
Quote:
Originally Posted by capnm View Post
Should I expect the 'updating metadata' part of this to be slow?

I just threw it at a several hundred book test library and it took a while to count (not surprising), but then updating the metadata took a looong time (several times as long as counting took) ...

(Using an integer type custom column)
It's not just populating the column, I think it's also updating the opf files for each book. So yeah, it can be a little slow. How slow depends on your computer.
CWatkinsNash is offline   Reply With Quote
Old 06-18-2011, 02:49 PM   #72
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,230
Karma: 1345754
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Not particularly slow, no. Doing a hundred books takes less than five seconds to update the database with the results on my machine. The updating is mostly using the same Calibre code as downloading metadata does.
kiwidude is offline   Reply With Quote
Old 06-18-2011, 03:12 PM   #73
CWatkinsNash
IOC Chief Archivist
CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.CWatkinsNash ought to be getting tired of karma fortunes by now.
 
CWatkinsNash's Avatar
 
Posts: 3,485
Karma: 32762584
Join Date: Dec 2010
Location: Nashville, TN, USA
Device: Nook STR Glowlight, Sony T1, Acer Iconia A200
I've noticed a huge difference between my two main computers (Win7 6GB updates really fast, Vista32 2GB much slower, taking 4-5 times as long) using the regular current version of calibre and the current version of the plugin.

The portable version is lagging after almost every operation at the moment so it's taking a looooong time. I can't base anything on that with regard to the plugin.
CWatkinsNash is offline   Reply With Quote
Old 06-18-2011, 03:31 PM   #74
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,901
Karma: 1216548
Join Date: Jan 2010
Location: France
Device: Many android devices
Quote:
Originally Posted by kiwidude View Post
Not particularly slow, no. Doing a hundred books takes less than five seconds to update the database with the results on my machine. The updating is mostly using the same Calibre code as downloading metadata does.
Be sure to use commit=False when updating the column, then commit at the end. If you don't, then SQLite will *per change* create, write, read, and delete a journal file. This can easily take a second, and is much worse on a NAS.

When we added commit-at-end to bulk metadata edit, changes to a column for 500 or books went from many minutes to a few seconds.
chaley is offline   Reply With Quote
Old 06-18-2011, 03:45 PM   #75
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,230
Karma: 1345754
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@Charles - as I mentioned above it is Calibre code that is doing the updating, the same code used at the end of downloading metadata. It is the same approach I used for this plugin and Extract ISBN - reusing Calibre's existing code to update a bunch of records by being given some Metadata objects with just the fields desired to be changed set on them (in this case two custom columns).

And that particular code (inside edit_metadata.py) does indeed delay the commit.
kiwidude is offline   Reply With Quote
Reply

Tags
page count

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Quality Check kiwidude Plugins 797 12-16-2014 01:01 PM
[GUI Plugin] Open With kiwidude Plugins 251 12-15-2014 01:07 PM
[GUI Plugin] Quick Preferences kiwidude Plugins 32 09-13-2014 11:34 PM
[GUI Plugin] Kindle Collections (old) meme Plugins 2070 08-11-2014 01:02 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 01:27 PM


All times are GMT -4. The time now is 04:10 AM.


MobileRead.com is a privately owned, operated and funded community.