Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Readers > Amazon Kindle > Kindle Developer's Corner

Notices

Reply
 
Thread Tools Search this Thread
Old 12-14-2013, 12:48 AM   #1
bobafruit
Member
bobafruit began at the beginning.
 
Posts: 11
Karma: 10
Join Date: Nov 2013
Device: paperwhite 2
Vocabulary builder

Has anybody looked at the .db file that vocabulary builder uses?

I was very much put off by the vocabulary builder words being completely deleted when I changed the registration on my Kindle, but I did some digging and I want to share what I found.

After installing USBNetwork on my PW2 I noticed that I can access the Vocabulary builder files, and after opening the .db file in notepad I see it is "SQLite format 3"

... and so I download a nice little database browser http://sqlitebrowser.sourceforge.net/
and in no time at all I can export .CSV files and import them into ANKI, and so avoid the rather slow and feature limited Vocabulary builder but still have the benefits of automatically added words while I'm reading.

only problem is the Kindle doesn't seem to store the definition in the database (which makes sense given how the dictionary is implemented, but makes a little more work)
bobafruit is offline   Reply With Quote
Old 12-15-2013, 12:59 PM   #2
zxczxc
Connoisseur
zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.zxczxc can bend spoons with a thought.
 
Posts: 99
Karma: 134979
Join Date: Apr 2013
Device: PW
nice work so far
zxczxc is offline   Reply With Quote
 
Advertisement
Old 01-06-2014, 10:00 PM   #3
bobafruit
Member
bobafruit began at the beginning.
 
Posts: 11
Karma: 10
Join Date: Nov 2013
Device: paperwhite 2


Hey guys!

I've been heavily using the dictionary to look up words while reading a chinese copy of Harry Potter.

The lookup has been gradually slowing down, and after I accumulated 1,550 entries in vocabulary bulder it started taking 20-30 seconds to look up each word, and it was killing the battery.

So I've gone and deleted the vocab.db file and suddenly it's back in tip-top shape.

Seems to me that Vocabulary builder may not be well optimized. The vocab.db file is only 1,125 KB, which seems small to be really messing up the Kindle.

Maybe there's some sort of problem related to the jailbreak or USBnetwork?
Any thoughts, has anyone else ran into slow down with too many vocabulary Builder entries?
bobafruit is offline   Reply With Quote
Old 01-06-2014, 10:33 PM   #4
knc1
Helpdesk Junkie
knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.knc1 ought to be getting tired of karma fortunes by now.
 
knc1's Avatar
 
Posts: 6,819
Karma: 6314522
Join Date: Feb 2012
Device: Too many.
Quote:
Originally Posted by bobafruit View Post


Hey guys!

I've been heavily using the dictionary to look up words while reading a chinese copy of Harry Potter.

The lookup has been gradually slowing down, and after I accumulated 1,550 entries in vocabulary bulder it started taking 20-30 seconds to look up each word, and it was killing the battery.

So I've gone and deleted the vocab.db file and suddenly it's back in tip-top shape.

Seems to me that Vocabulary builder may not be well optimized. The vocab.db file is only 1,125 KB, which seems small to be really messing up the Kindle.

Maybe there's some sort of problem related to the jailbreak or USBnetwork?
Any thoughts, has anyone else ran into slow down with too many vocabulary Builder entries?
Problem related to the Jailbreak :: Not possible.
Problem releated to the USBnetwork :: Chances are slim to none.

Neither of them have anything to do with directory look-up.
knc1 is offline   Reply With Quote
Old 01-07-2014, 01:36 PM   #5
bobafruit
Member
bobafruit began at the beginning.
 
Posts: 11
Karma: 10
Join Date: Nov 2013
Device: paperwhite 2
Quote:
Originally Posted by knc1 View Post
Problem related to the Jailbreak :: Not possible.
Problem releated to the USBnetwork :: Chances are slim to none.
I will accept your assurances that the Kindle system is not a teetering house of cards that can be set reeling by a slight breeze.

or maybe the opposite is true, it is a teetering house of cards, but the jailbreak and USBnet hack cannot in anyway affect it, it is instead brought to its' knees by using a 1 MB database... In which case I owe a debt of gratitude to the developers here, because without their work I would be looking at the immense task of deleting thousands of words just so the Kindle would continue working well.


I find it incredible that I can't find lotsa people complaining about this... but maybe no one else has been looking up as many words as I have been.
bobafruit is offline   Reply With Quote
Old 01-07-2014, 02:41 PM   #6
NiLuJe
BLAM!
NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.
 
NiLuJe's Avatar
 
Posts: 5,102
Karma: 4987077
Join Date: Jun 2010
Location: Paris, France
Device: Kindle 2i, 3g, 4, 5w, PW & PW2
To be perfectly honest, I kinda disabled this on mine because I was pretty sure an issue like that would crop up over time, so I'm not terribly surprised .
NiLuJe is offline   Reply With Quote
Old 01-14-2014, 05:59 AM   #7
jagal
Junior Member
jagal began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Jan 2014
Device: Kindle Paperwhite
VocabBuilder improved in 5.4.2

Hey guys,

It looks like the experience has been improved in 5.4.2. Please download the file (if you're on Wifi, you would probably have the update already). Let us know how the feature works now.
jagal is offline   Reply With Quote
Old 01-14-2014, 04:40 PM   #8
eschwartz
Irrational Optimist
eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.eschwartz ought to be getting tired of karma fortunes by now.
 
eschwartz's Avatar
 
Posts: 7,350
Karma: 12808697
Join Date: Nov 2012
Location: The Beaten Path, USA, Roundworld, This Side of Infinity
Device: Kindle Touch fw5.3.7 (Wifi only)
Quote:
Originally Posted by jagal View Post
Hey guys,

It looks like the experience has been improved in 5.4.2. Please download the file (if you're on Wifi, you would probably have the update already). Let us know how the feature works now.
Assuming you don't find the Cloud Collections to be a nightmare... It's been a big problem for a lot of people.
eschwartz is online now   Reply With Quote
Old 01-15-2014, 08:26 AM   #9
Akirainblack
abibliophobic
Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.
 
Posts: 176
Karma: 216102
Join Date: Aug 2012
Device: Kindle Touch + Paperwhite + PW2 all jailbroken
Oddly enough I've just had a look at my PW2 and for some reason it doesn't matter how many times I look up a word the vocabulary builder always remains blank.
Akirainblack is offline   Reply With Quote
Old 01-21-2014, 12:47 AM   #10
jagal
Junior Member
jagal began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Jan 2014
Device: Kindle Paperwhite
Strange..
Are you trying looking up words on personal documents (e.g. pdf) or downloaded content from Amazon? I know VocabBuilder only works on content bought/downloaded from Amazon.
Also, try restarting the device and seeing if VocabBuilder shows words then.
Let us know what you find.
jagal is offline   Reply With Quote
Old 03-11-2014, 01:24 PM   #11
YourFriendBen
Junior Member
YourFriendBen began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Feb 2014
Device: Pw2
Vocab Builder

Quote:
Originally Posted by jagal View Post
Strange..
Are you trying looking up words on personal documents (e.g. pdf) or downloaded content from Amazon? I know VocabBuilder only works on content bought/downloaded from Amazon.
Also, try restarting the device and seeing if VocabBuilder shows words then.
Let us know what you find.
mine does the same, and you are correct, it was because i was in a PDF.
Is there any way to turn that on for all documents? I do have mine rooted.
pw2 current fw at this time.

Thanks
what a great community!
YourFriendBen is offline   Reply With Quote
Old 03-12-2014, 08:25 AM   #12
Akirainblack
abibliophobic
Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.
 
Posts: 176
Karma: 216102
Join Date: Aug 2012
Device: Kindle Touch + Paperwhite + PW2 all jailbroken
Oops, I forgot to report back. Yes, it's due to the books I was reading not having come from Amazon.
How pants is that! Offer a wonderful feature that can only be used with books directly from Amazon.
Oh well.
Akirainblack is offline   Reply With Quote
Old 03-12-2014, 08:50 AM   #13
Doitsu
Wizard
Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.
 
Doitsu's Avatar
 
Posts: 2,027
Karma: 4836606
Join Date: Dec 2010
Device: Kindle PW2
Quote:
Originally Posted by Akirainblack View Post
Oops, I forgot to report back. Yes, it's due to the books I was reading not having come from Amazon.
How pants is that! Offer a wonderful feature that can only be used with books directly from Amazon.
Oh well.
AFAIK, the only way Amazon can tell books apart is by checking for the presence of an ASIN number, which all Amazon books have.

Can you please test whether adding or faking an ASIN number with an editor will make any difference:

1. Check whether the book is also available as a Kindle book on Amazon. If so, copy the ASIN number from the product page to a text file; if not, make up a number using the following format B000XXXXXX (X can be any number or upper case letter).

2. Download Java Mobi Metadata Editor and add an ASIN number to your non-Amazon book. (Click the plus sign and then select Type: 113.)

3. Delete the copy of your book on your Kindle and manually transfer the modifed .mobi file that Java Mobi Metadata Editor has saved to your Kindle via USB.
Doitsu is offline   Reply With Quote
Old 03-14-2014, 10:27 AM   #14
Akirainblack
abibliophobic
Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.Akirainblack ought to be getting tired of karma fortunes by now.
 
Posts: 176
Karma: 216102
Join Date: Aug 2012
Device: Kindle Touch + Paperwhite + PW2 all jailbroken
Sadly that trick didn't work for me Doitsu but thanks for the idea.
Akirainblack is offline   Reply With Quote
Old 06-11-2014, 04:57 AM   #15
Doitsu
Wizard
Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.Doitsu ought to be getting tired of karma fortunes by now.
 
Doitsu's Avatar
 
Posts: 2,027
Karma: 4836606
Join Date: Dec 2010
Device: Kindle PW2
Quote:
Originally Posted by jagal View Post
I know VocabBuilder only works on content bought/downloaded from Amazon.
Also, try restarting the device and seeing if VocabBuilder shows words then.
Let us know what you find.
I finally got a PW2 and did some tests. Apparently Vocabulary Builder only works with books that don't show up with a Personal tag in cover view.

AFAIK, there's a Calibre option to remove this tag, however, since I rarely use Calibre, I'm a bit fuzzy about the details.

But I've recently found out that KevinH has written a helpful Python script that will add the required ASIN and EBOK metadata entries. Books processed with this script no longer show up as personal docs and words looked up in them will be displayed in the Vocabulary Builder app.

The syntax of the python scripts is:

Code:
python dualmetafix_mmap.py ASIN old.mobi new.mobi
(If you don't know the actual ASIN or the book doesn't have one, you can also use a random UUID number.)
Doitsu is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Paperwhite 2 - Major Problem with Vocabulary Builder floriano Amazon Kindle 30 08-14-2014 02:01 PM
Vocabulary Builder for Kindle Paperwhite 1 pxpxpx Amazon Kindle 2 02-16-2014 07:07 PM
Vocabulary Builder for PW1 bookzLove Amazon Kindle 1 11-10-2013 08:21 PM
Vocabulary builder worth the upgrade? drago Amazon Kindle 4 10-28-2013 10:41 PM
How's your vocabulary? pdurrant Lounge 112 11-01-2011 07:06 AM


All times are GMT -4. The time now is 02:01 AM.


MobileRead.com is a privately owned, operated and funded community.