[GUI Plugin] WordDumb

[xxyzz]

v3.16.1

- send MOBI rawml or KFX json str to the new process's stdin
- fix NoneType error when creating KFX X-Ray file on macOS
- don't use outdated pip from Apple Command Line Tools

[xxyzz]

Edit: I guess the plugin works fine on rosette 2.

[xxyzz]

v3.17.0

- Add platform option to prevent command line tool's pip from compiling package
- Change X-Ray search people checkbox text and add tooltip
- Make plugin job unkillable
- Display X-Ray job progress on Linux and Windows
- Return iterator from parse_book()
- Add support of AZW format
- Install thinc-apple-ops on M1 native calibre

[samuelj]

many thanks for the great plugin. If possible can you point me in the direction to add words to wordwise, also how to mark words as difficult or easy?

[xxyzz]

Originally Posted by samuelj

If possible can you point me in the direction to add words to wordwise, also how to mark words as difficult or easy?

Word Wise data file is `data/lemmas.json`.

Document of Word Wise: https://github.com/xxyzz/WordDumb/bl..._db.md#glosses

Document of add more data and build plugin: https://github.com/xxyzz/WordDumb/bl...UTING.md#debug

[samuelj]

Thanks. Please correct me if I am wrong. Sorry, I am a noob at this.

lemmas = difficult level of the word.
sense = meaning/definition


I want to use wordlist from here: https://github.com/jnoodle/English-Vocabulary-Word-List

there is a similar plugin: https://github.com/tmilovanov/wisecreator. I think this uses it.

Originally Posted by xxyzz

Word Wise data file is `data/lemmas.json`.

Document of Word Wise: https://github.com/xxyzz/WordDumb/bl..._db.md#glosses

Document of add more data and build plugin: https://github.com/xxyzz/WordDumb/bl...UTING.md#debug

[xxyzz]

data/lemmas.json:

{
  "'neath": [  // lemma
    1,         // difficulty
    69182      // sense_id
  ],
  ...
}

You have to write some code to create your own data file(data/lemmas.json).

If you have some books have Word Wise enabled, you can use this script: https://github.com/xxyzz/WordDumb/bl.../add_lemmas.py.

[samuelj]

Wordwise is embedded into the azw3 or mobi, or is it downloaded after?

Originally Posted by xxyzz

data/lemmas.json:

{
  "'neath": [  // lemma
    1,         // difficulty
    69182      // sense_id
  ],
  ...
}

You have to write some code to create your own data file(data/lemmas.json).

If you have some books have Word Wise enabled, you can use this script: https://github.com/xxyzz/WordDumb/bl.../add_lemmas.py.

[xxyzz]

Originally Posted by samuelj

Wordwise is embedded into the azw3 or mobi, or is it downloaded after?

It's a sqlite file named "LanguageLayer.en.ASIN.kll".

[samuelj]

I have added a few words from the books I have.

kll.en.en.klld has 75819 lemmas
added 48 lemmas
updated 1 lemmas
lemmas.json has 29954 lemmas.

how do I use this file and do you want me to share it?

[xxyzz]

Originally Posted by samuelj

how do I use this file and do you want me to share it?

Run the command listed here(https://github.com/xxyzz/WordDumb/bl...UTING.md#debug) to use the updated file.

You can send a pull request at GitHub or upload the file and I will create a commit for you.

[yiming]

Hi xxyzz

I've failed in creating WordWise and X-Ray for the book The Murder of Roger Ackroyd. The book was downloaded as AZW3 and converted to KFX in Calibre. Here's the error log:

calibre, version 5.35.0 (win32, embedded-python: True)
Tonnerre de Brest!: Failed: Generating Word Wise and X-Ray for The Murder of Roger Ackroyd

Starting job: Generating Word Wise and X-Ray for The Murder of Roger Ackroyd
Job: "Generating Word Wise and X-Ray for The Murder of Roger Ackroyd" failed with error:
Traceback (most recent call last):
File "calibre\gui2\threaded_jobs.py", line 82, in start_work
File "calibre_plugins.worddumb.parse_job", line 33, in do_job
File "calibre_plugins.worddumb.metadata", line 56, in get_asin_etc
ModuleNotFoundError: No module named 'calibre_plugins.kfx_input'

Called with args: ((59, 'KFX', 'G:\\Calibre library\\Agatha Christie\\The Murder of Roger Ackroyd (59)\\The Murder of Roger Ackroyd - Agatha Christie.kfx', <calibre.ebooks.metadata.book.base.Metadata object at 0x0000016E8CC92190>, {'spacy': 'en_core_web_', 'wiki': 'en'}), True, True) {'notifications': <queue.Queue object at 0x0000016E8CC921C0>, 'abort': <threading.Event object at 0x0000016E892300D0>, 'log': <calibre.utils.logging.GUILog object at 0x0000016E89230280>}

Was using Calibre v5.35, KFX Output v1.58.0, WordDumb v3.17.0

Could you tell me what went wrong and how the problem can be resolved. Thanks.

[yiming]

Originally Posted by yiming

Hi xxyzz

I've failed in creating WordWise and X-Ray for the book The Murder of Roger Ackroyd. The book was downloaded as AZW3 and converted to KFX in Calibre. Here's the error log:



Was using Calibre v5.35, KFX Output v1.58.0, WordDumb v3.17.0

Could you tell me what went wrong and how the problem can be resolved. Thanks.

Problems partially solved. Realized that KFX Input plugin need to be installed. Managed to create Word Wise and X-Ray after installing it. But, Word Wise and X-Ray don't show up in Kindle. What could be the problem? Thanks.

[xxyzz]

Originally Posted by yiming

But, Word Wise and X-Ray don't show up in Kindle.

Delete the book from your Kindle and use WordDumb to send the book and created files.

Maybe the ASIN of the book on Kindle doesn't match the book in your library.

[yiming]

Originally Posted by xxyzz

Delete the book from your Kindle and use WordDumb to send the book and created files.

Maybe the ASIN of the book on Kindle doesn't match the book in your library.

Thanks, problem solved. I forgotten that you have to use WordDumb to send the book to Kindle and can't send it directly using the Send to Device function.