Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 01-03-2021, 12:34 AM   #46
booklover2111
Junior Member
booklover2111 began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Jan 2021
Device: OASIS2+VOYAGE
Quote:
Originally Posted by xxyzz View Post
v2.0.2
use absolute redis path on macOS, rm useless try except

I just updated the new version. After that, your plugin doesn't work anymore. It always shows this error


calibre, version 5.6.0 (win32, embedded-python: True)
Conversion error: Failed: Generating Word Wise

Starting job: Generating Word Wise
Job: "Generating Word Wise" failed with error:
Traceback (most recent call last):
File "calibre\gui2\threaded_jobs.py", line 83, in start_work
File "calibre_plugins.worddumb.parse_job", line 26, in do_job
File "calibre_plugins.worddumb.database", line 76, in start_redis_server
File "subprocess.py", line 854, in __init__
File "subprocess.py", line 1307, in _execute_child
FileNotFoundError: [WinError 2] The system cannot find the file specified

Called with args: (<calibre.db.cache.Cache object at 0x000000E956B02340>, [28], 'C:\\Users\\MyPC\\AppData\\Roaming\\calibre\\plugi ns\\WordDumb.zip') {'notifications': <queue.Queue object at 0x000000E956D55B80>, 'abort': <threading.Event object at 0x000000E956D55B50>, 'log': <calibre.utils.logging.GUILog object at 0x000000E959207400>}
booklover2111 is offline   Reply With Quote
Old 01-03-2021, 04:41 AM   #47
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
Quote:
Originally Posted by booklover2111 View Post
I just updated the new version. After that, your plugin doesn't work anymore. It always shows this error
WordDumb needs redis(https://redis.io/download) since v2.0.0. The reason for that is redis is way more efficient than python sqlite3 library. I don't know how to install redis on Windows, you can try install it on WSL(https://en.wikipedia.org/wiki/Window...stem_for_Linux). I haven't try it yet since I don't use Windows.

You also can stick with the old version if you don't care much about the performance. But I still encourage you try the new version, it's really fast.

Update: get redis running on Windows doesn't worth the effort, it just waste time. v1.8.1 uses multiple threads so it's not too slow but uses lots CPU resources.

Last edited by xxyzz; 01-03-2021 at 09:11 AM.
xxyzz is offline   Reply With Quote
Advert
Old 01-03-2021, 08:21 AM   #48
booklover2111
Junior Member
booklover2111 began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Jan 2021
Device: OASIS2+VOYAGE
Quote:
Originally Posted by xxyzz View Post
WordDumb needs redis(https://redis.io/download) since v2.0.0. The reason for that is redis is way more efficient than python sqlite3 library. I don't know how to install redis on Windows, you can try install it on WSL(https://en.wikipedia.org/wiki/Window...stem_for_Linux). I haven't try it yet since I don't use Windows.

You also can stick with the old version if you don't care much about the performance. But I still encourage you try the new version, it's really fast.
I have tried to install redis on my computer with no success ( I dual-boot windows and Linux Mint by the way). When I installed redis, on the terminal it shows the error like this .

I'm so confused, because I couldn't manage to install redis on the computer (I'm no expert when it comes to Linux and terminal things).

I really really like your plugin, and I think the final solution is to downgrade to its older version, but it is also a lost cause. After googling the net for an hour, I couldn't find any tutorial or instruction to help me.

Last edited by booklover2111; 01-03-2021 at 08:25 AM.
booklover2111 is offline   Reply With Quote
Old 01-03-2021, 09:16 AM   #49
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
Quote:
Originally Posted by booklover2111 View Post
I have tried to install redis on my computer with no success ( I dual-boot windows and Linux Mint by the way). When I installed redis, on the terminal it shows the error like this
You don't need to compile redis, you can install it via package manager. Please read the README(https://github.com/xxyzz/WordDumb#how-to-use). The commands for Ubuntu should work for you.

Last edited by xxyzz; 01-03-2021 at 09:21 AM.
xxyzz is offline   Reply With Quote
Old 01-03-2021, 10:27 AM   #50
booklover2111
Junior Member
booklover2111 began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Jan 2021
Device: OASIS2+VOYAGE
Using the commands from your HOW-TO page, I have installed redis successfully, but when I ran the plugin, it still didn't work. Anyway, I figured out how to install older version of your plugin by using a zip file. Now it works well (it takes a while but at least it works- that is a huge achievement for me). Thank for your support. Keep up the good work.
booklover2111 is offline   Reply With Quote
Advert
Old 01-03-2021, 07:14 PM   #51
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
Quote:
Originally Posted by booklover2111 View Post
Using the commands from your HOW-TO page, I have installed redis successfully, but when I ran the plugin, it still didn't work.
Could you please post the error message?

Maybe you installed an old version of redis? Please try the following command and see if it will install redis 5 or 6, The last command will print the redis version.

Code:
$ sudo apt update
$ sudo apt upgrade redis
$ redis-server -v
I just found how to install redis on Windows! Download redis installer from https://github.com/tporadowski/redis/releases and select 'add redis to PATH' option in the installer.
xxyzz is offline   Reply With Quote
Old 01-05-2021, 02:42 AM   #52
booklover2111
Junior Member
booklover2111 began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Jan 2021
Device: OASIS2+VOYAGE
Quote:
Originally Posted by xxyzz View Post
Could you please post the error message?

Maybe you installed an old version of redis? Please try the following command and see if it will install redis 5 or 6, The last command will print the redis version.

Code:
$ sudo apt update
$ sudo apt upgrade redis
$ redis-server -v
I just found how to install redis on Windows! Download redis installer from https://github.com/tporadowski/redis/releases and select 'add redis to PATH' option in the installer.
I couldn't update to redis 5 or 6. After I ran your commands, it shows version 4.0 I don't remember the exact number, but I have installed Window version, and it worked wonder.
booklover2111 is offline   Reply With Quote
Old 01-09-2021, 09:10 AM   #53
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
v2.1.0 Download wordnet in job thread.

Plugin zip file is smaller.
xxyzz is offline   Reply With Quote
Old 01-11-2021, 06:20 PM   #54
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
v2.1.1 use python packages from zip file directly

You may want to delete some useless folders generated by worddumb previously by clicking "Preferences" -> "Miscellaneous" -> "Open calibre configuration directory" -> go to "plugins" folder. Only "worddumb-db1" and "worddumb-wordnet3.0" folders are needed, other folders that has name start with "worddumb-" can be deleted.

Last edited by xxyzz; 01-11-2021 at 08:06 PM.
xxyzz is offline   Reply With Quote
Old 02-22-2021, 10:32 PM   #55
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
v3.0.0: create X-Ray file on Linux and Windows. Requires python3(using pip3 to download numpy).

X-Ray entities are created by nltk's ne_chunk().

This feature doesn't support macOS because numpy(required by nltk) has some .so files can't pass library validation unless they are signed by the same key of calibre.
xxyzz is offline   Reply With Quote
Old 02-23-2021, 08:47 AM   #56
PoP
 curly᷂͓̫̙᷊̥̮̾ͯͤͭͬͦͨ ʎʌɹnɔ
PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.
 
PoP's Avatar
 
Posts: 3,002
Karma: 50506927
Join Date: Dec 2010
Location: ♁ ᴺ₄₅°₃₀' ᵂ₇₃°₃₇' ±₆₀"
Device: K3₃.₄.₃ PW3&4₅.₁₃.₃
Wow, I am impressed by the quality of the generated X-Ray. Thank you.
PoP is offline   Reply With Quote
Old 02-24-2021, 01:12 AM   #57
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
Quote:
Originally Posted by PoP View Post
Wow, I am impressed by the quality of the generated X-Ray. Thank you.
Machine learning is really amazing(that's how NLTK find named entities but I don't know how it works). Thanks to projects like NLTK, Wikipedia and many others this feature can be achieved more easily. I think there is a lots of room for improvement in speed and accuracy.
xxyzz is offline   Reply With Quote
Old 02-26-2021, 12:52 AM   #58
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
v3.2.0

- enable unix domain socket for redis

- count people in x-ray correctly
xxyzz is offline   Reply With Quote
Old 02-26-2021, 08:55 AM   #59
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
v3.3.0 load data from json, doesn't require redis anymore.

This version is even faster, I tested it on the book 1984 and it only took one or two seconds to create word wise file!

v3.4.0 fix text position for kfx

Last edited by xxyzz; 02-26-2021 at 09:29 PM.
xxyzz is offline   Reply With Quote
Old 02-27-2021, 12:51 AM   #60
sammayor
Enthusiast
sammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trolls
 
Posts: 31
Karma: 81732
Join Date: Feb 2014
Device: KPW3
I am getting error while running plugin :

calibre, version 5.12.0 (win32, embedded-python: True)
Conversion error: Failed: Generating Word Wise

Starting job: Generating Word Wise
Job: "Generating Word Wise" failed with error:
Traceback (most recent call last):
File "D:\calibre\src\calibre\gui2\threaded_jobs.py" , line 83, in start_work
File "calibre_plugins.worddumb.parse_job", line 43, in do_job
File "calibre_plugins.worddumb.parse_job", line 110, in find_named_entity
File "C:\Users\sam\AppData\Roaming\calibre\plugins\Word Dumb.zip\.venv\lib\python3.8\site-packages\nltk\chunk\__init__.py", line 185, in ne_chunk
File "C:\Users\sam\AppData\Roaming\calibre\plugins\Word Dumb.zip\.venv\lib\python3.8\site-packages\nltk\data.py", line 757, in load
File "C:\Users\sam\AppData\Roaming\calibre\plugins\word dumb-numpy1.20.1\numpy\__init__.py", line 143, in <module>
File "C:\Users\sam\AppData\Roaming\calibre\plugins\word dumb-numpy1.20.1\numpy\_distributor_init.py", line 26, in <module>
File "ctypes\__init__.py", line 373, in __init__
OSError: [WinError 193] %1 is not a valid Win32 application

Called with args: (<calibre.db.cache.Cache object at 0x000001FFAAB86C40>, [12444]) {'notifications': <queue.Queue object at 0x000001FFBA77ECA0>, 'abort': <threading.Event object at 0x000001FFBA77E610>, 'log': <calibre.utils.logging.GUILog object at 0x000001FFBA77E790>}
sammayor is offline   Reply With Quote
Reply

Tags
worddumb, x-ray

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] CalibreSpy DaltonST Plugins 244 01-27-2024 06:43 AM
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 492 10-25-2022 08:13 AM
[GUI Plugin] Manga plugin mastertea Plugins 6 01-06-2022 02:43 AM
[GUI Plugin] Save Virtual Libraries To Column (GUI) chaley Plugins 14 04-04-2021 05:25 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 05:26 AM.


MobileRead.com is a privately owned, operated and funded community.