Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 02-27-2021, 01:28 AM   #61
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
You're using 64bit python? Can you try the 32bit python or 64bit version of calibre? You need to delete the 64bit python and the 'C:\Users\sam\AppData\Roaming\calibre\plugins\word dumb-numpy1.20.1' folder if you wanna install the 32bit python.

calibre and python should use the same architecture, both 64 or 32.

Last edited by xxyzz; 02-27-2021 at 01:42 AM.
xxyzz is offline   Reply With Quote
Old 02-27-2021, 09:35 AM   #62
sammayor
Enthusiast
sammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trollssammayor doesn't feed trolls
 
Posts: 31
Karma: 81732
Join Date: Feb 2014
Device: KPW3
Quote:
Originally Posted by xxyzz View Post
You're using 64bit python? Can you try the 32bit python or 64bit version of calibre? You need to delete the 64bit python and the 'C:\Users\sam\AppData\Roaming\calibre\plugins\word dumb-numpy1.20.1' folder if you wanna install the 32bit python.

calibre and python should use the same architecture, both 64 or 32.
It worked. Thanks for the plugin
sammayor is offline   Reply With Quote
Advert
Old 02-28-2021, 01:39 PM   #63
booklover2111
Junior Member
booklover2111 began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Jan 2021
Device: OASIS2+VOYAGE
Hi xxyzz, I updated your plugin yesterday to version 3.4.0. In the past, I used version 2.1.1, it usually took about 10-15 seconds to generate Word Wise for books about 200-300 pages. The new version took for ages to do same tasks (A 300-page book takes me 3'16 seconds).


I'm using calibre 5.12(64bit) and python 3.9 (64bit)
booklover2111 is offline   Reply With Quote
Old 02-28-2021, 07:36 PM   #64
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
The plugin needs to download some nltk data at first run. It also needs to download numpy and more nltk data if x-ray is enabled. Create word wise alone usually takes a few seconds but create x-ray needs more time because it have to download data from Wikipedia for each x-ray term. You can disable x-ray in the plugin settings.

For comparison, the GitHub action takes 1m18s to create word wise and x-ray for book 1984 and it contains the time for testing and downloading all the files. It's highly affected by your network speed. Maybe it can be optimized but I can't find any yet. Welcome any suggestions and pull requests!

Last edited by xxyzz; 02-28-2021 at 07:54 PM.
xxyzz is offline   Reply With Quote
Old 03-01-2021, 12:06 AM   #65
booklover2111
Junior Member
booklover2111 began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Jan 2021
Device: OASIS2+VOYAGE
Quote:
Originally Posted by xxyzz View Post
The plugin needs to download some nltk data at first run. It also needs to download numpy and more nltk data if x-ray is enabled. Create word wise alone usually takes a few seconds but create x-ray needs more time because it have to download data from Wikipedia for each x-ray term. You can disable x-ray in the plugin settings.

For comparison, the GitHub action takes 1m18s to create word wise and x-ray for book 1984 and it contains the time for testing and downloading all the files. It's highly affected by your network speed. Maybe it can be optimized but I can't find any yet. Welcome any suggestions and pull requests!

I checked the plugin in calibre and I couldn't find the settings for it. About programming, I'm know nothing about it. The only thing I want is the generating WordWise speed.
booklover2111 is offline   Reply With Quote
Advert
Old 03-01-2021, 12:14 AM   #66
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
Quote:
Originally Posted by booklover2111 View Post
I checked the plugin in calibre and I couldn't find the settings for it.
calibre preference -> plugins -> search worddumb -> click 'customize plugin' -> disable x-ray -> click ok
xxyzz is offline   Reply With Quote
Old 03-01-2021, 02:45 AM   #67
astro70.1
Junior Member
astro70.1 began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Mar 2021
Device: paperwhite 4
Generating Wordwise Failed

Hello, today I installed your plugin and encountered the error below:

calibre, version 5.12.0 (win32, embedded-python: True)
Conversion error: Failed: Generating Word Wise

Starting job: Generating Word Wise
Job: "Generating Word Wise" failed with error:
Traceback (most recent call last):
File "calibre\gui2\threaded_jobs.py", line 83, in start_work
File "calibre_plugins.worddumb.parse_job", line 26, in do_job
File "calibre_plugins.worddumb.unzip", line 51, in install_libs
File "calibre_plugins.worddumb.unzip", line 88, in download_numpy
File "subprocess.py", line 359, in check_call
File "subprocess.py", line 340, in call
File "subprocess.py", line 854, in __init__
File "subprocess.py", line 1307, in _execute_child
FileNotFoundError: [WinError 2] The system cannot find the file specified

Called with args: (<calibre.db.cache.Cache object at 0x000002A098032130>, [6]) {'notifications': <queue.Queue object at 0x000002A09CE483D0>, 'abort': <threading.Event object at 0x000002A09CE48970>, 'log': <calibre.utils.logging.GUILog object at 0x000002A09CE48640>}


I'm windows x64 user and have 64 bit python and calibre.
astro70.1 is offline   Reply With Quote
Old 03-01-2021, 06:05 AM   #68
booklover2111
Junior Member
booklover2111 began at the beginning.
 
Posts: 9
Karma: 10
Join Date: Jan 2021
Device: OASIS2+VOYAGE
Quote:
Originally Posted by xxyzz View Post
calibre preference -> plugins -> search worddumb -> click 'customize plugin' -> disable x-ray -> click ok
Thanks. It works great. It never runs that fast before. It's super fast exactly as you said after I disabled X-Ray. It takes only2-3 seconds to generate WW for 300-page books. Fanstastic!!!!!!!! Keep up the good work.
booklover2111 is offline   Reply With Quote
Old 03-01-2021, 06:06 AM   #69
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
Quote:
Originally Posted by astro70.1 View Post
Hello, today I installed your plugin and encountered the error below:
When you install Python, you have to select that 'Add Python to PATH' option for other programs to find Python.

Or maybe you don't want x-ray then you don't need to install Python, just disable x-ray as motioned before.

Last edited by xxyzz; 03-01-2021 at 08:38 AM.
xxyzz is offline   Reply With Quote
Old 03-01-2021, 06:58 AM   #70
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
Quote:
Originally Posted by booklover2111 View Post
Thanks. It works great. It never runs that fast before.
I should did this in the first place and trust the speed of Python... Anyway, enjoy your reading!
xxyzz is offline   Reply With Quote
Old 03-01-2021, 08:35 AM   #71
astro70.1
Junior Member
astro70.1 began at the beginning.
 
Posts: 7
Karma: 10
Join Date: Mar 2021
Device: paperwhite 4
Thanks!

Quote:
Originally Posted by xxyzz View Post
When you install Python, you have to select that 'Add Python to PATH' option for other programs to find Python.
wow appreciate for your quick reply. It works! thank you so much.
astro70.1 is offline   Reply With Quote
Old 03-03-2021, 03:51 AM   #72
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
v3.5.0

- add Accept-Encoding: gzip header to requests

- pipe titles to Wikipedia query requests

- exclude files in docs and tests folder from zip file

This version reduces x-ray creation time from about 7m to 1m on the 1984 novel.

Last edited by xxyzz; 03-03-2021 at 03:54 AM.
xxyzz is offline   Reply With Quote
Old 03-03-2021, 06:50 AM   #73
PoP
 curly᷂͓̫̙᷊̥̮̾ͯͤͭͬͦͨ ʎʌɹnɔ
PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.
 
PoP's Avatar
 
Posts: 3,002
Karma: 50506927
Join Date: Dec 2010
Location: ♁ ᴺ₄₅°₃₀' ᵂ₇₃°₃₇' ±₆₀"
Device: K3₃.₄.₃ PW3&4₅.₁₃.₃
Just to report that I consistently get this X-Ray problem with version 3.5.0

Code:
calibre, version 5.12.0 (win32, embedded-python: True)
Erreur lors de la conversion: Échoué: Generating Word Wise

Starting job: Generating Word Wise 
Job: "Generating Word Wise" failed with error: 
Traceback (most recent call last):
  File "calibre\gui2\threaded_jobs.py", line 83, in start_work
  File "calibre_plugins.worddumb.parse_job", line 43, in do_job
  File "calibre_plugins.worddumb.parse_job", line 124, in find_named_entity
  File "calibre_plugins.worddumb.x_ray", line 113, in search
  File "calibre_plugins.worddumb.x_ray", line 91, in insert_entity
  File "calibre_plugins.worddumb.x_ray", line 51, in search_wikipedia
  File "calibre_plugins.worddumb.x_ray", line 31, in insert_wiki_intro
  File "calibre_plugins.worddumb.database", line 193, in insert_x_entity_description
sqlite3.IntegrityError: UNIQUE constraint failed: entity_description.entity
 
Called with args: (<calibre.db.cache.Cache object at 0x00000254150E0760>, [6022]) {'notifications': <queue.Queue object at 0x000002541BE5B220>, 'abort': <threading.Event object at 0x000002541BE5B430>, 'log': <calibre.utils.logging.GUILog object at 0x000002541BE5B5E0>}
PoP is offline   Reply With Quote
Old 03-03-2021, 07:20 AM   #74
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 405
Karma: 2666666
Join Date: Nov 2020
Device: none
Quote:
Originally Posted by PoP View Post
Just to report that I consistently get this X-Ray problem with version 3.5.0
Can you try 3.5.1?
xxyzz is offline   Reply With Quote
Old 03-03-2021, 07:32 AM   #75
PoP
 curly᷂͓̫̙᷊̥̮̾ͯͤͭͬͦͨ ʎʌɹnɔ
PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.PoP ought to be getting tired of karma fortunes by now.
 
PoP's Avatar
 
Posts: 3,002
Karma: 50506927
Join Date: Dec 2010
Location: ♁ ᴺ₄₅°₃₀' ᵂ₇₃°₃₇' ±₆₀"
Device: K3₃.₄.₃ PW3&4₅.₁₃.₃
3.5.1 works fine.
PoP is offline   Reply With Quote
Reply

Tags
worddumb, x-ray

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] CalibreSpy DaltonST Plugins 244 01-27-2024 06:43 AM
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 492 10-25-2022 08:13 AM
[GUI Plugin] Manga plugin mastertea Plugins 6 01-06-2022 02:43 AM
[GUI Plugin] Save Virtual Libraries To Column (GUI) chaley Plugins 14 04-04-2021 05:25 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 05:14 AM.


MobileRead.com is a privately owned, operated and funded community.