Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 07-05-2022, 11:23 PM   #346
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 442
Karma: 2666666
Join Date: Nov 2020
Device: none
https://github.com/xxyzz/WordDumb/co...7aae7fc3667aed removes the newline characters from book text. The GitHub Action for this commit failed, you can download the plugin from the next job.
xxyzz is offline   Reply With Quote
Old 07-06-2022, 02:18 AM   #347
j.p.s
Grand Sorcerer
j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.
 
Posts: 5,800
Karma: 103362673
Join Date: Apr 2011
Device: pb360
Quote:
Originally Posted by xxyzz View Post
https://github.com/xxyzz/WordDumb/co...7aae7fc3667aed removes the newline characters from book text. The GitHub Action for this commit failed, you can download the plugin from the next job.
It works,

Thanks!
j.p.s is offline   Reply With Quote
Advert
Old 07-08-2022, 09:06 AM   #348
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 442
Karma: 2666666
Join Date: Nov 2020
Device: none
New test feature: Word Wise for EPUB books. It can be downloaded from GitHub Actions.

I use the Wiktionary data from https://kaikki.org, the English JSON file is 1.4GB, other language files should be smaller then that.

I only enabled this feature for the 21 languages that have the spaCy model, but this feature could work for any language as long as it's on Wiktionary and kaikki.org

Some definitions may be incorrect, you could fix them manually in the customize wiktionary dialog.
Attached Thumbnails
Click image for larger version

Name:	Screen Shot 2022-07-08 at 20.49.24.png
Views:	140
Size:	606.2 KB
ID:	194781   Click image for larger version

Name:	Screen Shot 2022-07-08 at 20.52.19.png
Views:	125
Size:	1,007.7 KB
ID:	194782  

Last edited by xxyzz; 07-08-2022 at 09:12 AM.
xxyzz is offline   Reply With Quote
Old 07-09-2022, 04:12 PM   #349
j.p.s
Grand Sorcerer
j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.
 
Posts: 5,800
Karma: 103362673
Join Date: Apr 2011
Device: pb360
X-ray feature request

I am requesting a couple of enhancements to the interpretation of the contents of the of the user created worddumb-custom-x-ray.json file. The first is important, the second nice to have. I do not think the changes would introduce any incompatibility or ambiguity with the current functionality.

1. Omit the entity if description is null and the source is null. This would allow exclusion of entities that do not need to be in the XRAY. An empty string could also be used for the description, but I think null is more appropriate. The rationale for this method is that if there is no description and no source, it must mean that entity is not a character or thing in the book or does not belong in the X-ray for some reason.

2. If the description is null and the source is Wikipedia or Fandom, the user is trying to correct mislabeling and/or adding alias but the description found by WordDumb is correct. Of course, the user could copy the previously found description but that would add clutter to worddumb-custom-x-ray.json and added work for the user and maybe prone to error.

I think #1 would allow significant quality enhancement to the generated X-ray and that #2 would add significant convenience but not strictly required.
j.p.s is offline   Reply With Quote
Old 07-09-2022, 11:43 PM   #350
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 442
Karma: 2666666
Join Date: Nov 2020
Device: none
I added a new omit option to the customize X-Ray dialog.

The source option is not used when the description is None or "", the None source means the description is a quote from the book. If the description is None or "", Wikipedia or Fandom or quote will be used but I somehow forgot to implement it.
xxyzz is offline   Reply With Quote
Advert
Old 07-10-2022, 01:48 AM   #351
j.p.s
Grand Sorcerer
j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.
 
Posts: 5,800
Karma: 103362673
Join Date: Apr 2011
Device: pb360
Quote:
Originally Posted by xxyzz View Post
I added a new omit option to the customize X-Ray dialog.

The source option is not used when the description is None or "", the None source means the description is a quote from the book. If the description is None or "", Wikipedia or Fandom or quote will be used but I somehow forgot to implement it.
Thanks!

I downloaded and installed the latest Action.

When I click on customize xray, then click on the "+Add" button, I get an error.
Attached Thumbnails
Click image for larger version

Name:	calibre.png
Views:	95
Size:	174.0 KB
ID:	194842   Click image for larger version

Name:	customize_xray.png
Views:	104
Size:	12.0 KB
ID:	194843   Click image for larger version

Name:	error.png
Views:	114
Size:	54.3 KB
ID:	194844  
j.p.s is offline   Reply With Quote
Old 07-10-2022, 02:27 AM   #352
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 442
Karma: 2666666
Join Date: Nov 2020
Device: none
I forgot to rename that variable... It'll be fixed in the next GitHub Action artifact. Sorry for the inconvenience.
xxyzz is offline   Reply With Quote
Old 07-10-2022, 02:00 PM   #353
j.p.s
Grand Sorcerer
j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.j.p.s ought to be getting tired of karma fortunes by now.
 
Posts: 5,800
Karma: 103362673
Join Date: Apr 2011
Device: pb360
Quote:
Originally Posted by xxyzz View Post
I forgot to rename that variable... It'll be fixed in the next GitHub Action artifact. Sorry for the inconvenience.
Works great. The usage hints in the form are also a nice touch.

Thanks!
j.p.s is offline   Reply With Quote
Old 07-12-2022, 05:21 AM   #354
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 442
Karma: 2666666
Join Date: Nov 2020
Device: none
v3.23.1

New features:
  • Add Word Wise <ruby> tags and footnotes to EPUB books
  • Add customize Wiktionary dialog for EPUB books
  • Remove soft hyphens from EPUB books
  • Add omit option to customize X-Ray dialog
  • Use MediaWiki smmary or book quote as X-Ray description if customize X-Ray description is None
  • Add support of Croatian language(spaCy 3.4.0 model)

Bug fixes:
  • Ignore invalid inception date
  • Upgrade outdated pip on all operating systems

Other changes:
  • Don't fuzz match customize X-Ray entities
  • Replace newline in X-Ray label with whitespace
  • Add unsupported book format/language dialog and warning log
  • Set minimum calibre version to 6.0.0

Last edited by xxyzz; 07-12-2022 at 07:05 AM.
xxyzz is offline   Reply With Quote
Old 07-21-2022, 04:57 AM   #355
samuelj
Member
samuelj began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Jan 2022
Device: Kindle oasis
Hi,

Great work! Honestly made the reading so joyful. Just a suggestion, will it be possible to import word a list from CSV or excel because I want to import words on GRE/SAT vocabulary and mark their difficulty.

Thank you again.
samuelj is offline   Reply With Quote
Old 07-21-2022, 07:50 PM   #356
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 442
Karma: 2666666
Join Date: Nov 2020
Device: none
I'm working on import Anki .apkg file: enable the word of the card front field and set difficulty based on the card type(new, learning, review, relearning).

Import CSV requires a specific file structure. I would assume the first column is word, the second column is difficulty(1-5).

Last edited by xxyzz; 07-21-2022 at 10:24 PM.
xxyzz is offline   Reply With Quote
Old 07-22-2022, 02:10 AM   #357
xxyzz
Evangelist
xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.xxyzz ought to be getting tired of karma fortunes by now.
 
Posts: 442
Karma: 2666666
Join Date: Nov 2020
Device: none
Hi samuelj, you can download the plugin from the latest GitHub Actions Artifacts to test the new import feature.

If you don't have a GitHub account, you can install the attached zip file.
Attached Files
File Type: zip worddumb-1baea91371d7a2ea2802d29323f140ad7aed0bf9.zip (468.5 KB, 66 views)
xxyzz is offline   Reply With Quote
Old 07-22-2022, 07:08 AM   #358
samuelj
Member
samuelj began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Jan 2022
Device: Kindle oasis
Hi xxyzz,

Thank you so much for your fantastic work. I have installed the plugin from GitHub, Action Artifacts, but I don't see any import option. Please let me know how the import option works.
Attached Thumbnails
Click image for larger version

Name:	wordDumb.png
Views:	86
Size:	48.3 KB
ID:	195220  
samuelj is offline   Reply With Quote
Old 07-22-2022, 07:22 AM   #359
samuelj
Member
samuelj began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Jan 2022
Device: Kindle oasis
Quote:
Originally Posted by samuelj View Post
Hi xxyzz,

Thank you so much for your fantastic work. I have installed the plugin from GitHub, Action Artifacts, but I don't see any import option. Please let me know how the import option works.
Never mind, got it. It is inside "Customize Kindle word wise". I will test it and let you know.


Thanks again.
samuelj is offline   Reply With Quote
Old 07-22-2022, 07:44 AM   #360
samuelj
Member
samuelj began at the beginning.
 
Posts: 12
Karma: 10
Join Date: Jan 2022
Device: Kindle oasis
As first few observations:

1) filter words based on difficulty or Lemma.
2) export/Backup WordWise DB, in case you reinstall the plugin or calibre.
3) sample CSV or Anki file

Thanks again.
samuelj is offline   Reply With Quote
Reply

Tags
worddumb, x-ray


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] KindleUnpack - The Plugin DiapDealer Plugins 523 07-15-2025 06:45 PM
[GUI Plugin] CalibreSpy DaltonST Plugins 245 08-18-2024 09:33 PM
[GUI Plugin] Manga plugin mastertea Plugins 6 01-06-2022 02:43 AM
[GUI Plugin] Save Virtual Libraries To Column (GUI) chaley Plugins 14 04-04-2021 05:25 AM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 03:37 AM.


MobileRead.com is a privately owned, operated and funded community.