[GUI Plugin] WordDumb

[Shark69]

Hello...
I'm processig eswiktionary-20220720-pages-articles.xml too, but I have a doubt. I can see several messages like:

UNRECOGNIZED PREFIX Wikcionario:Frecuencias/Finés/280001-290000
====== WARNING: PARSING PAGE TOOK 169.2s: Wikcionario:Frecuencias/Finés/270001-280000
... 41259/953296 pages (4.3%) processed, 15:31:02 remaining

I suppose it is because tatuylonen told his plan was to check the process in the Finnish wiktionary. Did you receive those kind a messages?
Did you manage to finish the process?

As you can see, my log says 15:31:02 remaining because is a VM.

Thanks

[xxyzz]

I stopped the command because these Wikcionario:Frecuencias/Finés pages are useless and take most of the process time. If `wiktwords` can ignore them it could finish way much faster. Maybe you can delete those pages from the dump file.

[xxyzz]

I managed to let the command ignore these pages: https://github.com/tatuylonen/wiktextract/pull/143

But it can't extract the Spanish dump file for now, I think wikitextprocessor requires some changes to support the Spanish Wiktionary.

[Shark69]

I was processing the file after deleting those pages as you told me, but it always failed. It was supposed to take 3 hours more or less. I didn't know if it was because of the code or because of my virtual machine. I guess the problem is the code, based on what you say.
Thanks.

[xxyzz]

I'm able to create a JSON file with the changes I posted above but it only contains the page title:

{
  "redirect": "Wikcionario:Portada",
  "title": "Main Page"
}
{
  "redirect": "Categoría:ES:Plantillas de flexión de verbos",
  "title": "Categoría:Plantillas para conjugación de verbos españoles"
}

The command prints many debug info:

picoamperio: DEBUG: unexpected top-level node: <LEVEL6(['Referencias y notas']){} '\n', <HTML(references){} >> at ['picoamperio']

It looks like wikitextprocessor currently can't parse Spanish Wiktioanry pages.

[Shark69]

Originally Posted by xxyzz

I'm able to create a JSON file with the changes I posted above but it only contains the page title:

{
  "redirect": "Wikcionario:Portada",
  "title": "Main Page"
}
{
  "redirect": "Categoría:ES:Plantillas de flexión de verbos",
  "title": "Categoría:Plantillas para conjugación de verbos españoles"
}

The command prints many debug info:

picoamperio: DEBUG: unexpected top-level node: <LEVEL6(['Referencias y notas']){} '\n', <HTML(references){} >> at ['picoamperio']

It looks like wikitextprocessor currently can't parse Spanish Wiktioanry pages.

Thanks for your efforts. I hope the project goes to inprove in managing another languages.

[Shark69]

Speaking of other topic. Do you want people to open issues related to an unofficial version? That is, problems related to a version downloaded after a "git push" and available in GitHub Actions Artifacts?

[xxyzz]

Originally Posted by Shark69

Speaking of other topic. Do you want people to open issues related to an unofficial version? That is, problems related to a version downloaded after a "git push" and available in GitHub Actions Artifacts?

Why not? Better fix bugs before a release. You can also create a new discussion on GitHub.

[Shark69]

Originally Posted by xxyzz

Why not? Better fix bugs before a release. You can also create a new discussion on GitHub.

[xxyzz]

I have added some new features recently:

• Improve search lemma performance
• Add IPA to Wiktionary table and footnotes
• Export lemmas and their definitions, this exported file can be imported to Anki.
• Book format can be selected manually for each job

to test these new features you need to delete the old "wiktionary_*" files in the "worddumb-lemmas" folder.

[Shark69]

Originally Posted by xxyzz

I have added some new features recently:

• Improve search lemma performance
• Add IPA to Wiktionary table and footnotes
• Export lemmas and their definitions, this exported file can be imported to Anki.
• Book format can be selected manually for each job

to test these new features you need to delete the old "wiktionary_*" files in the "worddumb-lemmas" folder.

Thanks!

[xxyzz]

I added Chinese translation files to the master branch. Please send pull requests if you want to add translation files for other languages. New .po file can be created from the .po file in the "translations" folder in poedit(https://poedit.net).

[Shark69]

Originally Posted by xxyzz

I added Chinese translation files to the master branch. Please send pull requests if you want to add translation files for other languages. New .po file can be created from the .po file in the "translations" folder in poedit(https://poedit.net).

I'm interested in Spanish translation. But I think it is quite difficult to create the .po file beginning from zero. Would you give me some suggestions about how have you made the chinese file? Thanks.

[xxyzz]

I created the .po file by scaning the source code with Poedit. But you can create new translation file from the Chinese .po file by using the "New from POT/PO file..." option in Poedit app.

[Shark69]

Originally Posted by xxyzz

I created the .po file by scaning the source code with Poedit. But you can create new translation file from the Chinese .po file by using the "New from POT/PO file..." option in Poedit app.

Thanks. I'll do it.