Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Readers > Kobo Reader

Notices

Reply
 
Thread Tools Search this Thread
Old 05-09-2020, 06:59 AM   #61
toancv
Enthusiast
toancv began at the beginning.
 
Posts: 49
Karma: 10
Join Date: Nov 2018
Device: Kindle paperwhite, Likebook Mars, Kobo Aura
Quote:
Originally Posted by geek1011 View Post
No, it can't fix those ones. This fix is only for large dictfiles used as source content for dictgen. It's not possible to fix Kobo's support for large dictionaries, even with a patch.
They are not large dictionaries, the total number of headwords is about 100k , some english dictionaries are more headwords than that. The problems is prefix rules of Kobo dictionary make Chinese dictionary create a lot of html files (in this case is more than 65K files) which make Kobo software cannot recoginze it. Penelope method used to tried to solve this problem by giving option to reduced prefix to 1 instead of 2 letters. This option reduced number of html files for chinese dictionaries significantly (about 10K more files), but the kobo software failed to recognized such html files.

Kobo support Traditional Chinese however it don't have any built in Chinese dictionary so far. Maybe due to this problem? I don't know.
toancv is offline   Reply With Quote
Old 05-15-2020, 01:43 AM   #62
loyukfai
Zealot
loyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura about
 
Posts: 136
Karma: 4260
Join Date: Jan 2011
Device: none
@geek1011 Do you think Kobo will revert the force-replacement behaviour in the next update?

BTW, what if I install a translation dictionary as a "normal" dictionary? Will that work as well?

Cheers.
loyukfai is offline   Reply With Quote
Advert
Old 05-15-2020, 02:56 AM   #63
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 19,027
Karma: 32527535
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by loyukfai View Post
@geek1011 Do you think Kobo will revert the force-replacement behaviour in the next update?
Only if someone can reproduce it in a repeatable and documentable way. I have seen it happen, but, it isn't consistent. And I haven't found anything in the logs to help. I don't normally sideload dictionaries, so I maybe I did something wrong (Set read-only flag and sync. Anything else?). Or I might have missed the discussion on how to break it. If so, can someone point it out.

And for the record, there are two syslogs posted in this thread. Neither show anything useful. Both show the "SyncDictionariesCommand" being run. That is what I would expect. Part of that function would be to decide if there are dictionaries to be updated, and if the read-only dictionaries shouldn't be replaced. A different log level might show more.
davidfor is online now   Reply With Quote
Old 05-15-2020, 09:12 AM   #64
loyukfai
Zealot
loyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura about
 
Posts: 136
Karma: 4260
Join Date: Jan 2011
Device: none
Noted with thanks. Is there anything I can do or provide for possible further investigation?

Cheers.
loyukfai is offline   Reply With Quote
Old 05-15-2020, 09:52 AM   #65
geek1011
Wizard
geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.
 
Posts: 1,779
Karma: 4402832
Join Date: May 2016
Location: Canada
Device: Kobo Mini, Aura Edition 2 v1, Clara HD
Quote:
Originally Posted by davidfor View Post
Only if someone can reproduce it in a repeatable and documentable way. I have seen it happen, but, it isn't consistent. And I haven't found anything in the logs to help. I don't normally sideload dictionaries, so I maybe I did something wrong (Set read-only flag and sync. Anything else?). Or I might have missed the discussion on how to break it. If so, can someone point it out.
You're looking for geek1011/dictutil#6. Most of the other discussion happened over PMs, but the important parts are in that issue. I still have yet to figure out the exact condition checked (I just haven't got around to it yet), but the issue should be apparent if Kobo looks at their own code.

Quote:
And for the record, there are two syslogs posted in this thread. Neither show anything useful. Both show the "SyncDictionariesCommand" being run. That is what I would expect. Part of that function would be to decide if there are dictionaries to be updated, and if the read-only dictionaries shouldn't be replaced. A different log level might show more.
Yes, see the issue I linked.

Last edited by geek1011; 05-15-2020 at 11:42 AM.
geek1011 is offline   Reply With Quote
Advert
Old 05-15-2020, 09:54 AM   #66
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 19,027
Karma: 32527535
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by loyukfai View Post
Noted with thanks. Is there anything I can do or provide for possible further investigation?
As I said, details of when and how it occurs are needed. Things like, do only some dictionaries get replaced? Does it only happen if there are a certain number of dictionaries? Does it happen with all syncs (manual, the scheduled sync or book syncs at other times)? Do you need to set all dictionaries to read only? What happens if you change settings. Does actually doing a dictionary lookup change things?

Otherwise, turn the logs on see if anything useful turns up. Different options will show different things. But, I haven't found a combination of options that show anything useful.
davidfor is online now   Reply With Quote
Old 05-15-2020, 10:10 AM   #67
geek1011
Wizard
geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.
 
Posts: 1,779
Karma: 4402832
Join Date: May 2016
Location: Canada
Device: Kobo Mini, Aura Edition 2 v1, Clara HD
Quote:
Originally Posted by davidfor View Post
Things like, do only some dictionaries get replaced?
It currently seems that for the affected people, all sideloaded dictionaries with the same name as an official one get replaced.

Quote:
Does it only happen if there are a certain number of dictionaries?
The number of dictionaries doesn't have an effect.

Quote:
Does it happen with all syncs (manual, the scheduled sync or book syncs at other times)?
Yes, for all syncs which update dictionaries (all of them, IIRC, but don't quote me on that one). And, the technical reason for this is that all of them build the list of dictionaries to sync using SyncDictionariesCommand:repareDownloadList, which is what should be checking if it's read-only.

Quote:
Do you need to set all dictionaries to read only?
It is independent for each one.

Quote:
What happens if you change settings. Does actually doing a dictionary lookup change things?
Nope.

Quote:
Otherwise, turn the logs on see if anything useful turns up. Different options will show different things. But, I haven't found a combination of options that show anything useful.
Nope. Nothing logs the relevant part, which is the check for read-only, the check for the filesize, and the check for IsSynced, however that's calculated (I'll look into that if needed, but Kobo can do that themselves).
geek1011 is offline   Reply With Quote
Old 05-15-2020, 11:42 AM   #68
geek1011
Wizard
geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.
 
Posts: 1,779
Karma: 4402832
Join Date: May 2016
Location: Canada
Device: Kobo Mini, Aura Edition 2 v1, Clara HD
Quote:
Originally Posted by davidfor View Post
Only if someone can reproduce it in a repeatable and documentable way. I have seen it happen, but, it isn't consistent. And I haven't found anything in the logs to help.
I've looked into the details of this bug, and if I've interpreted it correctly, I've narrowed it down to the file size check (see here). I might see if I can fix it with a patch later today if I have time and if the fix is simple enough.

Update: I think I've tracked down the bug: https://github.com/geek1011/dictutil...ment-629352018.

Last edited by geek1011; 05-15-2020 at 12:20 PM.
geek1011 is offline   Reply With Quote
Old 05-15-2020, 12:37 PM   #69
Flaviocc
Enthusiast
Flaviocc began at the beginning.
 
Posts: 49
Karma: 10
Join Date: May 2019
Location: Brazil
Device: Kindle PPW4 / Kobo Aura One
Guys, I'm new in Kobo's world and lost with a few infos about dictionaries.

I have 2 files:

hyph_pt_br.zip --- with hyph_pt_br.dic inside (hyphenation dictionary)

pt_br.zip -- with pt_br.aff and pt_br.dic inside (ptbr dictionary)

can i use these dictionaries in kobo? And if so how?

I saw that in the patches there is a dictionary file, would it be there to insert the file?

Post here to avoid a new topic about dictionaries.

Thanks for help me.
Flaviocc is offline   Reply With Quote
Old 05-20-2020, 02:15 PM   #70
loyukfai
Zealot
loyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura about
 
Posts: 136
Karma: 4260
Join Date: Jan 2011
Device: none
Just upgraded to 4.21.15015

Unfortunately my custom translation dictionaries are still being replaced on each sync.

Do you think if it's possible edit the sqlite db, perhaps the size? So that the system won't "detect" the anomaly?

Cheers.
loyukfai is offline   Reply With Quote
Old 05-20-2020, 03:02 PM   #71
geek1011
Wizard
geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.
 
Posts: 1,779
Karma: 4402832
Join Date: May 2016
Location: Canada
Device: Kobo Mini, Aura Edition 2 v1, Clara HD
Quote:
Originally Posted by loyukfai View Post
Just upgraded to 4.21.15015

Unfortunately my custom translation dictionaries are still being replaced on each sync.

Do you think if it's possible edit the sqlite db, perhaps the size? So that the system won't "detect" the anomaly?

Cheers.
Not anymore. The only option right now is the patch here: https://pgaskin.net/dictutil/dicthtml/install.html.
geek1011 is offline   Reply With Quote
Old 05-20-2020, 03:40 PM   #72
loyukfai
Zealot
loyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura about
 
Posts: 136
Karma: 4260
Join Date: Jan 2011
Device: none
Quote:
Originally Posted by geek1011 View Post
Not anymore. The only option right now is the patch here: https://pgaskin.net/dictutil/dicthtml/install.html.
Noted. Which option do I need to enable in /src?

Cheers.
loyukfai is offline   Reply With Quote
Old 05-20-2020, 03:48 PM   #73
geek1011
Wizard
geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.geek1011 ought to be getting tired of karma fortunes by now.
 
Posts: 1,779
Karma: 4402832
Join Date: May 2016
Location: Canada
Device: Kobo Mini, Aura Edition 2 v1, Clara HD
Quote:
Originally Posted by loyukfai View Post
Noted. Which option do I need to enable in /src?

Cheers.
Copy that into the yaml file for libnickel, then run kobopatch.
geek1011 is offline   Reply With Quote
Old 05-21-2020, 03:18 AM   #74
ICDeadPpl
Enthusiast
ICDeadPpl began at the beginning.
 
ICDeadPpl's Avatar
 
Posts: 31
Karma: 10
Join Date: Mar 2010
Location: Sweden
Device: Kobo Aura H2O
Quote:
Originally Posted by geek1011 View Post
Not anymore. The only option right now is the patch here: https://pgaskin.net/dictutil/dicthtml/install.html.
Maybe add to the page where the patch is supposed to be added?
ICDeadPpl is offline   Reply With Quote
Old 05-21-2020, 08:29 AM   #75
loyukfai
Zealot
loyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura aboutloyukfai has a spectacular aura about
 
Posts: 136
Karma: 4260
Join Date: Jan 2011
Device: none
Quote:
Originally Posted by geek1011 View Post
Copy that into the yaml file for libnickel, then run kobopatch.
Thanks a lot! Done and working.

Wish Kobo will revert the change, so no need to do this manual action every time the firmware is updated...

Cheers
loyukfai is offline   Reply With Quote
Reply

Tags
dictgen, dicthtml, dictionaries, dictionary, dictutil

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Adding new dictionaries to kobo. Robik Kobo Developer's Corner 50 04-17-2020 11:05 PM
Useful Related Tools Threads BetterRed Related Tools 3 05-17-2019 10:25 PM
Mini Sync Problems on 3 different Kobo Minis (related to software update?) jpottle Kobo Reader 2 06-20-2013 12:57 PM
Copy/Move books between libraries using command line tools jameszh Library Management 3 02-15-2011 09:02 AM
MSD (BBeB dictionaries) tools ? Papi LRF 0 12-20-2010 04:07 AM


All times are GMT -4. The time now is 09:15 PM.


MobileRead.com is a privately owned, operated and funded community.