Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Readers > Sony Reader > Sony Reader Dev Corner

Notices

Reply
 
Thread Tools Search this Thread
Old 04-04-2011, 11:03 AM   #16
Papi
Addict
Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.
 
Posts: 311
Karma: 547600
Join Date: Jul 2010
Location: Paris
Device: Kindle Keyboard, Kindle NT, PRS-650
TJ27 : thanks for the info, though I didn't understand everything :

Quote:
Originally Posted by TJ27 View Post
BBeb Dictionary studio worj in 'shiftJS' encoding (tittle, autor and words) - sony prs use unicode. Need big "path" bbebdic.dll
OK, I something was wrong in terms of encoding (I had to use Unicode BE as my CSV test encoding, else BBeB di studio would fail with a 616 error), but didn't know exactly what was going on.

Quote:
Official selling sony dictionary only japan -
That's what I've concluded, so only a few are available, and most to and from Japanese I guess. That's a bit sad, since I don't think we can achieve the same quality with free dictionaries, if they are even available.

Quote:
And header working dictionary and "made in studio" - different, not only CDUS <-> FDJP
Interesting, though it doesn't explain why I couldn't replace a built-in dictionary with another built-in dictionary. Maybe the mount --build trick doesn't work, that would explain I get no definition at all.

Quote:
Only library.mbf work - i remove dictionary and mbf file edited correctly
I attach 'patched' bbedic.dll (only not need correct CDUS <-> FDJP)
This part I didn't understand :
- I know the library.mbf is used to reference the .msd files, but is there anything to edit there ? Does BBeB Studio create this file ?
- The patched bbedic.dll allows to create BBeB dictionary with correct header for the PRS devices ?
- Did you actually succeed implementing your own dictionaries in the PRS 350 ?
- Do you have more information on the MSD /MBF format ?
Papi is offline   Reply With Quote
Old 04-04-2011, 11:51 AM   #17
TJ27
Enthusiast
TJ27 doesn't litterTJ27 doesn't litter
 
Posts: 44
Karma: 198
Join Date: Mar 2011
Location: Russia, Saratov
Device: Sony PRS-350
No, i dont correct header for full compatible. Only patch for CDUS <-> FDJP. (veryfing header)
Mbf file automatic create after send (modify complection) dictionary from memorystick.
Insert any formatted usb flash disk (or card to cardreader), select destination to this device. Dictionary for studio : x:/ebook/bbeb/dic
For repalce - may be need mount full dict directory (see prs+), and modify .js script file
I bad know
being don't have correct(unicode) version studio - uselessly
TJ27 is offline   Reply With Quote
Old 04-04-2011, 12:10 PM   #18
Mark Nord
2B || !2B
Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.Mark Nord can program the VCR without an owner's manual.
 
Posts: 818
Karma: 178742
Join Date: Feb 2010
Location: Austria
Device: Sony PRS505/650/T1
Hello,

I understand less then half of your discussion, but could setting bit 2 be of any help?
(Presumable using a dictionary in IM instead of the build in ones?)

Quote:
Originally Posted by Papi View Post
..
On another topic, in the kconfig.xml, there's the following line :
<variable name="dictionaryApplicationOnly" value="0"/> <!-- bit0:dicApp only, bit1:no Word Log, bit2:/Data/dictionary -->
Anyone knows more about this ?
Mark Nord is offline   Reply With Quote
Old 04-04-2011, 12:51 PM   #19
TJ27
Enthusiast
TJ27 doesn't litterTJ27 doesn't litter
 
Posts: 44
Karma: 198
Join Date: Mar 2011
Location: Russia, Saratov
Device: Sony PRS-350
Quote:
Originally Posted by Mark Nord View Post
Hello,

I understand less then half of your discussion, but could setting bit 2 be of any help?
(Presumable using a dictionary in IM instead of the build in ones?)
May be need set 4 and put all dictionary to /Data/dictionary - visible root /dictionary
Tommorow probe this
TJ27 is offline   Reply With Quote
Old 04-04-2011, 12:53 PM   #20
Papi
Addict
Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.
 
Posts: 311
Karma: 547600
Join Date: Jul 2010
Location: Paris
Device: Kindle Keyboard, Kindle NT, PRS-650
OK I understand now. I didn't try the "send to memory stick functionality" so I didn't see the MBF file.
As for the replacement, I simply copied a modified version of the original English -> French directory into /opt1/dict, and then did a mount --bind to replace another dictionary (the Nederlands -> English one). I see no errors in the log, but got no successful result. I edited the modified dictionary to put the correct name inside (CDUS125D0000????), I even tried to copy the entire header (anything starting from the beginning to the name) from the target dictionary to the modified one, but that didn't work either. Now I will try to mv the original dictionary file, and copy my modified file as the original one, so I'm sure it's not mount --bind which causes a problem.
But even if that does work, it seems we are stuck with BBeB dic Studio working only with Shift JIS encoding, and that encoding has only "basic" letters, so no Ú Ó š Ŕ Ń ÷, etc. So without a proper software to create a msd file, and without knowledge of the msd format, it seems hard to get a good functional dictionary. Maybe there's a way to implement the functionality using another dictionary format. I hope the PRS+ team succeed whatever the way.
Papi is offline   Reply With Quote
Old 04-05-2011, 04:07 AM   #21
Papi
Addict
Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.
 
Posts: 311
Karma: 547600
Join Date: Jul 2010
Location: Paris
Device: Kindle Keyboard, Kindle NT, PRS-650
Quote:
Originally Posted by Mark Nord View Post
Hello,

I understand less then half of your discussion, but could setting bit 2 be of any help?
(Presumable using a dictionary in IM instead of the build in ones?)
Mark : you're right we have to try that too.
I tried yesterday to replace a dictionary with another pre-installed one (instead of mount --build), and no luck either. I tried replacing a good part of the beginning of the header from the source to the target, but I guess there is a sort of checksum in the MBF file.

So next step would be creating a custom dictionary and associated MBF file, and try the dictionaryApplicationOnly trick. There's the problem of Shift JIS / Unicode thing though.
Papi is offline   Reply With Quote
Old 04-05-2011, 05:02 AM   #22
kartu
PRS+ author
kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.
 
Posts: 1,637
Karma: 2446233
Join Date: Dec 2007
Device: Sony PRS-300, 505, 600, 650, 950
Dictionary is located on VFAT partition I'm not sure if mount --bind works there.
But you can in mount it as read write and replace any file there.
kartu is offline   Reply With Quote
Old 04-05-2011, 05:32 AM   #23
Papi
Addict
Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.
 
Posts: 311
Karma: 547600
Join Date: Jul 2010
Location: Paris
Device: Kindle Keyboard, Kindle NT, PRS-650
Quote:
Originally Posted by kartu View Post
Dictionary is located on VFAT partition I'm not sure if mount --bind works there.
But you can in mount it as read write and replace any file there.
Yep, that's what I did : mount as rw, then mv the original file, cp my modified dictionary with the name of the original one. I did a ls -l before and after, and given the names and sizes of files, it seems that this part was executed without errors. But I suspect the library.mbf file contains more informations about the MSD files than just the names, and I don't know what exactly.
Papi is offline   Reply With Quote
Old 04-06-2011, 10:25 AM   #24
Papi
Addict
Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.
 
Posts: 311
Karma: 547600
Join Date: Jul 2010
Location: Paris
Device: Kindle Keyboard, Kindle NT, PRS-650
In fact I chose to modify the root for dictionaries in kconfig.xml and mount --bind it, so the root of Dictionaries is in /Data for easier access. After many trials, I was able to create a dictionary without errors in BBeB Dictionary Studio, and modifying consequently kconfig.xml, it is selectable and usable (see screenshots), but there are several problems :
- I had to "cheat" BBeB Dict Studio, which takes an CSV as input with the following format : entry,search_pattern1/search_pattern2/../,text_displayed.
For example : car,car,car. However, that would always generate an error in BBeB studio, which could be bypassed by not putting the 3rd field. So car,car, would be OK. The CSV format was given by someone who posted on Yahoo's Librie group, and I found on the same group someone who had the same problem as I had, but his solution didn't work for me. So to obtain the screenshot, I cheated by putting the entry car : test dictionnaire,car,, in the CSV, so it displays "car : test dictionnaire". So it would be nice to understand why BBeB Dict Studio gives an error with the "correct" format : there it would be nice to have someone speaking Japanese because the help file of the software is written in that language.
- I have not tried yet to look for a definition of a word inside the dictionary (given the first point, I'm not sure it works).
- I have not tried yet multiple search patterns.
- The LIBRARY.MBF file references the dictionaries, but I couldn't load the pre-installed dictionaries in BBeB Dict Studio, so I can't create a LIBRARY.MBF which references pre-installed dictionaries AND custom dictionaries at the same time. I have to try a "mix" of two LIBRARY.MBF, maybe it would work (I doubt it though).
- The main problem is : how to get quality dictionaries in CSV format. I was looking for a German -> French one for example but didn't find any. A solution would be to buy one, find a way to convert it to CSV and then to MSD...I don't know what is the main format for dictionaries, but I kind of doubt it's in "readable" format.
Attached Thumbnails
Click image for larger version

Name:	screen100.jpg
Views:	251
Size:	78.6 KB
ID:	69575   Click image for larger version

Name:	screen101.jpg
Views:	199
Size:	18.0 KB
ID:	69576  
Papi is offline   Reply With Quote
Old 04-06-2011, 11:23 AM   #25
TJ27
Enthusiast
TJ27 doesn't litterTJ27 doesn't litter
 
Posts: 44
Karma: 198
Join Date: Mar 2011
Location: Russia, Saratov
Device: Sony PRS-350
Get dictionary for Dict (txt format, or zd-format and use makezd)
http://free-dict.narod.ru/createzd.html - russian page
Or find utility for conversions/unpack stardick, xdxf dictionary to txt/csv format.
You have error conversion - set encoding for not-unicode program to Japan (in regional setting), reboot - and car,car,car processing OK.
TJ27 is offline   Reply With Quote
Old 04-06-2011, 12:02 PM   #26
kartu
PRS+ author
kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.kartu ought to be getting tired of karma fortunes by now.
 
Posts: 1,637
Karma: 2446233
Join Date: Dec 2007
Device: Sony PRS-300, 505, 600, 650, 950
Quote:
Originally Posted by Papi
The main problem is : how to get quality dictionaries in CSV format. I was looking for a German -> French one for example but didn't find any.
Try this. (well, not "quality", but still dictionary )

Last edited by kartu; 04-06-2011 at 12:06 PM.
kartu is offline   Reply With Quote
Old 04-06-2011, 02:29 PM   #27
porkupan
Fanatic
porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.
 
porkupan's Avatar
 
Posts: 554
Karma: 1057213
Join Date: Sep 2006
Location: North Eastern U.S.
Device: Sony Reader
Hey, I see the dictionary discussion has re-activated...

Unfortunately, I am afraid some of you are moving in the wrong direction. We have been though all these exercises last year, and concluded that BBeB Dic Studio cannot by itself be used to produce a working dictionary for Sony Reader. The problem seems to be in the format of the word/search index. The dictionary works with a few words, but only the first few words appear to be indexed correctly.

The BBeb Dic Studio generates a valid LIBRARY.MBF file. The reader's software in fact doesn't care if the dictionary ID starts with FDJP or CDUS. You can either make a binary change in the dictionary header, or hack up the Studio. kconfig.xml points to the dictionary (library) location [bbebDictionaryRootFile], so you can test with dictionaries located in the /Data partition, and you don't need to overmount anything. All you needed to do on PRS-600 was to put the MSD files in the same directory with the MBF file. I suspect it is still so for x50.

It is true that the new BBeB dictionary format supports Unicode, but Shift-JS encoding appears to be sufficient for most applications, so we tested with it.

The bottom line is, the index in the BBeB Dic Studio-generated MSD file must be regenerated. igorsk looked at the structure of the proper index, but he so far hasn't had the time to write code to generate a working index for Sony Reader-type BBeB dictionaries, and replace the Studio-generated index with the proper index. But that seems to be the way to go.

Last edited by porkupan; 04-06-2011 at 02:40 PM. Reason: grammar
porkupan is offline   Reply With Quote
Old 04-06-2011, 03:14 PM   #28
Papi
Addict
Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.
 
Posts: 311
Karma: 547600
Join Date: Jul 2010
Location: Paris
Device: Kindle Keyboard, Kindle NT, PRS-650
Quote:
Originally Posted by porkupan View Post
Hey, I see the dictionary discussion has re-activated...

Unfortunately, I am afraid some of you are moving in the wrong direction. We have been though all these exercises last year, and concluded that BBeB Dic Studio cannot by itself be used to produce a working dictionary for Sony Reader. The problem seems to be in the format of the word/search index. The dictionary works with a few words, but only the first few words appear to be indexed correctly.
Well I would have like to know this before I made all those tries/fails, I guess it was discussed on the russian forum, but it's too much pain to try to read the google translation. Well, I learned something in the process, so good for me.

Quote:
The BBeb Dic Studio generates a valid LIBRARY.MBF file. The reader's software in fact doesn't care if the dictionary ID starts with FDJP or CDUS. You can either make a binary change in the dictionary header, or hack up the Studio. kconfig.xml points to the dictionary (library) location [bbebDictionaryRootFile], so you can test with dictionaries located in the /Data partition, and you don't need to overmount anything. All you needed to do on PRS-600 was to put the MSD files in the same directory with the MBF file. I suspect it is still so for x50.
Yes that's basically how far I came, my "custom" dictionaries + library.mbf are in /Data/mydictionaries and I just overmount kconfig.xml, and assets.xml for the string displayed. I didn't know there was problem with indexing though, my custom dictionary only had 3 entries for testing purpose. I just tried with a more realistic dictionary, it made the reader reboot.

Quote:
It is true that the new BBeB dictionary format supports Unicode, but Shift-JS encoding appears to be sufficient for most applications, so we tested with it.
I thought Shift JIS only defines "basic" ANSI caracters, so no cyrillic, no Ú Ŕ ¨ Ř §, a etc...What did I miss here ? I thought in fact that the Shift JIS encoding would be also a big problem, and ideally we would need the new BBeB Dict Studio, but I guess it's not publicly available.

Quote:
The bottom line is, the index in the BBeB Dic Studio-generated MSD file must be regenerated. igorsk looked at the structure of the proper index, but he so far hasn't had the time to write code to generate a working index for Sony Reader-type BBeB dictionaries, and replace the Studio-generated index with the proper index. But that seems to be the way to go.
Regenerating the index...So you more or less "understand" MSD file format or part of it ? Did it need some reverse engineering there, by generating dictionaries with BBeB dict Studio ?
Papi is offline   Reply With Quote
Old 04-06-2011, 03:38 PM   #29
porkupan
Fanatic
porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.porkupan ought to be getting tired of karma fortunes by now.
 
porkupan's Avatar
 
Posts: 554
Karma: 1057213
Join Date: Sep 2006
Location: North Eastern U.S.
Device: Sony Reader
Quote:
Originally Posted by Papi View Post
I thought Shift JIS only defines "basic" ANSI caracters, so no cyrillic, no Ú Ŕ ¨ Ř §, a etc...What did I miss here ? I thought in fact that the Shift JIS encoding would be also a big problem, and ideally we would need the new BBeB Dict Studio, but I guess it's not publicly available.
Actually, Shift JS does support Russian Cyrillic and some other character sets. I don't think it's enough for full European support though.

Quote:
Originally Posted by Papi View Post
Regenerating the index...So you more or less "understand" MSD file format or part of it ? Did it need some reverse engineering there, by generating dictionaries with BBeB dict Studio ?
igorsk reverse-engineered the part that interprets the index in the Sony Reader FskBBeBDictionary.so module.
porkupan is offline   Reply With Quote
Old 04-06-2011, 04:07 PM   #30
Papi
Addict
Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.Papi ought to be getting tired of karma fortunes by now.
 
Posts: 311
Karma: 547600
Join Date: Jul 2010
Location: Paris
Device: Kindle Keyboard, Kindle NT, PRS-650
Oh it seems Cyrillic is indeed in Shift JIS. Not much luck for European languages though, except English of course. I don't see any way to get around this problem of accentuated characters. If BBeB Dict Studio uses a translation table from Shift JIS to UTF-16 or UTF-8, maybe there's some way to "hack" this table and replace non used "Shift JIS characters" with all accentuated alphabetic characters.
Papi is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Which reader has the most convenient dictionary access? cryohead Which one should I buy? 11 03-27-2010 04:49 PM
PRS-600 easy dictionary access? quillaja Sony Reader 6 09-16-2009 10:28 PM
A way to execute files without shell access?!? scotsman iRex 8 03-13-2009 08:35 AM
iLiad Access to all your iLiad files, without USB narve iRex Developer's Corner 30 01-28-2008 04:29 PM
Remotely access your files with Avvenu Colin Dunstan Lounge 4 11-30-2005 07:45 PM


All times are GMT -4. The time now is 06:33 AM.


MobileRead.com is a privately owned, operated and funded community.