English dictionary for Cybook Odyssey

[oldnat]

I also think it is win7 and Unicode (then V2 had also problems with malformed sqlite) and the V3 version i made up (with doing things binary) choked also on a 0x81 being an "unprintable ." instead of ANSI "ü" which it should be. I have no XP to test. But as for it works in the original V2 version fine on Linux and I converted all my needed dictionaries, and I lack time (and python knowledge as well :-) I also can not go deeper now.

Anyway, there seem not to be too much people seeking this... a week that nobody than us two is writing here.

I thank you again for your help, AlPe and wish you nice days.

BR Nathalie

[AlPe]

Actually, every other day I get an email from someone trying to convert dictionaries for the Odyssey, 1/3 of them have the Python 3 problem.

[oldnat]

Originally Posted by AlPe

Actually, every other day I get an email from someone trying to convert dictionaries for the Odyssey, 1/3 of them have the Python 3 problem.

They should read here instead of bothering you with emails :-)

I know I began also mailing you, but then I found the forum - I hope that other people find it also - and eventually they publish their experiences and/or solutions. Even if I personally do not need it anymore for I have all my dicts converted thank you :-)

BR Nat

[AlPe]

I do not feel like "they bother me". I try to help, if I can. Usually, if they can find the answer online, I will give them a URL to that Web page.

For now, I updated the Google Code wiki and its welcome page, highlighting the issue with Python 3. I might spend some time on it next week, for the benefit of all.

(Obviously, I started getting more mails since Bookeen started selling Odyssey's through their Saxon/Scandinavian partnerships with Thalia and Adlibris. In Italy, due to the problems with the first generation of those devices and the incompetence of the main Italian reseller (a major bookstore chain), it has been a massive flop so far.)

[oldnat]

Sorry, I was "outside".

Mentioning "bother" I used a smiley - for I was also one of them "bothering" you :-) And I really appreciate your help which helped me to solve my problem.

In Austria the device started selling mid November (I bought mine the 23rd of Nov.) and I saw quite a lot of people buying it. I have a lot of books on it already, also from Thalia.at as well as from other stores, also from free sources (state library etc.) and I had no problems with it. Nevertheless I do not think that too many of the people shall be confronted with this problem, for most of them seemed to want only to read and nothing more.

The bigger problem is, that the StarDict Project is quite silent and there are not too much dictionaries around which could be converted... especially in "exotic" languages like Hungarian (only it, de, en and it to hu, and only hu to en, no more) but I do not think that there shall be much more demand...

BR Nat

[AlPe]

@oldnat: no problem.

@all: I post here what I wrote on the Google Code Page of Penelope Project:

The current code requires Python 2.6 or Python 2.7. It does not run under Python 3. If you download the current code and modify it to run under Python 3, please share it! I will be glad to give you access to this project so that you could upload your Python 3 code, and make many other people happy! (You can just write me an email with the code, if you prefer.)

[oldnat]

I would also mention that also the python 2.x Versions fail on windows 7 because of the changed default encoding. As you remember, I could not do anything and the only successful way to convert was on Linux with V2.

BR Nat

[AlPe]

In the latest release (1.8) which added support for outputting in Kobo format, the main() sets the default encoding to UTF8:

http://code.google.com/p/penelope-di...nelope.py#1230

Does this help on Windows?

[oldnat]

Unfortunately, not. There is still some "worm" in it.
(Windows 7, Python 2.7)

[INFO] Input dictionary has sequence type 'm'.
[INFO] Starting conversion with the following parameters:

[INFO] Dictionary file: hu-en.dict
[INFO] Index file: hu-en.dict.idx
[INFO] Language from: hu
[INFO] Language to: en
[INFO] License: GNU GPL 3
[INFO] Copyright: GNU GPL 3
[INFO] Title: Dictionary hu -> en
[INFO] Description: Dictionary hu -> en
[INFO] Year: 2012

[INFO] Reading input dictionary...
[INFO] Parsing the input dictionary...
[INFO] Using the built-in parser...
[INFO] Outputting in Odyssey format to file...
Traceback (most recent call last):
File "penelope-Unicode.py", line 1231, in <module>
main()
File "penelope-Unicode.py", line 1197, in main
write_to_Odyssey_format(config, parsed_data, debug)
File "penelope-Unicode.py", line 188, in write_to_Odyssey_format
sql_cursor.execute('delete from T_DictIndex ')
sqlite3.DatabaseError: database disk image is malformed

[oldnat]

The problem is, I also am in quite a stress befor Christmas now in the bureau and have not too much time to investigate further now...

[AlPe]

Traceback (most recent call last):
File "penelope-Unicode.py", line 1231, in <module>
main()
File "penelope-Unicode.py", line 1197, in main
write_to_Odyssey_format(config, parsed_data, debug)
File "penelope-Unicode.py", line 188, in write_to_Odyssey_format
sql_cursor.execute('delete from T_DictIndex ')
sqlite3.DatabaseError: database disk image is malformed

Assuming empty.idx is a valid sqlite file (not a download of the HTML page from Google Code with the listing of that file), this looks like a problem of the sqlite lib for python on windows. I will try to have a look at it on a virtualized Windows machine, during the Christmas break.

[oldnat]

"Assuming empty.idx is a valid sqlite file" - I also assume it is. It begins with "SQLite format 3 NUL EOT NUL SCH NUL @" and looks an apselut orninary binary db file....

[AlPe]

The signature of my empty.idx is:

$ ll empty.idx 
-rw------- 1 xxx xxx 6144 Dec  8 19:23 empty.idx

$ md5sum empty.idx 
51ebcf397d50e4a2a673f85402ae2a94  empty.idx

$ sha1sum empty.idx 
0ae8d4467819786afe4324355fee50cd8e416f7d  empty.idx

$ hexdump -Cv empty.idx  | head
00000000  53 51 4c 69 74 65 20 66  6f 72 6d 61 74 20 33 00  |SQLite format 3.|
00000010  04 00 01 01 00 40 20 20  00 00 00 23 00 00 00 06  |.....@  ...#....|
00000020  00 00 00 00 00 00 00 00  00 00 00 06 00 00 00 01  |................|
00000030  00 00 00 00 00 00 00 00  00 00 00 01 00 00 00 00  |................|
00000040  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
00000050  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 23  |...............#|
00000060  00 2d e2 21 0d 00 00 00  05 01 77 00 03 98 02 cf  |.-.!......w.....|
00000070  02 30 01 dd 01 77 00 00  00 00 00 00 00 00 00 00  |.0...w..........|
00000080  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|
00000090  00 00 00 00 00 00 00 00  00 00 00 00 00 00 00 00  |................|

[oldnat]

md5 matched!

[AlPe]

Hi,

I have updated my script penelope.py, which now runs under Windows (XP) and Python 2.7.3.

Please clone from the Google Code project: http://code.google.com/p/penelope-dictionary-converter/