Mobiperl Mobiperl - Perl tools for handling MobiPocket files - Page 40

tompe · 09-14-2008, 09:46 AM

Thanks, I just uploaded it to the distribution directory also.

tompe · 09-16-2008, 10:21 AM

Quote:

Originally Posted by JSI

It could be the characters -- there are math formulas in the paper. Although I thought that in that particular paper the formulas were just rendered as images, but I may be mistaken. The mobi file was displayed properly in the Mobipocket Reader, but not on the Kindle. The second mobi file I created the same way actually caused the Mobipocket Reader to crash.

It seems that the problem was java script code in the HTML file. I wonder if this can be considered a bug in the Kindle and should be reported? The file worked on my Cybook but not on the Kindle.

wallcraft · 09-16-2008, 10:33 AM

Quote:

Originally Posted by tompe

It seems that the problem was java script code in the HTML file. I wonder if this can be considered a bug in the Kindle and should be reported? The file worked on my Cybook but not on the Kindle.

This is a documented difference between Mobipocket's Java Reader and its C++ Reader, see Cross-platform feature support.

achatham · 09-19-2008, 05:04 PM

Quote:

Originally Posted by JSI

Hi,

I converted a couple of html files to mobi by html2mobi and uploaded them to my Kindle.
They show up on the Kinlde (with correct title/author info), but when I try to open them, the message "The selected item could not be opened" appears. What could be the problem?
The source html files were scientific papers saved off the publisher's website ("web page complete" option). I used the Windows executable for html2mobi. Thanks.

Could you try editing the HTML files to remove all "script" tags? I've found that removing them and reconverting fixed the error you mention. No idea why, though.

JSI · 09-20-2008, 06:52 PM

Quote:

Originally Posted by achatham

Could you try editing the HTML files to remove all "script" tags? I've found that removing them and reconverting fixed the error you mention. No idea why, though.

Yes, I removed all javascript, and, as Tompe said in an earlier post, it solved the problem. I guess Kindles choke on javascript.

ZioNemo · 10-03-2008, 03:27 AM

Hi,
I do have problems with lit2mobi under ubuntu linux.
My .lit is exploded into the ctmp subdir apparently ok, but subsequent generation seems unable to parse the .opf file

Same result if I try to use directly opf2mobi on the generated .opf

If I debug the opf2mobi it chokes in:
...
</guide>
</package>
no element found
at /usr/local/share/perl/5.8.8/XML/Parser/LiteCopy.pm line 167
XML::Parser::LiteCopy::_final() called at /usr/local/share/perl/5.8.8/XML/Parser/LiteCopy.pm line 154
XML::Parser::LiteCopy:

arse('XML::Parser::LiteCop y=HASH(0x8a6b1ac)', '<?xml version="1.0" encoding="UTF-8" ?>\x{a}<!DOCTYPE package \x{a} ...') called at /usr/local/share/perl/5.8.8/XML/Parser/Lite/Tree.pm line 49
XML::Parser::Lite::Tree:

arse('XML::Parser::Lite: :Tree=HASH(0x8a3ca9c)', '<?xml version="1.0" encoding="UTF-8" ?>\x{a}<!DOCTYPE package \x{a} ...') called at /home/mauro/workspace/MobiPerl/MobiPerl/Opf.pm line 123
MobiPerl::Opf::initialize_from_file('MobiPerl::Opf =HASH(0x8a3c208)', 'ctmp/Pippo.opf') called at /home/mauro/workspace/MobiPerl/MobiPerl/Opf.pm line 29
MobiPerl::Opf::new('MobiPerl::Opf', 'ctmp/Pippo.opf') called at /home/mauro/workspace/MobiPerl/MobiPerl/Util.pm line 49
MobiPerl::Util::get_tree_from_opf('ctmp/Pippo.opf', 'MobiPerl::Config=HASH(0x8a61968)', 'MobiPerl::LinksInfo=HASH(0x8343068)') called at /home/mauro/workspace/MobiPerl/opf2mobi.pl line 96

Peculiar thing is if I just run it (no debugging) the error is different:
...
</guide>
</package>
OPF: TITLE:
OPF: CREATOR:
OPFTITLE:
OPFAUTHOR:
Coverimage:
All spine elements have been added
Have Read in HTML tree from opf
FIX PRE TAGS
Saving mobi file (version 4): Pippo.mobi
COVEROFFSET: -1
THUMBOFFSET: -1
MobiFile.pm: before get_data()
EXTH setting data: author - 100 - - 0x
EXTH add: author - 100 -
MOBIHDR: imgrecpointer: 2
EXTH setting data: author - 100 - - 0x
EXTH add: author - 100 -
MobiFile.pm: after get_data()
MobiFile.pm: before Write()
Can't write a database with no name

The effect is the same, it continues, but has an empty opf structure, so nothing is written (if I give a title on the command line it completes, but with an empty .mobi)

What am I doing wrong?

TiA
ZioNemo

tompe · 10-03-2008, 05:48 AM

You can always run html2mobi on the html file.

If you give me the lit file I will debug it and try to fix it. It seems like the opf file is not correct or that the parser lit2mobi uses are to strict.

ZioNemo · 10-03-2008, 08:50 AM

Quote:

Originally Posted by tompe

You can always run html2mobi on the html file.

If you give me the lit file I will debug it and try to fix it. It seems like the opf file is not correct or that the parser lit2mobi uses are to strict.

Hi,
thanks for the fast answer.

I *can* send You the .lit file (if You tell me just where and how), but I strongly doubt the problem lies there since I tried several ones (including a few I fetched from the Internet for this test) and *all* behave in the same way.

This is one example of the generated .opf file:
=============================================
<?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE package
PUBLIC "+//ISBN 0-9673008-1-9//DTD OEB 1.0.1 Package//EN"
"http://openebook.org/dtds/oeb-1.0.1/oebpkg101.dtd">
<package unique-identifier="OverDriveGUID">
<metadata>
<dc-metadata xmlns:dc="http://purl.org/dc/elements/1.0/" xmlns

ebpackage="http://openebook.org/namespaces/oeb-package/1.0/">
<dc:Title>La Maschera Di Cthulhu</dc:Title>
<dc:Creator role="aut">Gianni Pilo</dc:Creator>
<dc:Identifier id="OverDriveGUID" scheme="GUID">{1FF51F09-CD18-43CA-AF7A-83734D9EE29A}</dc:Identifier>
</dc-metadata>
<x-metadata>
<meta name="rwver-ReaderWorks-SDK-Control" content="2, 0, 2, 0215 (02/15/2002)" />
<meta name="rwver-HTML-Input-Filter" content="2, 0, 3, 1212 (12/12/2003)" />
<meta name="rwver-Image-Input-Filter" content="2, 0, 2, 0215 (02/15/2002)" />
<meta name="rwver-Text-Input-Filter" content="2, 0, 2, 0215 (02/15/2002)" />
<meta name="rwver-LIT-file-generator" content="1.5.1.0280 (12/19/2003)" />
<meta name="rw-License-Key" content="RWPTL" />
</x-metadata>
</metadata>
<manifest>
<item id="Gianni_Pilo_-_La_Maschera_Di_Cthulhu" href="Gianni Pilo - La Maschera Di Cthulhu.htm" media-type="text/html" />
<item id="RW_~Cover01" href="~Cover01.jpg" media-type="image/jpeg" />
<item id="RW_~Cover02" href="~Cover02.jpg" media-type="image/jpeg" />
<item id="RW_~Cover03" href="~Cover03.jpg" media-type="image/jpeg" />
<item id="RW_~Cover04" href="~Cover04.jpg" media-type="image/jpeg" />
<item id="RW_~Cover05" href="~Cover05.jpg" media-type="image/jpeg" />
</manifest>
<spine>
<itemref idref="Gianni_Pilo_-_La_Maschera_Di_Cthulhu" />
</spine>
<guide>
<reference type="other.ms-thumbimage-standard" href="~Cover01.jpg" />
<reference type="other.ms-coverimage-standard" href="~Cover02.jpg" />
<reference type="other.ms-titleimage-standard" href="~Cover03.jpg" />
<reference type="other.ms-thumbimage" href="~Cover04.jpg" />
<reference type="other.ms-coverimage" href="~Cover05.jpg" />
</guide>
</package>
=============================================
This looks like a valid XML file, but I don't really know what a .opf file should look like, so...

I should mention I self-compiled clit (+---[ ConvertLIT (Version 1.8) ]---------------[ Copyright (c) 2002,2003 ]---) and I, very likely, goofed somewhere there.
The generated .htm files look ok though.

Regards
ZioNemo

tompe · 10-03-2008, 11:38 AM

I tested the opf file above but cannot reproduce the error. But in:

Quote:

at /usr/local/share/perl/5.8.8/XML/Parser/LiteCopy.pm line 167
XML::Parser::LiteCopy::_final() called at /usr/local/share/perl/5.8.8/XML/Parser/LiteCopy.pm line 154
XML::Parser::LiteCopy:arse('XML::Parser::LiteCop y=HASH(0x8a6b1ac)', '<?xml version="1.0" encoding="UTF-8" ?>\x{a}<!DOCTYPE package \x{a} ...') called at /usr/local/share/perl/5.8.8/XML/Parser/Lite/Tree.pm line 49
XML::Parser::Lite::Tree:arse('XML::Parser::Lite: :Tree=HASH(0x8a3ca9c)', '<?xml version="1.0" encoding="UTF-8" ?>\x{a}<!DOCTYPE package \x{a} ...') called at

isn't "\x[a}" some strange character so this miight be related to UTF8. I am not runnint UTF8 myself in the machine I tested on. Test to set LANG to en_US maybe?

ZioNemo · 10-03-2008, 05:02 PM

Quote:

Originally Posted by tompe

I tested the opf file above but cannot reproduce the error. But in:

isn't "\x[a}" some strange character so this miight be related to UTF8. I am not runnint UTF8 myself in the machine I tested on. Test to set LANG to en_US maybe?

Hi,
my system does *not* have the "en_US" locale; nearest thing are "en_us.utf8" and plain old "C".
I tried both but nothing changed.

The "strange" "\x{a}" characters I guess they are just plain linefeed encoded in an XML-friendly way.

If I just run lit2mobi I get the following:
=========================================
mauro@heimdall:/tmp$ LC_ALL=C PATH=~/bin/mobiperl-0.0.39:$PATH lit2mobi Gianni\ Pilo\ -\ La\ Maschera\ Di\ Cthulhu.lit
Unpack file Gianni Pilo - La Maschera Di Cthulhu.lit in dir ctmp
+---[ ConvertLIT (Version 1.8) ]---------------[ Copyright (c) 2002,2003 ]---
ConvertLIT comes with ABSOLUTELY NO WARRANTY; for details
see the COPYING file or visit "http://www.gnu.org/license/gpl.html".
This is free software, and you are welcome to redistribute it under
certain conditions. See the GPL license for details.
LIT INFORMATION.........
DRM = 1
Timestamp = 24d8c9eb
Creator = 00140000
Language = 00000410
Writing out "Gianni_Pilo_-_La_Maschera_Di_Cthulhu" as "Gianni Pilo - La Maschera Di Cthulhu.htm" ...
Successfully written to "ctmp/Gianni Pilo - La Maschera Di Cthulhu.htm".

Writing out "RW_~Cover01" as "~Cover01.jpg" ...
Successfully written to "ctmp/~Cover01.jpg".

Writing out "RW_~Cover02" as "~Cover02.jpg" ...
Successfully written to "ctmp/~Cover02.jpg".

Writing out "RW_~Cover03" as "~Cover03.jpg" ...
Successfully written to "ctmp/~Cover03.jpg".

Writing out "RW_~Cover04" as "~Cover04.jpg" ...
Successfully written to "ctmp/~Cover04.jpg".

Writing out "RW_~Cover05" as "~Cover05.jpg" ...
Successfully written to "ctmp/~Cover05.jpg".

Exploded "Gianni Pilo - La Maschera Di Cthulhu.lit" into "ctmp/".
Read in HTML tree from opf
Opf: Initialize from file: Gianni Pilo - La Maschera Di Cthulhu.opf
CONTENT: <?xml version="1.0" encoding="UTF-8" ?>
<!DOCTYPE package
PUBLIC "+//ISBN 0-9673008-1-9//DTD OEB 1.0.1 Package//EN"
"http://openebook.org/dtds/oeb-1.0.1/oebpkg101.dtd">
<package unique-identifier="OverDriveGUID">
<metadata>
<dc-metadata xmlns:dc="http://purl.org/dc/elements/1.0/" xmlns

ebpackage="http://openebook.org/namespaces/oeb-package/1.0/">
<dc:Title>La Maschera Di Cthulhu</dc:Title>
<dc:Creator role="aut">Gianni Pilo</dc:Creator>
<dc:Identifier id="OverDriveGUID" scheme="GUID">{1FF51F09-CD18-43CA-AF7A-83734D9EE29A}</dc:Identifier>
</dc-metadata>
<x-metadata>
<meta name="rwver-ReaderWorks-SDK-Control" content="2, 0, 2, 0215 (02/15/2002)" />
<meta name="rwver-HTML-Input-Filter" content="2, 0, 3, 1212 (12/12/2003)" />
<meta name="rwver-Image-Input-Filter" content="2, 0, 2, 0215 (02/15/2002)" />
<meta name="rwver-Text-Input-Filter" content="2, 0, 2, 0215 (02/15/2002)" />
<meta name="rwver-LIT-file-generator" content="1.5.1.0280 (12/19/2003)" />
<meta name="rw-License-Key" content="RWPTL" />
</x-metadata>
</metadata>
<manifest>
<item id="Gianni_Pilo_-_La_Maschera_Di_Cthulhu" href="Gianni Pilo - La Maschera Di Cthulhu.htm" media-type="text/html" />
<item id="RW_~Cover01" href="~Cover01.jpg" media-type="image/jpeg" />
<item id="RW_~Cover02" href="~Cover02.jpg" media-type="image/jpeg" />
<item id="RW_~Cover03" href="~Cover03.jpg" media-type="image/jpeg" />
<item id="RW_~Cover04" href="~Cover04.jpg" media-type="image/jpeg" />
<item id="RW_~Cover05" href="~Cover05.jpg" media-type="image/jpeg" />
</manifest>
<spine>
<itemref idref="Gianni_Pilo_-_La_Maschera_Di_Cthulhu" />
</spine>
<guide>
<reference type="other.ms-thumbimage-standard" href="~Cover01.jpg" />
<reference type="other.ms-coverimage-standard" href="~Cover02.jpg" />
<reference type="other.ms-titleimage-standard" href="~Cover03.jpg" />
<reference type="other.ms-thumbimage" href="~Cover04.jpg" />
<reference type="other.ms-coverimage" href="~Cover05.jpg" />
</guide>
</package>
OPF: TITLE:
OPF: CREATOR:
OPFTITLE:
OPFAUTHOR:
GUESSING COVERIMAGE: ~Cover02.jpg
Coverimage: ~Cover02.jpg
All spine elements have been added
Have Read in HTML tree from opf
FIX PRE TAGS
Saving mobi file (version 4): Gianni Pilo - La Maschera Di Cthulhu.mobi
COVEROFFSET: 0
THUMBOFFSET: 1
MobiFile.pm: before get_data()
EXTH setting data: author - 100 - - 0x
EXTH add: author - 100 -
EXTH setting data: coveroffset - 201 - 0 - 0x30
EXTH add: coveroffset - 201 - 0 - 0x30
EXTH setting data: thumboffset - 202 - 1 - 0x31
EXTH add: thumboffset - 202 - 1 - 0x31
MOBIHDR: imgrecpointer: 2
EXTH setting data: author - 100 - - 0x
EXTH add: author - 100 -
EXTH setting data: coveroffset - 201 - 0 - 0x30
EXTH add: coveroffset - 201 - 0 - 0x30
EXTH setting data: thumboffset - 202 - 1 - 0x31
EXTH add: thumboffset - 202 - 1 - 0x31
MobiFile.pm: after get_data()
Reading data from file: ~Cover02.jpg - 510 x 680 - GIF
SCALE GD: 510 680 -> 480 640
Reading data from file: ~Cover02.jpg - 510 x 680 - GIF
SCALE GD: 510 680 -> 480 640
MobiFile.pm: before Write()
Can't write a database with no name
mauro@heimdall:/tmp$
=========================================
I suspect I have some problem with XML::Parser::Lite::Tree.

I will do some experimenting.

Regards
ZioNemo

ZioNemo · 10-03-2008, 07:30 PM

Quote:

Originally Posted by ZioNemo

I suspect I have some problem with XML::Parser::Lite::Tree.

I will do some experimenting.

Ok.
Got it.

It seems my version of XML::Parser::Lite::Tree (0.08) doe not use "tag" but uses "element" as "type" (see: XML::Parser::Lite::Tree.pm) so I had to modify in Opf.pm wherever You had "if ($type eq "tag"..." to "if ($type eq "tag" or $type eq "element"..."

Essentially all the opf_get_xxx() and parse_yyy() functions in Opf.pl were failing miserably.

I can send You a patch, if You want, but the changes are really trivial.

Another glitch I found:
opf2mobi should look for the various files referenced relative to the location of the .opf file. This is not done so I'm forced to cd to the directory containing the .opf file in order to make it work.
Something like "opf2moby ctmp/Pippo.lit" dies because it is unable to find the files it needs.
I did not look to see how hard would be to fix this.

Please let me know what version of XML::Parser::Lite::Tree You are using.

Best Regards
ZioNemo

tompe · 10-03-2008, 07:54 PM

Quote:

Originally Posted by ZioNemo

Please let me know what version of XML::Parser::Lite::Tree You are using.

I am using:

Code:

invid:~> dpkg -l | grep lite-tree
ii  libxml-parser-lite-tree-perl                  0.03-2                        Lightweight XML tree builder

That is the debian unstable package. Are you using the version from CPAN?

tompe · 10-03-2008, 08:04 PM

I checked in a fix so both tag and element is OK. I probably should change to some other library...

tompe · 10-03-2008, 09:22 PM

Quote:

Originally Posted by ZioNemo

Another glitch I found:
opf2mobi should look for the various files referenced relative to the location of the .opf file. This is not done so I'm forced to cd to the directory containing the .opf file in order to make it work.
Something like "opf2moby ctmp/Pippo.lit" dies because it is unable to find the files it needs.
I did not look to see how hard would be to fix this.

I did check in a fix for this now. Hopefully it works also in Windows. At least I am pretty sure I did not break the old functionality in Windows. The reason I have not looked to much at these kind of things is that it is hard to write it so it works also in Windows without testing it in Windows.

ZioNemo · 10-04-2008, 05:29 AM

Quote:

Originally Posted by tompe

The reason I have not looked to much at these kind of things is that it is hard to write it so it works also in Windows without testing it in Windows.

When I have to be portable I use a VirtualBox Win machine to test, sometimes I use several ones (Xp, XpSp2, vista, ...). This has the added advantage I always work with a "clean" machine because I discard the changes after test and revert to the previous snapshot.

If You want I can test Your code this way.
Just tell me exactly what You want me to test... and where to find the latest version; should I get the SVN project or do I have to use some release (I didn't see it)?

While I have You on line:
Some time ago I wrote some non-trivial perl scripts to convert from TeX source to .mobi; are You interested in them?

Regards
ZioNemo

10-03-2008, 03:27 AM	#591
ZioNemo Enthusiast Posts: 48 Karma: 10 Join Date: Mar 2008 Device: HTC-p3000	Hi, I do have problems with lit2mobi under ubuntu linux. My .lit is exploded into the ctmp subdir apparently ok, but subsequent generation seems unable to parse the .opf file Same result if I try to use directly opf2mobi on the generated .opf If I debug the opf2mobi it chokes in: ... </guide> </package> no element found at /usr/local/share/perl/5.8.8/XML/Parser/LiteCopy.pm line 167 XML::Parser::LiteCopy::_final() called at /usr/local/share/perl/5.8.8/XML/Parser/LiteCopy.pm line 154 XML::Parser::LiteCopy:arse('XML::Parser::LiteCop y=HASH(0x8a6b1ac)', '<?xml version="1.0" encoding="UTF-8" ?>\x{a}<!DOCTYPE package \x{a} ...') called at /usr/local/share/perl/5.8.8/XML/Parser/Lite/Tree.pm line 49 XML::Parser::Lite::Tree:arse('XML::Parser::Lite: :Tree=HASH(0x8a3ca9c)', '<?xml version="1.0" encoding="UTF-8" ?>\x{a}<!DOCTYPE package \x{a} ...') called at /home/mauro/workspace/MobiPerl/MobiPerl/Opf.pm line 123 MobiPerl::Opf::initialize_from_file('MobiPerl::Opf =HASH(0x8a3c208)', 'ctmp/Pippo.opf') called at /home/mauro/workspace/MobiPerl/MobiPerl/Opf.pm line 29 MobiPerl::Opf::new('MobiPerl::Opf', 'ctmp/Pippo.opf') called at /home/mauro/workspace/MobiPerl/MobiPerl/Util.pm line 49 MobiPerl::Util::get_tree_from_opf('ctmp/Pippo.opf', 'MobiPerl::Config=HASH(0x8a61968)', 'MobiPerl::LinksInfo=HASH(0x8343068)') called at /home/mauro/workspace/MobiPerl/opf2mobi.pl line 96 Peculiar thing is if I just run it (no debugging) the error is different: ... </guide> </package> OPF: TITLE: OPF: CREATOR: OPFTITLE: OPFAUTHOR: Coverimage: All spine elements have been added Have Read in HTML tree from opf FIX PRE TAGS Saving mobi file (version 4): Pippo.mobi COVEROFFSET: -1 THUMBOFFSET: -1 MobiFile.pm: before get_data() EXTH setting data: author - 100 - - 0x EXTH add: author - 100 - MOBIHDR: imgrecpointer: 2 EXTH setting data: author - 100 - - 0x EXTH add: author - 100 - MobiFile.pm: after get_data() MobiFile.pm: before Write() Can't write a database with no name The effect is the same, it continues, but has an empty opf structure, so nothing is written (if I give a title on the command line it completes, but with an empty .mobi) What am I doing wrong? TiA ZioNemo

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Mobi2Mobi Mobi2Mobi v0.13 - GUI for Mobiperl tools	Jad	Kindle Formats	476	03-15-2015 05:51 PM
Tools for Editing Kindle .mobi Files?	GJN	Kindle Formats	33	12-26-2013 02:05 PM
Handy Perl Script to convert HTML0 files to smartquotes	maggotb0y	Sony Reader	0	04-12-2007 11:49 AM
PRS-500 Perl tools to generate Reader content	TadW	Sony Reader Dev Corner	0	01-08-2007 05:55 AM
gmail copy (gmcp) - Perl script to copy files to/from Gmail	Colin Dunstan	Lounge	0	09-04-2004 01:24 PM

09-14-2008, 09:46 AM	#586
tompe Grand Sorcerer Posts: 7,452 Karma: 7185064 Join Date: Oct 2007 Location: Linköpng, Sweden Device: Kindle Voyage, Nexus 5, Kindle PW	Thanks, I just uploaded it to the distribution directory also.

10-03-2008, 05:48 AM	#592
tompe Grand Sorcerer Posts: 7,452 Karma: 7185064 Join Date: Oct 2007 Location: Linköpng, Sweden Device: Kindle Voyage, Nexus 5, Kindle PW	You can always run html2mobi on the html file. If you give me the lit file I will debug it and try to fix it. It seems like the opf file is not correct or that the parser lit2mobi uses are to strict.

10-03-2008, 08:04 PM	#598
tompe Grand Sorcerer Posts: 7,452 Karma: 7185064 Join Date: Oct 2007 Location: Linköpng, Sweden Device: Kindle Voyage, Nexus 5, Kindle PW	I checked in a fix so both tag and element is OK. I probably should change to some other library...