Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 02-22-2013, 05:25 PM   #391
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 14,843
Karma: 5654321
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Quote:
Originally Posted by icallaci View Post
<What the ducks says is spot on. However I am curious that you believe that runnin some Modify ePub functions is creating the issue and that it does not exist in the original ePub. If you ever hit this issue again, please PM me a link to the original ePub and the modified one along with as above what options you had ticked.>

Kiwidude, I didn't know what was causing the problem and didn't know where to start looking. I just noticed that it ONLY happened after I ran Modify ePub, but not when I ran Calibre's conversion program. Next time it happens, I'll look at the before and after OPFs to see what the difference is. TheDucks' answer makes complete sense to me. I'll post my findings (or if I can't figure it out, I'll PM you with links). Thanks. And thanks for Modify ePub, too. It makes cleaning up epubs less of a chore.
There is something else going on. I have used the Modify EPUB PI thousands of times. Never, has it made a mess of the books order.
I suspect GiGo . The PI only changes what it was told and does not validate the rest.
theducks is offline   Reply With Quote
Old 02-22-2013, 05:44 PM   #392
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,652
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
I've used Modify ePub extensively and find it works very well. Next time you have a problem, take the ePub (the one before the plugin was used) and validate it with ePubcheck and see what errors there are. Fix the errors and then when it validates, run the plugin again and see what happens.
JSWolf is online now   Reply With Quote
Old 02-22-2013, 10:28 PM   #393
icallaci
Addict
icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.
 
Posts: 235
Karma: 636268
Join Date: Sep 2012
Device: Kobo Aura H20, Kobo Aura HD, Samsung Galaxy Note 2, iPad 3
<I've used Modify ePub extensively and find it works very well. Next time you have a problem, take the ePub (the one before the plugin was used) and validate it with ePubcheck and see what errors there are. Fix the errors and then when it validates, run the plugin again and see what happens.>

Thanks, that's a good idea. I'll validate it with ePub Check, fix the errors, and run it through Modify ePub. If I see the problem pop up after that, I'll compare the OPFs. That gives me several things to try. Thanks to everyone who made suggestions.
icallaci is offline   Reply With Quote
Old 03-01-2013, 02:20 PM   #394
Barb-B
programmer wannabe
Barb-B began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Jul 2012
Device: Nook Simple Touch Glowlight; Sony PRS-T1; Kindle
I've had the same difficulty that icallaci describes with the plugin, but went a little further in trying to figure out how to work around it. I was able to isolate the result to the "Update Metadata" option. For files that will experience the problem, running the plugin with that option checked will cause the opf to fail and Sigil will create a new one in alpha order. If I re-do the process with the same book, and leave that option unchecked, the resulting opf will be acceptable.

Kiwidude - I have pm'd you links to before and after versions of a file that experienced this. Didn't want to post publicly.

Last edited by Barb-B; 03-01-2013 at 02:31 PM.
Barb-B is offline   Reply With Quote
Old 03-01-2013, 09:04 PM   #395
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,652
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by Barb-B View Post
I've had the same difficulty that icallaci describes with the plugin, but went a little further in trying to figure out how to work around it. I was able to isolate the result to the "Update Metadata" option. For files that will experience the problem, running the plugin with that option checked will cause the opf to fail and Sigil will create a new one in alpha order. If I re-do the process with the same book, and leave that option unchecked, the resulting opf will be acceptable.

Kiwidude - I have pm'd you links to before and after versions of a file that experienced this. Didn't want to post publicly.
Does the OPF (that fails) validate using epubcheck 3.0?
JSWolf is online now   Reply With Quote
Old 03-02-2013, 03:40 AM   #396
Barb-B
programmer wannabe
Barb-B began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Jul 2012
Device: Nook Simple Touch Glowlight; Sony PRS-T1; Kindle
I was unable to get 3.0 working on my machine set up as it is, and got tired of futzing around with it. However, was able to use an older version that some nice local folks had put into a GUI wrapper - and it did pass that with no errors.

Oops! (later edit) I just realized I slightly misread your question. The original version of the file passed with no errors. After running through the Modify Epub plugin, the after version produced the following errors:

date value '0101-01-01T00:00:00+00:00' is not valid, YYYY[-MM[-DD]] expected

unfinished element

unique-identifier attribute in package element must reference an existing identifier element id

Last edited by Barb-B; 03-02-2013 at 02:12 PM. Reason: additional info
Barb-B is offline   Reply With Quote
Old 03-02-2013, 12:16 PM   #397
icallaci
Addict
icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.
 
Posts: 235
Karma: 636268
Join Date: Sep 2012
Device: Kobo Aura H20, Kobo Aura HD, Samsung Galaxy Note 2, iPad 3
Barb B -- Thank you, thank you, thank you!
icallaci is offline   Reply With Quote
Old 03-02-2013, 09:48 PM   #398
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,228
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Barb B - I just dragged the epub you sent into calibre, ticked *only* the update metadata option in Modify ePub, and it all works perfectly fine.

As you say in the ePub the date field in that metadata looks a bit screwed up. I would suspect that this comes somehow from the metadata associated with the book as it exists in your calibre library. In my updated ePub this has:
Code:
<dc:date>2011-09-26T14:00:00+00:00</dc:date>
This plugin is calling standard calibre code for this feature. So I would expect you to get exactly the same result if you were to use the Save to Disk feature of calibre, where it applies the same updating of metadata.

Try that save to disk and see if you get the result I predicted. Also make sure you are only checking the Update metadata option, in case in fact it is some other option that is somehow disrupting the data.
kiwidude is offline   Reply With Quote
Old 03-03-2013, 11:11 AM   #399
icallaci
Addict
icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.icallaci ought to be getting tired of karma fortunes by now.
 
Posts: 235
Karma: 636268
Join Date: Sep 2012
Device: Kobo Aura H20, Kobo Aura HD, Samsung Galaxy Note 2, iPad 3
It seems to happen randomly for me, which is why I am having so much trouble tracking it down. The last time it happened (when I posted to ask about it), I reimported the original epub and ran it through Modify ePub, ticking just one box each time, and had no problems. It's not a big deal for me to check the order of files against the original, since it happens so rarely, but it would be nice to figure it out.
icallaci is offline   Reply With Quote
Old 03-03-2013, 02:19 PM   #400
Barb-B
programmer wannabe
Barb-B began at the beginning.
 
Posts: 21
Karma: 10
Join Date: Jul 2012
Device: Nook Simple Touch Glowlight; Sony PRS-T1; Kindle
Quote:
Originally Posted by kiwidude View Post
...
This plugin is calling standard calibre code for this feature. So I would expect you to get exactly the same result if you were to use the Save to Disk feature of calibre, where it applies the same updating of metadata.

Try that save to disk and see if you get the result I predicted. Also make sure you are only checking the Update metadata option, in case in fact it is some other option that is somehow disrupting the data.
KiwiDude - given your result with checking only "Update metadata", I'm guessing the problem may be related to a combination of selected options, and the sequence in which they occur. Here are all the other standard options I routinely use:

Remove calibre bookmark files
Remove unused image files
Remove Adobe .xpgt files and links
Remove Adobe resource DRM meta tags
Encode HTML in UTF-8
Remove all metadata jackets
Remove legacy metadata jackets
Remove broken image pages
Remove non dc: metadata elements

After running these others, and using the Calibre Save to Disk feature, the saved files don't exhibit any trouble with their opf's.

Since I care less about the "Update metadata" option than any of the others, I'd just as soon let it go, and get the other results that matter to me.

Hope that's helpful if you want to continue pursuing this issue. I'm perfectly happy to continue working around it. Either way, it's still a fantastic tool, and much appreciated!
Barb-B is offline   Reply With Quote
Old 03-03-2013, 07:17 PM   #401
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,228
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Barb-B - ok, I think I know what is happening. On my calibre I have read file metadata turned on when adding books, and I am betting you do not. So when I add to calibre, the date field calibre uses to put into the opf file is set, however I am betting you have not updated the metadata for the book, and hence that is why it is storing an invalid date in there.

This is not a bug in Modify ePub, it is really a flaw in calibre in my opinion, though Kovid may not see it that way, either that or Sigil should handle it better. As I predicted above this is the same behaviour you will see if you use the calibre Save to Disk feature to export the book, you get exactly the same "invalid" epub resulting.

So... I suggest you raise a bug request for calibre for Kovid and that way it will be fixed for all scenarios, he just needs to store a better "null date" than his current approach I believe. Of course if he disagrees then you should raise a bug request to Sigil, and ask the devs to handle that date value more effectively. Though the fact that epubcheck shows it as an error would indicate to me at least that really calibre should not be putting such a date value in there.

So for the record, the issue is occurring when the original book has this in the opf:
Code:
<dc:date opf:event="publication">2011-09-27</dc:date>
Which if calibre is not reading metadata from the book when adding, will then on save to disk (or update metadata in Modify ePub) turn it into this:
Code:
<dc:date>0101-01-01T00:00:00+00:00</dc:date>
kiwidude is offline   Reply With Quote
Old 03-03-2013, 09:48 PM   #402
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,116
Karma: 5101571
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
<dc:date>0101-01-01T00:00:00+00:00</dc:date> is a perfectly valid date as per the EPUB spec. If epubcheck is complaining about it, epubcheck is, as usual, wrong. http://idpf.org/epub/20/spec/OPF_2.0...m#Section2.2.7
kovidgoyal is offline   Reply With Quote
Old 03-03-2013, 09:56 PM   #403
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,652
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by kovidgoyal View Post
<dc:date>0101-01-01T00:00:00+00:00</dc:date> is a perfectly valid date as per the EPUB spec. If epubcheck is complaining about it, epubcheck is, as usual, wrong. http://idpf.org/epub/20/spec/OPF_2.0...m#Section2.2.7
I have just taken a look a that link and yes, <dc:date>0101-01-01T00:00:00+00:00</dc:date> is correct.
JSWolf is online now   Reply With Quote
Old 03-03-2013, 10:06 PM   #404
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 37,652
Karma: 18475502
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Sony Reader PRS-650, iPad, nook STR
Quote:
Originally Posted by Barb-B View Post
I was unable to get 3.0 working on my machine set up as it is, and got tired of futzing around with it. However, was able to use an older version that some nice local folks had put into a GUI wrapper - and it did pass that with no errors.

Oops! (later edit) I just realized I slightly misread your question. The original version of the file passed with no errors. After running through the Modify Epub plugin, the after version produced the following errors:

date value '0101-01-01T00:00:00+00:00' is not valid, YYYY[-MM[-DD]] expected

unfinished element

unique-identifier attribute in package element must reference an existing identifier element id
You will need to get epubcheck 3.0 working as this is not an error but an error is whatever version of epubcheck you used. epubcheck 3.0 says all is well. So there could be other errors in epubcheck prior to 3.0 that have been fixed in 3.0.
JSWolf is online now   Reply With Quote
Old 03-03-2013, 11:11 PM   #405
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,228
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
@JSWolf - well to be fair to Barb-B, she doesn't really care what epubcheck says, she just wants to be open the book in Sigil after doing a metadata update without having the opf corrupted. It was you that asked her to try the epubcheck route

Thanks for the reply Kovid. Given you have checked the spec and what calibre generates is correct, then that would appear to only leave Sigil as the culprit. I will drop an email to the other (i.e. active) Sigil devs and see what they have to say about it. Certainly since I see the exact same behaviour from a simple Save to Disk operation from calibre I don't feel there is anything that needs to be changed in the Modify ePub plugin concerning it.
kiwidude is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[GUI Plugin] Open With kiwidude Plugins 232 10-09-2014 12:38 AM
[GUI Plugin] Quality Check kiwidude Plugins 785 10-06-2014 05:25 PM
[GUI Plugin] Manage Series kiwidude Plugins 113 08-01-2014 08:18 PM
Modify ePub plugin dev thread kiwidude Development 346 09-02-2013 05:14 PM
[GUI Plugin] Plugin Updater **Deprecated** kiwidude Plugins 159 06-19-2011 12:27 PM


All times are GMT -4. The time now is 09:54 AM.


MobileRead.com is a privately owned, operated and funded community.