Books corrupted sendng to device

[AlanE]

I have recently found a number of my books ending prematurely when reading on my Kindle or Cybook. On investigating I have found that PRC files added to Calibre have been converted to MOBI. (Prior to about March PRC files were stored as PRC.) At this stage the books are complete. Only when sent to the device, Cybook or Kindle, are the files apparently corrupted.

Debug output for adding and sending 2 PRC and 1 MOBI files:

calibre Debug log
calibre 0.8.7
Linux-2.6.32-32-generic-i686-with-debian-squeeze-sid
Linux
('Linux', '2.6.32-32-generic', '#62-Ubuntu SMP Wed Apr 20 21:54:21 UTC 2011')
Python 2.7.1
Linux: ('debian', 'squeeze/sid', '')
Starting up...
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1 Get device information callback returned
Job: 2 Get list of books on device started
DEBUG: 0.0 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= None
DEBUG: 0.0 USBMS: dirs are: /media/Kindle/ documents
DEBUG: 0.3 USBMS: scan from root False /media/Kindle/documents
DEBUG: 0.3 USBMS: count found in cache: 209, count of files in metadata: 209, need_sync: False
DEBUG: 0.3 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 0.3 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= carda
DEBUG: 0.3 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= cardb
DeviceJob: 2 Get list of books on device done, calling callback
DeviceJob: 2 Get list of books on device callback returned
Job: 1 Get device information finished
No details available.
Job: 2 Get list of books on device finished
No details available.
Started up in 9.21536207199
Worker Launch took: 0.224585056305
Job: 3 Read metadata (0 of 1) finished
Read metadata (0 of 1)
is not a valid Kindle serial number or PID.
K4MobiDeDRM: Calibre configuration directory = /home/alan/.config/calibre
MOBI header version = 2, length = 208
global name 'openKindleInfo' is not defined
Crypto Type is: 0
This book is not encrypted.
Success!
Failed to read MOBI cover
is not a valid Kindle serial number or PID.
K4MobiDeDRM: Calibre configuration directory = /home/alan/.config/calibre
MOBI header version = 2, length = 208
global name 'openKindleInfo' is not defined
Crypto Type is: 0
This book is not encrypted.
Success!
Failed to read MOBI cover
is not a valid Kindle serial number or PID.
K4MobiDeDRM: Calibre configuration directory = /home/alan/.config/calibre
MOBI header version = 4, length = 228
global name 'openKindleInfo' is not defined
Crypto Type is: 0
This book is not encrypted.
Success!

Added Little Boy Lost: Enlightened to db in: 0.340909957886 seconds
Added Suffer the Little Children to db in: 0.299707889557 seconds
Added preciousboy to db in: 0.516490936279 seconds
Job: 4 Upload 3 books to devicereciousboy, Suffer the Little Children, Little Boy Lost: Enlightened started
Device using plugboard mobi KINDLE2 None
Setting metadata in: preciousboy at: /tmp/calibre_0.8.7_tmp_HMWk2q/calibre_0.8.7_IMc9KKcaltmpfmt.mobi
Device using plugboard mobi KINDLE2 None
Setting metadata in: Suffer the Little Children at: /tmp/calibre_0.8.7_tmp_HMWk2q/calibre_0.8.7_dmH7licaltmpfmt.mobi
Device using plugboard mobi KINDLE2 None
Setting metadata in: Little Boy Lost: Enlightened at: /tmp/calibre_0.8.7_tmp_HMWk2q/calibre_0.8.7_tl4h2Acaltmpfmt.mobi
DEBUG: 73.7 USBMS: uploading 3 books
DEBUG: 74.0 USBMS: finished uploading 3 books
DeviceJob: 4 Upload 3 books to devicereciousboy, Suffer the Little Children, Little Boy Lost: Enlightened done, calling callback
DEBUG: 74.0 USBMS: adding metadata for 3 books
DEBUG: 74.0 USBMS: finished adding metadata
DeviceJob: 4 Upload 3 books to devicereciousboy, Suffer the Little Children, Little Boy Lost: Enlightened callback returned
Job: 5 Send metadata to device started
DEBUG: 74.1 USBMS: starting sync_booklists
DEBUG: 74.4 USBMS: finished sync_booklists
DeviceJob: 5 Send metadata to device done, calling callback
DeviceJob: 5 Send metadata to device callback returned
Job: 5 Send metadata to device finished
No details available.
Job: 4 Upload 3 books to devicereciousboy, Suffer the Little Children, Little Boy Lost: Enlightened finished
No details available.

Little Boy Lost 190275 bytes in Calibre 190323 bytes on the Kindle
Suffer the Little Children 173765 bytes in Calibre 173813 bytes on the Kindle

Have I done something really stupid or is there a problem?

[user_none]

When you open the books in your calibre library as of now they are complete? Correct?

Plug in your Kindle, use Nautilus or some other file browser and go do the device. Don't do this though calibre. Open the book for viewing using the calibre viewer. Does the full book show or is part still missing?

What I'm trying to determine is if the file really is missing part of it after a transfer or if the device is not able to show the entire file. These are two very different issues.

[AlanE]

Thanks for the quick reply!

Yes, if I open them in Calibre they are complete.

Opening via the file browser, the books added to Calibre as PRC are incomplete. The MOBI book added to Calibre is fine.

[AlanE]

I'm sorry if my reply wasn't as clear as I had intended.

Yes, if I open the books in Calibre they are complete.

If I open the books on the device (Cybook or Kindle) for viewing using the Calibre viewer, they are incomplete i.e. after the transfer they are corrupted.

This appears to be a problem with PRC format books that I have added to Calibre since March.

[speakingtohe]

Have you tried converting the prc to mobi first and then sending it?
Helen

[AlanE]

From my original post: "I have found that PRC files added to Calibre have been converted to MOBI. (Prior to about March PRC files were stored as PRC.) "

[kovidgoyal]

calibre does not convert PRC files to MOBi. You likely have a dedrm plugin that is doing that and corrupting the files in the process.

[AlanE]

Thank you so much, that was it. I thought that having done what I thought was a clean install (deleting /opt/calibre and reinstalling) I had eliminated everything but Calibre, but no, a dedrm plugin was there.

[AlanE]

I was a little premature, prc files are no longer being converted when added to Calibre. However, prc files are being corrupted sending to device.

I have now installed Calibre on a netbook which, to the best of my knowledge, hasn't previously had Calibre or dedrm plugins installed. I have added prc files to calibre. When viewed these prove to be complete. I have then sent the books to the Kindle. When viewed on the Kindle, or using the ebook viewer, they are incomplete.

Debug output:

calibre 0.8.9
Linux-2.6.32-24-generic-i686-with-debian-squeeze-sid
Linux
('Linux', '2.6.32-24-generic', '#43-Ubuntu SMP Thu Sep 16 14:17:33 UTC 2010')
Python 2.7.1
Linux: ('debian', 'squeeze/sid', '')
Starting up...
Started up in 5.70666217804
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1 Get device information callback returned
Job: 2 Get list of books on device started
DEBUG: 0.0 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= None
DEBUG: 0.0 USBMS: dirs are: /media/Kindle/ documents
Job: 1 Get device information finished
No details available.
DEBUG: 1.4 USBMS: scan from root False /media/Kindle/documents
DEBUG: 1.6 USBMS: count found in cache: 225, count of files in metadata: 225, need_sync: False
DEBUG: 1.6 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 1.6 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= carda
DEBUG: 1.6 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= cardb
DeviceJob: 2 Get list of books on device done, calling callback
DeviceJob: 2 Get list of books on device callback returned
Job: 2 Get list of books on device finished
No details available.
Job: 3 Upload 5 books to device:The 38 Million Dollar Smile, Euphorbia, Just Between Friends: Gay Male Erotica, Tricked Out, Stepping Up to the Plate started
Device using plugboard prc KINDLE2 None
Setting metadata in: The 38 Million Dollar Smile at: /tmp/calibre_0.8.9_tmp_XTrx5c/calibre_0.8.9_s21ONMcaltmpfmt.prc
Device using plugboard prc KINDLE2 None
Setting metadata in: Euphorbia at: /tmp/calibre_0.8.9_tmp_XTrx5c/calibre_0.8.9_tagWcBcaltmpfmt.prc
Device using plugboard prc KINDLE2 None
Setting metadata in: Just Between Friends: Gay Male Erotica at: /tmp/calibre_0.8.9_tmp_XTrx5c/calibre_0.8.9_6dN3VNcaltmpfmt.prc
Device using plugboard prc KINDLE2 None
Setting metadata in: Tricked Out at: /tmp/calibre_0.8.9_tmp_XTrx5c/calibre_0.8.9_pwb_pqcaltmpfmt.prc
Device using plugboard prc KINDLE2 None
Setting metadata in: Stepping Up to the Plate at: /tmp/calibre_0.8.9_tmp_XTrx5c/calibre_0.8.9_hzJGbzcaltmpfmt.prc
DEBUG: 28.0 USBMS: uploading 5 books
DEBUG: 28.6 USBMS: finished uploading 5 books
DeviceJob: 3 Upload 5 books to device:The 38 Million Dollar Smile, Euphorbia, Just Between Friends: Gay Male Erotica, Tricked Out, Stepping Up to the Plate done, calling callback
DEBUG: 28.6 USBMS: adding metadata for 5 books
DEBUG: 28.7 USBMS: finished adding metadata
DeviceJob: 3 Upload 5 books to device:The 38 Million Dollar Smile, Euphorbia, Just Between Friends: Gay Male Erotica, Tricked Out, Stepping Up to the Plate callback returned
Job: 4 Send metadata to device started
DEBUG: 28.8 USBMS: starting sync_booklists
Job: 3 Upload 5 books to device:The 38 Million Dollar Smile, Euphorbia, Just Between Friends: Gay Male Erotica, Tricked Out, Stepping Up to the Plate finished
No details available.
DEBUG: 30.4 USBMS: finished sync_booklists
DeviceJob: 4 Send metadata to device done, calling callback
DeviceJob: 4 Send metadata to device callback returned
Job: 4 Send metadata to device finished
No details available.

[kovidgoyal]

convert them from prc to mobi in calibre.