Calibre 2.2 causing premature Kindle 4 disconnect

rpspringuel · 09-05-2014, 02:22 PM

I just got a new book from Amazon.com (http://smile.amazon.com/Bible-Englis...qid=1409939685) and downloaded it to my computer using Kindle for Mac before importing it into my calibre library. Given the size of the book, I figured that rather than ask the Kindle to download the book from the Archived Items I'd load it via the USB link. However, when I tried this, the Kindle got forcibly disconnected right away (causing the OS to complain). I tried again, got the same result, tried another book (which worked fine) and then tried twice more with the same net result (though different error message, see below). Finally, on the 5th attempt, the book was successfully sent to the Kindle.

In trying this I've gotten 2 errors from calibre. The first (on the first two attempts) was:

Quote:

[Errno 13] Permission denied: u'/Volumes/Kindle/metadata.calibre'

Traceback (most recent call last):
File "site-packages/calibre/gui2/device.py", line 86, in run
File "site-packages/calibre/gui2/device.py", line 531, in _sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 395, in sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 392, in write_prefix
IOError: [Errno 13] Permission denied: u'/Volumes/Kindle/metadata.calibre'

The second (on the second two attempts):

Quote:

calibre, version 2.2.0
ERROR: Error: Error communicating with device

[Errno 9] Bad file descriptor

Traceback (most recent call last):
File "site-packages/calibre/gui2/device.py", line 86, in run
File "site-packages/calibre/gui2/device.py", line 582, in _upload_books
File "site-packages/calibre/devices/usbms/driver.py", line 270, in upload_books
File "site-packages/calibre/devices/usbms/cli.py", line 60, in put_file
IOError: [Errno 9] Bad file descriptor

Has anyone else seen this behavior? Do I have to worry about it recurring? Should I be doing something different in order to avoid the problem in the future?

Calibre 2.2
Kindle 4.1.1
Mac OS 10.8.5

JSWolf · 09-05-2014, 03:01 PM

It sounds like a problem with the Kindle. The first error is a permission error with the file metadata.calibre on the Kindle. The second errors I'm not sure about. It could be a corruption on the Kindle.

Try running whatever disk checking tool you have with OS X and see if you can find what the problem is witht he Kindle filesystem. Also, try checking the permissions and finally try moving metadata.calibre off of the Kindle. All of this without Calibre running.

Then you can try Calibre once you have done all this.

kovidgoyal · 09-05-2014, 11:45 PM

The permission denied is almost certainly because there are too many files/directories in the root of the Kindle drive and it is formatted with FAT16 instead of FAT32.

Reformatting the Kindle drive to FAT32 will most likely both.

rpspringuel · 09-12-2014, 10:32 AM

Quote:

The permission denied is almost certainly because there are too many files/directories in the root of the Kindle drive and it is formatted with FAT16 instead of FAT32.

Checked this, the Kindle is already formated FAT32. Besides, I really don't want to jailbreak the Kindle if at all possible.

Quote:

Try running whatever disk checking tool you have with OS X and see if you can find what the problem is witht he Kindle filesystem. Also, try checking the permissions

Tried all this. Couldn't find any problems. However, I also can't seem to duplicate the errors anymore, so something clearly changed. If the problem recurs I'll keep the last suggestion in mind and try that then. Doesn't seem to be much point otherwise.

JSWolf · 09-12-2014, 10:44 AM

I think you need to have your Kindle see a doctor for it's problem of premature ejectulation.

rpspringuel · 09-19-2014, 05:44 PM

Well, the error's back and now it's worse.
If calibre is open when I connect the Kindle, or if I open calibre while the Kindle is connected, the Kindle gets removed without being properly ejected (making the OS complain) shortly after calibre detects it. This happens a handful of times and then things seem to settle down and I appear to have a proper connection. However, when I then try to send a book (any book) a cycle of 2 more removals and remountings happens (and the book is not sent).

I tried all the fixes mentioned above, to no avail. I tried updating to 2.3, still experiencing the problems. Restarted both the Kindle and the computer, still experiencing the problems.

Running in debug mode I did the following:

Spoiler:

Connect kindle to OS (without calibre running)
Start calibre-debug
Wait for device detection (no problems this time)
Send a book to the device (3 removal errors from OS and an error from calibre before going back to appearing normal)
Try again with a different book (same results)

Below is the debug output for this process

Quote:

rps-mac:~ RPS$ calibre-debug -g
calibre 2.3 isfrozen: True is64bit: True
Darwin-12.5.0-x86_64-i386-64bit Darwin ('64bit', '')
('Darwin', '12.5.0', 'Darwin Kernel Version 12.5.0: Sun Sep 29 13:33:47 PDT 2013; root:xnu-2050.48.12~1/RELEASE_X86_64')
Python 2.7.8
OSX: ('10.8.5', ('', '', ''), 'x86_64')
Successfully initialized third party plugins: DeDRM && Webscription && Find Duplicates && KindleUnpack - The Plugin && Barnes & Noble && Hyphenate This! && SmartEject && Goodreads
Starting up...
Failed to load recipe from: u'Vatican_1000.recipe'
Traceback (most recent call last):
File "site-packages/calibre/web/feeds/recipes/collection.py", line 110, in get_custom_recipe_collection
IOError: [Errno 2] No such file or directory: u'/Users/RPS/Library/Preferences/calibre/custom_recipes/Vatican_1000.recipe'
libpng warning: iCCP: Not recognizing known sRGB profile that has been edited
Started up in 3.02 seconds with 298 books
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1 Get device information callback returned
Job: 2 Set library information started
DeviceJob: 2 Set library information done, calling callback
2014-09-19 17:33:02.145 Calibre[2557:707] deliverNotificationWithTitle()
DeviceJob: 2 Set library information callback returned
Job: 3 Get list of books on device started
DEBUG: 0.0 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= None
DEBUG: 0.0 USBMS: dirs are: /Volumes/Kindle 2/ documents
exception during JSON decode_from_file
Traceback (most recent call last):
File "site-packages/calibre/ebooks/metadata/book/json_codec.py", line 163, in decode_from_file
File "lib/python2.7/json/__init__.py", line 290, in load
File "lib/python2.7/json/__init__.py", line 351, in loads
File "lib/python2.7/json/decoder.py", line 366, in decode
File "lib/python2.7/json/decoder.py", line 384, in raw_decode
ValueError: No JSON object could be decoded
DEBUG: 0.0 USBMS: scan from root False /Volumes/Kindle 2/documents
* Notification delivered.
Job: 2 Set library information finished
No details available.
Job: 1 Get device information finished
No details available.
Failed to read MOBI cover
Failed to read MOBI cover
Failed to read MOBI cover
Failed to read MOBI cover
DEBUG: 2.4 USBMS: count found in cache: 0, count of files in metadata: 87, need_sync: False
DEBUG: 2.4 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 2.4 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= carda
DEBUG: 2.4 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= cardb
DeviceJob: 3 Get list of books on device done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 87
Job: 3 Get list of books on device finished
No details available.
DeviceJob: set_books_in_library finished: time= 0.0167779922485
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
DeviceJob: 3 Get list of books on device callback returned
Job: 3 Get list of books on device finished
No details available.
2014-09-19 17:35:15.381 Calibre[2616:707] deliverNotificationWithTitle()
* Notification delivered.
Job: 4 Upload 1 books to device:The Conferences of John Cassian started
Device using plugboard azw3 KINDLE2 None
Setting metadata in: The Conferences of John Cassian at: /var/folders/7r/jmxwxnms3jl6hptxkfymx3800000gq/T/calibre_2.3.0_tmp_Bz4j4W/oglIsvcaltmpfmt.azw3
DEBUG: 134.8 USBMS: uploading 1 books
Invalid method choice for this book (u'none'), ignoring.
APNX META: guid: 9a209fc5
APNX META: ASIN: ebdbf7ad-dcdb-4e11-b32f-4d069f97b9f6
APNX META: CDE: EBOK
APNX META: format: MOBI_8
APNX META: Name: The_Conferences_of_John_Cassian
APNX Content Header: {"contentGuid":"9a209fc5","asin":"ebdbf7ad-dcdb-4e11-b32f-4d069f97b9f6","cdeType":"EBOK","format":"MOBI_8"," fileRevisionId":"1","acr":"The_Conferences_of_John _Cassian"}
DEBUG: 134.8 USBMS: finished uploading 1 books
DeviceJob: 4 Upload 1 books to device:The Conferences of John Cassian done, calling callback
DEBUG: 134.8 USBMS: adding metadata for 1 books
DEBUG: 134.8 USBMS: finished adding metadata
DeviceJob: set_books_in_library: books to process= 88
DeviceJob: set_books_in_library finished: time= 0.00594615936279
DeviceJob: 4 Upload 1 books to device:The Conferences of John Cassian callback returned
Job: 5 Send metadata to device started
DEBUG: 135.2 USBMS: starting sync_booklists
DeviceJob: 5 Send metadata to device done, calling callback
[Errno 13] Permission denied: u'/Volumes/Kindle 2/metadata.calibre'

Traceback (most recent call last):
File "site-packages/calibre/gui2/device.py", line 87, in run
File "site-packages/calibre/gui2/device.py", line 532, in _sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 395, in sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 392, in write_prefix
IOError: [Errno 13] Permission denied: u'/Volumes/Kindle 2/metadata.calibre'

DeviceJob: 5 Send metadata to device callback returned
Job: 4 Upload 1 books to device:The Conferences of John Cassian finished
No details available.
Job: 5 Send metadata to device finished
[Errno 13] Permission denied: u'/Volumes/Kindle 2/metadata.calibre'

Traceback (most recent call last):
File "site-packages/calibre/gui2/device.py", line 87, in run
File "site-packages/calibre/gui2/device.py", line 532, in _sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 395, in sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 392, in write_prefix
IOError: [Errno 13] Permission denied: u'/Volumes/Kindle 2/metadata.calibre'

Job: 6 Get device information started
DeviceJob: 6 Get device information done, calling callback
DeviceJob: 6 Get device information callback returned
Job: 7 Set library information started
DeviceJob: 7 Set library information done, calling callback
2014-09-19 17:35:40.844 Calibre[2660:707] deliverNotificationWithTitle()
DeviceJob: 7 Set library information callback returned
Job: 8 Get list of books on device started
DEBUG: 158.7 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= None
DEBUG: 158.7 USBMS: dirs are: /Volumes/Kindle 3/ documents
exception during JSON decode_from_file
Traceback (most recent call last):
File "site-packages/calibre/ebooks/metadata/book/json_codec.py", line 163, in decode_from_file
File "lib/python2.7/json/__init__.py", line 290, in load
File "lib/python2.7/json/__init__.py", line 351, in loads
File "lib/python2.7/json/decoder.py", line 366, in decode
File "lib/python2.7/json/decoder.py", line 384, in raw_decode
ValueError: No JSON object could be decoded
DEBUG: 158.7 USBMS: scan from root False /Volumes/Kindle 3/documents
* Notification delivered.
Job: 6 Get device information finished
No details available.
Job: 7 Set library information finished
No details available.
Failed to read MOBI cover
Failed to read MOBI cover
Failed to read MOBI cover
Failed to read MOBI cover
DEBUG: 162.0 USBMS: count found in cache: 0, count of files in metadata: 87, need_sync: False
DEBUG: 162.0 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 162.0 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= carda
DEBUG: 162.0 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= cardb
DeviceJob: 8 Get list of books on device done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 87
DeviceJob: set_books_in_library finished: time= 0.00887393951416
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
DeviceJob: 8 Get list of books on device callback returned
Job: 8 Get list of books on device finished
No details available.
2014-09-19 17:36:37.658 Calibre[2683:707] deliverNotificationWithTitle()
* Notification delivered.
Job: 9 Upload 1 books to device:The Sign of the Four started
Device using plugboard azw3 KINDLE2 None
Setting metadata in: The Sign of the Four at: /var/folders/7r/jmxwxnms3jl6hptxkfymx3800000gq/T/calibre_2.3.0_tmp_Bz4j4W/Tz7coYcaltmpfmt.azw3
DEBUG: 216.4 USBMS: uploading 1 books
Invalid method choice for this book (u'none'), ignoring.
Failed to generate APNX
Traceback (most recent call last):
File "site-packages/calibre/devices/kindle/driver.py", line 491, in upload_apnx
File "site-packages/calibre/devices/kindle/apnx.py", line 37, in write_apnx
File "site-packages/calibre/ebooks/pdb/header.py", line 18, in __init__
File "site-packages/calibre/ebooks/pdb/header.py", line 24, in identity
IOError: [Errno 6] Device not configured
DEBUG: 216.4 USBMS: finished uploading 1 books
DeviceJob: 9 Upload 1 books to device:The Sign of the Four done, calling callback
DEBUG: 216.4 USBMS: adding metadata for 1 books
DEBUG: 216.4 USBMS: finished adding metadata
DeviceJob: set_books_in_library: books to process= 88
Job: 9 Upload 1 books to device:The Sign of the Four finished
No details available.
DeviceJob: set_books_in_library finished: time= 0.0195710659027
DeviceJob: 9 Upload 1 books to device:The Sign of the Four callback returned
Job: 10 Send metadata to device started
DEBUG: 216.9 USBMS: starting sync_booklists
DeviceJob: 10 Send metadata to device done, calling callback
[Errno 13] Permission denied: u'/Volumes/Kindle 3/metadata.calibre'

Traceback (most recent call last):
File "site-packages/calibre/gui2/device.py", line 87, in run
File "site-packages/calibre/gui2/device.py", line 532, in _sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 395, in sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 392, in write_prefix
IOError: [Errno 13] Permission denied: u'/Volumes/Kindle 3/metadata.calibre'

DeviceJob: 10 Send metadata to device callback returned
Job: 9 Upload 1 books to device:The Sign of the Four finished
No details available.
Job: 10 Send metadata to device finished
[Errno 13] Permission denied: u'/Volumes/Kindle 3/metadata.calibre'

Traceback (most recent call last):
File "site-packages/calibre/gui2/device.py", line 87, in run
File "site-packages/calibre/gui2/device.py", line 532, in _sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 395, in sync_booklists
File "site-packages/calibre/devices/usbms/driver.py", line 392, in write_prefix
IOError: [Errno 13] Permission denied: u'/Volumes/Kindle 3/metadata.calibre'

Job: 11 Get device information started
DeviceJob: 11 Get device information done, calling callback
2014-09-19 17:37:08.703 Calibre[2734:707] deliverNotificationWithTitle()
DeviceJob: 11 Get device information callback returned
Job: 12 Set library information started
DeviceJob: 12 Set library information done, calling callback
DeviceJob: 12 Set library information callback returned
Job: 13 Get list of books on device started
DEBUG: 246.6 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= None
DEBUG: 246.6 USBMS: dirs are: /Volumes/Kindle 4/ documents
exception during JSON decode_from_file
Traceback (most recent call last):
File "site-packages/calibre/ebooks/metadata/book/json_codec.py", line 163, in decode_from_file
File "lib/python2.7/json/__init__.py", line 290, in load
File "lib/python2.7/json/__init__.py", line 351, in loads
File "lib/python2.7/json/decoder.py", line 366, in decode
File "lib/python2.7/json/decoder.py", line 384, in raw_decode
ValueError: No JSON object could be decoded
DEBUG: 246.6 USBMS: scan from root False /Volumes/Kindle 4/documents
* Notification delivered.
Job: 11 Get device information finished
No details available.
Job: 12 Set library information finished
No details available.
Failed to read MOBI cover
Failed to read MOBI cover
Failed to read MOBI cover
Failed to read MOBI cover
DEBUG: 249.8 USBMS: count found in cache: 0, count of files in metadata: 87, need_sync: False
DEBUG: 249.8 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 249.8 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= carda
DEBUG: 249.8 USBMS: Fetching list of books from device. Device= KINDLE2 oncard= cardb
DeviceJob: 13 Get list of books on device done, calling callback
DeviceJob: metadata_downloaded: Starting set_books_in_library
DeviceJob: set_books_in_library: books to process= 87
DeviceJob: set_books_in_library finished: time= 0.0106639862061
DeviceJob: metadata_downloaded: updating views
DeviceJob: metadata_downloaded: syncing
DeviceJob: metadata_downloaded: refreshing ondevice
DeviceJob: metadata_downloaded: sending metadata_available signal
DeviceJob: 13 Get list of books on device callback returned
Job: 13 Get list of books on device finished
No details available.

Any further ideas, suggestions?

JSWolf · 09-19-2014, 05:49 PM

This is your problem right here

Code:

IOError: [Errno 13] Permission denied: u'/Volumes/Kindle 3/metadata.calibre'

You have a permission error witht he file metadata.calibre that's on your Kindle. Try deleting that file and see if it works. Also with the Kindle plugged into the USB port, (without Calibre running), check the Kindle filesystem for errors. Also check the permission for /Volumes/Kindle 3/ and see what's going on.

This is not a Calibre problem. It's something either on your computer or the Kindle.

Another thing to try is to give a factory format to the Kindle and then see if it works from there.

rpspringuel · 09-20-2014, 04:04 PM

Quote:

You have a permission error witht he file metadata.calibre that's on your Kindle. Try deleting that file and see if it works. Also with the Kindle plugged into the USB port, (without Calibre running), check the Kindle filesystem for errors.

I tried all of that before posting. Couldn't find any problems, but still was getting the errors.

Quote:

Also check the permission for /Volumes/Kindle 3/ and see what's going on.

Permissions indicate that rwx for user and r-x for everyone else, the same as all other external drives connected to the system.

Quote:

This is not a Calibre problem. It's something either on your computer or the Kindle.

If it's not a Calibre problem, then why does the problem only occur when Calibre is running? The Kindle connects to the computer just fine when calibre isn't open.

Quote:

Another thing to try is to give a factory format to the Kindle and then see if it works from there.

Tried this. Still seeing the same error, but it isn't all the time now.

I've got it working at the moment, and checking the permissions I see that the current mount point has rwx access for all users (not just current) but the group is just me (not admin). So I guess this is a permissions issue, and calibre, for whatever reason, isn't considered a current user operation when it tries to write (raising the permissions error). Whereas anything I do through Finder is (and thus works). Why that would cause a force removal of the Kindle, I don't know, but it's what appears to be happening.

So, maybe not a calibre problem, but still one that's only showing up in conjunction with calibre and has me stumped.

kovidgoyal · 09-20-2014, 10:52 PM

Your device is failing. The failure is showing up only when you use it with calibre because calibre does the most with it.

JSWolf · 09-21-2014, 05:46 PM

Quote:

Originally Posted by rpspringuel

So, maybe not a calibre problem, but still one that's only showing up in conjunction with calibre and has me stumped.

It's failing with Calibre because Calibre tires to access the Kindle once it sees it. Calibre reads/writes to the device and your OS doesn't. Since it's working now, let's hope it keeps on working. If you've not done something to the device and it fails, it may be time to get a new Kindle.

09-19-2014, 05:49 PM	#7
JSWolf Resident Curmudgeon Posts: 79,029 Karma: 144284074 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	This is your problem right here Code: IOError: [Errno 13] Permission denied: u'/Volumes/Kindle 3/metadata.calibre' You have a permission error witht he file metadata.calibre that's on your Kindle. Try deleting that file and see if it works. Also with the Kindle plugged into the USB port, (without Calibre running), check the Kindle filesystem for errors. Also check the permission for /Volumes/Kindle 3/ and see what's going on. This is not a Calibre problem. It's something either on your computer or the Kindle. Another thing to try is to give a factory format to the Kindle and then see if it works from there.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Tablet Nook causing Calibre crash	slyvella	Nook Color & Nook Tablet	1	04-29-2014 09:21 PM
Calibre 1.0 Causing System to Crash	seacity1	Calibre	0	08-26-2013 11:53 AM
Using Multiple Kobo causing problems with Calibre	R1_guy	Kobo Reader	5	10-26-2011 05:07 PM
is it possible that Calibre is causing this issue?	Nana Sarah	Calibre	1	08-19-2011 04:43 PM
Calibre & Sony Software -- doing the disconnect dance	digitig	Calibre	2	12-03-2009 11:16 AM

09-05-2014, 03:01 PM	#2
JSWolf Resident Curmudgeon Posts: 79,029 Karma: 144284074 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	It sounds like a problem with the Kindle. The first error is a permission error with the file metadata.calibre on the Kindle. The second errors I'm not sure about. It could be a corruption on the Kindle. Try running whatever disk checking tool you have with OS X and see if you can find what the problem is witht he Kindle filesystem. Also, try checking the permissions and finally try moving metadata.calibre off of the Kindle. All of this without Calibre running. Then you can try Calibre once you have done all this.

09-05-2014, 11:45 PM	#3
kovidgoyal creator of calibre Posts: 45,170 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	The permission denied is almost certainly because there are too many files/directories in the root of the Kindle drive and it is formatted with FAT16 instead of FAT32. Reformatting the Kindle drive to FAT32 will most likely both.

09-12-2014, 10:44 AM	#5
JSWolf Resident Curmudgeon Posts: 79,029 Karma: 144284074 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	I think you need to have your Kindle see a doctor for it's problem of premature ejectulation.

09-20-2014, 10:52 PM	#9
kovidgoyal creator of calibre Posts: 45,170 Karma: 27110894 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Your device is failing. The failure is showing up only when you use it with calibre because calibre does the most with it.