Kindle Fire and Calibre

[gweminence]

Here you go, Kovid:

Spoiler:

calibre Debug log
calibre 0.8.27
Windows-7-6.1.7601-SP1
Windows
('Windows', '7', '6.1.7601')
Python 2.7.1
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Failed to initialize plugin: u'C:\\Users\\Greg\\AppData\\Roaming\\calibre\\plug ins\\Goodreads Metadata.zip'
Traceback (most recent call last):
File "site-packages\calibre\customize\ui.py", line 516, in initialize_plugins
File "site-packages\calibre\customize\ui.py", line 54, in load_plugin
File "site-packages\calibre\customize\zipplugin.py", line 169, in load
File "importlib\__init__.py", line 37, in import_module
File "site-packages\calibre\customize\zipplugin.py", line 150, in load_module
File "calibre_plugins.dummy1.__init__", line 15, in <module>
ImportError: No module named fetch
Failed to initialize plugin: u'C:\\Users\\Greg\\AppData\\Roaming\\calibre\\plug ins\\Goodreads Covers.zip'
Traceback (most recent call last):
File "site-packages\calibre\customize\ui.py", line 516, in initialize_plugins
File "site-packages\calibre\customize\ui.py", line 54, in load_plugin
File "site-packages\calibre\customize\zipplugin.py", line 167, in load
File "site-packages\calibre\customize\zipplugin.py", line 150, in load_module
File "calibre_plugins.dummy1.__init__", line 16, in <module>
ImportError: No module named covers
Starting up...
Started up in 3.99300003052 with 2730 books
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1 Get device information callback returned
Job: 2 Get list of books on device started
DEBUG: 0.0 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= None
DEBUG: 0.0 USBMS: dirs are: H:\
DEBUG: 0.0 USBMS: scan from root False H:\
DEBUG: 0.0 USBMS: count found in cache: 1, count of files in metadata: 0, need_sync: True
DEBUG: 0.0 USBMS: starting sync_booklists
DEBUG: 0.1 USBMS: finished sync_booklists
DEBUG: 0.1 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 0.1 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= carda
DEBUG: 0.1 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= cardb
DeviceJob: 2 Get list of books on device done, calling callback
READING LIST: Metadata available: {'main': {u'device_store_uuid': u'ade7b6ac-2aa9-45ca-8a7c-e201d07e3dd4', u'prefix': 'H:/', u'device_name': u'Fire', u'calibre_version': u'0.8.27', u'location_code': 'main', u'last_library_uuid': u'f8102d26-e28f-4fbc-8521-1f7b62ce1335', u'date_last_connected': u'2011-11-19T01:49:08.982000+00:00'}}
READING LIST: Sync Now - force_sync= False
DeviceJob: 2 Get list of books on device callback returned
Job: 3 Send metadata to device started
DEBUG: 0.2 USBMS: starting sync_booklists
Job: 1 Get device information finished
No details available.
Job: 2 Get list of books on device finished
No details available.
DEBUG: 0.3 USBMS: finished sync_booklists
DeviceJob: 3 Send metadata to device done, calling callback
DeviceJob: 3 Send metadata to device callback returned
Job: 3 Send metadata to device finished
No details available.
Job: 4 Upload 1 books to device:Neverwinter started
Device using plugboard mobi KINDLE_FIRE None
Setting metadata in: Neverwinter at: c:\users\greg\appdata\local\temp\calibre_0.8.27_tm p_n834d4\nizuybcaltmpfmt.mobi
DEBUG: 64.5 USBMS: uploading 1 books
DEBUG: 65.7 USBMS: finished uploading 1 books
DeviceJob: 4 Upload 1 books to device:Neverwinter done, calling callback
DEBUG: 65.7 USBMS: adding metadata for 1 books
DEBUG: 65.7 USBMS: finished adding metadata
DeviceJob: 4 Upload 1 books to device:Neverwinter callback returned
Job: 5 Send metadata to device started
DEBUG: 65.8 USBMS: starting sync_booklists
DEBUG: 65.9 USBMS: finished sync_booklists
DeviceJob: 5 Send metadata to device done, calling callback
DeviceJob: 5 Send metadata to device callback returned
Job: 5 Send metadata to device finished
No details available.
Job: 4 Upload 1 books to device:Neverwinter finished
No details available.
READING LIST: Device disconnected
Job: 6 Get device information started
DeviceJob: 6 Get device information done, calling callback
DeviceJob: 6 Get device information callback returned
Job: 7 Get list of books on device started
DEBUG: 100.1 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= None
DEBUG: 100.1 USBMS: dirs are: H:\
DEBUG: 100.1 USBMS: scan from root False H:\
DEBUG: 100.1 USBMS: count found in cache: 1, count of files in metadata: 0, need_sync: True
DEBUG: 100.1 USBMS: starting sync_booklists
DEBUG: 100.2 USBMS: finished sync_booklists
DEBUG: 100.2 USBMS: Finished fetching list of books from device. oncard= None
DEBUG: 100.2 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= carda
DEBUG: 100.2 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= cardb
DeviceJob: 7 Get list of books on device done, calling callback
READING LIST: Metadata available: {'main': {u'device_store_uuid': u'ade7b6ac-2aa9-45ca-8a7c-e201d07e3dd4', u'location_code': 'main', u'device_name': u'Fire', u'calibre_version': u'0.8.27', u'prefix': 'H:/', u'last_library_uuid': u'f8102d26-e28f-4fbc-8521-1f7b62ce1335', u'date_last_connected': u'2011-11-19T01:50:49.121000+00:00'}}
READING LIST: Sync Now - force_sync= False
DeviceJob: 7 Get list of books on device callback returned
Job: 8 Send metadata to device started
DEBUG: 100.4 USBMS: starting sync_booklists
DEBUG: 100.4 USBMS: finished sync_booklists
DeviceJob: 8 Send metadata to device done, calling callback
DeviceJob: 8 Send metadata to device callback returned
Job: 7 Get list of books on device finished
No details available.
Job: 8 Send metadata to device finished
No details available.
Job: 6 Get device information finished
No details available.

In this case, I started calibre, plugged in my Fire, sent 'Neverwinter' to my Fire, (at this point, the green check mark IS ticked in the automatic 'on device' column), unplugged my fire, and then plugged it back in, at which point, calibre no longer sees Neverwinter as being on my device.

Let me know if you want me to test it some other way.

[wallcraft]

I copied about 1,000 ebooks to my Fire, but they don't show up on reconnect. Debug output:

Started up in 40.493999958 with 1393 books
Job: 1 Get device information started
DeviceJob: 1 Get device information done, calling callback
DeviceJob: 1 Get device information callback returned
Job: 2 Get list of books on device started
DEBUG:    0.0 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= None
DEBUG:    0.0 USBMS: dirs are: D:\ 
DEBUG:    0.0 USBMS: scan from root False D:\
DEBUG:    0.0 USBMS: count found in cache: 0, count of files in metadata: 0, need_sync: False
DEBUG:    0.0 USBMS: Finished fetching list of books from device. oncard= None
DEBUG:    0.0 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= carda
DEBUG:    0.0 USBMS: Fetching list of books from device. Device= KINDLE_FIRE oncard= cardb
DeviceJob: 2 Get list of books on device done, calling callback
DeviceJob: 2 Get list of books on device callback returned
Job: 1 Get device information finished
No details available.
Job: 2 Get list of books on device finished
No details available.

There is a driveinfo.calibre and a metadata.calibre fire in the root of the Kindle Fire partition, but they appear to only contain 2 bytes: "[]".

[wallcraft]

I reconnected and wrote 4 ebooks to the Fire. The metadata.calibre file contained info on all 4 ebooks. Disconnected and then reconnected again. On connection the metadata.calibre file looked good, but when Calibre detected the Fire the metadata.calibre file was again zeroed out and the 4 ebooks were not marked as being on the Fire.

[kovidgoyal]

I've uploaded a build which *should* fix this, here; http://calibre-ebook.com/downloads/betas/

Please test, if it works, I'll upload the fixed builds for all platforms to the main calibre download site.

You should just be able to install on top of your existing calibre installation

[gweminence]

Worked for me, Kovid, thanks! It even picked up the books that were there previously, now (from calibre), which'll probably make wallman's day, since he won't have to reload all those books!

@wallman: nice catch, if that's what it wound up being. I'm not technical enough to have known to check that.

[gweminence]

For the record, I tested the remove functionality (from the device), and it worked fine, as well.

[wallcraft]

Originally Posted by kovidgoyal

Please test, if it works, I'll upload the fixed builds for all platforms to the main calibre download site.

It works for me.

A few .txt files are showing up as "on device" even though they are not in Documents or Books (one is in D:\Books\.MoonReader for example and another is in D:\Music\temp). This isn't a major issue.

[kovidgoyal]

Yeah the driver now scans the entire memory for ebook files. It is possible to restrict it to just Documents and Books but IMO it's better if it shows all files.

[kovidgoyal]

Fixed builds uploaded to main site.

[TonytheBookworm]

First and foremost. Thanks for keeping Calibre updated and user friendly. I have a question. I realize the Fire is new but has anyone had issues with the calibre webserver and the fire? I know Kovid made a driver for the fire that works with the usb cable just fine. I however like to access my books via the web and download them from my server at home. Currently I can access my server and then click on get and it downloads the book but it says can not open file as if it is encrypted but it isn't. They are dmr free books

[wallcraft]

Originally Posted by TonytheBookworm

Currently I can access my server and then click on get and it downloads the book but it says can not open file as if it is encrypted but it isn't. They are dmr free books

See Side loading books on the Fire. Some of the posts in that thread report that the Reader app open fails but the ebook is in Books when they look (also look in Docs), but others say they have to move the file explicitly to the Books folder (or Documents, it does not matter which), using a file manager app, and it then takes a reboot for them to show up.

[TonytheBookworm]

Originally Posted by wallcraft

See Side loading books on the Fire. Some of the posts in that thread report that the Reader app open fails but the ebook is in Books when they look (also look in Docs), but others say they have to move the file explicitly to the Books folder (or Documents, it does not matter which), using a file manager app, and it then takes a reboot for them to show up.

I will just wait and hopefully someone can figure out an easier way to get it to work. That is one of the features I like about Calibre is the webserver function.

[DoctorOhh]

Originally Posted by TonytheBookworm

I will just wait and hopefully someone can figure out an easier way to get it to work. That is one of the features I like about Calibre is the webserver function.

Someone may figure out an easier way for it to work, but that most likely will come from asking in the Kindle Fire forum. Calibre serves the book via a web page just like it does for any other device, so the change most likely won't occur in calibre.

Is the downloaded book there after you reboot your device?

[TonytheBookworm]

Originally Posted by dwanthny

Someone may figure out an easier way for it to work, but that most likely will come from asking in the Kindle Fire forum. Calibre serves the book via a web page just like it does for any other device, so the change most likely won't occur in calibre.

Is the downloaded book there after you reboot your device?

yes shows up just fine when you reboot. I will continue this in the kindle fire forum

[mkgtu]

In another thread, noticed someone having this problem with Kindle Touch also, but the partial workaround suggested there doesn't seem to work with Fire.

Basically, all news/periodical files transferred from calibre to Fire, either via USB or Email, show up OK as .mobi files. But they are all rendered as Books, i.e. they have no navigational controls (e.g., sections/article lists, etc). Just as with a book, you can "Go To . . ." the Table of Contents and navigate to a single article, but would have to repeat that procedure for each article.

Will send request to Amazon to look into the issue. Suggest others might do the same. Or some maybe some genius can figure out a fix. This behavior renders any kind of use of Calibre's "news" feature with the Kindle Fire (or the Touch) pretty useless.