07-24-2012, 06:23 AM | #1 |
Zealot
Posts: 116
Karma: 10
Join Date: Jun 2011
Location: Stockport, UK
Device: ipad, iphone, kindle
|
Error converting ePubs in Dropbox
I have been doing a load of library maintenance - removing duplicates - correcting series - grabbing metadata and covers.
I decided to do a full scale "convert ePub to ePub" to make sure everything was spot on with all the files. (I have over 9500 titles in library if that makes a difference) It started conversion - go 2% through lining them up to convert and I got calibre, version 0.8.61 ERROR: Unhandled exception: <b>DatabaseException</b>:disk I/O error RemoteTraceback (most recent call last): File "site-packages\calibre\library\sqlite.py", line 271, in run OperationalError: disk I/O error Traceback (most recent call last): File "site-packages\calibre\gui2\tools.py", line 178, in do_book File "site-packages\calibre\ebooks\conversion\config.py", line 45, in save_specifics File "site-packages\calibre\library\database.py", line 1168, in set_conversion_options File "site-packages\calibre\library\sqlite.py", line 314, in run DatabaseException: disk I/O error RemoteTraceback (most recent call last): File "site-packages\calibre\library\sqlite.py", line 271, in run OperationalError: disk I/O error I figured maybe there was some dross in the files choking it so I ran Modify ePub plugin - left it running overnight. Came back in morning - no error messages Checked jobs and found a note that it had been terminated as it was taking too long to run!! However, I then reran Calibre's ePub to ePub conversion and now it got 70% through lining them up to convert before choking again Any thoughts?? (There's over 150GB free space on disc concerned although they are in my Dropbox folder - which also has plenty of space online) |
07-24-2012, 06:45 AM | #2 | |
US Navy, Retired
Posts: 9,863
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
|
Quote:
I've been using dropbox and calibre for years and I have learned from experience. Good Luck. |
|
Advert | |
|
07-24-2012, 06:59 AM | #3 |
Zealot
Posts: 116
Karma: 10
Join Date: Jun 2011
Location: Stockport, UK
Device: ipad, iphone, kindle
|
worked like a dream
OK, so do I start a thread "Calibre and Dropbox fighting" |
07-24-2012, 09:30 AM | #4 | |
Well trained by Cats
Posts: 29,920
Karma: 55705262
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
Dropbox problems are NOT a Calibre problem. Calibre is designed to run on a Local PC. When you do otherwise, you takes your knocks Gracefully Sometimes (and it happens a lot) Kovid and crew will find a way to mitigate non-traditional installation problems , but don't count on it. |
|
07-24-2012, 10:35 AM | #5 |
Zealot
Posts: 116
Karma: 10
Join Date: Jun 2011
Location: Stockport, UK
Device: ipad, iphone, kindle
|
Sure - just wondering which is handling file locking incorrectly......
Last edited by DMee; 07-24-2012 at 10:55 AM. |
Advert | |
|
07-24-2012, 10:59 AM | #6 |
Well trained by Cats
Posts: 29,920
Karma: 55705262
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
|
07-24-2012, 11:04 AM | #7 |
Zealot
Posts: 116
Karma: 10
Join Date: Jun 2011
Location: Stockport, UK
Device: ipad, iphone, kindle
|
But files are held locally, then turfed to Dropbox when finished, so shouldn't hassle either??
|
07-24-2012, 11:25 AM | #8 |
creator of calibre
Posts: 43,966
Karma: 22669822
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
On windows file locking is done by the windows kernel for all files automatically. Not by programs. Therefore, neither dropbox nor calibre are handling file locking incorrectly, since neither of them do any file locking at all. You simply cannot have two programs simultaneously accessing the same set of files in both read and write modes. If you do that, things *will* break. Putting a calibre library in dropbox is a horrible hack. If you're careful, you can get away with it, but when things break, you have only yourself to blame.
|
07-24-2012, 11:36 AM | #9 |
Zealot
Posts: 116
Karma: 10
Join Date: Jun 2011
Location: Stockport, UK
Device: ipad, iphone, kindle
|
But Calibre is the one falling over? IMHO, its missing an "oooops files busy try again in a minute" setting.
More to point, why is dropbox trying to access the file if its not changed?? Its not a "horrible hack" - its lovely, allows me to use calibre2opds to access books anywhere |
07-24-2012, 11:56 AM | #10 |
Resident Curmudgeon
Posts: 74,481
Karma: 129668758
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
|
The solution is to do your conversions and whatnot locally and then copy it over to dropbox. Problem solved.
|
07-24-2012, 12:04 PM | #11 |
creator of calibre
Posts: 43,966
Karma: 22669822
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
It is a horrible hack. What it allows you to do is irrelevant to its horrible hackishness. You can put a bomb in a garbage can and sit on the lid as a wonderful way to jump up ten stories. Even if it works, that does not make it any less of a horrible hack and you really cannot complain to either the makers of the garbage can or the bomb if you end up a smear on the pavement.
And I shudder to think of what having a setting like "oops the file is busy try again later" would do to data integrity, UI predictability and code complexity. But hey, it will allow you to jump up ten stories Last edited by kovidgoyal; 07-24-2012 at 12:07 PM. |
07-24-2012, 01:08 PM | #12 |
Zealot
Posts: 116
Karma: 10
Join Date: Jun 2011
Location: Stockport, UK
Device: ipad, iphone, kindle
|
love it
Here's to jumping 10 stories Wasn't moaning. Just wondering. Now I know they don't play well I will just turn off Dropbox until finished with Calibre |
07-24-2012, 11:18 PM | #13 | |
US Navy, Retired
Posts: 9,863
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
|
Quote:
As Kovid stated: Kovid is 100% accurate. Even though putting your calibre library in a Dropbox folder has many advantages it is also a minefield that users have to be aware of. The occasional hiccup during conversion being one of those mines. The biggest mine is attempting to access your library from more than one computer and not allowing Dropbox to fully sync from the cloud prior to launching calibre. This could cause libraries on two machines to get out of sync. |
|
07-24-2012, 11:34 PM | #14 |
Grand Sorcerer
Posts: 12,236
Karma: 74000000
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
|
My approach with DropBox is while I *DO* have a copy of my library there, I use AllwaysSync to replicate to that folder from my actual library. Yes; it means I use double the space on my PC, but I also feel confident that there will be no issues with DropBox and Calibre "arguing". Syncs ONLY go from my actual library to my DropBox folder; not the other way.
|
07-24-2012, 11:39 PM | #15 | |
US Navy, Retired
Posts: 9,863
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
|
Quote:
|
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
trouble when converting many epubs to epubs | comet | Conversion | 13 | 03-21-2012 01:57 AM |
converting epubs to read on kindle | Ad2 | Calibre | 2 | 01-03-2012 06:17 AM |
Searching and converting all EPUBs I have | Giuseppe Chillem | Calibre | 3 | 11-14-2011 04:57 AM |
converting epubs | alansplace | ePub | 8 | 09-19-2010 10:30 PM |
calibre and dropbox error | modkindle | Calibre | 6 | 04-26-2010 10:57 PM |