Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 11-04-2014, 09:13 PM   #61
rjh4242
Member
rjh4242 can extract oil from cheeserjh4242 can extract oil from cheeserjh4242 can extract oil from cheeserjh4242 can extract oil from cheeserjh4242 can extract oil from cheeserjh4242 can extract oil from cheeserjh4242 can extract oil from cheeserjh4242 can extract oil from cheese
 
Posts: 16
Karma: 1000
Join Date: Oct 2009
Device: Kobo h2o, Kindle Paperwhite, Marvin on iPad/iPhone
I agree that the malformed database problem is likely to be related to the number of books in the Marvin library. I am running calibre 2.8 64-bit on a Windows 8.1 computer, connecting to an iPhone 4s running ios8.1 and an iPad 3rd gen running ios 8.1.

With the new DLLs, the iPhone is fine, but I only keep about 200 books on it, and transfer only a few (say up to 5) at a time.

I had over 3000 books on my iPad, and when calibre was trying to detect it I immediately got the "database malformed" error. I uninstalled Marvin from my iPad and reinstalled it. No problem with calibre connecting when the library was empty. Transferring over 3000 books resulted in the job uploading the books saying it had finished successfully but the subsequent (related) job to update the metadata failing with the "database malformed" error message.

I uninstalled and reinstalled Marvin on the iPad again. Transferring 600 books worked fine, no errors, calibre could connect to the iPad fine. Transferring another 600 books worked fine. I carried on transferring 600 books at a time until I was on the last 650. Calibre told me the upload job finished successfully, but again the subsequent metadata update failed with the "database malformed" error. All the books are on the iPad, but I now get the "database malformed" error when I try to connect calibre to the device.

I uninstalled and reinstalled Marvin again on the iPad, and tried transferring 2500 books at once. That worked fine and calibre had no trouble connecting to the iPad after a disconnect/reconnect/restart calibre.

I then added books 100 at a time. All was fine until I was on the 3rd lot of 100, when again the metadata job after the upload errored out with the "database malformed" error.

So I'm thinking that somewhere above 2700 books in Marvin causes a problem.
rjh4242 is offline   Reply With Quote
Old 11-05-2014, 12:36 AM   #62
Zebedi
Member
Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.Zebedi got an A in P-Chem.
 
Posts: 16
Karma: 6256
Join Date: Nov 2014
Location: Perth, Western Australia
Device: IPad Pro 12.9, 10.5, IPhone SE
I only got to 1218 when the malformed database error appeared, and in fact the message appeared while transferring the last 29, though they did transfer, but they were the last.
Zebedi is offline   Reply With Quote
Advert
Old 11-05-2014, 03:18 AM   #63
Josieb1
Wizard
Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.Josieb1 ought to be getting tired of karma fortunes by now.
 
Posts: 4,542
Karma: 12691930
Join Date: Nov 2009
Device: KVoyage, KOasis 2, KPW4, FHD8
Quote:
Originally Posted by ShellShock View Post
One of two things need to happen first: either we confirm the "malformed database" error is not caused by the new dlls, or we confirm it is (and the old ones are OK) and I managed to fix it.
Thank you. Will you post something somewhere when it's all official so I know what to upload, either a new calibre version or an update to the plug in. Or do I just keep an eye on the updates within Calibre?
Josieb1 is offline   Reply With Quote
Old 11-05-2014, 05:16 AM   #64
ShellShock
Wizard
ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.
 
ShellShock's Avatar
 
Posts: 1,150
Karma: 2429484
Join Date: Sep 2008
Device: IPad Mini 2 Retina
Best bet is to keep an idea on this thread. I have not thought yet about how to get any fixed dlls into Calibre.
ShellShock is offline   Reply With Quote
Old 11-05-2014, 05:47 AM   #65
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
PeterT's Avatar
 
Posts: 10,842
Karma: 61597503
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
Not to be stupid, but how do the original DLLs get there? If they are installed during the calibre installation, then the obvious solution is for kovid to include them in the next release.
PeterT is offline   Reply With Quote
Advert
Old 11-05-2014, 07:33 AM   #66
ShellShock
Wizard
ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.
 
ShellShock's Avatar
 
Posts: 1,150
Karma: 2429484
Join Date: Sep 2008
Device: IPad Mini 2 Retina
Yes, but Kovid may want to build them from source (https://github.com/Polyfun/libimobiledevice-windows)--I assume this is how the current dlls get into the Calibre build. Anyway, I would like to try and get the malformed database error fixed first, if possible.

Last edited by ShellShock; 11-05-2014 at 11:47 AM.
ShellShock is offline   Reply With Quote
Old 11-05-2014, 07:53 AM   #67
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 36,761
Karma: 16422043
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
I will definitely want to build them from source. Everything in the calibre windows build is built from source (except for the Microsoft C runtimes).

But I will wait to do so until ShellShock tells me he is ready.
kovidgoyal is offline   Reply With Quote
Old 11-05-2014, 01:32 PM   #68
MSWallack
Right, Except When Wrong
MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.MSWallack ought to be getting tired of karma fortunes by now.
 
MSWallack's Avatar
 
Posts: 317
Karma: 1179439
Join Date: Aug 2007
Location: Indianapolis
Device: Kindle Oasis 3 (sometimes iPad Mini).
Given the number of books I have in Marvin, I'll hold off trying to test things...
MSWallack is offline   Reply With Quote
Old 11-05-2014, 02:03 PM   #69
stanhere
Member
stanhere began at the beginning.
 
Posts: 13
Karma: 20
Join Date: Oct 2014
Device: iPad Retina 4th gen + Marvin v2.8 & Calibre v2.9 on W7 64
For Zebedi, rjh4242 & other W7 64 Calibre + Marvin + iPad users:

After importing ShellShock's "magic" 'DLL trio' to my 64bit Calibre v2.7 & again to v2.8 .....successfully!! ....., I also suddenly received the "Malformed database disk image" exception \ complaint.

After futzing around, I finally "cleared" out my Marvin iPad book database by simply uninstalling, shutting down & re-installing Marvin v2.8 on my iPad, updated to OS 8.1.

After re-connecting the iPad with an "empty Marvin" to W7 \ Calibre ....finally voila!!!!!

Reloaded Marvin's database by transferring batches of books from my Calibre library, 150 to no more than 250 at a time' until I successfully topped off at 2,214. Plus in the last two days, I've incrementally added more to a present total of 2,248.

So far Marvin's iPad DB remains UN-malformed AND All software & All Devices continue to Play Well Together!

Again, Lots of Appreciation due from W7 based users to ShellShock

Last edited by stanhere; 11-05-2014 at 02:09 PM.
stanhere is offline   Reply With Quote
Old 11-05-2014, 02:08 PM   #70
ShellShock
Wizard
ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.ShellShock ought to be getting tired of karma fortunes by now.
 
ShellShock's Avatar
 
Posts: 1,150
Karma: 2429484
Join Date: Sep 2008
Device: IPad Mini 2 Retina
I would be grateful if someone who gets the malformed database error could be a guinea pig and generate a debug log for me when the error occurs:

Customise the IOS reader and Marvin plugins to enable debug logging (two check boxes each).
Right click the Perferences toolbar button in Calibre and choose Restart in debug mode.
Reproduce the problem, starting with a good database and send a bunch of books until the problem occurs.

Warning - the debug log may get very big, and we may need several goes at this (e.g., I may need to add more debug logging to the code).

Thanks
ShellShock is offline   Reply With Quote
Old 11-05-2014, 04:28 PM   #71
Terisa de morgan
Grand Sorcerer
Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.
 
Terisa de morgan's Avatar
 
Posts: 5,427
Karma: 5757254
Join Date: Jun 2009
Location: Madrid, Spain
Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2
I've the log but I don't think it's useful because the error is there, at the first try... and I only have 289 books.
Terisa de morgan is offline   Reply With Quote
Old 11-05-2014, 04:44 PM   #72
Terisa de morgan
Grand Sorcerer
Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.
 
Terisa de morgan's Avatar
 
Posts: 5,427
Karma: 5757254
Join Date: Jun 2009
Location: Madrid, Spain
Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2
BTW, I've kept the database that has been copied to the local path... and it's totally corrupt (SqlLite Manager has problem reading some data).
Terisa de morgan is offline   Reply With Quote
Old 11-05-2014, 05:08 PM   #73
AndrewG
Enthusiast
AndrewG began at the beginning.
 
Posts: 32
Karma: 10
Join Date: Aug 2014
Location: Melbourne, Australia
Device: iPad using Marvin
I uninstalled Marvin from my iPhone (IOS8) then reinstalled. Customised Calibre plugins for debug, started Calibre in debug mode then gave it the task of transferring my 500 largest books to the iPhone. After 28 minutes it was reporting staging 400 of 500 books. No change after another 20 minutes so I disconnected the iPhone and closed Calibre. The log is attached as tmpxbjlbt.txt.zip
I then restarted Calibre in debug mode and discovered that 400 books had been successfully transferred and gave it the task of transferring the next 1100 books. 2 books were reported as not transferrable because of being in the incorrect format and then Calibre began to transfer the remaining 1098. After 16 minutes and 5 seconds Marvin gave a timeout error message, log attached as tmppe3ier.txt.zip.
I restarted Marvin in debug mode to find a further 1000 books had been transferred. Calibre would not transfer book 1401, it claimed no suitable formats found but reported the presence of an ePub. Calibre was next tasked with transferring the next 1599 books. No problem, so then the next 2000...and this time we have an error sending the metadata and the malformed database message:

calibre, version 2.8.0
ERROR: Error: Error communicating with device

database disk image is malformed

Traceback (most recent call last):
File "site-packages\calibre\gui2\device.py", line 87, in run
File "site-packages\calibre\gui2\device.py", line 532, in _sync_booklists
File "C:\Users\Andrew\AppData\Local\Temp\calibre_vzn1dh \c5a2ct_ios_local_db\Marvin_overlays.py", line 1009, in sync_booklists
File "C:\Users\Andrew\AppData\Local\Temp\calibre_vzn1dh \c5a2ct_ios_local_db\Marvin_overlays.py", line 2109, in _profile_db
DatabaseError: database disk image is malformed

The debug log is attached as tempdr7hyn.txt.zip
Attached Files
File Type: zip tmppe3ier.txt.zip (270.3 KB, 76 views)
File Type: zip tmpdr7hyn.txt.zip (954.9 KB, 77 views)
File Type: zip tmpxbjlbt.txt.zip (135.4 KB, 74 views)
AndrewG is offline   Reply With Quote
Old 11-05-2014, 05:14 PM   #74
AndrewG
Enthusiast
AndrewG began at the beginning.
 
Posts: 32
Karma: 10
Join Date: Aug 2014
Location: Melbourne, Australia
Device: iPad using Marvin
Another run of Calibre in debug mode, after the malformed database message failed to connect to the iPhone and yielded the attached log.
Attached Files
File Type: txt tmp3ypiax.txt (39.9 KB, 118 views)
AndrewG is offline   Reply With Quote
Old 11-06-2014, 01:27 AM   #75
stanhere
Member
stanhere began at the beginning.
 
Posts: 13
Karma: 20
Join Date: Oct 2014
Device: iPad Retina 4th gen + Marvin v2.8 & Calibre v2.9 on W7 64
Given the many reports of MalFormed Marvin DB's here & other forums, I offer the following -----
For Windows 7 32/64 Calibre users out there wanting to BackUp your iPad's Marvin "Book Records" composed of two key parts: A= "mainDb.sqlite" , a single small file {4.2mb in my case for 2,246 books} and B= a matching set of individual book files {2,246 books (collection) in my case totaling 4.67 gigs} ........

There are a number of freeware (e.g. iFunBox) & shareware Windows progs available to access & transfer Files & Data, TO & FROM one's iPad vs LapTop \ DeskTop, quite quickly. **1

Besides routinely Backing Up my "Window's Calibre Book Library" every time I alter it, I am now also backing up my iPad's Marvin library with DiskAid sw so that within minutes, I can restore my iPad \ Marvin DB if & when I get another "communication error; database is malformed" complaint from Calibre upon iPad connection!

In my case, using DiskAid on two Marvin App paths, a BackUp to my PC takes under 5 minutes: Copy "mainDb.sqlite" database file from 'Apps\Marvin\Library' and the complementary books "collection" from 'Apps\Marvin\Library\Documents' (folder contents). **1

If & when a restoration is required, simply reverse [overwrite] per the prior paragraph. **1

**1 - Marvin must be closed!

Lastly, Use google for clarification & further detail and another Thank You to ShellShock!

Last edited by stanhere; 11-06-2014 at 03:34 AM.
stanhere is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Save to iOS quotebook app from Marvin tsolignani Marvin 10 07-08-2018 10:27 AM
One (really) last update for Marvin iOS 5 + iPad users kguil Marvin 37 02-05-2015 04:50 AM
Important: Marvin and iOS 8 kguil Marvin 37 11-16-2014 04:15 AM
Calibre to Dropbox to Marvin (while iOS problems continue) MSWallack Marvin 7 10-27-2014 07:21 PM
iPad users: Meet Marvin, an iOS ePub reader GRiker Devices 4 06-20-2013 10:16 AM


All times are GMT -4. The time now is 08:54 AM.


MobileRead.com is a privately owned, operated and funded community.