New database backend - testers needed - Page 7

Divingduck · 07-31-2013, 02:42 AM

Seems it was too late yesterday. Forgot one important point

Is this crash reproducible -> yes
does it always happen when switching libraries ->yes

In addition: It happen only one time for each library. When I start Calibre again, it works with the actual selected database
As test library I use 2 different Databases in addition of the one-book library. One is a clone of an existing database the other one is a play library with 32 empty books.

As the computer leaves this morning my home (it wasn't my own, I did only an new installation on it), I setup a new VM-Ware Workstation machine (with actual service release) with a fresh installation of WIN-XP SP3 and check it again right now. The error occurs in this machine like I saw it on the computer yesterday. It happens with a library connected via share a host library (clone of my normal database), the initial installation library in the VM-machine and a small test library on the desktop, all the time by switching from one to another library. When I start Calibre after the crash again, Calibre works and I can open books or do other activities in the library.
Let me know, if you need a metadata.db. I will upload it then to zippy-share and send you a link as PM

kovidgoyal · 07-31-2013, 03:09 AM

@davidfor: Unfortunately, exception details on windows are entirely useless. What I need is some way to reproduce the crash. I think what's in common is that both you and divingduck are using 32 bit versions of calibre. I will see if I can reproduce it with that (in my testing I have only been using the 64 bit version).

kovidgoyal · 07-31-2013, 04:06 AM

Regarding the crash on switch library, I was able to reproduce it in a 32bit win xp VM. The problem seems to have been in the sqlite wrapper (apsw) that the new db uses, it was out of date in the 32 bit calibre build. Updating it seems to have fixed the crashes, at least, I can no longer reproduce them.

The updated windows 32 bit builds are at: http://calibre-ebook.com/downloads/betas/ as usual

Divingduck · 07-31-2013, 04:39 AM

Kovid, works for me too. Thanks.

davidfor · 07-31-2013, 07:49 AM

Working here as well. I was able to switch library without error and created a couple of new ones as well.

kacir · 07-31-2013, 10:31 AM

Thank you Kovid.

I have installed the beta version on Linux.

I have had installed full version, so I figured out I have all dependencies. I have just downloaded the beta archive and unpacked it over files at default location /opt/Calibre.

So far, it seems to be much faster than the previous version. I have very large library and I am delighted to see the speed-up when searching and sorting results.
You have sped up my computer more than my upgrading from Intel Pentium 4, 2GB RAM to Intel Core i7 6GB RAM ;-).
My main reason for upgrading was my Calibre library response time.

I have noticed that when I am merging two books, the process is noticeably slower.

kovidgoyal · 07-31-2013, 11:43 AM

@kacir: Glad to hear it. By merging two books you mean the Merge book records operation under Edit metadata?

kacir · 07-31-2013, 02:44 PM

Quote:

Originally Posted by kovidgoyal

@kacir: Glad to hear it. By merging two books you mean the Merge book records operation under Edit metadata?

I select a book, then press Ctrl and select another, press M, so the records and formats are merged into one record.
I am just about to test the newest version from
31-Jul-2013 13:04

BetterRed · 07-31-2013, 08:07 PM

Scenario : I drop a new format file (i.e one that doesn't currently exist) onto the Book Details panel

olddb - Format list its updated with new format shown in alphanumeric sort position
newdb - Format list is updated with new format appended at end of list - when Book Details gets refreshed the list of formats will be in alphanumeric sort order

BR

kovidgoyal · 08-01-2013, 12:01 AM

@BR: Fixed in next build

kovidgoyal · 08-02-2013, 05:09 AM

calibre 0.9.42 contains the following fixes:

1) Fix duplicates during adding causing a blank row to appear in the book list
2) Fix formats list in book details panel not always sorted alphabetically

There are no remaining known bugs. Still may be a few places where the newdb is a little slower than the olddb, these will get ironed out with time, it basically requires re-writing those bits of code to use the new api directly.

kacir · 08-02-2013, 09:59 AM

Quote:

Originally Posted by kovidgoyal

calibre 0.9.42 contains the following ...

There are no remaining known bugs. ...

So can we - betatesters - just install the mainstream version, or should we continue to use betas from
http://calibre-ebook.com/downloads/betas/ ?

kovidgoyal · 08-02-2013, 12:05 PM

Quote:

Originally Posted by kacir

So can we - betatesters - just install the mainstream version, or should we continue to use betas from
http://calibre-ebook.com/downloads/betas/ ?

Install the mainstream version, it includes the newdb code.

Patricia1066 · 08-03-2013, 06:39 AM

The 0.9.42 [new_db] works very well on Mac Mountain Lion 10.8.4
3 Libraries, 1297 books, 567 and 137 books in each library

Reading Blackberry Playbook db used to take a minimum of 5 mins sometimes 12; today it took 0 sec to Get device information; 7 secs to Get list of books.

Thanks for a wonderful update.

FanfictionDownloader is working well.

kovidgoyal · 08-03-2013, 07:15 AM

@Patricia1066: Glad to hear it

07-31-2013, 10:31 AM	#96
kacir Wizard Posts: 3,450 Karma: 10484861 Join Date: May 2006 Device: PocketBook 360, before it was Sony Reader, cassiopeia A-20	Testing - it works very nice, but merging books seems to be slower. Thank you Kovid. I have installed the beta version on Linux. I have had installed full version, so I figured out I have all dependencies. I have just downloaded the beta archive and unpacked it over files at default location /opt/Calibre. So far, it seems to be much faster than the previous version. I have very large library and I am delighted to see the speed-up when searching and sorting results. You have sped up my computer more than my upgrading from Intel Pentium 4, 2GB RAM to Intel Core i7 6GB RAM ;-). My main reason for upgrading was my Calibre library response time. I have noticed that when I am merging two books, the process is noticeably slower.

07-31-2013, 08:07 PM	#99
BetterRed null operator (he/him) Posts: 20,583 Karma: 26954694 Join Date: Mar 2012 Location: Sydney Australia Device: none	Observation Scenario : I drop a new format file (i.e one that doesn't currently exist) onto the Book Details panel olddb - Format list its updated with new format shown in alphanumeric sort position newdb - Format list is updated with new format appended at end of list - when Book Details gets refreshed the list of formats will be in alphanumeric sort order BR Last edited by BetterRed; 07-31-2013 at 08:13 PM.

08-03-2013, 06:39 AM	#104
Patricia1066 Zealot Posts: 131 Karma: 19894 Join Date: Mar 2010 Location: Bromley, UK Device: Kindle PW 10th gen, Kindle Fire 7 9th gen, Kindle KB 3rd gen	The 0.9.42 [new_db] works very well on Mac Mountain Lion 10.8.4 3 Libraries, 1297 books, 567 and 137 books in each library Reading Blackberry Playbook db used to take a minimum of 5 mins sometimes 12; today it took 0 sec to Get device information; 7 secs to Get list of books. Thanks for a wonderful update. FanfictionDownloader is working well. Last edited by Patricia1066; 08-03-2013 at 07:04 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
MTP support: Testers needed	kovidgoyal	Calibre	68	09-21-2012 03:54 AM
shared backend database?	perler	Calibre	4	01-26-2012 05:37 AM
Windows testers needed	kovidgoyal	Calibre	51	11-21-2010 05:58 AM
OS X testers needed	kovidgoyal	Calibre	23	11-18-2010 12:11 PM
calibre ereader output testers needed	user_none	Other formats	24	05-11-2009 12:00 AM

07-31-2013, 02:42 AM	#91
Divingduck Wizard Posts: 1,161 Karma: 1404241 Join Date: Nov 2010 Location: Germany Device: Sony PRS-650	Seems it was too late yesterday. Forgot one important point Is this crash reproducible -> yes does it always happen when switching libraries ->yes In addition: It happen only one time for each library. When I start Calibre again, it works with the actual selected database As test library I use 2 different Databases in addition of the one-book library. One is a clone of an existing database the other one is a play library with 32 empty books. As the computer leaves this morning my home (it wasn't my own, I did only an new installation on it), I setup a new VM-Ware Workstation machine (with actual service release) with a fresh installation of WIN-XP SP3 and check it again right now. The error occurs in this machine like I saw it on the computer yesterday. It happens with a library connected via share a host library (clone of my normal database), the initial installation library in the VM-machine and a small test library on the desktop, all the time by switching from one to another library. When I start Calibre after the crash again, Calibre works and I can open books or do other activities in the library. Let me know, if you need a metadata.db. I will upload it then to zippy-share and send you a link as PM

07-31-2013, 03:09 AM	#92
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@davidfor: Unfortunately, exception details on windows are entirely useless. What I need is some way to reproduce the crash. I think what's in common is that both you and divingduck are using 32 bit versions of calibre. I will see if I can reproduce it with that (in my testing I have only been using the 64 bit version).

07-31-2013, 04:06 AM	#93
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Regarding the crash on switch library, I was able to reproduce it in a 32bit win xp VM. The problem seems to have been in the sqlite wrapper (apsw) that the new db uses, it was out of date in the 32 bit calibre build. Updating it seems to have fixed the crashes, at least, I can no longer reproduce them. The updated windows 32 bit builds are at: http://calibre-ebook.com/downloads/betas/ as usual

07-31-2013, 04:39 AM	#94
Divingduck Wizard Posts: 1,161 Karma: 1404241 Join Date: Nov 2010 Location: Germany Device: Sony PRS-650	Kovid, works for me too. Thanks.

07-31-2013, 07:49 AM	#95
davidfor Grand Sorcerer Posts: 24,907 Karma: 47303748 Join Date: Jul 2011 Location: Sydney, Australia Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos	Working here as well. I was able to switch library without error and created a couple of new ones as well.

07-31-2013, 11:43 AM	#97
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@kacir: Glad to hear it. By merging two books you mean the Merge book records operation under Edit metadata?

08-01-2013, 12:01 AM	#100
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@BR: Fixed in next build

08-02-2013, 05:09 AM	#101
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	calibre 0.9.42 contains the following fixes: 1) Fix duplicates during adding causing a blank row to appear in the book list 2) Fix formats list in book details panel not always sorted alphabetically There are no remaining known bugs. Still may be a few places where the newdb is a little slower than the olddb, these will get ironed out with time, it basically requires re-writing those bits of code to use the new api directly.

08-03-2013, 07:15 AM	#105
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@Patricia1066: Glad to hear it

Advert

Advert