Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 07-29-2013, 09:42 AM   #46
GRiker
Comparer of the Ephemeris
GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.GRiker ought to be getting tired of karma fortunes by now.
 
Posts: 1,497
Karma: 424627
Join Date: Mar 2009
Device: iPad
Quote:
Originally Posted by kovidgoyal View Post
A note for plugin developers: I have tried hard to maintain API compatibility between the old and new backends, so hopefully most plugins should continue to work, without modification. However, given the complexity of the code involved there may well be regressions, if so I will be happy to help with fixing them.
Kovid,

I have a plugin which fetches .ondevice_col from the Metadata object for a given calibre id. It appears that ondevice_col is no longer available in the object. Is there some other way for me to find that property using the new db?

G
GRiker is offline   Reply With Quote
Old 07-29-2013, 09:45 AM   #47
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,434
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
mi._proxy_metadata.ondevice_col this will work with both the olddb and the newdb from 0.9.41 onwards.
kovidgoyal is offline   Reply With Quote
 
Advertisement
Old 07-29-2013, 09:49 AM   #48
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,434
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
The new builds with the fixes are available here: http://calibre-ebook.com/downloads/betas/

The version number remains the same, just install as normal. For linux binary users, the way to install is to go to /opt/calibre (or wherever you chose to install calibre) and untar the appropriate (32 bit/64 bit) tarball.
kovidgoyal is offline   Reply With Quote
Old 07-29-2013, 11:37 AM   #49
CRussel
Wizard
CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.
 
CRussel's Avatar
 
Posts: 4,830
Karma: 30841942
Join Date: Jul 2010
Location: Sunshine Coast, BC
Device: Kindle Voyage,Kindle PW, Fire HDX 8.9, Fire HD8.9
Kovid -- when I enabled the new_db, and restarted, it appeared to uninstall other plugins? I had to reload the official ones. (OTOH, the unofficial filetype plugin I run had no issues.)

Overall, no issues other than this yet. Load times are WAY better. I don't have timings, but it's at least an order of magnitude better. (This on a slow, single core, 64bit machine running Win7 64bit.) I'll try to get some timings on it later.
CRussel is offline   Reply With Quote
Old 07-29-2013, 11:38 AM   #50
gbm
Guru
gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.gbm ought to be getting tired of karma fortunes by now.
 
Posts: 728
Karma: 1394286
Join Date: Jun 2010
Device: Hisence Sero 7 Pro, Nook STR, jetbook lite
Quote:
Originally Posted by kovidgoyal View Post
The new builds with the fixes are available here: http://calibre-ebook.com/downloads/betas/

The version number remains the same, just install as normal. For linux binary users, the way to install is to go to /opt/calibre (or wherever you chose to install calibre) and untar the appropriate (32 bit/64 bit) tarball.
Installed useing:
Code:
sudo rm -rf /opt/calibre/* && sudo tar xvjf /replace_with_your_download_path/calibre-0.9.41-i686.tar.bz2 -C /opt/calibre
works.

Spoiler:

with old backend:
Code:
calibre 0.9.41  isfrozen: True is64bit: False
Linux-3.2.0-51-generic-i686-with-debian-wheezy-sid Linux ('32bit', 'ELF')
('Linux', '3.2.0-51-generic', '#77-Ubuntu SMP Wed Jul 24 20:21:10 UTC 2013')
Python 2.7.5
Linux: ('debian', 'wheezy/sid', '')
bernie@gbmoore:~$ Starting up...

macmenuhack file_path:/home/bernie/.config/calibre/plugins/fanfictiondownloader_macmenuhack.txt
Started up in 3.53 seconds with 2527 books
with new:
Code:
calibre 0.9.41  isfrozen: True is64bit: False
Linux-3.2.0-51-generic-i686-with-debian-wheezy-sid Linux ('32bit', 'ELF')
('Linux', '3.2.0-51-generic', '#77-Ubuntu SMP Wed Jul 24 20:21:10 UTC 2013')
Python 2.7.5
Linux: ('debian', 'wheezy/sid', '')
Starting up...

macmenuhack file_path:/home/bernie/.config/calibre/plugins/fanfictiondownloader_macmenuhack.txt
Started up in 2.74 seconds with 2527 books



bernie

System Details:

Ubuntu 12.04 LTS 32 bit
memory 2gb
processor: Intel® Core™2 CPU 6600 @ 2.40GHz × 2
graphics: Intel® 965G x86/MMX/SSE2

Last edited by gbm; 07-29-2013 at 01:42 PM. Reason: Added System Details
gbm is offline   Reply With Quote
Old 07-29-2013, 12:34 PM   #51
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,434
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
@gbm: Glad to hear it

@CRussel: As far as I know the new db should have no effect on plugins at all, they are not stored in the db. You can get startup time by running

calibre-debug -g

which will print the time taken to startup calibre.
kovidgoyal is offline   Reply With Quote
Old 07-29-2013, 02:00 PM   #52
CRussel
Wizard
CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.
 
CRussel's Avatar
 
Posts: 4,830
Karma: 30841942
Join Date: Jul 2010
Location: Sunshine Coast, BC
Device: Kindle Voyage,Kindle PW, Fire HDX 8.9, Fire HD8.9
On a fast machine (NOT that ancient Acer Ferrari laptop), startup time is 1.35 seconds with new, 1.83 seconds with old. This on 2core/4 logical processor HP laptop with 16 GB of RAM and an SSD, connecting to a shared network mounted Calibre database.

On the plugins not showing after restart. I wonder if it's related to updating the Count Pages plugin in the same pass as enabling the new db. Since that was the only one that showed after I restarted? I did not see that behaviour on the fast machine where I didn't have any that needed updating.
CRussel is offline   Reply With Quote
Old 07-29-2013, 02:11 PM   #53
CRussel
Wizard
CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.CRussel ought to be getting tired of karma fortunes by now.
 
CRussel's Avatar
 
Posts: 4,830
Karma: 30841942
Join Date: Jul 2010
Location: Sunshine Coast, BC
Device: Kindle Voyage,Kindle PW, Fire HDX 8.9, Fire HD8.9
On slow machine (Acer Ferrari laptop, 5400 RPM HD, 2 GB RAM, 64-bit Win7), I get 3.84 seconds on old db, 2.93 on new db. But both feel faster than I usually see, which probably means that the db is cached on the Windows Storage Server at this point and being served up from RAM.
CRussel is offline   Reply With Quote
Old 07-29-2013, 02:53 PM   #54
Divingduck
Fanatic
Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.Divingduck can talk all four legs off a donkey... then persuade it to go for a walk.
 
Posts: 562
Karma: 124000
Join Date: Nov 2010
Location: Germany
Device: Sony PRS-650
Kovid, I made some test with Windows Vista 64bit and a PRS-650. No problems up to now (did only normal things for testing). The feeling is a bit faster in opening Calibre, browsing in book covers.

Creating Catalogs seems to be approximately 8 to 10% faster


Edit: Saved searches are not working.

Edit once more: My mistake, I had change the GUI-language and forgot to reverse this.

Last edited by Divingduck; 07-29-2013 at 03:14 PM.
Divingduck is offline   Reply With Quote
Old 07-29-2013, 04:35 PM   #55
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,262
Karma: 1619751
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura H2O
Quote:
Originally Posted by kovidgoyal View Post
The new builds with the fixes are available here: http://calibre-ebook.com/downloads/betas/

The version number remains the same, just install as normal. For linux binary users, the way to install is to go to /opt/calibre (or wherever you chose to install calibre) and untar the appropriate (32 bit/64 bit) tarball.
YAY! I don't know what it was you fixed, but with the beta my problem (Calibre hanging with 100% CPU use on one core when connecting a device) is gone too.
mbovenka is offline   Reply With Quote
Old 07-29-2013, 06:06 PM   #56
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 3,968
Karma: 2925589
Join Date: Mar 2012
Location: NSW Australia
Device: none
Thumbs up My problems solved

Custom Column Dates are showing blank cell when date is Undefined
Find Duplicates error is gone, Right Arrow is working

BR
BetterRed is offline   Reply With Quote
Old 07-29-2013, 07:11 PM   #57
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,262
Karma: 1619751
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura H2O
Sorting seems buggered with the new backend. If I sort, say, on series and then on author, normally I end up with my book list sorted on author and within the author on series (this is my startup sort)

What happens now is that I end up with my last sort (author, in this case) and within that sorted on the date the book was added to the library.
mbovenka is offline   Reply With Quote
Old 07-29-2013, 08:48 PM   #58
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 15,250
Karma: 6020307
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Confirming on XP

Sort on date or series
Sort on Title
Sort on Authors

Titles for an author should be alphabetical, they are {Date} ordered


My tweak: maximum_resort_levels = 3
theducks is offline   Reply With Quote
Old 07-29-2013, 10:55 PM   #59
PeterT
Taking a break; Fed up
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
PeterT's Avatar
 
Posts: 7,360
Karma: 46281507
Join Date: Nov 2007
Location: Toronto
Device: Wife: Touch, Arc, Vox Me: Nexus 7, Glo
Quote:
Originally Posted by davidfor View Post
Peter, I'm not seeing this here. On my Touch, I have about 1100 books. The calibre library has 447 book of which 127 are on the Touch and have a reading postition. Selecting all the books in the library and doing a store took 31 seconds old DB engine and 37 with the new.
David; I just retried my tests using the current "beta" version of calibre.

Both tests done selecting 184 books (all the calibre managed material on the Kobo).

Old DB: Batch Mode: Updating metadata stage 00:13 seconds
New DB: Batch Mode: Updating metadata stage 2:49 seconds

Now I wonder if it's significant how I have things configured.
Code:
Current Reading Location:	#koboreadloc		Text, column shown in the tag browser
Percent Read Column:		#koboreadpct		Integers
Rating Column:			#koborating		Integers
Last Read Column:		#kobolastread		Date

Other related custom columns
#readstatus:						Column built from other columns
{#koboreadpct:'cmp($, 100, cmp($, 0, '', '', 'Reading'), 'Finished', '')'}
							Sort/Search column by Text
							Show in Tags browser
PeterT is offline   Reply With Quote
Old 07-29-2013, 11:43 PM   #60
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,434
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
@davidfor: From Peter's description it looks to me like updating the database for a large number of books is slower with the new backend in your plugin.

This is because the new backend operates in auto-commit mode. That is after every change, the database is committed. So if you are making changes to a lot of database records, you should do them in bulk. For example, to change the the #xyz field in for a number of records, in the old db you would do:

Code:
for book_id in book_ids:
   db.set_custom(book_id, val, label='xyz', commit=False)
db.commit()
With the new db you should instead do:
Code:
if hasattr(db, 'new_api'):
   db.new_api.set_field('#xyz', {book_id:val for book_id in book_ids})
else:
    # do it the old way
kovidgoyal is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
MTP support: Testers needed kovidgoyal Calibre 68 09-21-2012 04:54 AM
shared backend database? perler Calibre 4 01-26-2012 06:37 AM
Windows testers needed kovidgoyal Calibre 51 11-21-2010 06:58 AM
OS X testers needed kovidgoyal Calibre 23 11-18-2010 01:11 PM
calibre ereader output testers needed user_none Other formats 24 05-11-2009 01:00 AM


All times are GMT -4. The time now is 08:38 AM.


MobileRead.com is a privately owned, operated and funded community.