07-29-2013, 08:42 AM | #46 | |
Comparer of the Ephemeris
Posts: 1,496
Karma: 424697
Join Date: Mar 2009
Device: iPad
|
Quote:
I have a plugin which fetches .ondevice_col from the Metadata object for a given calibre id. It appears that ondevice_col is no longer available in the object. Is there some other way for me to find that property using the new db? G |
|
07-29-2013, 08:45 AM | #47 |
creator of calibre
Posts: 43,860
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
mi._proxy_metadata.ondevice_col this will work with both the olddb and the newdb from 0.9.41 onwards.
|
Advert | |
|
07-29-2013, 08:49 AM | #48 |
creator of calibre
Posts: 43,860
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
The new builds with the fixes are available here: http://calibre-ebook.com/downloads/betas/
The version number remains the same, just install as normal. For linux binary users, the way to install is to go to /opt/calibre (or wherever you chose to install calibre) and untar the appropriate (32 bit/64 bit) tarball. |
07-29-2013, 10:37 AM | #49 |
(he/him/his)
Posts: 12,161
Karma: 79742714
Join Date: Jul 2010
Location: Sunshine Coast, BC
Device: Oasis (Gen3),Paperwhite (Gen10), Voyage, Paperwhite(orig), Fire HD 8
|
Kovid -- when I enabled the new_db, and restarted, it appeared to uninstall other plugins? I had to reload the official ones. (OTOH, the unofficial filetype plugin I run had no issues.)
Overall, no issues other than this yet. Load times are WAY better. I don't have timings, but it's at least an order of magnitude better. (This on a slow, single core, 64bit machine running Win7 64bit.) I'll try to get some timings on it later. |
07-29-2013, 10:38 AM | #50 | |
Wizard
Posts: 2,082
Karma: 8796704
Join Date: Jun 2010
Device: Kobo Clara HD,Hisence Sero 7 Pro RIP, Nook STR, jetbook lite
|
Quote:
Code:
sudo rm -rf /opt/calibre/* && sudo tar xvjf /replace_with_your_download_path/calibre-0.9.41-i686.tar.bz2 -C /opt/calibre Spoiler:
bernie System Details: Ubuntu 12.04 LTS 32 bit memory 2gb processor: Intel® Core™2 CPU 6600 @ 2.40GHz × 2 graphics: Intel® 965G x86/MMX/SSE2 Last edited by gbm; 07-29-2013 at 12:42 PM. Reason: Added System Details |
|
Advert | |
|
07-29-2013, 11:34 AM | #51 |
creator of calibre
Posts: 43,860
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
@gbm: Glad to hear it
@CRussel: As far as I know the new db should have no effect on plugins at all, they are not stored in the db. You can get startup time by running calibre-debug -g which will print the time taken to startup calibre. |
07-29-2013, 01:00 PM | #52 |
(he/him/his)
Posts: 12,161
Karma: 79742714
Join Date: Jul 2010
Location: Sunshine Coast, BC
Device: Oasis (Gen3),Paperwhite (Gen10), Voyage, Paperwhite(orig), Fire HD 8
|
On a fast machine (NOT that ancient Acer Ferrari laptop), startup time is 1.35 seconds with new, 1.83 seconds with old. This on 2core/4 logical processor HP laptop with 16 GB of RAM and an SSD, connecting to a shared network mounted Calibre database.
On the plugins not showing after restart. I wonder if it's related to updating the Count Pages plugin in the same pass as enabling the new db. Since that was the only one that showed after I restarted? I did not see that behaviour on the fast machine where I didn't have any that needed updating. |
07-29-2013, 01:11 PM | #53 |
(he/him/his)
Posts: 12,161
Karma: 79742714
Join Date: Jul 2010
Location: Sunshine Coast, BC
Device: Oasis (Gen3),Paperwhite (Gen10), Voyage, Paperwhite(orig), Fire HD 8
|
On slow machine (Acer Ferrari laptop, 5400 RPM HD, 2 GB RAM, 64-bit Win7), I get 3.84 seconds on old db, 2.93 on new db. But both feel faster than I usually see, which probably means that the db is cached on the Windows Storage Server at this point and being served up from RAM.
|
07-29-2013, 01:53 PM | #54 |
Wizard
Posts: 1,161
Karma: 1404241
Join Date: Nov 2010
Location: Germany
Device: Sony PRS-650
|
Kovid, I made some test with Windows Vista 64bit and a PRS-650. No problems up to now (did only normal things for testing). The feeling is a bit faster in opening Calibre, browsing in book covers.
Creating Catalogs seems to be approximately 8 to 10% faster Edit: Saved searches are not working. Edit once more: My mistake, I had change the GUI-language and forgot to reverse this. Last edited by Divingduck; 07-29-2013 at 02:14 PM. |
07-29-2013, 03:35 PM | #55 | |
Wizard
Posts: 2,018
Karma: 13471689
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Sage
|
Quote:
|
|
07-29-2013, 05:06 PM | #56 |
null operator (he/him)
Posts: 20,575
Karma: 26954694
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
My problems solved
Custom Column Dates are showing blank cell when date is Undefined
Find Duplicates error is gone, Right Arrow is working BR |
07-29-2013, 06:11 PM | #57 |
Wizard
Posts: 2,018
Karma: 13471689
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Sage
|
Sorting seems buggered with the new backend. If I sort, say, on series and then on author, normally I end up with my book list sorted on author and within the author on series (this is my startup sort)
What happens now is that I end up with my last sort (author, in this case) and within that sorted on the date the book was added to the library. |
07-29-2013, 07:48 PM | #58 |
Well trained by Cats
Posts: 29,809
Karma: 54830978
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Confirming on XP
Sort on date or series Sort on Title Sort on Authors Titles for an author should be alphabetical, they are {Date} ordered My tweak: maximum_resort_levels = 3 |
07-29-2013, 09:55 PM | #59 | |
Grand Sorcerer
Posts: 12,168
Karma: 73448616
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
|
Quote:
Both tests done selecting 184 books (all the calibre managed material on the Kobo). Old DB: Batch Mode: Updating metadata stage 00:13 seconds New DB: Batch Mode: Updating metadata stage 2:49 seconds Now I wonder if it's significant how I have things configured. Code:
Current Reading Location: #koboreadloc Text, column shown in the tag browser Percent Read Column: #koboreadpct Integers Rating Column: #koborating Integers Last Read Column: #kobolastread Date Other related custom columns #readstatus: Column built from other columns {#koboreadpct:'cmp($, 100, cmp($, 0, '', '', 'Reading'), 'Finished', '')'} Sort/Search column by Text Show in Tags browser |
|
07-29-2013, 10:43 PM | #60 |
creator of calibre
Posts: 43,860
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
@davidfor: From Peter's description it looks to me like updating the database for a large number of books is slower with the new backend in your plugin.
This is because the new backend operates in auto-commit mode. That is after every change, the database is committed. So if you are making changes to a lot of database records, you should do them in bulk. For example, to change the the #xyz field in for a number of records, in the old db you would do: Code:
for book_id in book_ids: db.set_custom(book_id, val, label='xyz', commit=False) db.commit() Code:
if hasattr(db, 'new_api'): db.new_api.set_field('#xyz', {book_id:val for book_id in book_ids}) else: # do it the old way |
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
MTP support: Testers needed | kovidgoyal | Calibre | 68 | 09-21-2012 03:54 AM |
shared backend database? | perler | Calibre | 4 | 01-26-2012 05:37 AM |
Windows testers needed | kovidgoyal | Calibre | 51 | 11-21-2010 05:58 AM |
OS X testers needed | kovidgoyal | Calibre | 23 | 11-18-2010 12:11 PM |
calibre ereader output testers needed | user_none | Other formats | 24 | 05-11-2009 12:00 AM |