Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 07-10-2013, 09:07 AM   #16
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,125
Karma: 5381911
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
You've gotta live with it. When many records have changed, resorting makes sense. You should be able to reduce the sort overhead by using a virtual library, though off hand I can't recall if the current database code restricts to the VL when sorting or not, I know the new db code does.
kovidgoyal is offline   Reply With Quote
Old 07-10-2013, 09:10 AM   #17
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,125
Karma: 5381911
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
You can also reduce sort overhead by sorting ona simple column like date or a boolean/numeric column before bulk editing.
kovidgoyal is offline   Reply With Quote
Old 07-10-2013, 09:16 AM   #18
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,125
Karma: 5381911
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Actually on second thoughts, a virtual library probably wont help since after a bulk edit the VL itself has to be re-computed.
kovidgoyal is offline   Reply With Quote
Old 07-10-2013, 09:20 AM   #19
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,230
Karma: 1619751
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura H2O
Quote:
Originally Posted by kovidgoyal View Post
Actually on second thoughts, a virtual library probably wont help since after a bulk edit the VL itself has to be re-computed.
Yes, my experience is that a virtual library doesn't speed it up. Oh well, a good excuse to get me a beefier box
mbovenka is online now   Reply With Quote
Old 07-10-2013, 09:26 AM   #20
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 3,616
Karma: 2183656
Join Date: Mar 2012
Location: NSW Australia
Device: none
Quote:
Originally Posted by speakingtohe View Post
Even with the tag browser off though it takes a long time to do a bulk metadata change of even one field in two records, so there is something else in play here.

Helen
To twenty books in a 24000+ book library I just :-

added four tags,
changed the publisher,
changed a custom date (last change date) and
changed a fixed value set custom column (status) which is shown in the tag browser

the spreadsheet was sorted on status (ascending) and last change date (descending), which is the default I have in View Manager, the tag browser was open with all categories collapsed, no virtual libraries or search terms were in effect, book details was displayed

Took < 7secs - I regard that as plenty good enough.

Sometimes I change the metadata on 100's of books, I can't recall any that were unacceptably slow, like more than few minutes. I rarely need to change author names or titles - I try to ensure they are correct before I move the books from my 'new books' library to my 'main' library.

I do not have any columns derived/calculated from other columns, nor do I have coloured columns, or other decorative effects, and I don't use the cover browser - i.e as vanilla as it comes.

My calibre system has an i5 processor with 6GB RAM. The library is on a WD 2TB internal spinning disk, on a SATA controller, its formatted for NTFS, and the drive is fully indexed for Windows search and Locate 32. I don't use an SSD, or RAM Disks or any of that tricky stuff. The database is in the library folder with the author & book folders and its 109MB.

The software and config data are on another 2TB WD drive.

BR
BetterRed is offline   Reply With Quote
Old 07-10-2013, 10:08 AM   #21
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,230
Karma: 1619751
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura H2O
Quote:
Originally Posted by BetterRed View Post
:My calibre system has an i5 processor with 6GB RAM. The library is on a WD 2TB internal spinning disk, on a SATA controller, its formatted for NTFS, and the drive is fully indexed for Windows search and Locate 32. I don't use an SSD, or RAM Disks or any of that tricky stuff. The database is in the library folder with the author & book folders and its 109MB.

The software and config data are on another 2TB WD drive.

BR
See what I mean by 'beefier box'? . I'm talking an old laptop, a Core2Duo with 1.5GB RAM and a 71K books library on a USB2 external disk.

Starting up takes 3 minutes or so, but after that, it's surprisingly workable.
mbovenka is online now   Reply With Quote
Old 07-10-2013, 10:19 AM   #22
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 14,860
Karma: 5654321
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
About 32 seconds full startup (Library screen stabilized)
the Logo appeared after ~11 seconds

A lowly P4 2.4GHz w 2G RAM
Calibre program on Main HD
Library on External 2.5" HD connected by USB2

Note: Starting up with Calibre Portable (located on that same USB2 HD only added 2 seconds to 'Logo' and the total
theducks is offline   Reply With Quote
Old 07-10-2013, 12:40 PM   #23
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,636
Karma: 1137414
Join Date: Jan 2010
Location: France
Device: Many android devices
Quote:
Originally Posted by kovidgoyal View Post
You should be able to reduce the sort overhead by using a virtual library, though off hand I can't recall if the current database code restricts to the VL when sorting or not, I know the new db code does.
It does a search of all records to build the VL, then sorts the results of that search. One would need to see the VL search expression to know which of those two operations is the slower one.
chaley is offline   Reply With Quote
Old 07-10-2013, 01:24 PM   #24
speakingtohe
Wizard
speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.speakingtohe ought to be getting tired of karma fortunes by now.
 
Posts: 4,596
Karma: 25170848
Join Date: Apr 2010
Device: sony PRS-T1 and T3, Kobo Mini and Aura HD, Tablet
Quote:
Originally Posted by mbovenka View Post
Aha. Yeah, that would explain it. Is there a way around it, or is it just a question of 'Sorry, you gotta live with it'?
At one time there was no resort IIRC. I would rather not have it but many must prefer it. A tweak would be nice

Helen
speakingtohe is offline   Reply With Quote
Old 07-10-2013, 06:22 PM   #25
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 3,616
Karma: 2183656
Join Date: Mar 2012
Location: NSW Australia
Device: none
Quote:
Originally Posted by speakingtohe View Post
At one time there was no resort IIRC. I would rather not have it but many must prefer it. A tweak would be nice

Helen
I too would like a no re-sort or re-select tweak, not because of performance, but because a bulk edit can take books from the current selection criteria and/or virtual library. Thankfully this doesn't happen if I edit a book metadata in the spreadsheet

I'd rather use the Go button as & when I want the spreadsheet refreshed.

BR
BetterRed is offline   Reply With Quote
Old 07-11-2013, 04:58 AM   #26
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,230
Karma: 1619751
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura H2O
Quote:
Originally Posted by BetterRed View Post
I too would like a no re-sort or re-select tweak, not because of performance, but because a bulk edit can take books from the current selection criteria and/or virtual library. Thankfully this doesn't happen if I edit a book metadata in the spreadsheet

I'd rather use the Go button as & when I want the spreadsheet refreshed.

BR
Yeah, that would be another plus of no re-sorting.
mbovenka is online now   Reply With Quote
Old 07-11-2013, 05:38 AM   #27
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,125
Karma: 5381911
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
https://github.com/kovidgoyal/calibr...7b070cf5ab97fa
kovidgoyal is offline   Reply With Quote
Old 07-11-2013, 08:58 AM   #28
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,230
Karma: 1619751
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura H2O
Quote:
Originally Posted by kovidgoyal View Post
And Kovid comes through again Time for another donation...
mbovenka is online now   Reply With Quote
Old 07-11-2013, 08:40 PM   #29
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 3,616
Karma: 2183656
Join Date: Mar 2012
Location: NSW Australia
Device: none
Quote:
Originally Posted by mbovenka View Post
And Kovid comes through again Time for another donation...


Kovid

BR
BetterRed is offline   Reply With Quote
Old 07-12-2013, 02:55 PM   #30
mbovenka
Wizard
mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.mbovenka ought to be getting tired of karma fortunes by now.
 
Posts: 1,230
Karma: 1619751
Join Date: Oct 2007
Location: Almere, The Netherlands
Device: Kobo Aura H2O
Quote:
Originally Posted by kovidgoyal View Post
Just tried 0.9.39.
mbovenka is online now   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Batch transfer books from Kindle to Calibre engt Library Management 7 08-21-2014 06:54 AM
Batch Converting Ebooks with Calibre and Python jmeb Conversion 7 11-18-2013 12:12 PM
PRS-T1 questions on collections and slow operations Jade Aislin Sony Reader 9 08-14-2012 01:49 PM
Calibre Portable batch file. soleilos Calibre 2 08-20-2011 11:52 AM
calibre - very slow conversion, very slow on PRS cremofix Calibre 3 06-10-2009 04:21 PM


All times are GMT -4. The time now is 02:36 PM.


MobileRead.com is a privately owned, operated and funded community.