Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 09-08-2017, 11:01 AM   #16
BartZorn
Member
BartZorn began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Jul 2012
Device: Sony PRS-T1
Quote:
Originally Posted by BetterRed View Post
That database size, 61MB for 30,000 books, doesn't seem abnormal to me, others may care to comment.

Could you run calibre at the server in debug mode and post the log here?

That it is so slow when run from server suggests the server itself is the bottleneck, rather that anything related to the network.

What file system is the server running (NTFS or ??), how much memory does it have, and what other applications run at the server?

Have you tried relocating the database, as suggested in posts 3 and 4.

BR
OK. My server is a Core i5-4570, with 16 GB memory, running Windows Server 2016 standard edition. Two cores are occupied running a Hyper-V VM doing video conversions. The other two are doing only what a lightly loaded Windows Server does.

I did "calibre-debug -g >calibre.log" and lo and behold, startup took about 17 seconds. The log file is attached to this post.
Next I tried a normal startup of calibre, and that also took less than 20 seconds.

The library and the database are all on a local disk on this server, disk G:, not C:.

It seems that the problem has disappeared by itself. Not very satisfying.

Thanks for all your suggestions!

Bart


Bart
BartZorn is offline   Reply With Quote
Advert
Old 09-08-2017, 11:06 AM   #17
BartZorn
Member
BartZorn began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Jul 2012
Device: Sony PRS-T1
The forum site seems to think that a .log file is an invalid file. Strange. But it is so small, here it is:

calibre 3.7 embedded-python: True is64bit: False
Windows-10-10.0.14393-SP0 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '10', '10.0.14393')
Python 2.7.12+
Windows: ('10', '10.0.14393', 'SP0', u'Multiprocessor Free')
Interface language: None
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 141.76744186 x 141.402061856
Using calibre Qt style: True
Starting up...
Started up in 17.28 seconds with 36266 books

That's all

Bart
BartZorn is offline   Reply With Quote
Old 09-08-2017, 04:11 PM   #18
Fiat_Lux
Addict
Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.Fiat_Lux ought to be getting tired of karma fortunes by now.
 
Fiat_Lux's Avatar
 
Posts: 207
Karma: 3625582
Join Date: Jan 2012
Location: Gimel
Device: tablets
Quote:
Originally Posted by BartZorn View Post
Previously, the size of the database did not seem to be important, but now I have to wait 5 minutes or more for a single change.
a) What extensions have you installed;
b) How much RAM does your system have;
c) When Calibre is running, how much free RAM is available;

Quote:
OK, we have a ridiculous large database, over 30000 entries.
Large is when you have 100,000 entries in your Calibre library.
Huge is when you have 1,000,000 entries in your Calibre library.

Amber
Fiat_Lux is offline   Reply With Quote
Old 09-08-2017, 05:12 PM   #19
BartZorn
Member
BartZorn began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Jul 2012
Device: Sony PRS-T1
Quote:
Originally Posted by Fiat_Lux View Post
a) What extensions have you installed;
b) How much RAM does your system have;
c) When Calibre is running, how much free RAM is available;



Large is when you have 100,000 entries in your Calibre library.
Huge is when you have 1,000,000 entries in your Calibre library.

Amber
a) none
b) 16 GB, but about 4 GB is occupied by a VM.
c) about 6 GB

OK, I stand corrected, my library is not big.

Bart
BartZorn is offline   Reply With Quote
Old 09-08-2017, 06:47 PM   #20
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 9,175
Karma: 7656413
Join Date: Mar 2012
Location: Sydney Australia
Device: none
Quote:
Originally Posted by BartZorn View Post
OK. My server is a Core i5-4570, with 16 GB memory, running Windows Server 2016 standard edition. Two cores are occupied running a Hyper-V VM doing video conversions. The other two are doing only what a lightly loaded Windows Server does.

I did "calibre-debug -g >calibre.log" and lo and behold, startup took about 17 seconds. The log file is attached to this post.
Next I tried a normal startup of calibre, and that also took less than 20 seconds.

The library and the database are all on a local disk on this server, disk G:, not C:.

It seems that the problem has disappeared by itself. Not very satisfying.
Nah - something must have changed, I suspect you know that - Windows Yipdate, AntiViral... etc

I don't believe in fairies, or hobgoblins - unless they're of the kind mentioned in Menken's "In Defense of Women". But let's hope the cure sticks - whatever it was.

Were any video conversions running - I know they run in a VM but...

Quote:
Originally Posted by BartZorn View Post

calibre 3.7 embedded-python: True is64bit: False
Windows-10-10.0.14393-SP0 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '10', '10.0.14393')
Python 2.7.12+
Windows: ('10', '10.0.14393', 'SP0', u'Multiprocessor Free')
Interface language: None
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 141.76744186 x 141.402061856
Using calibre Qt style: True
Starting up...
Started up in 17.28 seconds with 36266 books
Looks like you're running the the 32bit version of calibre. Any specific reason for that, not saying you shouldn't, or that it is the cause of the poor performance, but why use the Windows on Windows detour when there's no need.

BR
BetterRed is online now   Reply With Quote
Advert
Old 09-09-2017, 12:14 AM   #21
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 21,006
Karma: 20776282
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: K4NT, Galaxy Tab 2(RIP)
Quote:
Originally Posted by BetterRed View Post
That database size, 61MB for 30,000 books, doesn't seem abnormal to me, others may care to comment.

Could you run calibre at the server in debug mode and post the log here?

That it is so slow when run from server suggests the server itself is the bottleneck, rather that anything related to the network.

What file system is the server running (NTFS or ??), how much memory does it have, and what other applications run at the server?

Have you tried relocating the database, as suggested in posts 3 and 4.

BR
38MB here for less than 1/2 that many books. That's a thin DB
theducks is offline   Reply With Quote
Old 09-09-2017, 12:23 AM   #22
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 21,006
Karma: 20776282
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: K4NT, Galaxy Tab 2(RIP)
Quote:
Originally Posted by BartZorn View Post
The forum site seems to think that a .log file is an invalid file. Strange. But it is so small, here it is:

calibre 3.7 embedded-python: True is64bit: False
Windows-10-10.0.14393-SP0 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '10', '10.0.14393')
Python 2.7.12+
Windows: ('10', '10.0.14393', 'SP0', u'Multiprocessor Free')
Interface language: None
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 141.76744186 x 141.402061856
Using calibre Qt style: True
Starting up...
Started up in 17.28 seconds with 36266 books

That's all

Bart
Why are you running the 32 bit version?

i5 don't make the best ' file Server' machines: Xeon is more common in server room racks
theducks is offline   Reply With Quote
Old 09-09-2017, 01:28 AM   #23
sydmalicious
Connoisseur
sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.sydmalicious ought to be getting tired of karma fortunes by now.
 
sydmalicious's Avatar
 
Posts: 84
Karma: 500010
Join Date: Mar 2014
Location: Pittsburgh, PA, US
Device: Marvin, iPad Pro 12.9", iPhone 6s
Quote:
Originally Posted by Fiat_Lux View Post

Large is when you have 100,000 entries in your Calibre library.

Huge is when you have 1,000,000 entries in your Calibre library.



Amber


And I thought I was an ebook hoarder with 4,000 books...😏

Where do people get this many books? How much money must One spend for a MILLION BOOK library? 😜


Sent from my iPad using Tapatalk Pro
sydmalicious is offline   Reply With Quote
Old 09-09-2017, 02:50 AM   #24
Roshni Patel
Enthusiast
Roshni Patel began at the beginning.
 
Posts: 31
Karma: 10
Join Date: Jun 2017
Location: India
Device: none
But many times database slow down the loading process. Isn't it?
Roshni Patel is offline   Reply With Quote
Old 09-09-2017, 04:39 AM   #25
BartZorn
Member
BartZorn began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Jul 2012
Device: Sony PRS-T1
Quote:
Originally Posted by theducks View Post
Why are you running the 32 bit version?

i5 don't make the best ' file Server' machines: Xeon is more common in server room racks
I did not realize that a 64 bit version exists. Where can I download it? The normal download page does not give a hint.

Bart
BartZorn is offline   Reply With Quote
Old 09-09-2017, 04:57 AM   #26
itimpi
Wizard
itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.
 
Posts: 4,380
Karma: 910965
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
Quote:
Originally Posted by BartZorn View Post
I did not realize that a 64 bit version exists. Where can I download it? The normal download page does not give a hint.

Bart
The normal download page has an option labelled Windows (64-bit)! If you are not seeing that you are downloading from somewhere else.
itimpi is offline   Reply With Quote
Old 09-09-2017, 04:57 AM   #27
BetterRed
null operator
BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.BetterRed ought to be getting tired of karma fortunes by now.
 
Posts: 9,175
Karma: 7656413
Join Date: Mar 2012
Location: Sydney Australia
Device: none
Quote:
Originally Posted by BartZorn View Post
I did not realize that a 64 bit version exists. Where can I download it? The normal download page does not give a hint.

Bart
Eh, where have you been downloading from

Click image for larger version

Name:	1.jpg
Views:	26
Size:	93.9 KB
ID:	158932

BR
BetterRed is online now   Reply With Quote
Old 09-09-2017, 05:05 AM   #28
BartZorn
Member
BartZorn began at the beginning.
 
Posts: 19
Karma: 10
Join Date: Jul 2012
Device: Sony PRS-T1
Yes, sorry. I have always downloaded newer versions after being prompted by the running version, 32 bit.

I will replace it by the 64 bit version.

Thanks,

Bart
BartZorn is offline   Reply With Quote
Old 09-09-2017, 05:19 AM   #29
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 50,047
Karma: 43179559
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Aura H2O, Sony PRS-650, Sony PRS-T1, nook STR, iPad 4, iPhone 5
The 64-bit version should be faster as it will use more memory and have less swapping.
JSWolf is offline   Reply With Quote
Old 09-09-2017, 06:40 AM   #30
Divingduck
Guru
Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.Divingduck ought to be getting tired of karma fortunes by now.
 
Posts: 894
Karma: 1216240
Join Date: Nov 2010
Location: Germany
Device: Sony PRS-650
@BartZorn
When the performance issue happen again check with the task manager and resource manager your system performance. This will maybe give you additional hints for improvements.
Divingduck is offline   Reply With Quote
Reply

Tags
performance

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Large Library Performance Comparisons Down South Calibre 9 06-08-2013 12:37 PM
Performance issue with large library audeojude Calibre 25 12-07-2011 05:44 PM
DX performance on large (>100MB) pdf files? Blackguard Amazon Kindle 6 06-16-2009 07:57 PM
Library size and performance MrFinch Calibre 4 01-01-2009 05:11 AM
Performance with large Libraries? itimpi Calibre 3 12-14-2008 03:46 PM


All times are GMT -4. The time now is 02:42 AM.


MobileRead.com is a privately owned, operated and funded community.