Calibre speed and hierarchical tags

Noughty · 01-23-2013, 04:54 AM

I was wondering what exactly is making calibre slow for me. I have 64 version. It loads quite fast and all, but when I edit metadata in bulk (even if it's just 2 books and just changing column #kindle to on/to/was). It often hangs for awhile and sometimes I even have to restart it.
For example, in my edit column I have 8 fixed values, changing that value for 8 books at the same time gives me freeze of 20 seconds.

I think the problem could be that I have a big mess with tags - some hierarchical some not (halfway done) - it's a big mess.

Does hierarchical tags slow down calibre a lot? If there is like 200 tags, grouped in a few categories and up to 3-4 levels? Does it slow it down even then tags aren't changed, only other columns are edited?

I'm considering just getting rid off hierarchical tags and creating columns for every category - most of them would be columns values like tags and some with a fixed values. Now I made 9 columns and two would need hierarchical tags in them (only two level) or I can just add a few more columns and avoid hierarchical tags. Which would be the better option?

I just hate the freezes after every metadata edit, would like to make it as small as possible but still keep all the metadata I want (tags, columns).

I'd just like some suggestions how to optimize. I already learned using program and not simple templates (it's supposed to be faster) for columns designed from other columns and I even disable them when I don't need them (writing nothing and pasting program in it only when I need to use that column)

Sabardeyn · 01-23-2013, 05:59 AM

I don't know if it is hierarchical tags so much as just tags. At least I remember another post saying that populating the Tag Browser on loading a Library is the primary reason for the delay.

When performing searches, the delay is because of the number of records by the wide variety of fields/columns to be examined for a generic search. There is a way to limit the fields a search will check, within Preferences>Look and Feel, I believe.

As for Edit Metadata... I'm not sure what might be responsible other than the overhead involved in updating two files. Each book would be altering the metadata.db for the library and the individual OPF file save per book.

itimpi · 01-23-2013, 06:07 AM

The thing that normally slows down Calibre severely is custom columns that need recalculating. You do not mention what custom columns you have, but since #kindle is mentioned at least one is in use.

Also adding a formats column slows things down.

Whether your tags are an issue I am not sure.

Noughty · 01-23-2013, 06:25 AM

Searches and loading is fine. Only metadata change for more than one book freezes. If I edit one book it's no problem. Problem is the same either I edit 2 or 100 books.

I have quite a few custom columns, but none made from other columns, so why should my change in simple #kindle column with a few fixed values makes calibre freeze? Again, only if it's bulk edit.

Maybe with bulk edit it checks all fields if there are changes made even if you change only one value? I mean it checks all the options available in the bulk edit (my #kindel column, #genre, #type column and all others). Then it would seem logical why it takes a lot of time for me since there are a lot of columns to check.

Maybe there should be a change how bulk edit is done, to not check all values, but only the ones the changes were made to. There is Apply changes to columns in bulk edit to every column, so it would seem that it shouldn't go through all the columns, but maybe it does on some degree?
That would really explain why it freezes after bulk edit. But also rises a question why does it check all columns (if it does) if there is the "Apply changes" to every column which is ticked (v) when there are any changes made to that column.
It would explain why calibre freezes after bulk edit - it checks every single column, even if it shouldn't.

Hope at least somebody understood what I was trying to say. My english sometimes limits me.

DoctorOhh · 01-23-2013, 06:47 AM

Quote:

Originally Posted by Noughty

Maybe with bulk edit it checks all fields if there are changes made even if you change only one value? I mean it checks all the options available in the bulk edit (my #kindel column, #genre, #type column and all others). Then it would seem logical why it takes a lot of time for me since there are a lot of columns to check.

I have no logical explanation, but if by #type the column is setup to show book formats this is the biggest culprit of slowing libraries to a crawl.

Noughty · 01-23-2013, 07:11 AM

no

. Its anthology, spin off and other things about book, ending, favorites, length. That's why I'd like to divide it into hierarchical on ending, length, favorites etc.

Honest Fantasist · 01-23-2013, 08:45 AM

I have the slow problem all the time. when i click ok to exit "edit metadata" it hangs. I have one custom column which id read or not read yet, i have 12 libraries, my largest has 5 1/2 thousand books.
Any ideas?

Noughty · 01-23-2013, 10:00 AM

how long does it hangs? I think a few seconds are normal - I always had that. Over 15 seconds is annoying.

Do you have a lot of tags?

You said you only have one custom column which looks pretty simple, so it can't be just the columns.

I edited 4 books on the custom column with a few fixed values in bulk edit and it froze for 35 seconds. That's not normal.
When I installed 64 version I noticed the speed up, now it's gotten worse again.

I have latest version 64bit. And the problem definitely was with the version 9.12, don't know about others. Either something changed in calibre or something in my library. I wasn't messing with it lately.

Before with older versions of kindle hiding tag browser made it faster, now it doesn't help.

kovidgoyal · 01-23-2013, 11:46 AM

Disable your antivirus. That's the most likely culprit for speed issues.

Noughty · 01-23-2013, 12:11 PM

After disabling antivirus freeze was 36 seconds after changing author to 10 books. So no improvement.

And the speed was fine then I first installed version 64 with the same antivirus

calvin-c · 01-24-2013, 01:30 PM

Under no circumstances is disabling protective software a 'solution'. Doing so might be fine for diagnosing a problem but disabling it permanently ends with a corrupted computer.

01-23-2013, 04:54 AM	#1
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	Calibre speed and hierarchical tags I was wondering what exactly is making calibre slow for me. I have 64 version. It loads quite fast and all, but when I edit metadata in bulk (even if it's just 2 books and just changing column #kindle to on/to/was). It often hangs for awhile and sometimes I even have to restart it. For example, in my edit column I have 8 fixed values, changing that value for 8 books at the same time gives me freeze of 20 seconds. I think the problem could be that I have a big mess with tags - some hierarchical some not (halfway done) - it's a big mess. Does hierarchical tags slow down calibre a lot? If there is like 200 tags, grouped in a few categories and up to 3-4 levels? Does it slow it down even then tags aren't changed, only other columns are edited? I'm considering just getting rid off hierarchical tags and creating columns for every category - most of them would be columns values like tags and some with a fixed values. Now I made 9 columns and two would need hierarchical tags in them (only two level) or I can just add a few more columns and avoid hierarchical tags. Which would be the better option? I just hate the freezes after every metadata edit, would like to make it as small as possible but still keep all the metadata I want (tags, columns). I'd just like some suggestions how to optimize. I already learned using program and not simple templates (it's supposed to be faster) for columns designed from other columns and I even disable them when I don't need them (writing nothing and pasting program in it only when I need to use that column)

01-23-2013, 10:00 AM	#8
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	how long does it hangs? I think a few seconds are normal - I always had that. Over 15 seconds is annoying. Do you have a lot of tags? You said you only have one custom column which looks pretty simple, so it can't be just the columns. I edited 4 books on the custom column with a few fixed values in bulk edit and it froze for 35 seconds. That's not normal. When I installed 64 version I noticed the speed up, now it's gotten worse again. I have latest version 64bit. And the problem definitely was with the version 9.12, don't know about others. Either something changed in calibre or something in my library. I wasn't messing with it lately. Before with older versions of kindle hiding tag browser made it faster, now it doesn't help. Last edited by Noughty; 01-23-2013 at 11:07 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Calibre Tags & Aldiko Tags Not the Same	Themus	Calibre	3	03-21-2012 08:23 PM
Hierarchical tags and their format on book details	Noughty	Library Management	12	02-19-2012 07:47 AM
Patch: Calibre adds tags to identify ebook formats created by calibre.	siebert	Calibre	1	07-18-2011 02:07 PM
Way to speed up Calibre?	johnnyr	Calibre	14	11-24-2010 02:21 AM

01-23-2013, 05:59 AM	#2
Sabardeyn Guru Posts: 644 Karma: 1242364 Join Date: May 2009 Location: The Right Coast Device: PC (Calibre), Nexus 7 2013 (Moon+ Pro), HTC HD2/Leo (Freda)	I don't know if it is hierarchical tags so much as just tags. At least I remember another post saying that populating the Tag Browser on loading a Library is the primary reason for the delay. When performing searches, the delay is because of the number of records by the wide variety of fields/columns to be examined for a generic search. There is a way to limit the fields a search will check, within Preferences>Look and Feel, I believe. As for Edit Metadata... I'm not sure what might be responsible other than the overhead involved in updating two files. Each book would be altering the metadata.db for the library and the individual OPF file save per book.

01-23-2013, 06:07 AM	#3
itimpi Wizard Posts: 4,552 Karma: 950151 Join Date: Nov 2008 Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)	The thing that normally slows down Calibre severely is custom columns that need recalculating. You do not mention what custom columns you have, but since #kindle is mentioned at least one is in use. Also adding a formats column slows things down. Whether your tags are an issue I am not sure.

01-23-2013, 06:25 AM	#4
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	Searches and loading is fine. Only metadata change for more than one book freezes. If I edit one book it's no problem. Problem is the same either I edit 2 or 100 books. I have quite a few custom columns, but none made from other columns, so why should my change in simple #kindle column with a few fixed values makes calibre freeze? Again, only if it's bulk edit. Maybe with bulk edit it checks all fields if there are changes made even if you change only one value? I mean it checks all the options available in the bulk edit (my #kindel column, #genre, #type column and all others). Then it would seem logical why it takes a lot of time for me since there are a lot of columns to check. Maybe there should be a change how bulk edit is done, to not check all values, but only the ones the changes were made to. There is Apply changes to columns in bulk edit to every column, so it would seem that it shouldn't go through all the columns, but maybe it does on some degree? That would really explain why it freezes after bulk edit. But also rises a question why does it check all columns (if it does) if there is the "Apply changes" to every column which is ticked (v) when there are any changes made to that column. It would explain why calibre freezes after bulk edit - it checks every single column, even if it shouldn't. Hope at least somebody understood what I was trying to say. My english sometimes limits me.

01-23-2013, 07:11 AM	#6
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	no . Its anthology, spin off and other things about book, ending, favorites, length. That's why I'd like to divide it into hierarchical on ending, length, favorites etc.

01-23-2013, 08:45 AM	#7
Honest Fantasist Junior Member Posts: 6 Karma: 10 Join Date: Dec 2012 Location: Sussex England Device: kindle wi-fi	I have the slow problem all the time. when i click ok to exit "edit metadata" it hangs. I have one custom column which id read or not read yet, i have 12 libraries, my largest has 5 1/2 thousand books. Any ideas?

01-23-2013, 11:46 AM	#9
kovidgoyal creator of calibre Posts: 43,842 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Disable your antivirus. That's the most likely culprit for speed issues.

01-23-2013, 12:11 PM	#10
Noughty Addict Posts: 352 Karma: 103850 Join Date: Apr 2011 Device: Kindle NT	After disabling antivirus freeze was 36 seconds after changing author to 10 books. So no improvement. And the speed was fine then I first installed version 64 with the same antivirus

01-24-2013, 01:30 PM	#11
calvin-c Guru Posts: 787 Karma: 1575310 Join Date: Jul 2009 Device: Moon+ Pro	Under no circumstances is disabling protective software a 'solution'. Doing so might be fine for diagnosing a problem but disabling it permanently ends with a corrupted computer.

Advert

Advert