Suddently Search Unusably Slow, Cannot Delete Tag

idwtgyai · 01-22-2021, 03:18 AM

I recently upgraded my OS (Fedora 33). Now, I cannot use calibre because all searches are too slow. It doesn't matter what or where I search. The main Search field and the tag search are both too slow; it takes 30 seconds per character. It's unusable.

In trying to fix this, I also managed to delete the tag group from the left-side pane, which lists authors, languages, series, formats, etc. I don't know how to add the tags group back. This is not a major problem, but I would like to get it back, of course.

When I try to search anything, the "Worker" process spikes to 100 % CPU usage.

My suspicion is that there is a bad tag. When I go to the tag manager, I see there is one tag at the very top that has special characters in it. But, when I try to "recycle" this tag, the whole application crashes. I can delete other tags this way, though, so I'm pretty sure I should get rid of that tag, even if it is not the root cause.

I have a pretty large library of 4300+ books.

Any ideas? How do I delete this one tag? Do you think this slowness could be cause by one bad tag?

kovidgoyal · 01-22-2021, 03:26 AM

Switch to a new library to check if the slowness is caused by your existing library. And since you are on linux make sure you are using the official calibre binaries not the distro calibre package.

idwtgyai · 01-22-2021, 03:30 AM

Okay, so I've located the entry with that strange tag, and anything I do to try to interact with it, hangs Calibre. I even deleted the directories & files in the library, but the entry is still there. How do I fix this?

idwtgyai · 01-22-2021, 03:35 AM

Thanks!

I created a new, empty library, and that doesn't show any slowness, but it doesn't have any books in it, so, I'm not sure what to make of that.

idwtgyai · 01-22-2021, 03:37 AM

Okay, i added a hand full of PDFs I had laying around and still no slowness. Searching is supper spiffy fast.

idwtgyai · 01-22-2021, 03:39 AM

I am using the distro package. But, I was using the official release and had some problems with it, so I switched back to the distro. I could try it again, but there's no way to install it "locally", which is a problem for me. So that made using the installer a lot of trouble.

idwtgyai · 01-22-2021, 03:59 AM

Okay, I installed the official 5.10 version from your server and it behaves the same way. But, now my database is upgraded to version 24, so I'm guessing I cannot go back.

idwtgyai · 01-22-2021, 04:05 AM

Yay! The new version allowed me to delete the offending tag and now all the searching is spiffy fast again!

Thank you!

So, it was one offending tag. And, the tag editor was more robust and let me delete it without crashing. The offending tag was huge, very long, with '%' chars all over, like a URL.

I think my install of your official version is working. I'll keep that, for now.

idwtgyai · 01-22-2021, 04:18 AM

Also, got my tag category back in the left pane: right-click...

kovidgoyal · 01-22-2021, 06:16 AM

you most definitely can install the official version locally, the instructions to do so are on the download page.

idwtgyai · 01-22-2021, 02:56 PM

What I meant was that it cannot be completed in user space. All install procedures require root privileges at some point. That's the part that I don't like. I prefer the distro pkg for that reason. I don't mind placing files in /opt, but i don't want to run any code/scripts as root.

It's okay, I think I have a functional install, without running the post install script.

Thanks for your help!

idwtgyai · 01-22-2021, 03:01 PM

BTW, I did not add this offending tag. It must have been part of the PDF when I imported it. FYI.

kovidgoyal · 01-22-2021, 11:16 PM

No, the installer does not require root if you run it in isolated mode.

idwtgyai · 01-23-2021, 03:28 PM

Hmm, I have read the installation instruction three times now and never got to the "isolated installation" version of the instructions. I had to search the page to find it. There are seven different installation command sets on that page, and six of them explicitely require root privileges. Thanks for telling me about this option. I'll try it.

01-22-2021, 03:18 AM	#1
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	Suddently Search Unusably Slow, Cannot Delete Tag I recently upgraded my OS (Fedora 33). Now, I cannot use calibre because all searches are too slow. It doesn't matter what or where I search. The main Search field and the tag search are both too slow; it takes 30 seconds per character. It's unusable. In trying to fix this, I also managed to delete the tag group from the left-side pane, which lists authors, languages, series, formats, etc. I don't know how to add the tags group back. This is not a major problem, but I would like to get it back, of course. When I try to search anything, the "Worker" process spikes to 100 % CPU usage. My suspicion is that there is a bad tag. When I go to the tag manager, I see there is one tag at the very top that has special characters in it. But, when I try to "recycle" this tag, the whole application crashes. I can delete other tags this way, though, so I'm pretty sure I should get rid of that tag, even if it is not the root cause. I have a pretty large library of 4300+ books. Any ideas? How do I delete this one tag? Do you think this slowness could be cause by one bad tag?

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Delete complete tag	abraum	Editor	8	09-28-2020 05:39 AM
Tag Editor - Delete multiple categories?	weberr	Library Management	13	09-16-2018 04:04 PM
How do I delete a User-Defined tag?	phossler	Editor	7	04-19-2015 09:49 PM
Delete Tag Slows/Freezes Calibre	Alphite	Library Management	3	05-26-2014 02:29 PM
How to delete a tag?	TdeV	Calibre	5	06-19-2011 11:10 PM

01-22-2021, 03:26 AM	#2
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Switch to a new library to check if the slowness is caused by your existing library. And since you are on linux make sure you are using the official calibre binaries not the distro calibre package.

01-22-2021, 03:30 AM	#3
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	Okay, so I've located the entry with that strange tag, and anything I do to try to interact with it, hangs Calibre. I even deleted the directories & files in the library, but the entry is still there. How do I fix this?

01-22-2021, 03:35 AM	#4
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	Thanks! I created a new, empty library, and that doesn't show any slowness, but it doesn't have any books in it, so, I'm not sure what to make of that.

01-22-2021, 03:37 AM	#5
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	Okay, i added a hand full of PDFs I had laying around and still no slowness. Searching is supper spiffy fast.

01-22-2021, 03:39 AM	#6
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	I am using the distro package. But, I was using the official release and had some problems with it, so I switched back to the distro. I could try it again, but there's no way to install it "locally", which is a problem for me. So that made using the installer a lot of trouble.

01-22-2021, 03:59 AM	#7
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	Okay, I installed the official 5.10 version from your server and it behaves the same way. But, now my database is upgraded to version 24, so I'm guessing I cannot go back.

01-22-2021, 04:05 AM	#8
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	Yay! The new version allowed me to delete the offending tag and now all the searching is spiffy fast again! Thank you! So, it was one offending tag. And, the tag editor was more robust and let me delete it without crashing. The offending tag was huge, very long, with '%' chars all over, like a URL. I think my install of your official version is working. I'll keep that, for now.

01-22-2021, 04:18 AM	#9
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	Also, got my tag category back in the left pane: right-click...

01-22-2021, 06:16 AM	#10
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	you most definitely can install the official version locally, the instructions to do so are on the download page.

01-22-2021, 02:56 PM	#11
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	What I meant was that it cannot be completed in user space. All install procedures require root privileges at some point. That's the part that I don't like. I prefer the distro pkg for that reason. I don't mind placing files in /opt, but i don't want to run any code/scripts as root. It's okay, I think I have a functional install, without running the post install script. Thanks for your help!

01-22-2021, 03:01 PM	#12
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	BTW, I did not add this offending tag. It must have been part of the PDF when I imported it. FYI.

01-22-2021, 11:16 PM	#13
kovidgoyal creator of calibre Posts: 45,609 Karma: 28549044 Join Date: Oct 2006 Location: Mumbai, India Device: Various	No, the installer does not require root if you run it in isolated mode.

01-23-2021, 03:28 PM	#14
idwtgyai Member Posts: 21 Karma: 10 Join Date: Aug 2017 Device: kobo	Hmm, I have read the installation instruction three times now and never got to the "isolated installation" version of the instructions. I had to search the page to find it. There are seven different installation command sets on that page, and six of them explicitely require root privileges. Thanks for telling me about this option. I'll try it.