04-25-2021, 06:39 PM
|
#1 |
|
Junior Member
 Posts: 4
Karma: 10
Join Date: Apr 2021
Device: none
|
Calibre not responding
First of all, I really love Calibre.
I found an old collection of EBooks and the ease of sorting out, correcting meta, deleting unwanted titles and generally playing librarian really soothes the autistic part of my mind. Since a couple of weeks the program became unresponsive. Please find the steps already taken below. Could you please help me out? I've been at it for days and I don't seem to be making any progress. Calibre really calmed me and I was so happy using it, I would love to fix this. Issues: Calibre.exe not responding at startup for five or ten minutes Calibre.exe not responding after opening internal (Calibre) or external (Chrome/CDisplay) Ebook Viewer. Description: Was working fine before with ~75.000. Have been editing metadata and deleting titles for more than two months without issues. Installed 64 bit after reading conversion and metadata download should be faster. 64 bit ran fine for a month or so. No identified pre-cursors to start of issues: Did not install any additional software Did not update Calibre nor Windows prior to issues. Did not perform major database changes. Was running 1 or 2 versions behind current. No other issues with OS. Initially, opening an EBook viewer (native to Calibre) causes "Application is not responding" for ~4 minutes. Process info: Processor 12%, Memory 508mb Sometimes I waited, sometimes I restarted the program. After that happened about ten times, issue did not occur again for two weeks (daily use). Suddenly, issue reappeared and upon startup got "Application is not responding". Takes 5 to 10 minutes for program to load. When loaded everything works fine, apart from opening files, EBook viewer runs fine but program is not responding. Both 32bit & 64bit have the same issues. Installed software apart from misc. default Intel & Alienware applications: Witcher+Enhanced edition, Winamp, VLC, Nexus Mod Manager, MS-Office 2013, HP Smart, Chrome, CDisplay, CCleaner, 7-zip Calibre Program: Calibre version 5.16.0 32bit from file. Gui reads Calibre version 5.16.1 Calibre version 5.16.0 64bit from file. Gui reads Calibre version 5.16.1 Contents: 60.782 titles (but lots of titles have multiple filetypes) Metadata.db=148mb Library folder size: 250GB Files in folder: 512,506 files in 229,585 folders Plugins: Duplicate Files Quality Check A few Metadata sources Sharing: Local sharing upon startup Troubleshooting steps so far: Disabled possible interfering programs: (temporarily for troubleshooting purposes) No AV installed Windows Defender running at minimal, disabled: FW Anti-Malware Account Security App & Browser Security UAC Did not touch: Exploit Protection Default RansomWare protection enabled File Recovery disabled Tips & Checks from helpfile: No External monitor No instances present of: RoboForm, Logitech SetPoint Settings, Constant Guard Protection by Xfinity, Spybot, Killer Network Manager, Nahimic UI Interface, Acronis True Image. No Wacom branded USB mouse/tablet No occurrence of crash during copying from EBook viewer, no clipboard monitoring/managing application. No occurrence of crash during adding or save to disk, no instances present of: SpiderOak, odrive sync and Dell Backup and Recovery and NetDrive. RoboForm or an assistive technology like Voice Control or a Screen Reader. Full Control of C:\Users\USERNAME\AppData\Local Tried different startups: Calibre-debug --no plugins: No difference, startup time ~six minutes. Windows Safe Mode: Startup time ~6 minutes. "Application is not responding" after opening EBook Viewer persists. Installation: Tried repair mode from installer Uninstalled/Reinstalled both Privileges: Ran program "as administrator", no difference GUI: Checked Database, identified ~2000 invalid files, ~99% HTML or ZIP. Tried to mark invalid files but application stopped responding. After 2 hours, I terminated program. After restart, I selected HTML & ZIP from browser and deleted the titles, at 49% application stopped responding. After 2 hours, I terminated program. After restart, I selected HTML & ZIP from GUI browser and removed the 2 specific formats instead of deleting titles. This worked but left ~1000 titles without format. Selected those titles without format and deleted, running very long but without errors. This is where I turned to help. Would these next steps help? Complete removal of both applications Run CCleaner to assure clean registry Reinstall 64bit Calibre Rebuild database from directory System Details: Microsoft Windows 10 Home 10.0.19041 Build 19041 Alienware X51 R3 x64-based PC Systeem-SKU 6e3 Intel(R) Core(TM) i7-6700K CPU @ 4.00GHz, 4001 MHz, 4 core('s), 8 logische processor(s) BIOS Alienware 1.2.15, 29/05/2019 SMBIOS-versie 2.8 HAL 10.0.19041.906 RAM 8.00 GB Available 3.97 GB Virtual 15.2 GB Avail.virtual 10.3 GB DMA-security disabled Harddisk Calibre Program: Model TOSHIBA DT01ACA100 @ 7200 RPM Fixed hard disk Part# 4 931.51 GB Harddisk Library: Model WD Elements 2620 USB Device @ 7200 RPM External hard disk Part# 1 4.55 TB Debug Log: Spoiler:
Last edited by theducks; 04-25-2021 at 06:51 PM. Reason: spoilered |
|
|
|
04-25-2021, 07:01 PM
|
#2 |
|
Well trained by Cats
 
Posts: 30,917
Karma: 60358908
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
 Wish we always got the details up front like this. I wonder if there is something wrong with %appdata%\roaming\calibre That is where settings, PI are kept (the other loc was cache) Also, where is your system TMP and TEMP? |
|
|
|
|
04-25-2021, 07:29 PM
|
#3 |
|
Custom User Title
Posts: 10,726
Karma: 74203799
Join Date: Oct 2018
Location: Canada
Device: Kobo Libra H2O, formerly Aura HD
|
Have you run chkdsk on your drives? A failing hard drive caused some lag/not responding issues with Calibre for me.
|
|
|
|
|
04-25-2021, 07:41 PM
|
#4 | |
|
Well trained by Cats
Posts: 30,917
Karma: 60358908
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
|
Quote:
|
|
|
|
|
|
04-25-2021, 07:47 PM
|
#5 | ||
|
null operator (he/him)
Posts: 21,645
Karma: 29710510
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
Quote:
Quote:
|
||
|
|
|
|
04-25-2021, 09:56 PM
|
#6 | |
|
Bibliophagist
Posts: 45,069
Karma: 168808721
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
|
Quote:
|
|
|
|
|
|
04-25-2021, 10:34 PM
|
#7 |
|
creator of calibre
Posts: 45,223
Karma: 27110894
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Try rebooting in safe mode and see if it works there.
|
|
|
|
|
04-25-2021, 11:50 PM
|
#8 | |||
|
null operator (he/him)
Posts: 21,645
Karma: 29710510
Join Date: Mar 2012
Location: Sydney Australia
Device: none
|
Quote:
 Quote:
Quote:
Last edited by BetterRed; 04-25-2021 at 11:53 PM. |
|||
|
|
|
|
04-26-2021, 12:31 AM
|
#9 |
|
creator of calibre
Posts: 45,223
Karma: 27110894
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
If its opening the ebook viewer that is hanging, it is GPU driver issues. Update the gpu drivers and if that doesnt help, turn off hardware acceleration as described here: https://doc.qt.io/qt-5/qtwebengine-debugging.html
|
|
|
|
|
04-27-2021, 05:54 AM
|
#10 |
|
Junior Member
Posts: 4
Karma: 10
Join Date: Apr 2021
Device: none
|
Thanks all for taking the time to reply. I really appreciate the effort you put in this forum and Calibre itself.
"Wish we always got the details up front like this." Thanks, I tried to be complete and not waste your time with things I can figure out myself by reading this forum and the helpfile. "I wonder if there is something wrong with %appdata%\roaming\calibre That is where settings, PI are kept (the other loc was cache)" I could not find anything out of the ordinary. Permissions are all good. What would I be looking for? "Also, where is your system TMP and TEMP?" TEMP=C:\Users\Ik\AppData\Local\Temp TMP=C:\Users\Ik\AppData\Local\Temp "Have you run chkdsk on your drives? A failing hard drive caused some lag/not responding issues with Calibre for me." I ran checkdisk for the system disk but it found no errors: Spoiler:
I ran checkdisk for the external data disk (which is ~3 months old) and was happy to find no errors: Spoiler:
Looking at the eventlog I found a few bad block warnings but the oldest is 3 weeks ago. They appear to coincide with connecting older disks, although worrying, that is to be expected of drives ten years old. That is why I connected them, to back them up. "If its opening the ebook viewer that is hanging, it is GPU driver issues." I updated the Radeon drivers to the latest version. Having most auto-update functions disabled on my system, they were indeed outdated. The issue still persisted. Just to be absolutely clear, it's the main program that stops responding. It takes minutes to start (what it used to do in ten seconds at most). The ebookviewer works fine but when I open it, the main programs stops responding for ~6 minutes. I tried to figure out how to disable the GPU hardware acceleration. To my shame I must admit that even with the instructions you provided, I was in over my head. I found this description but it did not help so I reverted that setting. Launch Chrome, “Menu” > “Settings“. “Advanced” option. “System” section toggle “Use hardware acceleration when available” Could you please point me in the right direction? |
|
|
|
|
04-27-2021, 02:31 PM
|
#11 |
|
Junior Member
Posts: 4
Karma: 10
Join Date: Apr 2021
Device: none
|
Thank you so much for responding!
It is seldom seen that a developer of an application so popular as yours can find the time to be so interactive with their users. Of course, that gratitude extends to the users above as well! I don't know yet if it is out of bounds to reply to each and every tip so I just crammed it in to one reply. I've found some Chrome settings that hinted at GPU acceleration and disabled them (below). There were more GPU settings but they were related to camera and logging so I ruled them out as a possible culprit. Alas, changing these did not help. I'm running an export at the moment, just to be on the safe side. After that finishes I will completely remove both applications. Then, reinstall and try to start with a new library of ~100 epubs to rule out possible issues with the database or settings. I was planning to make a backup of calibre settings and metadata.db and remove them from the export directory in order to rebuild from file. Just checking the export directory (it's at 29% atm) I see that it contains to 20 1GB partxxx.calibre-data files so that probably will not work. So, after the export I will use "Save to Disk" to create another backup to rebuild the database from file. Given that it's 60.000 titles spread over 500.000 files totalling at 250GB, it should take a while. In the original rar files I found there were 75.000 titles. Since then, I have been trying to delete all erotic women's fiction. Being a middle aged man, I never knew that there were so many books written in that genre, let alone would I expect to have them in my possession. Furthermore, I also did know that, apart from so many "shades" of bondage, vampires and werewolves were so sexually appealing to women. Well, live and learn. I have been trying to be smart in the 'censoring' process and after selecting by keywords in titles and description, tags and authors I had no more tricks up my sleeve. This helped me removing about 12.000 titles but the library is still riddled with them. The process of deletion left me feeling like an old 1950's Puritan Church lady and after a long session flashing images of muscly bare chested men, some sporting fangs, still haunted me. I will leave that for another topic to see if the community can come up with some smarter filters I, namely going through the covers. In the meantime, I would really appreciate any help with your advise of disabling GPU hardware acceleration. I work in IT but it has been a very long time since that work was actually hands-on. I feel stupid and ashamed that I did not get this working. The Google Chrome flags settings (that did not help): Accelerated 2D canvas Enables the use of the GPU to perform 2d canvas rendering instead of using software rendering. – Mac, Windows, Linux, Chrome OS, Android #disable-accelerated-2d-canvas GPU rasterization Use GPU to rasterize web content. – Mac, Windows, Linux, Chrome OS, Android #disable-gpu-rasterization Zero-copy rasterizer Raster threads write directly to GPU memory associated with tiles. – Mac, Windows, Linux, Chrome OS, Android #disable-zero-copy |
|
|
|
|
04-27-2021, 10:52 PM
|
#12 |
|
creator of calibre
Posts: 45,223
Karma: 27110894
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
Set the environment variable QTWEBENGINE_CHROMIUM_FLAGS to the value --disable-gpu and then reboot and try it. That will disable the hardware acceleration.
|
|
|
|
|
04-30-2021, 05:01 AM
|
#13 |
|
Junior Member
Posts: 4
Karma: 10
Join Date: Apr 2021
Device: none
|
Thank you ever so much for taking your time and replying.
I tried to look it up but ended up in developer pages that were over my head. So, sorry but I could not figure out how to follow your advise regarding the GPU. I did manage to do what I said in previous message. I exported entire library, including settings but re-importing that would not rule out any database or settings issues. So, I saved to disk and uninstalled afterwards. I've seen a few messages regarding Calibre's cleanup of registry but I'm not sure what the fuzz is about, I did not have to remove a lot entries. After reboot, installed again (32bit to start with) and re-imported the saved directory. Obviously, this took a while so I left it overnight. This morning I found it finished with only a few warnings on duplicates. I restarted the program and it easily opened the database of ~58000 titles in ten seconds or so. The issue with the viewer, both external and internal, was gone. The gui remained responsive. Problem solved. Remaining Unknowns Plugins: I will add the metadata crawlers later tonight and if that works and I feel adventurous the "quality check" and "duplicate finder" later on. I cannot imagine they caused the issues since I tried the "no plugins" option but if the issues resurface after doing so I will let you know. Database: The backup directory from three weeks ago was ~254gb, I made a simple backup just using windows explorer. Its database was ~160mb. The directory used in Calibre (the one with the issues) was ~250gb. Its database was 148mb but after troubleshooting (deleting a few thousand files) it ended up 152mb. After some bewilderment I remembered that databases do not automatically shrink in size when you delete their content. The recently exported directory with the "calibre-data" files, the "save to disk" directory and the current working directory are all ~118gb. Obviously the former two do not contain a database that I could check without importing. Adding the "saved to disk" books from directory left me with the original amount of 58000 titles yet the database was only 88mb. So, somewhere in the process, I lost some weight in both files and database, half of it, to be exactly. I'm not sure but I seem to recall reading somewhere in the documentation that Calibre stores metadata and covers in the database (which makes absolute sense). When saving the files to disk Calibre would export that content in the opf, saving the cover in a jpg. When reading the files back from disc, it would not need to store that content in the database. That would explain at least some shrinkage but surely not half of the original database. Especially not considering the size of the directory shrunk proportionally the same half. Files: At first glance it appears like there are less duplicate formats but I could not say for sure. Since the original directory and the current one are not even remotely similar in structure, I don't know a smart way to verify their differences. There must be some tool out there that can do this but after 10 minutes of googling I was not able to find it. At these points in life I wish that I would possess basic programming skills in Python or any other language for that matter. I'm sure it would be a simple routine to verify the existence of the contents of a previously saved 63000 lines long "mybooks.csv" in the current directory. Merely the title or uuid and formats would be sufficient. I tried to think of a way do this in simple DOS but the multiple formats kept tripping me. I could not think of another way besides re-importing the 'offending' directory from file. Since I do not want to mess up again, I will use another system to do so and check what I end up with. I might post the files issue later in a suitable part of the forum if I don't manage to get my head around it. GPU settings: I never got around to trying them since, to my shame, I have to admit I'm not savvy enough to follow your simple instructions. That's on me, not on you, I really appreciate you taking the time to answer my questions. Updating the drivers from graphics card left me with horrible AMD bloatware that threatened me it would remove the updated drivers as well if I would uninstall it. I found a minimal install and will use it somewhere in time. Messing with the graphic card always makes me a bit nervous. Again, thank you very much.* Last edited by Biebel; 04-30-2021 at 05:02 AM. Reason: correction |
|
|
|
 |
| Tags |
| after ebook viewer, large library, unresponsive start |
«
Previous Thread
|
Next Thread
»
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Calibre reader not responding after switching chapters | citiroller | Calibre | 2 | 03-03-2020 04:28 AM |
| Delays: Calibre selectbooks (not responding) | johnelle | Library Management | 11 | 02-13-2019 02:58 PM |
| adding books - Calibre Not Responding | KyBunnies | Library Management | 9 | 06-08-2017 02:52 PM |
| [Old Thread] Calibre not responding | JMikeD | Calibre | 32 | 06-24-2011 01:19 AM |
| Calibre stops responding.... | phil75070 | Calibre | 1 | 12-28-2010 10:01 PM |
All times are GMT -4. The time now is 01:07 AM.