Calibre lags on Windows 10 Home - Page 2

BetterRed · 07-26-2018, 06:07 PM

Quote:

Originally Posted by DrChiper

Interesting.
I added search file extensions for epub files which work reasonable well as epub are just text files (within a zip container). See attachment.

Interesting, Pretty sure I've tried that and found it to be ineffective, even with Citekits ZIP iFilter DLL, but that was a long time ago on Win 7.

I'll give it a another spin on my laptop. Maybe MS did some work on Indexing in Windows 10 and didn't tell customers, or only told corporate customers.

Are you able to do successful searches?

But, even if it works for EPUB I won't be able to see them in Explorer or X1's Preview panels as I can with DOCX and PDF.

BR

Divingduck · 07-27-2018, 03:29 AM

Quote:

Originally Posted by Tanjamuse

Is there a setting in Calibre where I'm not using all the CPU?

Not really. calibre takes whatever the system is available to deliver. Like @theducks wrote, there is only a limitation for parallel jobs possible. I like to have a manual processor load limitation too but @Kovid told me long time ago this is not possible. Guess this is true also today.

DrChiper · 07-27-2018, 03:40 AM

Quote:

Originally Posted by BetterRed

Are you able to do successful searches?

Yes, I made sure to include the folder with e-books in the index search path. For my purposes using MS keyword search was sufficient enough.

Quote:

Originally Posted by BetterRed

But, even if it works for EPUB I won't be able to see them in Explorer or X1's Preview panels as I can with DOCX and PDF.

Indeed, that requires a different approach. I used to have a freeware custom indexer which worked on all kinds of files, but after they changed their business model and limited the search for the free version, I ditched that one and started using the built-in MS search.

BetterRed · 07-27-2018, 04:02 AM

Quote:

Originally Posted by BetterRed

My textual ebooks either have DOCX, PDF or both formats. DOCX and PDF get completely indexed by WS and X1, which is why I keep the DOCX/PDF formats.

Quote:

Originally Posted by DrChiper

Interesting.
I added search file extensions for epub files which work reasonable well as epub are just text files (within a zip container). See attachment.

Quote:

Originally Posted by BetterRed

Interesting, Pretty sure I've tried that and found it to be ineffective, even with Citekits ZIP iFilter DLL, but that was a long time ago on Win 7.

I'll give it a another spin on my laptop.

@DrChiper

Nuh, EPUBs are not listed in the WS or X1 search results. In books where I have DOCX, PDF or both I see both files listed in search results, but I don't see any EPUBs when I have all three.

And there's no point in creating a ZIP or RAR archives as calibre format files and using archive file iFilter DLLs just so I can search them, because I still won't see the text in the Explorer or X1 Preview panels.

So, I ask once again, are you able to do WS searches and see EPUB files listed in the WS search results?

BR

DrChiper · 07-27-2018, 04:05 AM

Oh, I just remembered that I also specifically set that the search should include compressed files (Computer -> Tools -> Folder options).

BetterRed · 07-27-2018, 04:24 AM

Quote:

Originally Posted by DrChiper

Oh, I just remembered that I also specifically set that the search should include compressed files (Computer -> Tools -> Folder options).

Nuh, already have that

Click image for larger version

Name: 1.jpg
Views: 127
Size: 34.6 KB
ID: 165234

I'm using Win 10 64bit Pro 1709.

BR

DrChiper · 07-27-2018, 04:41 AM

Unfortunately, I have to recall all this from memory as the system I'm working on now does not have epub searching configured.

What tickled my memory was your mentioning of iFilter: I remember that I did certainly installed some additional ones, at least a PDF iFilter. I do remember that I did some tweaking to get it to work.

That said: at that time when using a "search string", WS returned:

epub files of which the file name comprised the "search string";
epub files in which the epub contents contained the "search string".

Obviously, the latter situation was what I was after, but I cannot remember the details how I got there.

LadyKate · 07-27-2018, 04:43 AM

Until last week Calibre was a little slow opening but not horrid when I consider that my library is around 250 gig and over 700000 "books". I updated Avast (it required a new version be installed) on my Windows 10 system and tried opening Calibre. Oh yes, the last thing I did before the Avast update was to run a check on the library and make some corrections.

Since then Calibre would not open. It would sit there for hours, I actually let it sit overnight to see if it would finally open.

I uninstalled Calibre using Control Panel and after a reboot reinstalled. Still no luck opening the program. I finally renamed the library directory so it would open on an empty folder. After a fairly long wait Calibre opened. I then switched to the newly named directory and my library was fine.

Once again Calibre is taking a long time trying to open. It has been three hours. I am wondering where I should be looking. The library itself is on a normal hard drive. The program is running on an SSD.

If anyone else has had these issues I would like any hints you have for fixing it.

I am starting to think I need to look into doing a reinstall of windows. It has been years since I did a clean install.

BetterRed · 07-27-2018, 04:56 AM

Quote:

Originally Posted by DrChiper

Yes, I made sure to include the folder with e-books in the index search path. For my purposes using MS keyword search was sufficient enough.

I want to search the content, keyword searches requires the keywords be in the file metadata - if I'm looking for a person (e.g. Alan Greenspan) it's unlikely to be in a keyword.

What i have works reliably, with no performance penalties, search response times are typically sub one-second, and I can integrate with calibre using DaltonST's DSR plugin. For WS searches I can even save the ms-search file in the calibre library itself and run it again. And I can Preview the results in a human readable format. Hence, I'm loathe to disturb that happy set of circumstances.

Apparently there is a tool that allows one to preview EPUB covers in Windows Explorer, but AFAIK there's nothing to preview the content - weird.

Added: what's needed is an EPUB iFilter/Preview DLL, but none of the outfits who have the skills to write one have an incentive to do so, they'd want to be another brick in their garden wall.

BR

BetterRed · 07-27-2018, 05:00 AM

Quote:

Originally Posted by LadyKate

Until last week Calibre was a little slow opening but not horrid when I consider that my library is around 250 gig and over 700000 "books". I updated Avast (it required a new version be installed) on my Windows 10 system and tried opening Calibre. Oh yes, the last thing I did before the Avast update was to run a check on the library and make some corrections.

Since then Calibre would not open. It would sit there for hours, I actually let it sit overnight to see if it would finally open.

I uninstalled Calibre using Control Panel and after a reboot reinstalled. Still no luck opening the program. I finally renamed the library directory so it would open on an empty folder. After a fairly long wait Calibre opened. I then switched to the newly named directory and my library was fine.

Once again Calibre is taking a long time trying to open. It has been three hours. I am wondering where I should be looking. The library itself is on a normal hard drive. The program is running on an SSD.

If anyone else has had these issues I would like any hints you have for fixing it.

I am starting to think I need to look into doing a reinstall of windows. It has been years since I did a clean install.

I'd get rid of Avast - or at least exclude all calibre related folders (install, libraries, configuration, and cache) from its grasp. I'd also give calibre a private TEMP folder and exclude that as well.

BR

Divingduck · 07-27-2018, 05:07 AM

@LadyKate,
Had you check with resource monitor? This will give you maybe an idea to look at.

DrChiper · 07-27-2018, 05:35 AM

Quote:

Originally Posted by BetterRed

Added: what's needed is an EPUB iFilter/Preview DLL, but none of the outfits who have the skills to write one have an incentive to do so, they'd want to be another brick in their garden wall.

Yep, that's the ultimate solution. However, I vaguely recall that I did something to associate epub files with the Zip iFilter as that is what epubs really are: a zip wrapper around htm, html or xhtml files. But retracing the index settings today, one does not seems to be allowed to do that (anymore?).

DrChiper · 07-27-2018, 06:50 AM

Ok, as I was intrigued, I did some searches so I perhaps could recreate the steps I took for the epub contents indexing. And encountered on MobileRead several false positives in the past by BetterRed... So I now understand your eagerness, BR, on my remarks

Unfortunately, I could not find my aha erlebnis from the past, when I positively did had something working. I did at least installed a separate PDF iFilter and possibly some others as well (ZIP, HTML, ?). So I figure that combination and perhaps some other tweaking (registry?) somehow made it work, but that's it.

I'm sorry, but due to my age my brain is not up to par anymore.

Adoby · 07-27-2018, 08:10 AM

Quote:

Originally Posted by BetterRed

I'd get rid of Avast - or at least exclude all calibre related folders (install, libraries, configuration, and cache) from its grasp. I'd also give calibre a private TEMP folder and exclude that as well.

BR

... and make sure that the TEMP folder is on the SSD.

But that is a general performance tip. Nothing about your specific problem.

Turning off the AV software is the first thing I would try. And see what processes/programs are working in the system monitor.

BetterRed · 07-27-2018, 08:55 AM

@DrChiper - maybe this will ring a bell ==>> Nirsoft's Search Filter View

It allows one to 'force' an iFilter onto a file type. When I first got Win 7 (2008/9) I think I tried the iFilterShop ZIP iFilter. As I recall it sort of half-worked. but it treated the zip content as plain text and I couldn't find a way for get it to use the HTML iFilter. The end result was that the index would become hopelessly corrupt and search would stop working; I might even have gotten some BSODs because of it.

At one stage I decided the only way to fix it was to re-install windows, which I duly did but it was still broken - then I realised all I had to do was to uninstall/reinstall the Indexing - that fixed it until it broke again

Once I stopped force feeding EPUBs into the ZIP iFilter I had a stable system again.

At the time, I searched high and low for some Open Source ZIP and HTML iFilter DLLs, back then I thought might have had a go at producing a EPUB iFilter, but I never found anything,

If MS persevere with their Edge support for EPUB there maybe some hope that they might provide EPUB Support in Windows Explorer ans Search.

BTW : you may have seen me suggest that MacOS Spotlight could search within EPUBs, that turned out to be fake news. All it can do is search on HFS extended attributes - which is a bit like MS keywords.

BR

07-27-2018, 04:05 AM	#20
DrChiper Bookish Posts: 1,017 Karma: 2003162 Join Date: Jun 2011 Device: PC, t1, t2, t3, Clara BW, Clara HD, Libra 2, Libra Color, Nxtpaper 11	Oh, I just remembered that I also specifically set that the search should include compressed files (Computer -> Tools -> Folder options). Attached Thumbnails

07-27-2018, 04:41 AM	#22
DrChiper Bookish Posts: 1,017 Karma: 2003162 Join Date: Jun 2011 Device: PC, t1, t2, t3, Clara BW, Clara HD, Libra 2, Libra Color, Nxtpaper 11	Unfortunately, I have to recall all this from memory as the system I'm working on now does not have epub searching configured. What tickled my memory was your mentioning of iFilter: I remember that I did certainly installed some additional ones, at least a PDF iFilter. I do remember that I did some tweaking to get it to work. That said: at that time when using a "search string", WS returned: epub files of which the file name comprised the "search string"; epub files in which the epub contents contained the "search string". Obviously, the latter situation was what I was after, but I cannot remember the details how I got there.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Windows 7 at home, and XP at work...	wolfskies	Calibre	5	06-11-2015 01:38 PM
Calibre Content Server and Windows Home Server 2011	HughMcC	Calibre	8	10-01-2014 07:26 AM
Kindle 3 page lags solved?	troutguy	Amazon Kindle	7	09-19-2010 05:12 AM
Ejecting K2 Int'l from Calibre on Windows Vista Home Premium	nickredding	Calibre	4	01-16-2010 07:04 PM
Hack Windows XP Home into Windows XP Pro	Colin Dunstan	Lounge	1	06-01-2005 03:23 PM

07-27-2018, 04:43 AM	#23
LadyKate Fanatic Posts: 515 Karma: 1470724 Join Date: Jul 2013 Location: Quebec CA Device: android 4 (samsung tablet and asus tablet)	Until last week Calibre was a little slow opening but not horrid when I consider that my library is around 250 gig and over 700000 "books". I updated Avast (it required a new version be installed) on my Windows 10 system and tried opening Calibre. Oh yes, the last thing I did before the Avast update was to run a check on the library and make some corrections. Since then Calibre would not open. It would sit there for hours, I actually let it sit overnight to see if it would finally open. I uninstalled Calibre using Control Panel and after a reboot reinstalled. Still no luck opening the program. I finally renamed the library directory so it would open on an empty folder. After a fairly long wait Calibre opened. I then switched to the newly named directory and my library was fine. Once again Calibre is taking a long time trying to open. It has been three hours. I am wondering where I should be looking. The library itself is on a normal hard drive. The program is running on an SSD. If anyone else has had these issues I would like any hints you have for fixing it. I am starting to think I need to look into doing a reinstall of windows. It has been years since I did a clean install.

07-27-2018, 05:07 AM	#26
Divingduck Wizard Posts: 1,166 Karma: 1410083 Join Date: Nov 2010 Location: Germany Device: Sony PRS-650	@LadyKate, Had you check with resource monitor? This will give you maybe an idea to look at.

07-27-2018, 06:50 AM	#28
DrChiper Bookish Posts: 1,017 Karma: 2003162 Join Date: Jun 2011 Device: PC, t1, t2, t3, Clara BW, Clara HD, Libra 2, Libra Color, Nxtpaper 11	Ok, as I was intrigued, I did some searches so I perhaps could recreate the steps I took for the epub contents indexing. And encountered on MobileRead several false positives in the past by BetterRed... So I now understand your eagerness, BR, on my remarks Unfortunately, I could not find my aha erlebnis from the past, when I positively did had something working. I did at least installed a separate PDF iFilter and possibly some others as well (ZIP, HTML, ?). So I figure that combination and perhaps some other tweaking (registry?) somehow made it work, but that's it. I'm sorry, but due to my age my brain is not up to par anymore.

07-27-2018, 08:55 AM	#30
BetterRed null operator (he/him) Posts: 21,744 Karma: 30237526 Join Date: Mar 2012 Location: Sydney Australia Device: none	@DrChiper - maybe this will ring a bell ==>> Nirsoft's Search Filter View It allows one to 'force' an iFilter onto a file type. When I first got Win 7 (2008/9) I think I tried the iFilterShop ZIP iFilter. As I recall it sort of half-worked. but it treated the zip content as plain text and I couldn't find a way for get it to use the HTML iFilter. The end result was that the index would become hopelessly corrupt and search would stop working; I might even have gotten some BSODs because of it. At one stage I decided the only way to fix it was to re-install windows, which I duly did but it was still broken - then I realised all I had to do was to uninstall/reinstall the Indexing - that fixed it until it broke again Once I stopped force feeding EPUBs into the ZIP iFilter I had a stable system again. At the time, I searched high and low for some Open Source ZIP and HTML iFilter DLLs, back then I thought might have had a go at producing a EPUB iFilter, but I never found anything, If MS persevere with their Edge support for EPUB there maybe some hope that they might provide EPUB Support in Windows Explorer ans Search. BTW : you may have seen me suggest that MacOS Spotlight could search within EPUBs, that turned out to be fake news. All it can do is search on HFS extended attributes - which is a bit like MS keywords. BR