Any Way to Subdivide the Main Directory? - Page 2

johnelle · 12-21-2020, 05:25 AM

So to wrap up this thread. I have been working with Synology on this and it turns out there are no resource limits per se that I am hitting. They do have a limitation of 10,000 sub-folders per folder if you want to view the files from the web gui built into the unit. That doesn't apply to file systems mounted on other computers.

Over time Calibre builds up a file structure that doesn't match the expectations of other file manipulation software. So while I haven't hit any limits, dealing with many 10s of thousands of tiny files (i.e. subfolders) contained in a single main folder can have an impact on performance. For example a full backup of the Calibre directory from scratch (i.e. empty disk) takes ~2 weeks. A year ago it was more like 2 days.

So I will probably try the column hack at some point after things settle down a bit.

Funny I thought I would be hitting limits on the embedded database before I hit basic file system limitations.

As far as settable OS parameters there is very little that can be changed once the volume is created.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Remote add to content server using server directory instead of local directory	Velk	Server	3	01-03-2019 06:05 AM
(Suggestion) Move ebook-viewer.exe to the main directory next to calibre-portable.exe	avid01	Library Management	6	07-03-2014 03:55 AM
What is the difference between the main metadata.db and sub-directory metadata.db?	iridius	Library Management	5	02-23-2011 11:44 AM
LOST.DIR in NC main directory.	roger_15	Nook Color & Nook Tablet	7	01-11-2011 02:35 PM
I Can't add a directory	takelu	Calibre	2	02-05-2010 07:21 PM

12-21-2020, 05:25 AM	#16
johnelle Zealot Posts: 119 Karma: 2137668 Join Date: Mar 2015 Location: Groton, MA Device: Kindle app on Samsung Tab	So to wrap up this thread. I have been working with Synology on this and it turns out there are no resource limits per se that I am hitting. They do have a limitation of 10,000 sub-folders per folder if you want to view the files from the web gui built into the unit. That doesn't apply to file systems mounted on other computers. Over time Calibre builds up a file structure that doesn't match the expectations of other file manipulation software. So while I haven't hit any limits, dealing with many 10s of thousands of tiny files (i.e. subfolders) contained in a single main folder can have an impact on performance. For example a full backup of the Calibre directory from scratch (i.e. empty disk) takes ~2 weeks. A year ago it was more like 2 days. So I will probably try the column hack at some point after things settle down a bit. Funny I thought I would be hitting limits on the embedded database before I hit basic file system limitations. As far as settable OS parameters there is very little that can be changed once the volume is created.