Adding books to a large database

[kovidgoyal]

Originally Posted by sirbruce

Is it resorting *after every add*? Perhaps that's the issue.

The slowdown seems clearly exponential to me; if I add a lot of books, the progress bar moves rapidly at first, then slower and slower.

Hmm it is something in the metadata reading in that case. That susbsytem is also slated for a re-re-write (i'm going to move it into a separate process, instead of jumping through hoops to get it to work in the GUI thread, that should hopefully fix this. Unfortunately because of the currently backed up state of my TODO list, it will be a little while before I get around to doing this.

I think what's happening is that there is some sort of leak in all the SIGNAL passing between the read metadata thread and the main GUI thread. Unfortunately, debugging this sort of thing takes a lot of time and effort, so unless someone is willing to spend the time and effort, it will have to wait till I get around to refactoring it into a separate process.

[sirbruce]

If it helps at all, I experienced it when I had "read metadata from files" unchecked; it was purely filling metadata from the filenames. But this was a couple of months ago; I haven't tried to add that many books since.