AAGGGGGGGGGHHHHHHHHH - Memory Errors, Leaks and WTF's!
Hi there,
I am importing my entire library of over 14,000 ebooks into Calibre.
I have gone to a lot of trouble pre organising all my books into ln, fn - series - title or ln, fn - title (and vice versa fn ln). So I have 4 groupings of books which has captured 90% of my Library - the rest (approx 2000) are in leftover groupings.
I then import the books into calibre and making sure I clean up the few imported incorrectly (over 1000) etc I wanted to run the ISBN import plugin - but it isn't accurate and also it takes aaaaaaaages and if you select more than 500 at a time chances are it will run into a format that hangs the plugin (right at about 99% of the way through) - So I skipped doing the ISBN import.
So I start runnning the download metadata process and I think everything is going along smoothly, however upon going through my library I find that even if you have the correct title, series, series index, and author (EVERYTHING is CORRECT) and it's taken like hours and hours of work to confirm everything is correct, if the search returns 3 results 2 of which are correct (and would suffice), if there is a newer result returned (by year), or similar name but different authors etc the one at the top is selected even if it's completely wrong.
Now your thinking how often can this happen - very often is my answer as i am time and time again having to go through and check everything individually and we are talking out of 1000 titles maybe 100 to 200 titles end up being renamed either to something entirely incorrect, or just the title is correct but different series or author and sometimes everything is incorrect but the correct cover was downloaded?!?
After spending so much time making sure everything is correct only to have everything renamed automatically is like WTF?!?
Also I get memory errors after 4 hours and the entire process was a waste of time because it doesn't save the results it just downloaded for the 980 out of 1000 books it processed before getting the memory error and the memory usage of calibre has jumped to 1.4GB RAM.
Ok so I select 500 books next time and depending on a number of things it takes 4 hours to do those also, and sometimes I get a memory errors also, there is a serious memory leak in Calibre and I've learned the hard way to restart it if it's memory usage gets above 300MB (it starts with 150MB) especially before any big jobs.
Long story short - I can use windows explorer to accurately search my books - I know they are correct and I don't have to think about it... I am very quickly losing confidence in calibre as being accurate and I dread having to manually go through 10,000 books one at a time to confirm they are all correct especially that once it imports the books in calibre if the book has no cover page and happens to be one of those books that doesn't state the name of the book anywhere else your then having to revert searching sizes, or text search (oops text searching .lit or .pdf or numerous other formats - had to buy a grep program to do that).
If I did nothing else for the next month and sat at my computer for 12 hours a day going through 1 book at a time to confirm it is correctly titled, or the series hasn't been changed or the correct series number or the correct author is being displayed then I would be just about done with my library.
Can you do something like ComicRack that will return the results for the titles you are downloading metadata for if more than one result is returned or if the title and or series and or authors are incorrect, allowing you to select the CORRECT title you are downloading for or SKIP that title?!??!!?
I wouldn't mind sitting there baby sitting the process doing 100 metadata downloads at a time if I knew it wasn't going to screw with what I have that I know is correct UNLESS it prompts me to do so.
You might want to have a history for a file as well - or a short summary for the metadata download that summarises BEFORE and AFTER for each file for example:
BEFORE
Dragons of Winter Night - Dragonlance: Chronicles Trilogy [2] - Margaret Weis & Tracy Hickman
AFTER
Dragonlance - Chronicles [2] - Tracy Hickman & Douglas Niles
(that would have been a skip choice for me or download cover only choice - there are other ways that give better cover and or metadata results (MANUALLY SEARCHING AND PASTING IT IN FOR ONE!!! than by downloading crap metadata which RENAMES EVERYTHING - just coz that's all it's returning)
Sigh Peace
|