Quote:
Originally Posted by mbovenka
I think I am hitting some corner case where the Soundex algorithm starts eating memory. When I use Soundex match on my Titles, the Calibre process starts using more and more RAM (from a base value of about 900 MB) until it hits the 32-bit process limit and goes kaboom (with the portable version) or starts swapping like mad after filling my 8 GB RAM and completely locking my PC (with the 64-bit version). With the Fuzzy algorithm it uses no more than 1 GB (32-bit)or 1.5 GB (64-bit).
The debug log of the 32-bit version is here: Spoiler:
calibre Debug log
calibre 2.26 Portable isfrozen: True is64bit: False
Windows-8-6.2.9200 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM && BOL_NL && catawiki && Extract ISBN && KoboTouchExtended && KindleUnpack - The Plugin && Manage Series && Count Pages && Barnes & Noble && Quality Check && Obok DeDRM && Kobo Utilities && Webscription && KePub Output && Goodreads && Fantastic Fiction Adults && Fantastic Fiction && Find Duplicates
Starting up...
DEBUG: 0.0 obok::utilities.py - loading translations
DEBUG: 0.0 obok::dialogs.py - loading translations
DEBUG: 0.0 obok::config.py - loading translations
DEBUG: 0.0 obok::action_err.py - loading translations
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 13.1 No Kobo Touch, Glo or Mini appears to be connected
DEBUG: 13.1 rebuild_menus - self.supports_ratings=None
Started up in 29.84 seconds with 140238 books
SMART_DEV ( 0.00: 0.002) _attach_to_port try ip address "" on port 9090
SMART_DEV ( 0.91: 0.804) startup_on_demand listening on port 9090
SMART_DEV ( 0.97: 0.021) _attach_to_port try ip address "" on port 54982
SMART_DEV ( 1.02: 0.000) startup_on_demand broadcast socket listening on port 54982
SMART_DEV ( 2.08: 1.014) run All IP addresses {'{6517BCBE-7D0A-4CB1-8C84-14B3FFAFC80F}': [{'addr': '169.254.196.192'}], '{FB9E5A1C-970A-4FE3-A88F-546A6A940162}': [{'broadcast': '192.168.192.255', 'netmask': '255.255.255.0', 'addr': '192.168.192.3'}], '{F42A7CC3-6D02-11E3-824E-806E6F6E6963}': [{'broadcast': '127.255.255.255', 'netmask': '255.0.0.0', 'addr': '127.0.0.1'}], '{5B09173B-6A84-4D21-87C3-BD721EB0E535}': [{'addr': '169.254.101.53'}]}
calibre 2.26 Portable isfrozen: True is64bit: False
Windows-8-6.2.9200 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '8', '6.2.9200')
Python 2.7.9
Windows: ('8', '6.2.9200', '', 'Multiprocessor Free')
Successfully initialized third party plugins: DeDRM && BOL_NL && catawiki && Extract ISBN && KoboTouchExtended && KindleUnpack - The Plugin && Manage Series && Count Pages && Barnes & Noble && Quality Check && Obok DeDRM && Kobo Utilities && Webscription && KePub Output && Goodreads && Fantastic Fiction Adults && Fantastic Fiction && Find Duplicates
Traceback (most recent call last):
File "calibre_plugins.find_duplicates.action", line 195, in toolbar_button_clicked
File "calibre_plugins.find_duplicates.action", line 156, in find_book_duplicates
File "calibre_plugins.find_duplicates.duplicates", line 127, in run_book_duplicates_check
File "calibre_plugins.find_duplicates.book_algorith ms", line 61, in run_duplicate_check
File "calibre_plugins.find_duplicates.book_algorith ms", line 114, in convert_candidates_to_groups
File "calibre_plugins.find_duplicates.book_algorith ms", line 199, in partition_using_exemptions
MemoryError
If any more info is needed, let me know. |
What you need to do is stop running the 32-bit portable version and install the 64-bit version. The 32-bit version cannot access all of your 8GB of ram. You need the 64-bit version so it can access more ram.