[FileType Plugin] GetFileName

[ownedbycats]

Here we go. You should be able to tell which file is which by the filenames.

EpubMerge: DEBUG: 2021-05-09 18:02:10,015: calibre_plugins.epubmerge.epubmerge_plugin(158): macmenuhack file_path:C:\Users\Brianna\AppData\Roaming\calibre\plugins\fanficfare_macmenuhack.txt
FFF: DEBUG: 2021-05-09 18:02:10,025: calibre_plugins.fanficfare_plugin.fff_plugin(221): Plugin FanFicFare macmenuhack file_path:C:\Users\Brianna\AppData\Roaming\calibre\plugins\fanficfare_macmenuhack.txt
calibre Debug log
calibre 5.17 [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.19041 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19041')
Python 3.8.5
Windows: ('10', '10.0.19041', '', 'Multiprocessor Free')
Interface language: None
DEBUG:    0.0 GetFileName::__init__.py - loading translations
Successfully initialized third party plugins: DeDRM (7, 2, 1) && Action Chains (1, 8, 7) && Audit Log (1, 0, 16) && Barnes & Noble (1, 2, 16) && Calibre Power Search Plugin (2, 0, 0) && Comments Cleaner (1, 3, 2) && Count Pages (1, 11, 0) && Embed Comic Metadata (1, 6, 1) && EpubCheck (0, 2, 3) && EpubMerge (2, 11, 0) && Extract ISBN (1, 5, 0) && FanFicFare (4, 2, 0) && Fantastic Fiction (1, 4, 0) && Favourites Menu (1, 0, 5) && Find Duplicates (1, 8, 5) && Generate Cover (2, 0, 2) && GetFileName (0, 1, 1) && Goodreads (1, 5, 1) && Import List (1, 5, 4) && Job Spy (1, 0, 190) && Kindle hi-res covers (0, 5, 0) && Kobo Books (1, 8, 2) && Kobo Utilities (2, 13, 2) && KoboTouchExtended (3, 4, 4) && Library Codes (1, 0, 50) && Manage Series (1, 2, 11) && Modify ePub (1, 6, 2) && Obok DeDRM (7, 2, 1) && Open With (1, 5, 13) && Overdrive Link (2, 45, 1) && Quality Check (1, 11, 2) && Reading List (1, 7, 6) && Search The Internet (1, 8, 1) && SmartEject (2, 3, 0) && Standard Ebooks (1, 0, 0) && Sum Column (0, 3, 1) && View Manager (1, 6, 0) && Walk Search History (1, 3, 2)
calibre 5.17 [64bit]  embedded-python: True is64bit: True
Windows-10-10.0.19041 Windows ('64bit', 'WindowsPE')
('Windows', '10', '10.0.19041')
Python 3.8.5
Windows: ('10', '10.0.19041', '', 'Multiprocessor Free')
Interface language: None
Successfully initialized third party plugins: DeDRM (7, 2, 1) && Action Chains (1, 8, 7) && Audit Log (1, 0, 16) && Barnes & Noble (1, 2, 16) && Calibre Power Search Plugin (2, 0, 0) && Comments Cleaner (1, 3, 2) && Count Pages (1, 11, 0) && Embed Comic Metadata (1, 6, 1) && EpubCheck (0, 2, 3) && EpubMerge (2, 11, 0) && Extract ISBN (1, 5, 0) && FanFicFare (4, 2, 0) && Fantastic Fiction (1, 4, 0) && Favourites Menu (1, 0, 5) && Find Duplicates (1, 8, 5) && Generate Cover (2, 0, 2) && GetFileName (0, 1, 1) && Goodreads (1, 5, 1) && Import List (1, 5, 4) && Job Spy (1, 0, 190) && Kindle hi-res covers (0, 5, 0) && Kobo Books (1, 8, 2) && Kobo Utilities (2, 13, 2) && KoboTouchExtended (3, 4, 4) && Library Codes (1, 0, 50) && Manage Series (1, 2, 11) && Modify ePub (1, 6, 2) && Obok DeDRM (7, 2, 1) && Open With (1, 5, 13) && Overdrive Link (2, 45, 1) && Quality Check (1, 11, 2) && Reading List (1, 7, 6) && Search The Internet (1, 8, 1) && SmartEject (2, 3, 0) && Standard Ebooks (1, 0, 0) && Sum Column (0, 3, 1) && View Manager (1, 6, 0) && Walk Search History (1, 3, 2)
Turning on automatic hidpi scaling
devicePixelRatio: 1.0
logicalDpi: 96.0 x 96.0
physicalDpi: 91.84180790960451 x 91.7458193979933
Using calibre Qt style: True
[0.00] Starting up...
[0.00] Showing splash screen...
[3.84] splash screen shown
[3.84] Initializing db...
[4.64] db initialized
[4.64] Constructing main UI...
DEBUG:    0.0 KoboUtilites::action.py - loading translations
DEBUG:    0.0 KoboUtilites::dialogs.py - loading translations
DEBUG:    0.0 KoboUtilites::action.py - loading translations
DEBUG:    0.0 obok::utilities.py - loading translations
DEBUG:    0.0 obok::dialogs.py - loading translations
DEBUG:    0.0 obok::config.py - loading translations
DEBUG:    0.0 obok::action_err.py - loading translations
Action chains: _call_plugins_action_chains_resources(): start
Action Chains: _call_plugins_action_chains_resources(): finished
calling method (on_modules_update) of obj (Formulas)
Action chains: formulas: running on_modules_update()
Action chains: _call_plugins_on_modules_update(): start
Action Chains: _call_plugins_on_modules_update(): finished
Job Spy has begun initialization...
Calibre, and hence Job Spy, was gracefully shut down last time?  True
Last time daemon started:  never
Last time daemon failed:  never
Total daemon starts inception_to_date:  0
Total daemon failures inception-to-date:  0
JS Tag Browser Icons Tool is running at Startup
Job Spy has finished initialization...
DEBUG:    7.2 No Kobo Touch, Glo or Mini appears to be connected
DEBUG:    7.2 rebuild_menus - self.supports_ratings=None, self.supports_tiles=None
DEBUG:    7.2 KoboUtilities:set_toolbar_button_tooltip - start: text='None'
DEBUG:    7.2 KoboUtilities:set_toolbar_button_tooltip - setting to text='Utilities to use with Kobo ereaders

Driver: KoboTouchExtended'
Job Spy: self.gui.tags_view.recount() is enhanced for showing icons of user category child values...
[14.75] main UI initialized...
[14.75] Hiding splash screen
Action Chain: Event (Location Selected) entry is unchecked, not proceeding
DeDRM v7.2.1: Trying to decrypt Death by Coffee - DRM.epub
DeDRM v7.2.1: Verifying zip archive integrity
DeDRM v7.2.1: Death by Coffee - DRM.epub is a secure Adobe Adept ePub
DeDRM v7.2.1: Trying Encryption key default_key
DeDRM v7.2.1: Decrypted with key default_key after 0.3 seconds
DeDRM v7.2.1: Finished after 0.3 seconds
Action Chain: Event (Calibre Initialized) entry is unchecked, not proceeding
Starting QuickView
[79.97] splash screen hidden
[79.97] Started up in 79.97 seconds with 1684 books
Job Spy: self.gui.tags_view.recount() is enhanced for showing icons of user category child values...
stdout+stderr from file dialog helper: [b'', b'']
piped data from file dialog helper: [b'LJ\xd5b\x8aA\xd9\xa9\xf6\xbd\xb2\xf9\xc7\xe7BQ\x8e^\xba\xb9\x85\xa2\xdf\x01\xa2\x84\x18w!M.Y', b'D:\\Documents\\Death by Coffee - DRM.epub']
Running file type plugin GetFileName failed with traceback:
Traceback (most recent call last):
  File "calibre\customize\ui.py", line 176, in _run_filetype_plugins
  File "calibre_plugins.getfilename.__init__", line 108, in run
  File "json\__init__.py", line 180, in dump
TypeError: a bytes-like object is required, not 'str'
DeDRM v7.2.1: Trying to decrypt Death by Coffee - No DRM.epub
DeDRM v7.2.1: Verifying zip archive integrity
DeDRM v7.2.1: “Death by Coffee - No DRM.epub” is neither an Adobe Adept nor a Barnes & Noble encrypted ePub
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
DEBUG:  100.3 Lineas:  []
DEBUG:  100.3 File:  C:\Users\Brianna\AppData\Local\Temp\calibre_ozyourxv\5x6fpu9q_add_books\0\Death by Coffee - DRM.epub  - Format:  epub
DEBUG:  100.3 Fich ori:  C:\Users\Brianna\AppData\Local\Temp\calibre_ozyourxv\5x6fpu9q_add_books\0\Death by Coffee - DRM.epub
DEBUG:  100.3 Ori:  C:\Users\Brianna\AppData\Local\Temp\calibre_ozyourxv\5x6fpu9q_add_books\0\Death by Coffee - DRM.epub
DEBUG:  100.3 File:  Death by Coffee - DRM.epub
DEBUG:  100.3 Updating column  #filename for book id:  6343  with value:  Death by Coffee - DRM.epub
DEBUG:  100.5 Updating column  #filedate for book id:  6343  with value:  2021-05-09 21:03:31.338489
Added Death by Coffee to db in: 1.3
Added 1 books in 5.9 seconds
Job Spy: self.gui.tags_view.recount() is enhanced for showing icons of user category child values...
Job Spy: self.gui.tags_view.recount() is enhanced for showing icons of user category child values...
stdout+stderr from file dialog helper: [b'', b'']
piped data from file dialog helper: [b'TA\xbe\x994b\xd9\xbf\xe7\x0e\xd0|XX\xac\xe2\t=f\x08oD\xc2\x16\x88C\xeb\x04K\x88\xac\x9b', b'D:\\Documents\\Death by Coffee - No DRM.epub']
Running file type plugin DeDRM failed with traceback:
Traceback (most recent call last):
  File "calibre\customize\ui.py", line 176, in _run_filetype_plugins
  File "calibre_plugins.dedrm.__init__", line 644, in run
  File "calibre_plugins.dedrm.__init__", line 420, in ePubDecrypt
calibre_plugins.dedrm.DeDRMError: DeDRM v7.2.1: Couldn't decrypt after 0.2 seconds. DRM free perhaps?
Running file type plugin GetFileName failed with traceback:
Traceback (most recent call last):
  File "calibre\customize\ui.py", line 176, in _run_filetype_plugins
  File "calibre_plugins.getfilename.__init__", line 108, in run
  File "json\__init__.py", line 180, in dump
TypeError: a bytes-like object is required, noPrefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
Prefs:  {'SchemaVersion': '0.3', 'configured': True, 'date_col': '#filedate', 'ext_col': '', 'nom_col': '#filename', 'opc_name': 'name', 'path_col': ''}
DEBUG:  116.1 Lineas:  []
DEBUG:  116.1 File:  D:\Documents\Death by Coffee - No DRM.epub  - Format:  epub
DEBUG:  116.1 Fich ori:  D:\Documents\Death by Coffee - No DRM.epub
DEBUG:  116.1 Ori:  D:\Documents\Death by Coffee - No DRM.epub
DEBUG:  116.1 File:  Death by Coffee - No DRM.epub
DEBUG:  116.1 Updating column  #filename for book id:  6344  with value:  Death by Coffee - No DRM.epub
DEBUG:  116.4 Updating column  #filedate for book id:  6344  with value:  2021-04-03 21:02:44.022055
Added Death by Coffee to db in: 1.2
Added 1 books in 3.9 seconds
Job Spy: self.gui.tags_view.recount() is enhanced for showing icons of user category child values...
Job Spy: self.gui.tags_view.recount() is enhanced for showing icons of user category child values...
Job Spy: self.gui.tags_view.recount() is enhanced for showing icons of user category child values...

[Terisa de morgan]

Ok, thank you, I'll try to check both errors this evening.

[jonzim]

This looks very close to what I need. I wrote a separate app I use on my machine that pulls in all the metadata from Calibre and stores it on Lucene so I can quickly search before importing a new book (it searches for me automatically on various parameters when I select the file in my own separate UI) --

However, sometimes the original filenames are different when importing books - an identical book might have already been imported under a different filename. I'm currently also checking filesize, but that's not guaranteed to be accurate.

If it is compatible with your intent, could you consider adding another custom column for the MD5 checksum of the original file too? It only matters the checksum at the time of import, not the current checksum. I think it would be rather trivial - maybe something like this? (i haven't tried it)

from hashlib import md5
...
filestream = file.read()
h = hashlib.md5()
h.update(filestream)
mi.md5 = h.hexdigest()

[Clark G. Flipper]

Hi,

it's probably not significant, but a little annoying: the plugin writes trace info because of a type error (it is also contained in ownedbycats' debug info above):

Running file type plugin GetFileName failed with traceback:
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 176, in _run_filetype_plugins
  File "calibre_plugins.getfilename.__init__", line 108, in run
    json.dump (dictio_aux, file)
  File "json/__init__.py", line 180, in dump
TypeError: a bytes-like object is required, not 'str'

Is that possibly python 2->3 issue?

[Clark G. Flipper]

I had some funny effects that may be indirectly conncted to the DeDRM plugin, in a roundabout way. I am not concerned about the directory, but the filename itself. It happens reproducibly, thus:

Start with a DRM protected ebook, add it to calibre with installed DeDRM plugin. It gets decrypted.
Experiment 1) Copy the decrypted file to somewhere else and remove it from calibre. Forget about encryption, deactivate the DeDRM plugin. Now adapt the filename of the decryted ebook following your personal standars (e.g. remove spaces and special characters, abbridge, etc. pp.) Add this file to calibre again and watch what the GetFilename plugin derives as filename: the adapted one or the original one?
Experiment 2) Remove the ebook again, deactivate the GetFilename plugin, add the ebook again and watch what happens to the filename columns.

I would like to know if someone could reproduce the phenomena I experienced.

[Clark G. Flipper]

I believe I found out what's going on. Calibre places the derived columns in the opf file inside the ebook (not only the external opf file, unfortunately), and this information gets used if the ebook is added again.
So what we would need is that the GetFilename plugin overwrites the obsolete information from the opf file by the newly derived one, or an option to do that. Terisa de Morgan, would that be possible?

[Terisa de morgan]

Originally Posted by Clark G. Flipper

I believe I found out what's going on. Calibre places the derived columns in the opf file inside the ebook (not only the external opf file, unfortunately), and this information gets used if the ebook is added again.
So what we would need is that the GetFilename plugin overwrites the obsolete information from the opf file by the newly derived one, or an option to do that. Terisa de Morgan, would that be possible?

No, sorry, the plugin is not going to recreate the opf, that goes a lot over the scope.

[Terisa de morgan]

Originally Posted by Clark G. Flipper

Hi,

it's probably not significant, but a little annoying: the plugin writes trace info because of a type error (it is also contained in ownedbycats' debug info above):

Running file type plugin GetFileName failed with traceback:
Traceback (most recent call last):
  File "calibre/customize/ui.py", line 176, in _run_filetype_plugins
  File "calibre_plugins.getfilename.__init__", line 108, in run
    json.dump (dictio_aux, file)
  File "json/__init__.py", line 180, in dump
TypeError: a bytes-like object is required, not 'str'

Is that possibly python 2->3 issue?

I have to check, there are pending bugs that I have not solved due to work, I'll try to do it as soon as possible.

[ownedbycats]

Question: I have a few books I added prior to getting this plugin. If I still have the original file, is there any way to import the info from a backed-up archive copy other than add it again and merge?

[Terisa de morgan]

Originally Posted by ownedbycats

Question: I have a few books I added prior to getting this plugin. If I still have the original file, is there any way to import the info from a backed-up archive copy other than add it again and merge?

Not that I know, because adding a new file to the existing record doesn't start the plugin.

[ownedbycats]

Adding it again and merging I'll do then; not like the Calibre database is going to run out of ID numbers.

[Terisa de morgan]

Originally Posted by ownedbycats

Adding it again and merging I'll do then; not like the Calibre database is going to run out of ID numbers.

[davidfor]

Originally Posted by ownedbycats

Adding it again and merging I'll do then; not like the Calibre database is going to run out of ID numbers.

How many files are involved? If there enough, you could put them in a CSV file and use the Import Wizard plugin.

[ownedbycats]

Just a handful, thankfully.

[davidfor]

Originally Posted by ownedbycats

Just a handful, thankfully.

In that case, why not just use the metadata editor and paste the file name in?