Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre > Plugins

Notices

Reply
 
Thread Tools Search this Thread
Old 07-20-2011, 04:23 PM   #1
Jesse Chisholm
Enthusiast
Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.
 
Jesse Chisholm's Avatar
 
Posts: 27
Karma: 56200
Join Date: Jul 2011
Location: California
Device: none
[Metadata Reader Plugin] Read MP3 audio book metadata

Read MP3 audio book metadata:
This plugin eases the process of managing your Audio Books in Calibre.

Audio Books, if they are long enough, are typically broken up into separate files by chapter, to ease downloading pain over slow connections. Calibre considers each file a separate book in its database. The work-around I've chosen is to put all the chapters of the Audio Book into a Series by the book's actual name, ordered by chapter number.

MP3 files have some metadata internally in ID3 tags. These are extracted and used to populate the metadata for the book as it is added to Calibre. A slightly massaged version of eyeD3-0.6.17 is used to parse these files.

M3U files are playlists of MP3 files. ( Actually, .M3U8, .PLS, .KPL, .RAM all use a sufficiently similar file format, and are also parsed. YMMV ) The MP3 files should be referenced with an absolute URL or path.

M4A and M4B files have metadata internally in MPEG tags. These are extracted and used to populate the metadata for the book as it is added to Calibre. ( Actually, .MP4, .3GP, .3G2, .QT all use the exact same file format, and are also parsed. YMMV ) A slightly massaged version of mp4file-0.2 is used to parse these.

AA and AAX (Audible.com) files have some metadata internally. These are extracted and used to populate the metadata for the book as it is added to Calibre. The Google Code item pyaudibletags is used to parse these files.

Main Features of v1.0.79:
Spoiler:
  • When MP3 files are added to Calibre, the ID3 tags are read and used to fill in as many metadata fields as possible.
  • When M4B or M4A files are added to Calibre, the MPEG-4 tags are read and used to fill in as many metadata fields as possible.
  • When AA or AAX files are added to Calibre, the tags are read and used to fill in as many metadata fields as possible.
  • When M3U or M3U8 files are added to Calibre, the tags in the individual MP3 files are read and used to fill in as many metadata fields as possible.
  • These fields are filled in:
    • title - the Title of this chapter of the book
    • title_sort - set to "chapter. title"
    • series - the title of the Book as a whole
    • series_index - the Chapter number
    • authors - the primary Author(s) of the book
    • publisher - the Publisher of the book
    • tags - the Genre of the book
    • cover - the name of the embedded cover art if it is available.
    • cover_data - the embedded cover art if possible, or a small audio book image if nothing better is available.
    • pubdate - set to the earliest date found in the file; if no more than a year is located, then February 2nd (Groundhog's Day) is arbitrarily chosen.
    • comments - some books have copyright information or longer descriptions embedded. When these are found, they are copied here.

FUTURE THOUGHTS:
Spoiler:

As I read and learn more about Calibre, Python and Audio Book formats, I notice EPUB3:
  • will eventually be part of Calibre
  • will allow sound files as part of an EPUB eBook
  • as of 2011 3rd Quarter is in the final stages of nailing down the specification so implementers won't have to shoot in the dark anymore.
Therefore, I won't be coming out with a new version of the MP3 Metadata Reader until I see what is happening with EPUB3.
This plugin may become unnecessary.

I will instead be looking at the desirability of a tool to bundle a collection of MP3 files into an EPUB3 file that happens to have no text, but is otherwise manageable by Calibre.

Known Issues:
Spoiler:
  • If you add an .M3U file that references an .MP3 file on the web, ( http://some.site/somefile.mp3 ) it will copy the file locally for metadata parsing. If this URL is a streaming URL ( rtsp://some.site/somestream.mp3 ), the copy will never finish, but it will fill your local hard disk.
  • If you try to download metadata (in the Edit Metadata dialog) the search is automatically done by Chapter Title, rather than by Series, so the search fails.
    • A workaround is to temporarily change the Title field to be the Series name, do your metadata search, then change it back.
  • Many Audio Book files do not have an embedded cover art image. (In this case you get the generic audio book image that comes with this plugin.)
  • There are other potentially useful fields in the various file formats that are currently ignored.
  • Sometimes, Calibre ignores what is set to title_sort and replaces it with what it thinks should be there. I suspect this means I have something wrong with the format in those cases.

Special Notes:
  • Requires Calibre v0.7.53 or later.
  • When adding books, you need to change your File Type to look for "All Files" to see the MP3 files.

Installation Steps:
  1. Download the attached zip file and install the plugin/restart Calibre as described in the Introduction to plugins thread.
  2. You should now be able to add Audio Book Files to Calibre. Select all files for a book, or select them individually. (You will need to change File Type to All Files in the Add Books Dialog, or just drag-n-drop them.)

Version History:
Spoiler:

Version 1.0.79: Fixed bug in .mp3 parsing if no Track value.
Contact me if you want one of these older versions.
Version 1.0.77: Add .m3u file parsing.
Version 0.6.75: Removed erroneous .FLV extension inclusion.
Version 0.6.74: Added .mp4 and .aa file parsing. Fixed some .mp3 issues.
Version 0.6.62: Added .m4b and .m4a file parsing.
Version 0.5.1: Renamed to more standard "Read MP3 audio book metadata".
Version 0.5.0: Initial BETA release of AudioBookReader plugin.
Attached Files
File Type: zip AudioBookReader.zip (114.9 KB, 216273 views)

Last edited by Jesse Chisholm; 04-10-2012 at 01:55 PM. Reason: Add thoughts about the Future of this plugin.
Jesse Chisholm is offline   Reply With Quote
Old 07-20-2011, 07:30 PM   #2
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 9,864
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
I would suggest that you look at the other plugin threads and format this one similarly. Attach the plugin to the post and ask Kiwidude to add the plugin to the Index of plugins sticky post. This will allow this plugin to be installed and updated from calibre. Review the Index of plugins, specifically the Notes for Plugin Developers area for more information.
DoctorOhh is offline   Reply With Quote
Advert
Old 07-22-2011, 07:22 PM   #3
Stampercam
Connoisseur
Stampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to behold
 
Stampercam's Avatar
 
Posts: 86
Karma: 19674
Join Date: Jan 2011
Device: ipad, MiGear
I've added it, and will use it to add some audio books today. It could be a very useful plug-in. Thanks.
Stampercam is offline   Reply With Quote
Old 08-01-2011, 07:25 PM   #4
Jesse Chisholm
Enthusiast
Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.
 
Jesse Chisholm's Avatar
 
Posts: 27
Karma: 56200
Join Date: Jul 2011
Location: California
Device: none
I've updated the plugin (v0.6.74) to parse metadata from the following file formats:
.MP3 - original format, but more robust parsing.
.M4B, .M4A - second file format, more complete parsing.
.AA, .AAX - the new file format.
.MP4, .FLV, .3GP, 3G2. QT - happen to have the same file format as .M4B, so why not.

No attempt is made to bypass DRM. Only public metadata is parsed from the files for the purpose of managing the books/files in Calibre.

I have not tested it with .FLV, .3GP, 3G2. QT only because I don't have any examples. I have tested it with Audio Books in the .aa and .mp4 formats.

CAVEAT: You still have to switch the Add Books file type to "All Books", or drag-and-drop the files onto Calibre.
I have not yet tackled the GUI tweaks in Calibre.

-Jesse
Jesse Chisholm is offline   Reply With Quote
Old 08-02-2011, 08:28 AM   #5
Stampercam
Connoisseur
Stampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to beholdStampercam is a splendid one to behold
 
Stampercam's Avatar
 
Posts: 86
Karma: 19674
Join Date: Jan 2011
Device: ipad, MiGear
The update is not coming up on the user plugins dialogue, it is saying I have the latest version installed... 0.5.1

Cam
Stampercam is offline   Reply With Quote
Advert
Old 08-02-2011, 10:40 AM   #6
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
PeterT's Avatar
 
Posts: 12,160
Karma: 73448616
Join Date: Nov 2007
Location: Toronto
Device: Nexus 7, Clara, Touch, Tolino EPOS
Quote:
Originally Posted by Stampercam View Post
The update is not coming up on the user plugins dialogue, it is saying I have the latest version installed... 0.5.1

Cam
I think we need Kiwidude to update the Index post in this forum.
PeterT is offline   Reply With Quote
Old 08-03-2011, 09:20 AM   #7
Jesse Chisholm
Enthusiast
Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.
 
Jesse Chisholm's Avatar
 
Posts: 27
Karma: 56200
Join Date: Jul 2011
Location: California
Device: none
The delay in getting the index updated was my fault. (I forgot to ping kiwidude to ask him to update it.) It has now been taken care of.

Sorry about the delay.

-Jesse
Jesse Chisholm is offline   Reply With Quote
Old 08-03-2011, 11:17 AM   #8
theducks
Well trained by Cats
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 29,782
Karma: 54830978
Join Date: Aug 2009
Location: The Central Coast of California
Device: Kobo Libra2,Kobo Aura2v1, K4NT(Fixed: New Bat.), Galaxy Tab A
Quote:
Originally Posted by Jesse Chisholm View Post
The delay in getting the index updated was my fault. (I forgot to ping kiwidude to ask him to update it.) It has now been taken care of.

Sorry about the delay.

-Jesse
Jesse
any of the Calibre Mods can do a simple edit, like that, of the Plugin list.

I trust myself to change a release number without messing up the whole works .
theducks is offline   Reply With Quote
Old 08-05-2011, 03:46 PM   #9
feenix1363
Lost and clueless
feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.feenix1363 ought to be getting tired of karma fortunes by now.
 
feenix1363's Avatar
 
Posts: 194
Karma: 233336
Join Date: Jan 2011
Location: UK
Device: PRS-T1, Kobo Glo, Kindle for Andriod, Kobo for Android
Handy little tool. I'll just have to start making sure I update the ID3 tags in future
feenix1363 is offline   Reply With Quote
Old 10-22-2011, 01:15 PM   #10
Jesse Chisholm
Enthusiast
Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.
 
Jesse Chisholm's Avatar
 
Posts: 27
Karma: 56200
Join Date: Jul 2011
Location: California
Device: none
No change to the plugin. Just to the description.

I've added my thoughts about the future of this plugin.

Basically, I'm waiting to see what the Calibre coverage of the EPUB3 standard will be.

Since EPUB3 allows the embedding and linking of sound files as part of an eBook, there may be no further need for this plug in as it is currently conceived.

-Jesse Chisholm
Jesse Chisholm is offline   Reply With Quote
Old 10-24-2011, 10:34 PM   #11
ratsima
Junior Member
ratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheese
 
Posts: 5
Karma: 1000
Join Date: Oct 2011
Device: none
Audio files not to be copied to the Calibre database?

Hi, seems like a plug-in I could really use. Can I somehow list the audio-book within Calibre but without copying the audio files to the database? I obviously want the cover and metadata being in the database but I really don't want to copy the audio files, nor do i want point to them, as their location/organisation may change from time to time. Thanks again for the plug-in.
ratsima is offline   Reply With Quote
Old 10-24-2011, 10:41 PM   #12
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 9,864
Karma: 13806776
Join Date: Feb 2009
Location: North Carolina
Device: Icarus Illumina XL HD, Nexus 7
Quote:
Originally Posted by ratsima View Post
Can I somehow list the audio-book within Calibre but without copying the audio files to the database? I obviously want the cover and metadata being in the database but I really don't want to copy the audio files, nor do i want point to them, as their location/organisation may change from time to time. Thanks again for the plug-in.
You can create as many empty book records as you wish using the dropdown arrow next to the add books icon. Using some imagination this should allow to track your audio files in calibre.
DoctorOhh is offline   Reply With Quote
Old 10-24-2011, 11:35 PM   #13
ratsima
Junior Member
ratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheeseratsima can extract oil from cheese
 
Posts: 5
Karma: 1000
Join Date: Oct 2011
Device: none
Thanks for that suggestion which will work on an occasional basis. I was really hoping for a solution where all of the audiobook tags (say from the first file) and any cover art etc could be taken into Calibre but without copying the actual audio files. Thanks again for the suggestion.
ratsima is offline   Reply With Quote
Old 12-16-2011, 08:26 AM   #14
transmitthis
Addict
transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.transmitthis ought to be getting tired of karma fortunes by now.
 
transmitthis's Avatar
 
Posts: 288
Karma: 1003542
Join Date: May 2011
Device: Google Nexus 7 16GB
Quote:
Originally Posted by ratsima View Post
Hi, seems like a plug-in I could really use. Can I somehow list the audio-book within Calibre but without copying the audio files to the database? I obviously want the cover and metadata being in the database but I really don't want to copy the audio files, nor do i want point to them, as their location/organisation may change from time to time. Thanks again for the plug-in.
I just came here to see what the plugin was, and if it offered me any + over what I do already.
Anyway, saw your post so to answer:
What I do is just have an extra column called audio, and pop a tickmark next to the text book that I also have on Audio. For those rare occasions I only have an audio copy, just create an empty book.

This works very well, and leaves your massive audio library alone.
Don't really know what this plugin does, but I can't see it being more useful than that really.
transmitthis is offline   Reply With Quote
Old 01-05-2012, 06:53 PM   #15
Jesse Chisholm
Enthusiast
Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.Jesse Chisholm actually enjoys Vogon poetry.
 
Jesse Chisholm's Avatar
 
Posts: 27
Karma: 56200
Join Date: Jul 2011
Location: California
Device: none
Many people asked for a way to:
1: manage audio books without copying them into the Calibre DB
2: manage M3U (playlist) files

So, I've added feature request #2, which gives you a workaround for #1.
See version 1.0.77 and following.

* : by hand, or with a tool (like mp3tag) make an .m3u playlist file of your .m3u files
* : edit the .m3u file in notepad (or notepad++ or vi or ...) a simple text editor
* : ensure the file references are ABSOLUTE PATHS
the .m3u file will be copied into calibre, so relative paths get broken.
* : in calibre, add books, set for file type all (*.*)
locate your .m3u file and add it

CAVEAT: if your .mp3 file is online ( http://some.site/somefile.mp3 ), a local copy if retrieved for parsing of metadata. If that happens to be a stream, it will never finish the copy, but will fill your local disk drive. Don't do streams!

-Jesse
Jesse Chisholm is offline   Reply With Quote
Reply

Tags
audio, audiobook, metadata, reader


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Differences between library and reader: Force calibre to write metadata into ebook durtreg Calibre 17 01-28-2011 04:30 AM
Reading metadata on Sony Reader BeccaAnn Calibre 5 08-01-2010 06:06 AM
Sony Reader Metadata Nightmare osirisomeomi Sony Reader 1 04-06-2010 04:25 AM
Metadata to Reader ccowie Calibre 3 11-05-2009 10:59 AM
Metadata is wrong on Reader BeccaAnn Calibre 5 09-15-2009 12:38 PM


All times are GMT -4. The time now is 04:25 PM.


MobileRead.com is a privately owned, operated and funded community.