Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 01-05-2011, 05:48 AM   #16
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,265
Karma: 821512
Join Date: Jan 2010
Location: France
Device: Many android devices
Quote:
Originally Posted by unboggling View Post
Normally as I understand it I accomplish this by doing a send to disk then creating a new library and then bulk adding all my books to it. But, the empty books in Library1 aren't there in Library2. What do I have to do to get them there? Add them to Library2, which is a clunky should-be-unnecessary extra step.
Why not just replace the formats in the existing library?
chaley is offline   Reply With Quote
Old 01-05-2011, 05:48 AM   #17
unboggling
by the bootstraps
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,052
Karma: 858115
Join Date: Jan 2011
Location: Southeast US
Device: PRS-T2, Nexus 7, KindleT, iPad1, Kindle3KB
Quote:
Originally Posted by chaley View Post
calibre automatically creates an OPF file in the book folder in the library. This file will be created whether or not there are any book formats. Its purpose in life is to permit rebuilding the database in the event the db gets corrupted and the user has no backup.
which perhaps lends more weight to my point about consistency.
unboggling is offline   Reply With Quote
Old 01-05-2011, 05:52 AM   #18
itimpi
Wizard
itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.
 
Posts: 4,048
Karma: 777825
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
I would have thought that it was easy enough to do this within a library by taking advantage of the Author Tweaks/Manage Authors facility and the plugboard facility (depending on what you are starting with).

This would accomplish all the required changes to author/author-sort and any required renaming of files/folders within the Calibre library file/folde structure. The metadata already embedded in ebook files would then be updated as soon as you tried to do a Send to Disk/Device for ones of interest.
itimpi is offline   Reply With Quote
Old 01-05-2011, 05:53 AM   #19
unboggling
by the bootstraps
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,052
Karma: 858115
Join Date: Jan 2011
Location: Southeast US
Device: PRS-T2, Nexus 7, KindleT, iPad1, Kindle3KB
Quote:
Originally Posted by chaley View Post
Why not just replace the formats in the existing library?
hmm. You mean a bulk format to format conversion, forcing the new metadata into the books? How does the conversion handler know to write the new metadata into the actual book formats, which I thought only send-to-disk or -device could do?
unboggling is offline   Reply With Quote
Old 01-05-2011, 05:57 AM   #20
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,265
Karma: 821512
Join Date: Jan 2010
Location: France
Device: Many android devices
Quote:
Originally Posted by unboggling View Post
which perhaps lends more weight to my point about consistency.
Sorry, but I don't see the issue. Consistency of what? It seems that you are talking about the metadata in every format of a book being equal to the metadata in the DB for that book. If there are no books, then there isn't a problem.

My guess is that you have a particular work flow scenario in mind that I don't share.

As for replacing formats, use the command line calibredb add_format. Generate the script from the files in the save to disk hierarchy. To simplify things, put the book ID into the path somewhere.
chaley is offline   Reply With Quote
Old 01-05-2011, 06:00 AM   #21
unboggling
by the bootstraps
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,052
Karma: 858115
Join Date: Jan 2011
Location: Southeast US
Device: PRS-T2, Nexus 7, KindleT, iPad1, Kindle3KB
Quote:
Originally Posted by itimpi View Post
I would have thought that it was easy enough to do this within a library by taking advantage of the Author Tweaks/Manage Authors facility and the plugboard facility (depending on what you are starting with).

This would accomplish all the required changes to author/author-sort and any required renaming of files/folders within the Calibre library file/folde structure. The metadata already embedded in ebook files would then be updated as soon as you tried to do a Send to Disk/Device for ones of interest.
But would still leave all the empty books inconsistent, i think. unless the plugboard step could create an empty txt file and write the metadata to it?
unboggling is offline   Reply With Quote
Old 01-05-2011, 06:03 AM   #22
itimpi
Wizard
itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.itimpi ought to be getting tired of karma fortunes by now.
 
Posts: 4,048
Karma: 777825
Join Date: Nov 2008
Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)
Quote:
Originally Posted by unboggling View Post
But would still leave all the empty books inconsistent, i think. unless the plugboard step could create an empty txt file and write the metadata to it?
No - each empty book (folder) would still contain a metadata.opf file with the updated metadata inside it. The metadata.opf file is re-written any time the metadata for a book changes.
itimpi is offline   Reply With Quote
Old 01-05-2011, 06:18 AM   #23
unboggling
by the bootstraps
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,052
Karma: 858115
Join Date: Jan 2011
Location: Southeast US
Device: PRS-T2, Nexus 7, KindleT, iPad1, Kindle3KB
Quote:
Originally Posted by dwanthny View Post
I'm curious though did you have the options (Preferences - Saving books to disk) of Save cover separately and Save metadata in OPF file checked?
Sorry dwanthny, I somehow missed your post earlier. Answer: both, i think. Regarding the BU info, thx.

Last edited by unboggling; 01-05-2011 at 05:29 PM. Reason: clarity re checkboxes - 'all 3 yes' to 'both'
unboggling is offline   Reply With Quote
Old 01-05-2011, 06:25 AM   #24
DoctorOhh
US Navy, Retired
DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.DoctorOhh ought to be getting tired of karma fortunes by now.
 
DoctorOhh's Avatar
 
Posts: 8,809
Karma: 12535517
Join Date: Feb 2009
Location: North Carolina
Device: Nexus 7
Quote:
Originally Posted by unboggling View Post
hmm. You mean a bulk format to format conversion, forcing the new metadata into the books? How does the conversion handler know to write the new metadata into the actual book formats, which I thought only send-to-disk or -device could do?
Yes this would put the new metadata into the books.

Send to Device
Save to Disk
Conversion

Three ways to embed whatever metadata the ebook format can contain into a book. I'm backing out of this conversation because your OCD might be contagious.
DoctorOhh is offline   Reply With Quote
Old 01-05-2011, 06:33 AM   #25
unboggling
by the bootstraps
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,052
Karma: 858115
Join Date: Jan 2011
Location: Southeast US
Device: PRS-T2, Nexus 7, KindleT, iPad1, Kindle3KB
Thx @ kiwidude, dwanthny, chaley, itimpi for all responses and suggestions. At this point I'm not able to explain even to myself why i thought there was an issue, if there is one. I'll give it a rest while digesting your responses.
unboggling is offline   Reply With Quote
Old 01-05-2011, 04:31 PM   #26
unboggling
by the bootstraps
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,052
Karma: 858115
Join Date: Jan 2011
Location: Southeast US
Device: PRS-T2, Nexus 7, KindleT, iPad1, Kindle3KB
After some sleep:

I get it. The OPFs, empty book and full, are updated automatically. So are full books if the setting's set. No problem.

Backups, ok. No problem.

Send to disk or device? Um. Calibre doesn't send the empty book OPFs. Which is what started me thinking about this issue in the first place. So here's a case: I want to buy all the books in a particular series, but so far only have some and not others. I have listed those un-owned-yet as empty books to keep better track of series numbers and what I own and don't. eBooks aren't available yet because the series is over 20 years old but not public domain. So off to the used bookstores I go, either physically traveling or virtually online, with trusty eBD containing calibre catalog in hand, to buy pBooks. Wanting to use the catalog as reference to what I need to buy. Question: does the catalog contain the OPF metadata from the empty books, or did it skip over them like send to disk or device did? (I haven't checked yet.) If it skips, I have a problem because the metadata I need to refer to won't be there. If it doesn't skip, there isn't a problem.
unboggling is offline   Reply With Quote
Old 01-05-2011, 04:38 PM   #27
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,265
Karma: 821512
Join Date: Jan 2010
Location: France
Device: Many android devices
Quote:
Originally Posted by unboggling View Post
Question: does the catalog contain the OPF metadata from the empty books, or did it skip over them like send to disk or device did? (I haven't checked yet.) If it skips, I have a problem because the metadata I need to refer to won't be there. If it doesn't skip, there isn't a problem.
I just tried it. I removed the formats for a book and generated a catalog. My epub catalog contains the empty book.
chaley is offline   Reply With Quote
Old 01-05-2011, 04:53 PM   #28
kiwidude
calibre/Sigil Developer
kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.kiwidude ought to be getting tired of karma fortunes by now.
 
Posts: 4,224
Karma: 1334002
Join Date: Oct 2010
Location: London, UK
Device: Kindle Paperwhite 3G, iPad 3, iPad Air
Quote:
Originally Posted by chaley View Post
I just tried it. I removed the formats for a book and generated a catalog. My epub catalog contains the empty book.
Indeed - I vaguely recall reading that if you have a tag called "Wishlist" on those items you are missing they get especially marked in the catalog too.
http://www.mobileread.com/forums/sho...st#post1223881
kiwidude is offline   Reply With Quote
Old 01-05-2011, 05:18 PM   #29
unboggling
by the bootstraps
unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.unboggling ought to be getting tired of karma fortunes by now.
 
Posts: 1,052
Karma: 858115
Join Date: Jan 2011
Location: Southeast US
Device: PRS-T2, Nexus 7, KindleT, iPad1, Kindle3KB
Awesome that catalog includes empties. Awesomer that "wishlist" tag might highlight them. I'll try that. My confusion stems from my not previously defining or knowing what universes each operation lives in. (save to disk, send to device, conversion, cataloging) There is a set of items called bookID. There is a set of items called metadatabookID (or whatever you call it) that includes both empty-of-format and formats-exist. The universe of metadatabookID is larger than bookID. The universe of bookID doesn't include metadatabookID if empty-of-format. Some operations use one universe, other operations use another universe.
unboggling is offline   Reply With Quote
Old 01-06-2011, 03:58 AM   #30
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,265
Karma: 821512
Join Date: Jan 2010
Location: France
Device: Many android devices
Quote:
Originally Posted by unboggling View Post
The universe of metadatabookID is larger than bookID. The universe of bookID doesn't include metadatabookID if empty-of-format. Some operations use one universe, other operations use another universe.
To be pedantic (something I am good at):

In calibre, there are two concepts that you have mostly identified. First, there is the notion of 'book', which is the fundamental thing that calibre manipulates. When you edit metadata, send to device, or do almost anything else, you are first-and-foremost operating on a book. Books are abstract. For example, you can't read a calibre book.

The second concept is a 'format'. A format is a file that is part of the data associated with a book (is a child of book). The assumption made is that the format is something you can read, and can have a life independent of calibre.

Thus, in calibre, every book in a given library has what you are calling the metadatabookID. This is one-to-one mapping. Books in another calibre library will have a different metadatabookID, even if you (the human) know that the books are in fact the same.

A book can have zero or more formats. Inside calibre, a format cannot exist without being associated with (is a child of) a book. Books can exist quite happily without formats.

When you export information from calibre (send/save to), you are exporting format files. The resulting files are no longer associated with the book. Because of metadata updating, they may be (probably are) different from the format file still in calibre's library. After export, calibre doesn't know what the files are, and in fact completely forgets about them. Only if the user asks for it does calibre attempt to re-associate an external format file with a book. The most obvious way of 'asking' is to add a format file to the library. The second-most is to connect a device, in which case calibre sniffs over the format files on the device, trying to determine which book (if any) the files are associated with.

Given the above, I argue that the universe of "bookID" is much larger than that of "metadatabookID". BookID includes every format file that exists: whether exported, sent to devices/folders, on dropbox, or put wherever-have-you by the content server. MetadatabookID is strictly associated with a book in a given calibre library. There is no fixed mapping between bookIDs and metadatabookIDs. One can have formats that have no analogous book, and vice versa. Many formats that can be associated with a given book.
chaley is offline   Reply With Quote
Reply

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
series similar to Simon Scarrow's Cato/Macro Eagle books for my son... sufue Reading Recommendations 6 01-11-2014 12:03 AM
Convert your my clippings.txt to .doc, csv, and html Ericc22 Amazon Kindle 7 04-02-2011 11:10 AM
Please recommend: Books similar to the The Icarus Hunt Dave Berk Reading Recommendations 8 03-23-2010 10:37 PM
Classic *Two Books with Similar Names, only ONE Available!* RedSox09 Barnes & Noble NOOK 18 01-14-2010 12:41 PM
Export to CSV/XLS? highwaykind Calibre 19 05-31-2009 02:35 PM


All times are GMT -4. The time now is 02:56 AM.


MobileRead.com is a privately owned, operated and funded community.