Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Software > Calibre > Library Management

Notices

Reply
 
Thread Tools Search this Thread
Old 07-18-2011, 05:20 PM   #1
stonehat
Re-Iliadist
stonehat began at the beginning.
 
Posts: 23
Karma: 10
Join Date: Oct 2008
Device: none
Calibre uses directory of books as structure

I would like to use Calibre, it seems to be a great program that does a lot of things I need, but I am not willing to create a duplicate of all my ebooks just to put them in Calibre's system.

In the FAQ, I read "The whole point of calibre's library management features is that they provide a search and sort based interface for locating books that is much more efficient than any possible directory scheme you could come up with for your collection.".

Am I to understand that the directory structure forms the book database, rather than storing the information in a real, seperate database ? This seems a little strange.
If it is not possible to move away from using the directories as a database, would it not be possible for Calibre to only store links to the actual ebook files, obviating the need for copying the files themselves ?

TIA.
stonehat is offline   Reply With Quote
Old 07-18-2011, 05:28 PM   #2
chaley
"chaley", not "charley"
chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.chaley ought to be getting tired of karma fortunes by now.
 
Posts: 5,896
Karma: 1216548
Join Date: Jan 2010
Location: France
Device: Many android devices
Quote:
Originally Posted by stonehat View Post
I would like to use Calibre, it seems to be a great program that does a lot of things I need, but I am not willing to create a duplicate of all my ebooks just to put them in Calibre's system.

In the FAQ, I read "The whole point of calibre's library management features is that they provide a search and sort based interface for locating books that is much more efficient than any possible directory scheme you could come up with for your collection.".

Am I to understand that the directory structure forms the book database, rather than storing the information in a real, seperate database ? This seems a little strange.
If it is not possible to move away from using the directories as a database, would it not be possible for Calibre to only store links to the actual ebook files, obviating the need for copying the files themselves ?
http://www.mobileread.com/forums/sho...d.php?t=119175 and http://manual.calibre-ebook.com/faq....tory-structure give some explanation for why calibre works the way it does. The latter also says "Finally, if you are irrevocably wedded to the filesystem, feel free to patch your local copy of calibre to use whatever storage scheme you like. But, do not bother me with requests to change the directory structure, they will be ignored." I think that answers your question.
chaley is offline   Reply With Quote
Old 07-18-2011, 07:07 PM   #3
stonehat
Re-Iliadist
stonehat began at the beginning.
 
Posts: 23
Karma: 10
Join Date: Oct 2008
Device: none
Quote:
Originally Posted by chaley View Post
http://www.mobileread.com/forums/sho...d.php?t=119175 and http://manual.calibre-ebook.com/faq....tory-structure give some explanation for why calibre works the way it does. The latter also says "Finally, if you are irrevocably wedded to the filesystem, feel free to patch your local copy of calibre to use whatever storage scheme you like. But, do not bother me with requests to change the directory structure, they will be ignored." I think that answers your question.
The authors of both of those explanations seem incapable of contemplating the use of a database to store ( ebook meta ) data instead of using a wierd directory structure in a file system - the rest of the world thinks differently.

And, sheesh, if that is an indication of the way Calibre people take on new ( to them ) ideas, I will stay well away !
stonehat is offline   Reply With Quote
Old 07-18-2011, 07:20 PM   #4
user_none
Sigil & calibre developer
user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.
 
user_none's Avatar
 
Posts: 2,473
Karma: 1053245
Join Date: Jan 2009
Location: Florida, USA
Device: Nook STR
This is not a new idea. It has been around for years and is brought up about once a month. Typically it's brought up in a fashion not nearly as nice as you did. That said there has not been a convincing enough argument to change the current directory structure.
user_none is offline   Reply With Quote
Old 07-18-2011, 07:36 PM   #5
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,433
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by stonehat View Post
The authors of both of those explanations seem incapable of contemplating the use of a database to store ( ebook meta ) data instead of using a wierd directory structure in a file system - the rest of the world thinks differently.
Understand what you are speaking about before opening your mouth to bleat.
kovidgoyal is offline   Reply With Quote
Old 07-18-2011, 09:38 PM   #6
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 15,236
Karma: 6020307
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Quote:
Originally Posted by stonehat View Post
I would like to use Calibre, it seems to be a great program that does a lot of things I need, but I am not willing to create a duplicate of all my ebooks just to put them in Calibre's system.

In the FAQ, I read "The whole point of calibre's library management features is that they provide a search and sort based interface for locating books that is much more efficient than any possible directory scheme you could come up with for your collection.".

Am I to understand that the directory structure forms the book database, rather than storing the information in a real, seperate database ? This seems a little strange.
If it is not possible to move away from using the directories as a database, would it not be possible for Calibre to only store links to the actual ebook files, obviating the need for copying the files themselves ?

TIA.
Might be good for 20-100 books... But some users have 20K or more.

Plus
Using your idea: 1 tiny DB burp and books are gone.
BLOBs are not as robust as what we have.

Metadata.db can be totally destroyed and the books are still there.
In addition, Calibre backs up the record with the titles metadata in the same folder.
Calibre can rebuild the DB from this data.
theducks is offline   Reply With Quote
Old 07-19-2011, 07:37 AM   #7
redsky
Junior Member
redsky began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Dec 2009
Device: iliad
Quote:
Originally Posted by kovidgoyal View Post
Understand what you are speaking about before opening your mouth to bleat.
What a charming chap.
redsky is offline   Reply With Quote
Old 07-19-2011, 08:26 AM   #8
darknessangel
Addict
darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.darknessangel ought to be getting tired of karma fortunes by now.
 
darknessangel's Avatar
 
Posts: 294
Karma: 1018140
Join Date: Feb 2009
Device: PRS-505, iPad
Aaaand here we go again XD... I wonder if Kovidgoyal has a bet about how long he can say no to this request from the users.
darknessangel is offline   Reply With Quote
Old 07-19-2011, 08:29 AM   #9
user_none
Sigil & calibre developer
user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.user_none ought to be getting tired of karma fortunes by now.
 
user_none's Avatar
 
Posts: 2,473
Karma: 1053245
Join Date: Jan 2009
Location: Florida, USA
Device: Nook STR
Quote:
Originally Posted by darknessangel View Post
Aaaand here we go again XD... I wonder if Kovidgoyal has a bet about how long he can say no to this request from the users.
It's been said again and again that if someone wants to do the work to create a new backend that allows for this then by all means do so. Kovid has been working on making the DB pluggable to support cases like this. However, Kovid as well as every other calibre developer has no interest in this feature. We will not spend our time working on it.
user_none is offline   Reply With Quote
Old 07-19-2011, 08:33 AM   #10
avantman42
Guru
avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.avantman42 ought to be getting tired of karma fortunes by now.
 
avantman42's Avatar
 
Posts: 957
Karma: 3096418
Join Date: Sep 2010
Location: UK
Device: Kindle & Nook
Quote:
Originally Posted by stonehat View Post
The authors of both of those explanations seem incapable of contemplating the use of a database to store ( ebook meta ) data instead of using a wierd directory structure in a file system - the rest of the world thinks differently.
The metadata is stored in a database. To be precise, it's stored in an SQLite database file named metadata.db

Quote:
Originally Posted by stonehat View Post
And, sheesh, if that is an indication of the way Calibre people take on new ( to them ) ideas, I will stay well away !
It's not a new idea. As Manichean said in one of the linked-to threads, "There's been enough of that discussion already, and at best you'll get annoyed reactions by everyone."

Last edited by avantman42; 07-19-2011 at 08:34 AM. Reason: Added formatting to make things clearer
avantman42 is offline   Reply With Quote
Old 07-19-2011, 08:35 AM   #11
ThR
Tatütatuter
ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.ThR could sell banana peel slippers to a Deveel.
 
ThR's Avatar
 
Posts: 389
Karma: 3148
Join Date: Oct 2008
Location: Germany, Baden, Karlsruhe
Device: PRS-950, DR1000S (sold), HX4700
Calibre stores its contents in a database. A file system IS a database and calibre is using it. Where's the problem?

Last edited by ThR; 07-19-2011 at 08:45 AM.
ThR is offline   Reply With Quote
Old 07-19-2011, 09:52 AM   #12
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 26,433
Karma: 5383257
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Quote:
Originally Posted by darknessangel View Post
Aaaand here we go again XD... I wonder if Kovidgoyal has a bet about how long he can say no to this request from the users.
No need to bet. I am never going to say yes to something I think is bad for calibre.
kovidgoyal is offline   Reply With Quote
Old 07-19-2011, 10:16 AM   #13
Lady Fitzgerald
Wizard
Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.
 
Lady Fitzgerald's Avatar
 
Posts: 2,013
Karma: 251649
Join Date: Apr 2010
Location: Tempe, AZ, USA, Earth
Device: JetBook Lite (away from home) + 1 spare, 32" TV (at home)
Quote:
Originally Posted by redsky View Post
What a charming chap.
Actually, Kovid is being quite charming under the circumstances. Every month or few, we have someone who comes to this forum to complain about calibre not using the user's folder/filename tree and reject any explainations from the FAQs, the developers, and other users. We even have one person who comes back to the forum for the sole purpose of compaining about it. After a while, the attacks become tiresome.
Lady Fitzgerald is offline   Reply With Quote
Old 07-19-2011, 10:22 AM   #14
Lady Fitzgerald
Wizard
Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.Lady Fitzgerald ought to be getting tired of karma fortunes by now.
 
Lady Fitzgerald's Avatar
 
Posts: 2,013
Karma: 251649
Join Date: Apr 2010
Location: Tempe, AZ, USA, Earth
Device: JetBook Lite (away from home) + 1 spare, 32" TV (at home)
Quote:
Originally Posted by stonehat View Post
And, sheesh, if that is an indication of the way Calibre people take on new ( to them ) ideas, I will stay well away !
As explained already, there is nothing new about this. As far as staying well away goes, thank you.
Lady Fitzgerald is offline   Reply With Quote
Old 07-19-2011, 10:43 AM   #15
theducks
Grand Sorcerer
theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.theducks ought to be getting tired of karma fortunes by now.
 
theducks's Avatar
 
Posts: 15,236
Karma: 6020307
Join Date: Aug 2009
Location: (The original) Silicon Valley, USA
Device: Galaxy Tab 2, Astak Pocket Pro, K4NT
Quote:
Originally Posted by Lady Fitzgerald View Post
As explained already, there is nothing new about this. As far as staying well away goes, thank you.
theducks is offline   Reply With Quote
Reply

Tags
directory copy ebooks

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[Old Thread] Why doesn’t calibre let me store books in my own directory structure? darknessangel Calibre 68 08-24-2014 01:16 AM
Directory structure praky Library Management 36 01-24-2011 09:23 AM
Directory Structure Calibre after importing Tuborg Calibre 2 01-16-2011 07:25 AM
books on SD, directory structure Cue Sony Reader 2 06-17-2010 09:24 AM
directory structure Dopedangel Calibre 7 08-20-2009 07:17 AM


All times are GMT -4. The time now is 09:00 PM.


MobileRead.com is a privately owned, operated and funded community.