Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Software > Calibre

Notices

Reply
 
Thread Tools Search this Thread
Old 08-18-2009, 08:04 AM   #1
hakan42
Zealot
hakan42 is on a distinguished road
 
hakan42's Avatar
 
Posts: 136
Karma: 60
Join Date: Jul 2009
Location: Munich, Germany
Device: Nook Classic rooted; Galaxy S IV with Aldiko, other older devices
Where is the path of an ebook determined?

Hi,

I want to manage my Perry Rhodan collection with calibre, a weekly series with more than 2500 issues, and other series (about 200 issues in my collection here) that are written in the same setting, largely by the same team of authors. In this use case, this leads to a folders with hundreds of nodes in it, which slows my system down to a crawl.

This series is split into 35 sub-series which contain up to 100 issues each, of which each author writes less than 20.

I would like to modify my local version of calibre so that my directory structure would look like "<Series>/<Author>/<Title>". Before I go digging into the source code, is there any hint where I should start? I have already looked at the database schema, so I hope there is just one single place in the source where the "path" column of the "books" determined

btw, yes, I have read the FAQ and understand that kovid regards the "<Author>/<Title>" directory structure as an internal implementation detail and the GUI as the main search interface. My main problem is the slow-as-molasses implementation of the Windows filesystem as soon as it encounters directories with hundreds of nodes



Regards,
Hakan
hakan42 is offline   Reply With Quote
Old 08-18-2009, 10:51 AM   #2
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,842
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
set_path in database2.py
kovidgoyal is online now   Reply With Quote
Old 08-18-2009, 11:04 AM   #3
hakan42
Zealot
hakan42 is on a distinguished road
 
hakan42's Avatar
 
Posts: 136
Karma: 60
Join Date: Jul 2009
Location: Munich, Germany
Device: Nook Classic rooted; Galaxy S IV with Aldiko, other older devices
Thanks :-)

Regards,
Hakan
hakan42 is offline   Reply With Quote
Old 08-18-2009, 12:30 PM   #4
hakan42
Zealot
hakan42 is on a distinguished road
 
hakan42's Avatar
 
Posts: 136
Karma: 60
Join Date: Jul 2009
Location: Munich, Germany
Device: Nook Classic rooted; Galaxy S IV with Aldiko, other older devices
I modified database2.py and config.py to enable the behaviour I discussed in starting this post. Well, "it works for me"

Would you consider thins enhancement for 0.6.8? As far as I can determine, the default behaviour of calibre should be unchanged.

I was just about to create an enhancement ticket and attach my patch to it, but I'm getting an internal error from trac:

Code:
Trac detected an internal error:

DatabaseError: database disk image is malformed

The action that triggered the error was:

POST: /newticket
Attached Files
File Type: zip series.zip (930 Bytes, 196 views)
hakan42 is offline   Reply With Quote
Old 08-18-2009, 12:42 PM   #5
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,842
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
trac should be fixed now. I probably wont make any changes to the database in the 0.6 series. But calibre's entire database subsytem is undergoing a re-write to make it backed independent for 0.7, so at that time, I'll be happy to look at your patch.

So attach it to a ticket.
kovidgoyal is online now   Reply With Quote
Old 08-18-2009, 12:58 PM   #6
hakan42
Zealot
hakan42 is on a distinguished road
 
hakan42's Avatar
 
Posts: 136
Karma: 60
Join Date: Jul 2009
Location: Munich, Germany
Device: Nook Classic rooted; Galaxy S IV with Aldiko, other older devices
Done, Ticket #3208.

Actually, I did not make any changes to the database itself, the change is only in interpretation of data that comes into construct_path_name.

Do you have any time frame for 0.7 ?


Regards,
Hakan
hakan42 is offline   Reply With Quote
Old 08-18-2009, 01:06 PM   #7
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,842
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
0.7 is still in very early stages, at the moment I'm still focused on bug fixing 0.6. Once that's done, I will create a public branch of 0.7 and then you can follow its development. I don't expect it earlier than the end of the year, certainly.
kovidgoyal is online now   Reply With Quote
Old 08-18-2009, 01:33 PM   #8
hakan42
Zealot
hakan42 is on a distinguished road
 
hakan42's Avatar
 
Posts: 136
Karma: 60
Join Date: Jul 2009
Location: Munich, Germany
Device: Nook Classic rooted; Galaxy S IV with Aldiko, other older devices
O.k., I just have to remember patching my local installation whenever you release an update

Regards,
Hakan
hakan42 is offline   Reply With Quote
Old 08-19-2009, 12:34 AM   #9
animedude01
Addict
animedude01 can extract oil from cheeseanimedude01 can extract oil from cheeseanimedude01 can extract oil from cheeseanimedude01 can extract oil from cheeseanimedude01 can extract oil from cheeseanimedude01 can extract oil from cheeseanimedude01 can extract oil from cheeseanimedude01 can extract oil from cheeseanimedude01 can extract oil from cheese
 
animedude01's Avatar
 
Posts: 254
Karma: 1200
Join Date: Jul 2009
Location: Los Angeles
Device: DR1000S, ILIAD2, Nokia n900, Kindle for PC, Astak EZReader Pro
Quote:
Originally Posted by kovidgoyal View Post
trac should be fixed now. I probably wont make any changes to the database in the 0.6 series. But calibre's entire database subsytem is undergoing a re-write to make it backed independent for 0.7, so at that time, I'll be happy to look at your patch.

So attach it to a ticket.
I don't want to hijack the thread, but when Calibre goes backend independent, will we be able to connect to the db using multiple machines simultaneously? For example, can I set up the DB on my Linux server and have all my machines connect to it?
animedude01 is offline   Reply With Quote
Old 08-19-2009, 11:14 AM   #10
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,842
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
When it goes backend independent, it will be easy to add support for concurrent backends, like a MySQL server, so yes, though someone will still have to write the MySQL backend.
kovidgoyal is online now   Reply With Quote
Old 08-19-2009, 11:42 AM   #11
hakan42
Zealot
hakan42 is on a distinguished road
 
hakan42's Avatar
 
Posts: 136
Karma: 60
Join Date: Jul 2009
Location: Munich, Germany
Device: Nook Classic rooted; Galaxy S IV with Aldiko, other older devices
If you need help, pencil me down for database support.

There are some use cases I'm thinking about (nothing finished to report about, just wild ideas) that would benefit from a shared database. This would make solving Ticket #2195, multiple writing clients, easier.

Regards,
Hakan
hakan42 is offline   Reply With Quote
Old 08-19-2009, 12:07 PM   #12
kovidgoyal
creator of calibre
kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.kovidgoyal ought to be getting tired of karma fortunes by now.
 
kovidgoyal's Avatar
 
Posts: 43,842
Karma: 22666666
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
Cool, I'll let you know when the framework is in place.
kovidgoyal is online now   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
File Path iceman00 Calibre 6 04-24-2010 04:35 PM
Path to CSS PlainBobMax Calibre 2 03-08-2010 10:55 PM
Path Error Help CSL Calibre 0 04-24-2009 03:07 PM
Greetings from THE DARK PATH Luke Romyn Introduce Yourself 5 03-10-2009 08:51 PM


All times are GMT -4. The time now is 02:57 AM.


MobileRead.com is a privately owned, operated and funded community.