Apart from
the sticky I linked to earlier in this thread, there is some further explanation of the decision regarding Calibre's folder structure
in the FAQ.
The bottom line is to view the library as a database. You need programs to interface with a database, or it is a black box. The programs here are Calibre and its CLI tools.