Koreader: How to get metadata to device?

[embryo]

Originally Posted by WS64

Is the LIBRARY_PATH really set to "/mnt/sd/.Books"?

Yes.
It does find everything I search.

Manually check the metadata.calibre file in this folder for one of the books, does the lpath point to a valid book?

Yes.
E.g. "lpath": ".Books/Doyle, Arthur Conan/Arthur Conan Doyle - The Adventures of Sherlock Holmes.epub",
but after clicking on it "File does not exist"

I'll wait for the next nightly, since this one is a little suspicious.

[WS64]

No, sounds logical to me.
If the metadatafile is in /mnt/sd/.Books and it says the book is located at ".Books/Doyle, Arthur Conan/Arthur Conan Doyle - The Adventures of Sherlock Holmes.epub" it will search for "/mnt/sd/.Books/.Books/Doyle, Arthur Conan/Arthur Conan Doyle - The Adventures of Sherlock Holmes.epub". (twice .books)
Did you change the location of the metadata file? Because that will simply not work.
If not, how exactly did you export the books from Calibre? Maybe there is one setting that I have to take into account, since Calibre is able to find the Sherlock Holmes book although the relative path to it does not exist under mnt/sd/.Books

[embryo]

Originally Posted by WS64

No, sounds logical to me.
If the metadatafile is in /mnt/sd/.Books and it says the book is located at ".Books/Doyle, Arthur Conan/Arthur Conan Doyle - The Adventures of Sherlock Holmes.epub" it will search for "/mnt/sd/.Books/.Books/Doyle, Arthur Conan/Arthur Conan Doyle - The Adventures of Sherlock Holmes.epub". (twice .books)

OK. Thats the problem.

Did you change the location of the metadata file? Because that will simply not work.

No. The location of the metadata files are at the root of my file systems (1 for onboard and 1 for sd).
Its the default place for Calibre to save it.
It uses the root path on all my android systems also.

If not, how exactly did you export the books from Calibre?

Just save them to disk and sideload them.
Also at the KoboExtended driver setup, I use ".Books/{author_sort}/{authors} - {title}" as the 'Save Template'.

Maybe there is one setting that I have to take into account, since Calibre is able to find the Sherlock Holmes book although the relative path to it does not exist under mnt/sd/.Books

I think that the problem is that in defaults.lua I wrote the whole path to the books, a thing you don't need, since its relative to the metadata file.
When I just wrote "mnt/sd" or "mnt/onboard" (depending on the location I was targeting) the "mnt/sd/.Books" or the "mnt/onboard/Books" was searched as it supposed to.

Maybe the only thing the user should have to do is to tell if the books are on the Internal or the External card.
Or maybe not even that.
You could look at the onboard and sd root by default.

[WS64]

But Koreader searches for the metadatafile in the directory you specified. If you can search it did find one in mnt/onboard/.Books
But according to the way you exported the books from Calibre this file should be in mnt/onboard/ (and if you use this one all should work). But again that means that you manually must have copied the metadata file into the .books folder, are you sure you don#t have two copies of the file, one in mnt/sd and one in mnt/sd/.books?

Wait for the next nightly, this finally will have the defaults.lua editor, with that you can see (after one search at least!) which value Koreader found and uses now.

UPDATE: readeing your post again it sounds like Koreader took your value, did not find any metadata file in your directory, did an automatical search (but did not tell you, not sure why not!) and used the searched value. But again, you can see this with the next nightly by checking the defaults editor.
Actually I made things even easier, if you just leave the setting to the path to NIL (default value), Koreader will search for it. If you save the settings then everything is fine. But of course it will just find one, maybe I have to think of finding more than one Calibre file, e.g. one on sd and one on onboard. But then again someone could think of putting even more metadata files on the device...

[embryo]

Originally Posted by WS64

But Koreader searches for the metadatafile in the directory you specified. If you can search it did find one in mnt/onboard/.Books
But according to the way you exported the books from Calibre this file should be in mnt/onboard/ (and if you use this one all should work). But again that means that you manually must have copied the metadata file into the .books folder, are you sure you don#t have two copies of the file, one in mnt/sd and one in mnt/sd/.books?

No metadata file in "mnt/sd/.Books" or the "mnt/onboard/Books"

Wait for the next nightly, this finally will have the defaults.lua editor, with that you can see (after one search at least!) which value Koreader found and uses now.

I'm using 500 and its the same thing.
The path thats used (in the 'Set defaults') is "mnt/sd"
Maybe I'm missing something obvious here ...

Searching with unicode characters (case sensitive always) produces the expected results.
But if I click on one of them I get a "mnt/sd/.Books/\u03b9\u03c7\u....epub file does not exist" message.
Latin characters work as expected.

BTW. Using the 'Set defaults' has a couple of small problems.
1. Its difficult to read some settings because of the lines cut off to the right.
I couldn't use landscape even if I was coming to the file manager from a "Landscaped" book.
Maybe smaller letters or a horizontal slider can solve this.

2. Every time I change something I have to tap more than 4 times to get to change something else.
Maybe an 'Apply' button or a final 'Save Settings' before leave the configuration window was less time consuming.

Tell me if there is anything I should check for you.

[WS64]

If it uses mnt/sd everything is fine...

To the unicodes, so far I assumed that the lpath field does NOT include any. But if it does (and I guess you can tell Calbire to export to folder without making the letters "english") I can easily enough also change the unicodes in the lpath fields into the real values, I just did not do so because I thought it was not necessary. But easy to fix.

Not sure which number the 500 is, but I just changed something this morning that you are back in the editor at exactly the same point where you were before you edited one field, I was annoyed of the 4 taps too...
The whole thing "hangs" in the filemanager which does not support landscape at all (so far), maybe I can do something like a long hold on a menu item to display the complete name, let me check. Basically this whole view is the same as the "history" view.

I think we will get all these problems solved, it will just take a few more releases until we have everything sorted out!

[embryo]

Originally Posted by WS64

To the unicodes, so far I assumed that the lpath field does NOT include any. But if it does (and I guess you can tell Calbire to export to folder without making the letters "english")

You can 'Save to Disk' with the original filenames, but if you 'Send to Device' they are converted to latin.

Not sure which number the 500 is, but I just changed something this morning that you are back in the editor at exactly the same point where you were before you edited one field, I was annoyed of the 4 taps too...

koreader-kobo-arm-linux-gnueabihf-v2014.04-500-g138b311.tar
Just downloaded the 2014.04-510 version.
They coming out real fast!

This 510 version has your solution the '4 taps to return' problem.
Great!

The whole thing "hangs" in the filemanager which does not support landscape at all (so far), maybe I can do something like a long hold on a menu item to display the complete name, let me check.

Good idea ..

[Ken Maltby]

Originally Posted by WS64

If it uses mnt/sd everything is fine...

To the unicodes, so far I assumed that the lpath field does NOT include any. But if it does (and I guess you can tell Calbire to export to folder without making the letters "english") I can easily enough also change the unicodes in the lpath fields into the real values, I just did not do so because I thought it was not necessary. But easy to fix.

Not sure which number the 500 is, but I just changed something this morning that you are back in the editor at exactly the same point where you were before you edited one field, I was annoyed of the 4 taps too...
The whole thing "hangs" in the filemanager which does not support landscape at all (so far), maybe I can do something like a long hold on a menu item to display the complete name, let me check. Basically this whole view is the same as the "history" view.

I think we will get all these problems solved, it will just take a few more releases until we have everything sorted out!

Odd, maybe some of it is device specific? I think if you just use caliber in a normal fashion it puts the metadata file in /mnt/onboard, if you select the Main device and into /mnt/sd if you select the "A drive". I guess you can have the book(s) go to a folder of your choosing (you can have templates for different devices, like the "A drive", by customizing the device interface plugins) otherwise a general template is used. It appears that the metadata file is not in the same folder as the books, that the books are in a subfolder from the one that the metadata is in. Moving it around would be a bad idea as calibre says that it maintains the file, on every connection. It should be where caliber expects it. The books need to be where the metadata file for that device ( the Main storage is one device and the "A Drive" is another device ) thinks they are.

I have calibre Metadata files at both /mnt/onboard and at /mnt/sd. I direct your search to the /mnt/sd one, and it works fine. I could point it to the other one but I only have one book (for testing) there.

Luck;
Ken

[WS64]

So, the next version will have the "long tap => file info" feature in the search and will take care of unicode characters in the path also.

[embryo]

Originally Posted by WS64

So, the next version will have the "long tap => file info" feature in the search and will take care of unicode characters in the path also.

Using v2014.04-514
Nice new feature: Long press on a filename of the search results gives you a popup window with the properties of the file (including the tags).

There are still some problems with the UTF-8 characters.
This version doesn't have your updated filemanagersearch.lua, so it can't find unicode characters.
Using your file fixed this, but introduce another strange behavior.

- If I open a file with UTF-8 filename from the search, it starts OK.
- I then exit Koreader.
- I start Koreader again and it complains that it can't find the last opened file.
- I exit the reader and go to the file manager.
- From History I choose the same UTF-8 filename.
- It opens OK.
- I close Koreader.
- I start Koreader again and the previous file with the UTF-8 filename opens OK.

[WS64]

Open the file again from "search", exit, connect to USB and check the file settings.reader.lui.
It should have an entry
["lastfile"] = "/mnt/sd/.Books/something.epub",
Does it contain a valid filename, or \uxxxx characters?

[embryo]

Originally Posted by WS64

Open the file again from "search", exit, connect to USB and check the file settings.reader.lui.
It should have an entry
["lastfile"] = "/mnt/sd/.Books/something.epub",
Does it contain a valid filename, or \uxxxx characters?

Hmmm,
I can not reproduce the error.
I do remember though that the time it did occur, the path that it couldn't find was full of \uxxxx characters.
Now everything works OK (with your updated file, not the one from the release).