Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Readers > Kobo Reader > Kobo Developer's Corner

Notices

Reply
 
Thread Tools Search this Thread
Old 01-17-2024, 07:21 PM   #1
nixR3ad
Enthusiast
nixR3ad began at the beginning.
 
Posts: 25
Karma: 10
Join Date: Jan 2024
Device: Sage / rm2
Better storage for my Sage?

IIRC, I had a kobo years ago with internal ext4 storage. I know this because I have a painful memory of being very intoxicated and converting it to btrfs. It bricked. Many years later I own a Sage. It's a FAT format which is very limiting. Are people creating ext4 partitions? Is that what I did back then? Memories are fuzzy, but I require a filesystem that doesn't truncate the paths of files when I send them to the device.
nixR3ad is offline   Reply With Quote
Old 01-17-2024, 09:51 PM   #2
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 35,464
Karma: 145525534
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Forma, Clara HD, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Quote:
Originally Posted by nixR3ad View Post
IIRC, I had a kobo years ago with internal ext4 storage. I know this because I have a painful memory of being very intoxicated and converting it to btrfs. It bricked. Many years later I own a Sage. It's a FAT format which is very limiting. Are people creating ext4 partitions? Is that what I did back then? Memories are fuzzy, but I require a filesystem that doesn't truncate the paths of files when I send them to the device.
Converting the exposed partition to another format is both very easy to do and not that easy to do. It will require that you modify various scripts to change multiple settings such the flavour of fsck used. This will also break on a firmware update since the scripts will be overwritten. You may also want to remember that the Sage does not have removable internal storage so if you brick it, you have an expensive paperweight.

As for truncating file names, since I use calibre, it doesn't matter what file system I use, the file names will be truncated since calibre aims for the LCD. As for the effect of truncating the file names, it is a non-starter for me since Kobo uses the information from the book metadata for everything. You had noticed the common complaints that Kobo default software does not allow you to browse by file name/paths? From comments I've read, most people consider Kobo's search to do a far better job of locating authors, books, series, subtitles, etc. than any directory structure can offer.

You can console yourself that 2/3 of the partitions will still be ext4.
DNSB is offline   Reply With Quote
Advert
Old 01-17-2024, 10:42 PM   #3
Aleron Ives
Wizard
Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.
 
Posts: 1,026
Karma: 11500112
Join Date: Sep 2022
Device: Kobo Libra 2
How is FAT32 limiting? Do you have a 5 GiB e-book you want to read? I see full filenames when I connect to a computer, not 8.3 DOS names.
Aleron Ives is offline   Reply With Quote
Old 01-18-2024, 01:00 AM   #4
Sirtel
Grand Sorcerer
Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.Sirtel ought to be getting tired of karma fortunes by now.
 
Sirtel's Avatar
 
Posts: 10,146
Karma: 224760044
Join Date: Jan 2014
Location: Estonia
Device: Kobo Sage & Libra 2
Quote:
Originally Posted by DNSB View Post
As for the effect of truncating the file names, it is a non-starter for me since Kobo uses the information from the book metadata for everything. You had noticed the common complaints that Kobo default software does not allow you to browse by file name/paths? From comments I've read, most people consider Kobo's search to do a far better job of locating authors, books, series, subtitles, etc. than any directory structure can offer.
I suspect the OP wants to use KOReader, hence the need for filenames.
Sirtel is offline   Reply With Quote
Old 01-18-2024, 04:04 AM   #5
Uncle Robin
Diligent dilettante
Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.Uncle Robin ought to be getting tired of karma fortunes by now.
 
Uncle Robin's Avatar
 
Posts: 3,417
Karma: 48736498
Join Date: Sep 2019
Location: in my mind
Device: Kobo Sage; Kobo Libra H2O
Quote:
Originally Posted by Aleron Ives View Post
How is FAT32 limiting? Do you have a 5 GiB e-book you want to read? I see full filenames when I connect to a computer, not 8.3 DOS names.
This is what I was wondering.
Uncle Robin is offline   Reply With Quote
Advert
Old 01-18-2024, 12:45 PM   #6
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 35,464
Karma: 145525534
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Forma, Clara HD, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Quote:
Originally Posted by Aleron Ives View Post
How is FAT32 limiting? Do you have a 5 GiB e-book you want to read? I see full filenames when I connect to a computer, not 8.3 DOS names.
I suspect that the OP wants to be able to use a path/filename length greater than the 32,760 Unicode characters (maximum 255 per block) allowed by FAT32. Given the complex directory structure required for a directory based library to allow easily locating a book, path lengths can and do get ridiculously long.

For compatibility reasons, calibre imposes a maximum 185(?) character limit on path/filename length which can lead to truncation with moderately complex setups such as using the directory for tags, series, multiple authors, subtitles and anything else that you can think of when sending books to your ereader.

Last edited by DNSB; 01-18-2024 at 12:48 PM.
DNSB is offline   Reply With Quote
Old 01-22-2024, 06:11 PM   #7
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 74,015
Karma: 129333114
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
What eBook has a filename longer than 185 characters?
JSWolf is offline   Reply With Quote
Old 01-22-2024, 07:42 PM   #8
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 35,464
Karma: 145525534
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Forma, Clara HD, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Quote:
Originally Posted by JSWolf View Post
What eBook has a filename longer than 185 characters?
Jon, that is the total for the file path and file name. As for which books have filenames longer than 185 characters? Try an anthology with 26 authors where the file name is title - authors.
DNSB is offline   Reply With Quote
Old 01-22-2024, 08:35 PM   #9
Aleron Ives
Wizard
Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.Aleron Ives ought to be getting tired of karma fortunes by now.
 
Posts: 1,026
Karma: 11500112
Join Date: Sep 2022
Device: Kobo Libra 2
Some people sure come up with unwieldy naming conventions.
Aleron Ives is offline   Reply With Quote
Old 01-22-2024, 09:28 PM   #10
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 35,464
Karma: 145525534
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Forma, Clara HD, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Quote:
Originally Posted by Aleron Ives View Post
Some people sure come up with unwieldy naming conventions.
Add in the people who want to be able to use series, multiple tags, genre, etc. as part of the file name/path. People whom, IMHO, are stuck back in the 1980s.

A few years back, one person was complaining that they had a very carefully crafted directory structure and they could not send it to their Kobo and that when they tried calibre, it turned their directory structure into a pile of crap. When I asked why they were so concerned about directory structure on a Kobo or in calibre, the response was how else could they locate a book to read? Evidently using calibre or their Kobo's ability to search on various criteria was not acceptable in their opinion.

After a few more rounds back and forth in PMs about calibre not touching the original directory structure unless you use auto-add which is specific to one directory, I gave up on debating what amounted to a religious dispute about search vs. directory structure.
DNSB is offline   Reply With Quote
Old 01-23-2024, 09:04 PM   #11
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 74,015
Karma: 129333114
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by DNSB View Post
Jon, that is the total for the file path and file name. As for which books have filenames longer than 185 characters? Try an anthology with 26 authors where the file name is title - authors.
For an anthology, I don't use author names. I put in the editor(s) instead. Solves the too unwieldy problem.
JSWolf is offline   Reply With Quote
Old 01-23-2024, 09:07 PM   #12
JSWolf
Resident Curmudgeon
JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.JSWolf ought to be getting tired of karma fortunes by now.
 
JSWolf's Avatar
 
Posts: 74,015
Karma: 129333114
Join Date: Nov 2006
Location: Roslindale, Massachusetts
Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3
Quote:
Originally Posted by DNSB View Post
Add in the people who want to be able to use series, multiple tags, genre, etc. as part of the file name/path. People whom, IMHO, are stuck back in the 1980s.

A few years back, one person was complaining that they had a very carefully crafted directory structure and they could not send it to their Kobo and that when they tried calibre, it turned their directory structure into a pile of crap. When I asked why they were so concerned about directory structure on a Kobo or in calibre, the response was how else could they locate a book to read? Evidently using calibre or their Kobo's ability to search on various criteria was not acceptable in their opinion.

After a few more rounds back and forth in PMs about calibre not touching the original directory structure unless you use auto-add which is specific to one directory, I gave up on debating what amounted to a religious dispute about search vs. directory structure.
I don't actually like directory structure based eBook storage. It's too fixed in it's ways. I prefer the calibre way and I can find something much easier. Kobo makes it fairly easy to find something as well.
JSWolf is offline   Reply With Quote
Old 01-23-2024, 10:03 PM   #13
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 35,464
Karma: 145525534
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Forma, Clara HD, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Quote:
Originally Posted by JSWolf View Post
For an anthology, I don't use author names. I put in the editor(s) instead. Solves the too unwieldy problem.
Whereas for me, I allow calibre to list all the author names plus any editor names ( postfixed with (ed) ) names. The template for send to device limits the use of the author name to the first entry in the list since the metadata will allow search for any of the authors in either calibre or my Kobo.

Doing this with a directory structure leads to insanely complex structures which is where I stepped out of that years back discussion.

To argue with a man who has renounced the use and authority of reason, and whose philosophy consists in holding humanity in contempt, is like administering medicine to the dead, or endeavoring to convert an atheist by scripture.—Thomas Paine

Last edited by DNSB; 01-23-2024 at 10:05 PM.
DNSB is offline   Reply With Quote
Old 01-25-2024, 03:02 PM   #14
nixR3ad
Enthusiast
nixR3ad began at the beginning.
 
Posts: 25
Karma: 10
Join Date: Jan 2024
Device: Sage / rm2
Mysuecase is specific. I don't use metadata lookups. I use koreader. I actually don't mind that the filename be truncated, beause in the target directory, koreader displays metadata. But when I dort things into

/books/History/Author/title.epub
/books/Psychology/Author/title.epub
(it's actually more complicated than that)
I randomly get paths like

/books/Hstry/Auhor/title.epub
/boks/History/Auor/title.epub
/books/Psychology/Ar/title.epub
/boks/Psyclgy/Author/title.epub

When there are series in the paths and/or subtitles for academic titles, this makes finding things in a reader packed with 300 books difficult at the worst; unpleasant, and ugly at the least.
Reformatting a drive is a comfort zone. I'm a published linux support analyst. the path to the career began because of my first Nook and Kindle jailbreak enjoyments. There are a few ways to do it, but I would like to hear what works for others first. Someone posted a write-up elsewhere of using loopback images for a full Alpine environment which sounds kinda neat

My secondary need for ext4 (or similar) is the use of links to put books into multiple #subject directories like "anthologies" or "short fiction." I know Koreader has its own "shortcuts" feature, which is great, but this is a custom method that I'd worked out on my pc, however vfat doesn't support links (or other useful features).

I'm curious to see if the 4.x kernel the Sage uses includes btrfs support. It did not last time, but kernels can be compiled. Getting the userspace btrfs-progs onto it wouldn't be impossible, and I'd have reflink clones, compression, data protection, snapshots of config directories, and most importantly... write leveling on the card. Anyway, a man can dream...
nixR3ad is offline   Reply With Quote
Old 01-25-2024, 03:09 PM   #15
nixR3ad
Enthusiast
nixR3ad began at the beginning.
 
Posts: 25
Karma: 10
Join Date: Jan 2024
Device: Sage / rm2
if anyone does need a method to avoid random vfat truncation of top-level directories, here is my send-to-device template. It sends to a "books" directory, then the #shelf.

The rest is a single filename (no author, series dirs) so that koreader will just show the metadata in the #shelf directory. The author is shortened, and the "title" part ensures the filenames don't include subtitles, and any main titles longer than 10 words get shortened to 10, preserving the '/books/#shelf' part of the path.

This wasn't mine, as I'm new to the template language, but I did hack it together from various examples I'd found in this forum.
Code:
books/{#shelf:||/}{author_sort:sublist(0,1,\,)}-{series:||-}{series_index:re(^(\d)(\.|$),0\1\2)||-}{title:'sublist(sublist($, 0, 1, ':'), 0, 10, '_')'}
nixR3ad is offline   Reply With Quote
Reply

Tags
ext4, filesystems


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Kobo Sage Error when sending from Calibre to Kobo Sage ctm3rd Kobo Reader 4 05-19-2022 07:36 AM
Kobo Sage vs Forma: is Sage FASTER? Has Sage battery-life improved? LivresInOz Kobo Reader 24 04-23-2022 02:04 AM
Same old. Same old. Limited onboard storage. No removable storage. SeaKing General Discussions 29 09-07-2012 12:06 PM
question about app storage and internal storage gilly78201 Kindle Fire 5 03-06-2012 02:08 AM
iPhone Two new iPhone Storage Solutions: Zoomit (SD Card Reader) & Boxnet (Cloud Storage) kjk Apple Devices 0 02-09-2010 06:20 PM


All times are GMT -4. The time now is 11:15 AM.


MobileRead.com is a privately owned, operated and funded community.