Register Guidelines E-Books Today's Posts Search

Go Back   MobileRead Forums > E-Book Readers > Kobo Reader > Kobo Developer's Corner

Notices

Reply
 
Thread Tools Search this Thread
Old 05-19-2018, 04:12 AM   #1
hfpop
Addict
hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.
 
Posts: 250
Karma: 136662
Join Date: Apr 2011
Device: N/A
Tips for a large number of books

Hello,

My Kobo A1 LE, even with 32 GB of memory available, moves a lot slower with about 15.000 books on it, organized in collections via the autoshelf addon.

Are there some tips and tricks for managing such a large number of books in a more efficient way?

For instance, is there a way to make books folders not processed and not visible by Kobo, but I should see them (and "download" them) only via the web browser (for example)?

Last edited by hfpop; 05-19-2018 at 04:26 AM.
hfpop is offline   Reply With Quote
Old 05-19-2018, 12:42 PM   #2
cramoisi
Librarian
cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.cramoisi did not drink the Kool Aid.
 
Posts: 346
Karma: 72225
Join Date: Apr 2015
Location: Liège - Belgium
Device: kobo gloHD - KA1
all folders named dot something will not be processed by kobo like .hidden ; but i'm not sure you will be able to download inside them from the browser (they will be hidden so I'm not sure the browser will see them)
cramoisi is offline   Reply With Quote
Old 05-19-2018, 06:55 PM   #3
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by hfpop View Post
Hello,

My Kobo A1 LE, even with 32 GB of memory available, moves a lot slower with about 15.000 books on it, organized in collections via the autoshelf addon.
That 32GB is not memory, but storage. There is no change from the Aura ONE in the amount of RAM in the Aura ONE LE.
Quote:
Are there some tips and tricks for managing such a large number of books in a more efficient way?
To be honest, the only way to make it faster is to not put so many books on the device. But, what is slow? The home page, reading, opening a book, the library or something else?
Quote:
For instance, is there a way to make books folders not processed and not visible by Kobo, but I should see them (and "download" them) only via the web browser (for example)?
As cramoisi said, a directory whose name starts with a dot will be ignored. But, there is no way to load books from there later without connecting to a PC. You could enable telnet, and use that to copy the books somewhere that will be processed, but then you need a method to trigger the processing.
davidfor is offline   Reply With Quote
Old 05-20-2018, 01:58 AM   #4
ilovejedd
hopeless n00b
ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.
 
ilovejedd's Avatar
 
Posts: 5,110
Karma: 19597086
Join Date: Jan 2009
Location: in the middle of nowhere
Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9
Quote:
Originally Posted by davidfor View Post
That 32GB is not memory, but storage. There is no change from the Aura ONE in the amount of RAM in the Aura ONE LE.
In fairness, storage is a type of memory - persistent or non-volatile. It's just that "memory" is often used as shorthand to refer to volatile memory.
ilovejedd is offline   Reply With Quote
Old 05-20-2018, 02:22 AM   #5
hfpop
Addict
hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.
 
Posts: 250
Karma: 136662
Join Date: Apr 2011
Device: N/A
When I say memory I do mean storage memory, not RAM.

The user interface is very slow, with waiting times. With 15000 books and 22 GB still available. I miss the point to offer 32GB if the whole architecture cannot process that number of books.

The process to copy books from the hidden library can be a simple file manager that knows to do one thing: copy books from their place to a folder visible for kobo.
hfpop is offline   Reply With Quote
Old 05-20-2018, 02:34 AM   #6
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by ilovejedd View Post
In fairness, storage is a type of memory - persistent or non-volatile. It's just that "memory" is often used as shorthand to refer to volatile memory.
But, it also depends on how it is used. The 32GB of "stuff" in the Aura ONE LE is used as storage, not RAM or anything else that would normally be called "memory" when referring to computers.
davidfor is offline   Reply With Quote
Old 05-20-2018, 02:40 AM   #7
ilovejedd
hopeless n00b
ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.
 
ilovejedd's Avatar
 
Posts: 5,110
Karma: 19597086
Join Date: Jan 2009
Location: in the middle of nowhere
Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9
Quote:
Originally Posted by hfpop View Post
When I say memory I do mean storage memory, not RAM.

The user interface is very slow, with waiting times. With 15000 books and 22 GB still available. I miss the point to offer 32GB if the whole architecture cannot process that number of books.

The process to copy books from the hidden library can be a simple file manager that knows to do one thing: copy books from their place to a folder visible for kobo.
Kobo purchased manga tend to range from 100-200MB per volume. Factor in binary-decimal discrepancy and operating system, you likely only have ~28GB available. It's very easy to fill that with less than 500 books.
ilovejedd is offline   Reply With Quote
Old 05-20-2018, 02:41 AM   #8
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by hfpop View Post
When I say memory I do mean storage memory, not RAM.
I commented because your first post made it seem you expected the Aura ONE LE to be faster than the standard Aura ONE. The only change is the amount of storage for books in them.
Quote:
The user interface is very slow, with waiting times. With 15000 books and 22 GB still available. I miss the point to offer 32GB if the whole architecture cannot process that number of books.
For comics and manga. This has been one of the complaints about the fixed memory devices, they don't have enough space to carry many comics.
Quote:
The process to copy books from the hidden library can be a simple file manager that knows to do one thing: copy books from their place to a folder visible for kobo.
And how would you run it? You would need to connect to the PC or have someone write a filemanager for the device that you can run and also, as I said before, triggers the import into the library process.

Alternatively, you can try one of the alternative reader apps such as Koreader.
davidfor is offline   Reply With Quote
Old 05-20-2018, 02:47 AM   #9
ilovejedd
hopeless n00b
ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.ilovejedd ought to be getting tired of karma fortunes by now.
 
ilovejedd's Avatar
 
Posts: 5,110
Karma: 19597086
Join Date: Jan 2009
Location: in the middle of nowhere
Device: PW4, PW3, Libra H2O, iPad 10.5, iPad 11, iPad 12.9
Quote:
Originally Posted by davidfor View Post
But, it also depends on how it is used. The 32GB of "stuff" in the Aura ONE LE is used as storage, not RAM or anything else that would normally be called "memory" when referring to computers.
Volatile and non-volatile memory does refer to computers. An example of volatile memory is RAM. Examples of non-volatile memory include floppies, hard drives, tapes, etc. Heck, I think that lesson was from my first ever computer science class (back when we still used floppies). It's just that "memory" is often used colloquially to refer to volatile or random access memory nowadays.

Mind, I seem to recall RAM also referred to as primary storage and NVM secondary storage in the above-mentioned class.

Last edited by ilovejedd; 05-20-2018 at 02:57 AM.
ilovejedd is offline   Reply With Quote
Old 05-20-2018, 02:54 AM   #10
DNSB
Bibliophagist
DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.DNSB ought to be getting tired of karma fortunes by now.
 
DNSB's Avatar
 
Posts: 46,210
Karma: 168983734
Join Date: Jul 2010
Location: Vancouver
Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos
Quote:
Originally Posted by hfpop View Post
When I say memory I do mean storage memory, not RAM.

The user interface is very slow, with waiting times. With 15000 books and 22 GB still available. I miss the point to offer 32GB if the whole architecture cannot process that number of books.

The process to copy books from the hidden library can be a simple file manager that knows to do one thing: copy books from their place to a folder visible for kobo.
As far as I can tell, the raison d'être for the Aura One Comic/Limited Edition was not so much to allow epub lovers to have thousands of books available but for manga/comic lovers whose book file sizes often exceed 100MB each to have hundreds of books available (I seem to remember that one announcement mentioned 700 manga).

The 512MB of RAM is likely the source of some of your issues -- take a look at the size of your SQLite databases for instance, add in the size of the font files (all 4 files for fonts offering variants) for whichever fonts you are using and suddenly RAM is becoming a scarce commodity.
DNSB is offline   Reply With Quote
Old 05-20-2018, 04:14 AM   #11
hfpop
Addict
hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.
 
Posts: 250
Karma: 136662
Join Date: Apr 2011
Device: N/A
David, in principle you are right. But take a look at the official web page of Rakuten Kobo for A1-LE: https://us.kobobooks.com/products/ko...imited-edition . You see there their formal specs description: "32 GB on-board memory, holds up to 28,000 eBooks or 700 graphic novels and manga volumes".

They advertise their product is operational with 28,000 eBooks. They do know how much space the sqlite file takes (750 MB for half of that capacity). And they still advertise the 28,000 eBooks.

I am not opening a debate here. I simply would like to know how I could best use 15,000 ebooks (never mind 28,000 ebooks) on my Kobo A1-LE.
hfpop is offline   Reply With Quote
Old 05-20-2018, 04:25 AM   #12
Terisa de morgan
Grand Sorcerer
Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.Terisa de morgan ought to be getting tired of karma fortunes by now.
 
Terisa de morgan's Avatar
 
Posts: 6,629
Karma: 12595249
Join Date: Jun 2009
Location: Madrid, Spain
Device: Kobo Clara/Aura One/Forma,XiaoMI 5, iPad, Huawei MediaPad, YotaPhone 2
Quote:
Originally Posted by hfpop View Post
David, in principle you are right. But take a look at the official web page of Rakuten Kobo for A1-LE: https://us.kobobooks.com/products/ko...imited-edition . You see there their formal specs description: "32 GB on-board memory, holds up to 28,000 eBooks or 700 graphic novels and manga volumes".

They advertise their product is operational with 28,000 eBooks. They do know how much space the sqlite file takes (750 MB for half of that capacity). And they still advertise the 28,000 eBooks.

I am not opening a debate here. I simply would like to know how I could best use 15,000 ebooks (never mind 28,000 ebooks) on my Kobo A1-LE.
As other people have already told you, for that quantity of books, nickel (the standard app for Kobo is not a great solution). Check koreader thread and an alternate reader app.

As far as I know, there's nothing that allows you to get a book from a hidden (dot beginning) folder in the ereader, move it to a non-hidden folder and the ereader reads the ebook on the fly, adds it to the database and it appears in the Kobo library.
Terisa de morgan is offline   Reply With Quote
Old 05-20-2018, 04:55 AM   #13
davidfor
Grand Sorcerer
davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.davidfor ought to be getting tired of karma fortunes by now.
 
Posts: 24,905
Karma: 47303824
Join Date: Jul 2011
Location: Sydney, Australia
Device: Kobo:Touch,Glo, AuraH2O, GloHD,AuraONE, ClaraHD, Libra H2O; tolinoepos
Quote:
Originally Posted by hfpop View Post
David, in principle you are right. But take a look at the official web page of Rakuten Kobo for A1-LE: https://us.kobobooks.com/products/ko...imited-edition . You see there their formal specs description: "32 GB on-board memory, holds up to 28,000 eBooks or 700 graphic novels and manga volumes".

They advertise their product is operational with 28,000 eBooks. They do know how much space the sqlite file takes (750 MB for half of that capacity). And they still advertise the 28,000 eBooks.

I am not opening a debate here. I simply would like to know how I could best use 15,000 ebooks (never mind 28,000 ebooks) on my Kobo A1-LE.
You are right about all that. But, nowhere does it say that it is a good idea to put 15000 books on the device. And based on what you have said, you can actually use the device, it just isn't very fast.
davidfor is offline   Reply With Quote
Old 05-20-2018, 07:55 AM   #14
PeterT
Grand Sorcerer
PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.PeterT ought to be getting tired of karma fortunes by now.
 
Posts: 13,515
Karma: 78910202
Join Date: Nov 2007
Location: Toronto
Device: Libra H2O, Libra Colour
Just curious as to what sort of directory structure you're using for all these books.

Sent from my Nexus 7 using Tapatalk
PeterT is offline   Reply With Quote
Old 05-20-2018, 05:41 PM   #15
hfpop
Addict
hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.hfpop knows how many angels can dance on the head of a pin.
 
Posts: 250
Karma: 136662
Join Date: Apr 2011
Device: N/A
Quote:
Originally Posted by PeterT View Post
Just curious as to what sort of directory structure you're using for all these books.
This forum has a lot of threads with shared experiences on what people consider an optimal directory structure. This is besides the point here.

With respect to my original question. Let me try a complete answer. You do need programming experience for this.

(1) Your library will have to stay in a dot folder, for instance /mnt/onboard/.books. This is the only useful information I learned on this thread.

(2) You will use a file manager to copy whatever you need to the right place, for instance /mnt/onboard/books.

The closest thing you have is KOReader. You need to set it to read hidden files, and to read files from that .books folder. You need to modify the lua sources to add a context sensitive menu option to do the file copy.

(3) After exiting that file manager you will need to fire the books refresh function that happens after usb disconnect. This is the only thing not yet working correctly. An advice here is most welcome.

And please, do not say it cannot be done.
hfpop is offline   Reply With Quote
Reply


Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Glo Glo keeps getting stuck after adding a large number of books Lofwyr23 Kobo Reader 16 05-18-2014 02:17 AM
Djvu: Extracting ISBN numbers from a large number of books? MelBr Other formats 7 04-13-2014 03:35 AM
Large number of books on memory card pwalker8 Sony Reader 8 03-24-2009 02:20 PM
PRS-505 with large number of books? murraypaul Sony Reader 22 07-08-2008 01:23 AM
Hanlin with large number of books? murraypaul HanLin eBook 3 06-23-2008 06:54 AM


All times are GMT -4. The time now is 03:08 AM.


MobileRead.com is a privately owned, operated and funded community.