Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Readers > Kobo Reader > Kobo Developer's Corner

Notices

Reply
 
Thread Tools Search this Thread
Old 05-18-2020, 04:59 PM   #91
NiLuJe
BLAM!
NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.
 
NiLuJe's Avatar
 
Posts: 10,494
Karma: 18151936
Join Date: Jun 2010
Location: Paris, France
Device: Kindle 2i, 3g, 4, 5w, PW & PW2; Kobo H2O & Forma
Latest update includes some more minor shell QoL tweaks, and some more busybox tweaks (like, working modutils! modprobe with automagic dependency resolution, yay!).

Python 2 is EoL, so the default python symlink now points to Python 3.

perf & co is now bundled. It requires (among other things) perf events in the kernel, though, so it's probably Mk.6+ only (I can confirm that it won't work on Mk.5, but is probably okay on Mk. 7).

----

Most importantly, it changes how Python is shipped: instead of the insanity of bundling *two* full Python builds in every KoboRoot tarball, what's available in the first post now only bundles the core shell stuff.
So, how do you install Python, now?

A new OTA update script has been added: update-kobostuff
It'll check for updates and properly (i.e., it finally handles pre- and post- install cleanup) install the latest version of the core stuff, the python 3 build, or the python 2 build.

The README has a new section with more details about it, but, basically: it's much more convenient, it's a lot faster (zstd instead of gzip), it doesn't require a reboot or even an USBMS session, and it saves a bunch of precious write cycles, as the compressed data never actually makes it to disk (it's a curl -> zstd -> tar pipeline).
And, you no longer get force-fed 300MB of Python down your throat if you couldn't care less about Python, which makes the initial install that much more pleasant.

As far as this is concerned, you basically never have to deal with a KoboRoot tarball ever again, as using the script to update the core shell stuff will also be much faster, and it'll only update if there's actually an update available.

(TL;DR: All hail our evil overlord Facebook for coming up with zstandard, because zlib is the absolute pits).

Last edited by NiLuJe; 05-18-2020 at 05:17 PM.
NiLuJe is offline   Reply With Quote
Old 05-18-2020, 07:07 PM   #92
sherman
Guru
sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.
 
Posts: 605
Karma: 1223802
Join Date: Aug 2008
Location: Auckland - NZ
Device: Kobo Aura H2O, Kobo Forma
Quote:
Originally Posted by NiLuJe View Post
(TL;DR: All hail our evil overlord Facebook for coming up with zstandard, because zlib is the absolute pits).
Interestingly I did some quick and dirty compression tests on my Aura H2O a few weeks ago for a project that may or may not happen. Speed wise, there didn't seem to be an awful lot of difference between zstd and zlib TBH. Which makes sense, because from what I've read, most of the performance uplift comes from multithreading, and maybe some architecture specific optimizations, with a Cortex A8 class CPU being very low on the priority list.

Now granted, the compression ratio may be better, but I wasn't to concerned about that for my specific desires.

If you ever want speed, LZ4 is waaaaaay faster. But that comes at the expense of compression ratio, so you win some, and lose some.
sherman is offline   Reply With Quote
Advert
Old 05-18-2020, 07:47 PM   #93
NiLuJe
BLAM!
NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.NiLuJe ought to be getting tired of karma fortunes by now.
 
NiLuJe's Avatar
 
Posts: 10,494
Karma: 18151936
Join Date: Jun 2010
Location: Paris, France
Device: Kindle 2i, 3g, 4, 5w, PW & PW2; Kobo H2O & Forma
@sherman: Decompression is where it's truly impressive, and that's what I was going for (coupled w/ a decent compression ratio, since the actual bottleneck is liable to be the Wifi, anyway) . Here, to get a compression ratio that's still worse than xz's defaults, I jump to --ultra -20, and it's then *slower* than xz (on the host, x64, both threaded).

(I mention xz because I've actually been using xz for these for quite a while on the Kindle side of things, and decompression speed is fairly nice (IIRC, better than both gzip & bz2) ).

But, yeah, if I needed the reverse (i.e, quick on-device compression, without particularly caring about the compression ratio), LZ4 would definitely be the top contender .

Last edited by NiLuJe; 05-18-2020 at 07:57 PM.
NiLuJe is offline   Reply With Quote
Old 05-18-2020, 07:50 PM   #94
sherman
Guru
sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.sherman ought to be getting tired of karma fortunes by now.
 
Posts: 605
Karma: 1223802
Join Date: Aug 2008
Location: Auckland - NZ
Device: Kobo Aura H2O, Kobo Forma
Quote:
Originally Posted by NiLuJe View Post
@sherman: Decompression is where it's impressive, and what I was going for (coupled w/ a decent compression ratio, since the actual bottleneck is liable to be the Wifi, anyway) . Here, to get a compression ratio that's still worse than xz's defaults, I jump to --ultra -20, and it's then *slower* than xz (on the host, x64, both threaded).

But, yeah, if I needed the reverse (i.e, quick on-device compression), LZ4 would definitely be the top contender .
Ahhh, yeah, I guess I was mainly testing compression, come to think of it.

Makes sense.
sherman is offline   Reply With Quote
Reply

Tags
ssh, telnet, tools

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Package with console tools CGarces Development 0 09-06-2013 05:04 PM
Combined Tools Package Lizj1 Plugins 5 01-11-2013 10:32 AM
USBNetwork USB Driver & Telnet on Windows XP SP3 namati Kindle Developer's Corner 0 02-24-2012 01:20 AM
Instruction to get root on 60x/90x + remote telnet & FTP mamaich PocketBook 17 08-27-2011 07:41 PM


All times are GMT -4. The time now is 09:15 AM.


MobileRead.com is a privately owned, operated and funded community.