Tools Snapshots of NiLuJe's hacks

[Neposeda]

Originally Posted by crazyelectron

For those of us who eagerly await the release the proper armhf compatible python3 package, in the meantime, this is how I’ve compiled python3 to run on my Kindle Scribe 5.17.0.1 (armhf)...

Can You post already compiled files here?
Unfortunately I have no possibility and experience to compile it myself

[DNSB]

You can post compiled files here. In Advanced mode, you can use either the Paperclip icon or the Manage Attachments button. Add the compiled file(s) to a .zip archive (maximum archive size is 40MB) before attempting to attach them.

[Aadvik5951]

Originally Posted by crazyelectron

For those of us who eagerly await the release the proper armhf compatible python3 package, in the meantime, this is how I’ve compiled python3 to run on my Kindle Scribe 5.17.0.1 (armhf)

Please consider this just as a notebook in progress, most of the things may/will not work, I followed the suggestion and tried the

By the way thanks to the eminent programmer/s involved in Koxtoolchain, KindleTool and all the packages in this thread.

Dockerfile

FROM --platform=linux/amd64 debian:bullseye AS amd64-base

RUN apt-get update

RUN DEBIAN_FRONTEND=noninteractive apt-get install -y \
    build-essential autoconf automake bison flex gawk \
    libtool libtool-bin libncurses-dev \
    curl file git gperf help2man texinfo unzip wget

# Python dev deps for --with-build-python
RUN DEBIAN_FRONTEND=noninteractive apt-get install -y \
    make libssl-dev zlib1g-dev libbz2-dev libreadline-dev \
    libsqlite3-dev llvm libncurses5-dev libncursesw5-dev \
    xz-utils tk-dev liblzma-dev tk-dev libffi-dev

RUN DEBIAN_FRONTEND=noninteractive apt-get install -y \
    pkg-config

WORKDIR /root

RUN wget -qO- https://www.python.org/ftp/python/3.11.11/Python-3.11.11.tgz | tar xvz

RUN cp -r Python-3.11.11 Python-3.11.11-armhf

RUN cd Python-3.11.11 && \
    ./configure --prefix=/usr/local/python-native --enable-optimizations --with-lto --with-computed-gotos --with-system-ffi && \
    make -j$(nproc) && \
    make install

RUN wget -qO- https://github.com/KindleModding/koxtoolchain/releases/download/2025.01/kindlehf.tar.gz | tar xvz && \
    wget -qO- https://github.com/KindleModding/koxtoolchain/raw/27f361f5d5e1b85b6d02978a6b45271a2605019c/refs/x-compile.sh > x-compile.sh

# TO-Discover Where on earth are the contents of ./Kindle/CrossTool/Build_KHF sysroot?? "./gen-tc.sh kindlehf" doesn't seem to gather them, and they are not in kindlehf.tar.gz either.   
RUN mkdir -p /mnt/us/python3

RUN echo '#!/bin/bash\n\
\n\
set -a\n\
HOME=/root source /root/x-compile.sh kindlehf env bare\n\
set +a\n\
\n\
export CC=$CROSS_TC-gcc\n\
export CXX=$CROSS_TC-g++\n\
export STRIP=$CROSS_TC-strip\n\
export AR=$CROSS_TC-gcc-ar\n\
export RANLIB=$CROSS_TC-gcc-ranlib\n\
export LD=$CROSS_TC-ld\n\
export READELF=$CROSS_TC-readelf\n\
export SYSROOT=/mnt/us/python3\n\
export X_TOOLS_SYSROOT=/root/x-tools/arm-kindlehf-linux-gnueabihf/arm-kindlehf-linux-gnueabihf/sysroot\n\
export CFLAGS="-I$SYSROOT/usr/include -I$X_TOOLS_SYSROOT/usr/include"\n\
export CPPFLAGS="-I$SYSROOT/usr/include -I$X_TOOLS_SYSROOT/usr/include"\n\
export LDFLAGS="-L$SYSROOT/lib -L$SYSROOT/usr/lib -L$X_TOOLS_SYSROOT/lib -L$X_TOOLS_SYSROOT/usr/lib -Wl,-rpath=/mnt/us/python3/usr/lib -Wl,-rpath-link=$SYSROOT/lib:$SYSROOT/usr/lib:$X_TOOLS_SYSROOT/lib:$X_TOOLS_SYSROOT/usr/lib"\n\
export PKG_CONFIG_SYSROOT_DIR="$SYSROOT"\n\
export PKG_CONFIG_PATH="$SYSROOT/usr/lib/pkgconfig"\n\
' > /root/exec && chmod +x /root/exec

RUN wget -qO- https://github.com/madler/zlib/archive/refs/tags/v1.3.1.tar.gz | tar xvz
RUN cd zlib-1.3.1 && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN wget -qO- https://github.com/libffi/libffi/releases/download/v3.4.6/libffi-3.4.6.tar.gz | tar xvz
RUN cd libffi-3.4.6 && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr --host=arm-linux-gnueabihf --build=x86_64-pc-linux-gnu && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN wget -qO- https://github.com/openssl/openssl/archive/refs/tags/OpenSSL_1_1_1w.tar.gz | tar xvz
RUN cd openssl-OpenSSL_1_1_1w && \
    bash -c "source /root/exec && \
    ./Configure linux-armv4 --prefix=/usr --openssldir=/etc/ssl -DOPENSSL_PIC -DOTHER_LIBS=atomic -lpthread -latomic && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN wget -qO- https://www.sqlite.org/2024/sqlite-autoconf-3450100.tar.gz | tar xvz 
RUN cd sqlite-autoconf-3450100 && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr --host=arm-linux-gnueabihf --build=x86_64-pc-linux-gnu && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN wget -qO- https://ftp.gnu.org/gnu/ncurses/ncurses-6.4.tar.gz | tar xvz 
RUN cd ncurses-6.4 && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr --host=arm-linux-gnueabihf --build=x86_64-pc-linux-gnu --with-shared --disable-stripping && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN cd Python-3.11.11-armhf && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr --host=arm-linux-gnueabihf --build=x86_64-pc-linux-gnu --with-build-python=/usr/local/python-native/bin/python3.11 --enable-shared --enable-optimizations --enable-loadable-sqlite-extensions --with-lto --with-computed-gotos --with-system-ffi --with-ensurepip=install --disable-ipv6 --disable-test-modules ac_cv_file__dev_ptmx=no ac_cv_file__dev_ptc=no && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

Next, I built the image and copied the python3 sysroot to the device:

docker buildx build -t kterm_kindle .

docker run --rm -it -v $(pwd):/project kterm_kindle bash -c "tar -czvf /project/python3.tar.gz -C /mnt/us python3"

scp python3.tar.gz root@192.168.1.101:/mnt/us

On the Kindle extracted the python3 sysroot:

[root@kindle us]# tar -xvf python3.tar.gz -C /mnt/us/

Then running python3 and pip (It is necessary to use the full path or modify $PATH):

[root@kindle us]# /mnt/us/python3/usr/bin/python3.11 -m ensurepip
[root@kindle us]# /mnt/us/python3/usr/bin/python3.11 -m pip install requests
[root@kindle us]# /mnt/us/python3/usr/bin/python3.11
Python 3.11.11 (main, Jan 29 2025, 20:15:57) [GCC 14.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import requests
>>> r = requests.get('https://httpbin.org/basic-auth/user/pass', auth=('user', 'pass'))
>>> r.status_code
200
>>>

Of course only packages with a compatible built distribution (.whl) available will/may work.

Note: all the “docker” commands were run on MacOS, for linux it may be necessary to adapt them.

Can you tell this in simpler instructions?

[juegos]

Originally Posted by crazyelectron

For those of us who eagerly await the release the proper armhf compatible python3 package, in the meantime, this is how I’ve compiled python3 to run on my Kindle Scribe 5.17.0.1 (armhf)

Please consider this just as a notebook in progress, most of the things may/will not work, I followed the suggestion and tried the

By the way thanks to the eminent programmer/s involved in Koxtoolchain, KindleTool and all the packages in this thread.

Dockerfile

FROM --platform=linux/amd64 debian:bullseye AS amd64-base

RUN apt-get update

RUN DEBIAN_FRONTEND=noninteractive apt-get install -y \
    build-essential autoconf automake bison flex gawk \
    libtool libtool-bin libncurses-dev \
    curl file git gperf help2man texinfo unzip wget

# Python dev deps for --with-build-python
RUN DEBIAN_FRONTEND=noninteractive apt-get install -y \
    make libssl-dev zlib1g-dev libbz2-dev libreadline-dev \
    libsqlite3-dev llvm libncurses5-dev libncursesw5-dev \
    xz-utils tk-dev liblzma-dev tk-dev libffi-dev

RUN DEBIAN_FRONTEND=noninteractive apt-get install -y \
    pkg-config

WORKDIR /root

RUN wget -qO- https://www.python.org/ftp/python/3.11.11/Python-3.11.11.tgz | tar xvz

RUN cp -r Python-3.11.11 Python-3.11.11-armhf

RUN cd Python-3.11.11 && \
    ./configure --prefix=/usr/local/python-native --enable-optimizations --with-lto --with-computed-gotos --with-system-ffi && \
    make -j$(nproc) && \
    make install

RUN wget -qO- https://github.com/KindleModding/koxtoolchain/releases/download/2025.01/kindlehf.tar.gz | tar xvz && \
    wget -qO- https://github.com/KindleModding/koxtoolchain/raw/27f361f5d5e1b85b6d02978a6b45271a2605019c/refs/x-compile.sh > x-compile.sh

# TO-Discover Where on earth are the contents of ./Kindle/CrossTool/Build_KHF sysroot?? "./gen-tc.sh kindlehf" doesn't seem to gather them, and they are not in kindlehf.tar.gz either.   
RUN mkdir -p /mnt/us/python3

RUN echo '#!/bin/bash\n\
\n\
set -a\n\
HOME=/root source /root/x-compile.sh kindlehf env bare\n\
set +a\n\
\n\
export CC=$CROSS_TC-gcc\n\
export CXX=$CROSS_TC-g++\n\
export STRIP=$CROSS_TC-strip\n\
export AR=$CROSS_TC-gcc-ar\n\
export RANLIB=$CROSS_TC-gcc-ranlib\n\
export LD=$CROSS_TC-ld\n\
export READELF=$CROSS_TC-readelf\n\
export SYSROOT=/mnt/us/python3\n\
export X_TOOLS_SYSROOT=/root/x-tools/arm-kindlehf-linux-gnueabihf/arm-kindlehf-linux-gnueabihf/sysroot\n\
export CFLAGS="-I$SYSROOT/usr/include -I$X_TOOLS_SYSROOT/usr/include"\n\
export CPPFLAGS="-I$SYSROOT/usr/include -I$X_TOOLS_SYSROOT/usr/include"\n\
export LDFLAGS="-L$SYSROOT/lib -L$SYSROOT/usr/lib -L$X_TOOLS_SYSROOT/lib -L$X_TOOLS_SYSROOT/usr/lib -Wl,-rpath=/mnt/us/python3/usr/lib -Wl,-rpath-link=$SYSROOT/lib:$SYSROOT/usr/lib:$X_TOOLS_SYSROOT/lib:$X_TOOLS_SYSROOT/usr/lib"\n\
export PKG_CONFIG_SYSROOT_DIR="$SYSROOT"\n\
export PKG_CONFIG_PATH="$SYSROOT/usr/lib/pkgconfig"\n\
' > /root/exec && chmod +x /root/exec

RUN wget -qO- https://github.com/madler/zlib/archive/refs/tags/v1.3.1.tar.gz | tar xvz
RUN cd zlib-1.3.1 && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN wget -qO- https://github.com/libffi/libffi/releases/download/v3.4.6/libffi-3.4.6.tar.gz | tar xvz
RUN cd libffi-3.4.6 && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr --host=arm-linux-gnueabihf --build=x86_64-pc-linux-gnu && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN wget -qO- https://github.com/openssl/openssl/archive/refs/tags/OpenSSL_1_1_1w.tar.gz | tar xvz
RUN cd openssl-OpenSSL_1_1_1w && \
    bash -c "source /root/exec && \
    ./Configure linux-armv4 --prefix=/usr --openssldir=/etc/ssl -DOPENSSL_PIC -DOTHER_LIBS=atomic -lpthread -latomic && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN wget -qO- https://www.sqlite.org/2024/sqlite-autoconf-3450100.tar.gz | tar xvz 
RUN cd sqlite-autoconf-3450100 && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr --host=arm-linux-gnueabihf --build=x86_64-pc-linux-gnu && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN wget -qO- https://ftp.gnu.org/gnu/ncurses/ncurses-6.4.tar.gz | tar xvz 
RUN cd ncurses-6.4 && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr --host=arm-linux-gnueabihf --build=x86_64-pc-linux-gnu --with-shared --disable-stripping && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

RUN cd Python-3.11.11-armhf && \
    bash -c "source /root/exec && \
    ./configure --prefix=/usr --host=arm-linux-gnueabihf --build=x86_64-pc-linux-gnu --with-build-python=/usr/local/python-native/bin/python3.11 --enable-shared --enable-optimizations --enable-loadable-sqlite-extensions --with-lto --with-computed-gotos --with-system-ffi --with-ensurepip=install --disable-ipv6 --disable-test-modules ac_cv_file__dev_ptmx=no ac_cv_file__dev_ptc=no && \
    make -j$(nproc) && \
    make install DESTDIR=\$SYSROOT"

Next, I built the image and copied the python3 sysroot to the device:

docker buildx build -t kterm_kindle .

docker run --rm -it -v $(pwd):/project kterm_kindle bash -c "tar -czvf /project/python3.tar.gz -C /mnt/us python3"

scp python3.tar.gz root@192.168.1.101:/mnt/us

On the Kindle extracted the python3 sysroot:

[root@kindle us]# tar -xvf python3.tar.gz -C /mnt/us/

Then running python3 and pip (It is necessary to use the full path or modify $PATH):

[root@kindle us]# /mnt/us/python3/usr/bin/python3.11 -m ensurepip
[root@kindle us]# /mnt/us/python3/usr/bin/python3.11 -m pip install requests
[root@kindle us]# /mnt/us/python3/usr/bin/python3.11
Python 3.11.11 (main, Jan 29 2025, 20:15:57) [GCC 14.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import requests
>>> r = requests.get('https://httpbin.org/basic-auth/user/pass', auth=('user', 'pass'))
>>> r.status_code
200
>>>

Of course only packages with a compatible built distribution (.whl) available will/may work.

Note: all the “docker” commands were run on MacOS, for linux it may be necessary to adapt them.

Thanks for the detailed instructions! In the final untarring step I get the following kind of errors:

tar: can't create symlink 'python3/usr/share/man/man3/i2d_ASN1_T61STRING.3' to 'd2i_X509.3': Operation not permitted
python3/usr/share/man/man3/i2d_PKCS8_fp.3

EDIT: actually these errors can be ignored it seems

Pretty cool to be able to run Python on a Kindle!!

[mobichuck]

Originally Posted by Aadvik5951

Can you tell this in simpler instructions?

Not really, I would guess - these are very detailed, step-by-step instructions.

But keep in mind they are instructions for custom-compiling a binary, which is not trivial and it may be that it's simply beyond your skills.

I don't say that to be mean or insulting, merely to inform that this isn't something that can be streamlined/simplified any further. There are some vague steps like "here's some docker code" that requires that you know or be able to figure out what docket is and how to use it.

But shedding light on each little part that requires, to be frank, a fair amount of technical know-how and problem solving ability, would explode those directions to be many times longer than they already are.

The specifics are there - I suggest you Google anything you can't handle/don't understand because I don't think it really can be made any more simple.

[jeliozver]

PW5 Firmware 5.17.1.0.3 using the WinterBreak JB
Both python 2 and 3 versions fail to install

Both. failing with following line in log from mrinstaller


python2
"./install.sh" line 92: ./xzdec not found
tar: short read
return code 1

python3
"./install.sh" line 154: ./xzdec not found
tar: short read
return code 1

Is the python builds not working with latest firmwares?

[DNSB]

Kindle firmware versions from 5.16.3 switched to using hardware floating point instead of software floating point. You may have noticed packages with kindlehf in the name. Older packages need to be rebuilt to use hardware floating point as mentioned in the last couple of pages of this thread.

[jeliozver]

I suspected something like that, thanks for the answer.
Guess only thing we can do is wait for some kind soul that knows what they're doing to make updates.

[killsKindle]

i tried getting the usbnet working at least manually copying all the files, but when i click toggle it will always remain on usb disk, shows switching usbnet to usbms and never changes? What could be the issue ?

[DNSB]

Originally Posted by killsKindle

i tried getting the usbnet working at least manually copying all the files, but when i click toggle it will always remain on usb disk, shows switching usbnet to usbms and never changes? What could be the issue ?

If your firmware version is 5.16.3 or higher, you will need to use USBNetLite and not USBNet (hf versus sf).

[killsKindle]

Originally Posted by DNSB

If your firmware version is 5.16.3 or higher, you will need to use USBNetLite and not USBNet (hf versus sf).

thanks for that finally installed, but now when i hit toggle it will remain in usbms mode and i get disk visible, its not getting the net interface on :/ what could be wrong ? when i hit status it says enabled all the time

[Malc]

First post and sorry if this resurrects some of the old posts. If its in the wrong section I'm sure the moderators will move it.

YouTube suggested a video which described the process of modifying old kindles and unlocking the ties with Amazon, and freeing them up to use ebooks in other formats etc. So I dusted off my old paperwhite Kindle and followed the steps in the Wiki that the video linked to (https://kindlemodding.org/jailbreaking/post-jailbreak/)

Entered the serial number and was informed its a gen4. So downloaded the jailbrake packages and followed the instructions. It took several attempts, as my kindle had the "update device" option greyed out, but by more luck than judgement on one occasion I got the "you are jailbroken" message listed on the main page. I then went to the post jailbrake section and applied the hot fix to stop it auto updating.

So the next item was to install KUAL and MRPI. I downloaded the files for the version of kindle I own. Again probably by luck after the update KUAL appeared as an item on the main screen. I then followed the steps to install MRPI but when it gets to entering ;log mrpi into the search bar nothing happened, and if I select the "directory" option it reports no results found, which seemed to match the screen shot on the walk through.

If I use the "joystick" and hit the right arrow button having selected it in the list a new page opens. KUAL is the title, followed with what looks like the members names underneath. States its ver 2.7, but the reports that "Mobileread Kindlet Kit is not installed. Is this correct and its not actually anything to open, or has something failed in some way ?

Googling brought me to this forum, but it seems that a lot of posts just link back to others then link to the first etc, so it gets confusing. The video made the process look simple and claimed a 10 minute process... I've been doing this all day !!

Any pointers as to what I may have done wrong, or if this is correct and I need to add a book in a particular format to confirm its' "unlocked" would be welcome.

Thanks

Malcolm

[toadclones]

I was able to get python running on a HF device using crazyelectron's build script. It works but we still need to get FBInk bindings working. Also the build is much larger than it should be(i think).

@NiLuJe Do you still have the build script you used to cross compile python? It would make things much easier.

[silver251]

Hey, sorry if I interrupt, I was reviving my good old KT4 and ended up with a pretty nice idea.
I have a Calibre with OPDS and I use KOReader to connect to it and download my own epubs right into my kindle.

Turns out, that same server is connected to my Tailscale account, and I found this repo:

https://github.com/mitanshu7/tailscale_kual/issues/2

I was able to set it up right away (it appears listed on my devices, and tailscale ping works, ping from the server to the kindle works...) but I was not able to reach the server, turns out its a limitation of the Kernel, has to use a SOCKS5 proxy and its a mess but when I try to run it, the current kernel (4.15, running 5.17.1) tun.ko is not installed.

I am not that fluent compiling (i dont even have an environment ready at this moment) but if anybody could compile it, this would be a nice solution.

I have checked in the source code, the tun.c file is there so I believe it should not be a nightmare (IDK)

Thank you in advance for your help (the amount of hours your threads saved me already is huge).

[toadclones]

I managed to build a python3.11 for hard floating point devices. (firmware > 5.16.2.1.1) This works on my Kindle 11th gen with 5.17.1

I basically took crazyelectron's dockerfile and added preinstalled packages and cross compiles when necessary(numpy). Most packages you would use are installed except pillow(for image manipulation). FBInk bindings are installed.

I included the code used, etc. It's pretty messy. Enjoy.

A list of packages installed

• requests
• bs4
• httpie
• requests_oauthlib
• betamax
• html5lib
• pyjwt
• Wand
• PySocks
• asn1crypto
• SLPP
• cffi
• FBInk bindings

EDIT: This was meant to be in this thread: https://www.mobileread.com/forums/sh...63#post4505663
lmao sorry it's late