My NSLU2 is an Intel Xscale IXP420 device -
I have a complete, self-hosting, install of Debian on it -
I know, I set it up to build the entire install from source (it took 3 or 4 days IIRC).
So it is possible.
Didn't you once tell me you had an NSLU-2 also?
Use it to native compile your code for Xscale under NSLU2/Debian.
Xscale is really, really old - I can only guess beyond what I have already posted.
Note: The XScale architecture is based on the ARMv5TE ISA without the floating point instructions.
Ref:
https://en.wikipedia.org/wiki/XScale