so i just decided to give it another try before going to bed, apparently it is the port issue. It seems like you cannot specify port on the kindle browser, it has to be the browser default port(80).
Although it still got stuck on "loading..." from the content server and it's probably caused by the javascripts, you can easily turn off the server & use apache & write some custom scripts instead. I just downloaded a book with this method and it works just fine.