impserve: serving content and accessing the internet for the 1200/1150

ashkulz · 08-28-2008, 08:21 PM

NOTE: impserve is now part of ebookutils which is hosted at http://ebookutils.berlios.de.

I'm proud to release impserve, which will allow you to do the following:

serve as a local content server so that you can download IMP books to your device (you do not need software like GEB Librarian)
serve static pages/media residing on your hard-disk
browse the net using impserve as a proxy server
download .IMP books from the net
automatic conversion of PRC, LIT, DJVU and PDF books to .IMP (via plugins)

Please see the Impserve page for further details on how to configure your ebook, install and use impserve. For downloading the latest version, please visit the ebookutils homepage.

I always planned to do this script, but linreb gave me quite a few good ideas. Big thanks to Nick, Nandu, and all the other people who are helping us to maintain this community

nrapallo · 08-28-2008, 10:59 PM

Ashish,

I'm using WinXP with ActivePython 2.5.1.1 installed (hey, I compiled PDFRead didn't I?) and I get the segmentation fault below:

Code:

E:\ebooks\Impserve>impserve.py -a 192.168.X.XX -p 8118 shelf
Traceback (most recent call last):
  File "E:\ebooks\Impserve\impserve.py", line 119, in <module>
    signal.signal(signal.SIGALRM, SIGALRM_handler)
AttributeError: 'module' object has no attribute 'SIGALRM'

Is this a windows thing using alarm()?

Eagerly waiting for a fix, and don't say switch to linux!

nrapallo · 08-29-2008, 01:14 AM

I already have some suggestions, without even using the program, Sheesh!

When you "serve up" the webpages to the hardware reader, could you text substitute:
- <a href> to <a UNDERLINE="YES" href> (so that you can SEE hyperlinks) - DONE IN LATEST VERSION!
- <body> to <body style="margin-left:2%; margin-right:2%"> (so there's no edge-bleeding) - HAS NO EFFECT SO CAN'T DO THIS!
- etc. (give it time; more suggestions forthcoming...)

ashkulz · 08-29-2008, 06:38 AM

Quote:

Originally Posted by nrapallo

Is this a windows thing using alarm()?

Eagerly waiting for a fix, and don't say switch to linux!

Released a new version 0.2, with miscellaneous windows compatibility fixes.

nrapallo · 08-29-2008, 09:04 AM

Congratulations on a finely-crafted all-in-one software solution! Kudos!

OK, works now, sort of.

Have to FIRST change a line in def main(argv) to fix a simple typo ('b' should be 'a'):

Code:

opts, args = getopt.getopt(argv, "hb:p:")  --> opts, args = getopt.getopt(argv, "ha:p:")

It transfers .imp ebooks OK from the "online bookshelf", but the "local content" traffic seems slower than Linreb + privoxy (especially for MIME image types for .gif/.jpg/.png files).

I initially thought, "Maybe my network is congested?". But after further testing using Linreb instead, I would have to say "No, it seems that impserve is very much slower (guessing about 1/2 to 1/3 the transfer speed of Linreb + privoxy)". It seems to have lost it's "snap"!

Would the python libraries be at fault here? I used my content/index.html from the Linreb package as a test and surfed to the Mobileread Wiki pages.

Can you try a comparison at your end?

derrell · 08-29-2008, 09:06 AM

Theres a typo in the options so that the -a option isn't recoginized. Its a b instead of an a.
ver .02 line 332

Code:

opts, args = getopt.getopt(argv, "hb:p:")

//edit//
Nick beat me to it.

Changed that and it worked fine, had to specify the directory for it to use as a basis for the book shelf though. Just used impserve -a 127.0.0.1 . and it picked up all of the imp files in the current directory and all of those below it. Very nice.

Things keep changing so fast I'll never be able to keep a tutorial up to date on how to get your eb-1150 working with usb and linux.

nrapallo · 08-29-2008, 09:14 AM

Quote:

Originally Posted by derrell

Theres a typo in the options so that the -a option isn't recoginized. Its a b instead of an a.
ver .02 line 332

Code:

opts, args = getopt.getopt(argv, "hb:p:")

//edit//
Nick beat me to it.

Sorry, what's that phrase again "Great minds, ..."

Quote:

Changed that and it worked fine, had to specify the directory for it to use as a basis for the book shelf though. Just used impserve -a 127.0.0.1 . and it picked up all of the imp files in the current directory and all of those below it. Very nice.

Things keep changing so fast I'll never be able to keep a tutorial up to date on how to get your eb-1150 working with usb and linux.

Tutorial? what's that and who has the time...

Did you notice any speed degregation in linux? If not, it may just be a windows-specific thing with ActiveState Python 2.5.1.1! Oh, well...

derrell · 08-29-2008, 09:31 AM

Seems just a touch slower, but its hard to say that just may be an impression.

Tried it with the same book about 500k as close as I can tell they were exactly the same speed wise. Took about 8 seconds with a pause toward the middle of the progress bar for both impserve and linreb. I'm assuming that was when the 1150 was converting the imp to its internal format.

nrapallo · 08-29-2008, 09:34 AM

Quote:

Originally Posted by derrell

Seems just a touch slower, but its hard to say that just may be an impression.

Tried it with the same book about 500k as close as I can tell they were exactly the same speed wise. Took about 8 seconds with a pause toward the middle of the progress bar for both impserve and linreb. I'm assuming that was when the 1150 was converting the imp to its internal format.

My .imp transfer speed to the reader "seems" OK as well, it's the internet MIME transfers that are very slow, as far as I can tell!

derrell · 08-29-2008, 09:45 AM

Can't tell you about that all I'm getting is 404 errors when the reader tries to open the index.html file in content.

Code:

localhost - - [29/Aug/2008 07:43:32] code 404, message File not found
localhost - - [29/Aug/2008 07:43:32] "GET http://bookshelf.ebooksystem.net/content/ HTTP/1.0" 404 -

nrapallo · 08-29-2008, 09:58 AM

Quote:

Originally Posted by derrell

Can't tell you about that all I'm getting is 404 errors when the reader tries to open the index.html file in content.

Code:

localhost - - [29/Aug/2008 07:43:32] code 404, message File not found
localhost - - [29/Aug/2008 07:43:32] "GET http://bookshelf.ebooksystem.net/content/ HTTP/1.0" 404 -

Did you try copying in the entire 'content' directory from the Linreb-0.2.02 package? Just the index.html is in ashkulz's v0.2 post above; it's missing the rest of the files to make it work.

Otherwise, "roll your own" index.html.

nrapallo · 08-29-2008, 10:04 AM

I have tried the same ebook reader actions under two 'surf the internet' solutions: one being impserve; the other being 'Linreb+privoxy'. I only used the REB1200, so far, haven't tried the EBW1150 yet.

I attach the log results from both and you can see that the transfer times are much slower in impserve. Now to find the cause of it and if it is system related...

BTW, Ashish, notice the last log entry; it's a delete request from the online bookshelf that could be implemented in impserve. Linreb also ignores that delete request. Food for thought...

derrell · 08-29-2008, 10:06 AM

Quote:

Originally Posted by nrapallo

Did you try with the entire 'content' directory from the Linreb-0.2.02 package?

Yep tried both access to the net has been flaky for me with my eb-1150 anyway. It could very well be a problem with my box somewhere. Permissions, or something.

I'll try some more later I'm off to bed for now. Just got in from work a couple of hours ago.

Ret · 08-29-2008, 10:41 AM

IMPRESSIVE work! Congratulations ashkulz! Thank you for your effort!
I downloaded Portable Python and in a minute Impserve was up and running!

I'd change the first hard-coded web page to use an index.html file. It nows shows two links: local contents, and online library which I find to be unnecessary. Just open local contents page.

I'm adding the HTML code I use as index.html to show a Google search, a link to an IMP book in mobileread and a link to the forum message where it was found.
So far it seems you cannot directly download ebooks from Mobileread. As I said before, this is becausem Mobileread webservers (as almost ALL webservers) doesn't know the MIME type application/x-softbook and handles IMP files with type unknown/unknown. Is there a way to change those HTTP headers to "Conten-type: applicaction/x-sofbook"?

Thanks again for your code. It's incredible that such few lines of code resolves HOURS of testing, settings, etc. Well done!

Code:

<html>

<head>
<title>Welcome to ImpServe</title>
</head>

<body>
<p><h1> Welcome to Impserve</h1>
</p>
<p>&nbsp;</p>
<p>&nbsp;</p>


<center>
<img alt="Google" src="http://www.google.com/intl/en/images/about_logo.gif" height=65 width=175>
</center>
<p>
<form name=Search  method=GET action="http://www.google.com/search?hl=en">
<input type=text name='q' size=22 maxlength=2048 value="">
<input type=submit name="btnG" value="Search"></form>
</p>
<p>&nbsp;</p>
<center>
<a href="http://www.mobileread.com/forums/attachment.php?attachmentid=15610&d=1219722410
">Link to an IMP ebook in Mobileread</a>
<a href="http://www.mobileread.com/forums/showthread.php?t=28232">Link to a Mobileread forum</a>
</center>

</body>

</html>

nrapallo · 08-29-2008, 11:03 AM

Quote:

Originally Posted by Ret

IMPRESSIVE work! Congratulations ashkulz! Thank you for your effort! ... Thanks again for your code. It's incredible that such few lines of code resolves HOURS of testing, settings, etc. Well done!

I echo the same sentiment. You look at that python code and say "WOW". I guess you have to be a techie to really appreciate what Ashish has done!

Thanks, Ret, for the startup page; it was a bit minimalist. I would leave the 'Online Bookshelf' link, for nothing else, but the novelty of it!

It only gets better and better... What next, whispernet!

08-28-2008, 10:59 PM	#2
nrapallo GuteBook/Mobi2IMP Creator Posts: 2,386 Karma: 24580 Join Date: Dec 2007 Location: Toronto, Canada Device: REB1200, EBW1150 Device: REB1100, iLiad v2 System: WinXP SP3	Ashish, I'm using WinXP with ActivePython 2.5.1.1 installed (hey, I compiled PDFRead didn't I?) and I get the segmentation fault below: Code: E:\ebooks\Impserve>impserve.py -a 192.168.X.XX -p 8118 shelf Traceback (most recent call last): File "E:\ebooks\Impserve\impserve.py", line 119, in <module> signal.signal(signal.SIGALRM, SIGALRM_handler) AttributeError: 'module' object has no attribute 'SIGALRM' Is this a windows thing using alarm()? Eagerly waiting for a fix, and don't say switch to linux! __________________ -Nick ‹The REB1200 Guy› Like Gargantuan ebooks? See previews of my work-in-progress 2006 Wikipedia ebooks! Have you tried GuteBook yet? Last edited by nrapallo; 08-28-2008 at 11:47 PM.

08-29-2008, 01:14 AM	#3
nrapallo GuteBook/Mobi2IMP Creator Posts: 2,386 Karma: 24580 Join Date: Dec 2007 Location: Toronto, Canada Device: REB1200, EBW1150 Device: REB1100, iLiad v2 System: WinXP SP3	I already have some suggestions, without even using the program, Sheesh! When you "serve up" the webpages to the hardware reader, could you text substitute: - <a href> to <a UNDERLINE="YES" href> (so that you can SEE hyperlinks) - DONE IN LATEST VERSION! - <body> to <body style="margin-left:2%; margin-right:2%"> (so there's no edge-bleeding) - HAS NO EFFECT SO CAN'T DO THIS! - etc. (give it time; more suggestions forthcoming...) __________________ -Nick ‹The REB1200 Guy› Like Gargantuan ebooks? See previews of my work-in-progress 2006 Wikipedia ebooks! Have you tried GuteBook yet? Last edited by nrapallo; 09-09-2008 at 02:43 PM. Reason: added comment what can be done using latest verison.

08-29-2008, 09:04 AM	#5
nrapallo GuteBook/Mobi2IMP Creator Posts: 2,386 Karma: 24580 Join Date: Dec 2007 Location: Toronto, Canada Device: REB1200, EBW1150 Device: REB1100, iLiad v2 System: WinXP SP3	Congratulations on a finely-crafted all-in-one software solution! Kudos! OK, works now, sort of. Have to FIRST change a line in def main(argv) to fix a simple typo ('b' should be 'a'): Code: opts, args = getopt.getopt(argv, "hb:p:") --> opts, args = getopt.getopt(argv, "ha:p:") It transfers .imp ebooks OK from the "online bookshelf", but the "local content" traffic seems slower than Linreb + privoxy (especially for MIME image types for .gif/.jpg/.png files). I initially thought, "Maybe my network is congested?". But after further testing using Linreb instead, I would have to say "No, it seems that impserve is very much slower (guessing about 1/2 to 1/3 the transfer speed of Linreb + privoxy)". It seems to have lost it's "snap"! Would the python libraries be at fault here? I used my content/index.html from the Linreb package as a test and surfed to the Mobileread Wiki pages. Can you try a comparison at your end? __________________ -Nick ‹The REB1200 Guy› Like Gargantuan ebooks? See previews of my work-in-progress 2006 Wikipedia ebooks! Have you tried GuteBook yet?

08-29-2008, 09:06 AM	#6
derrell Jack O' Apes Posts: 208 Karma: 1843 Join Date: Dec 2007 Location: Oklahoma Device: Ebookwise 1150, Sony Clie Peg SJ22, Nokia N810, EZ-Reader	Theres a typo in the options so that the -a option isn't recoginized. Its a b instead of an a. ver .02 line 332 Code: opts, args = getopt.getopt(argv, "hb:p:") //edit// Nick beat me to it. Changed that and it worked fine, had to specify the directory for it to use as a basis for the book shelf though. Just used impserve -a 127.0.0.1 . and it picked up all of the imp files in the current directory and all of those below it. Very nice. Things keep changing so fast I'll never be able to keep a tutorial up to date on how to get your eb-1150 working with usb and linux.

08-29-2008, 09:45 AM	#10
derrell Jack O' Apes Posts: 208 Karma: 1843 Join Date: Dec 2007 Location: Oklahoma Device: Ebookwise 1150, Sony Clie Peg SJ22, Nokia N810, EZ-Reader	Can't tell you about that all I'm getting is 404 errors when the reader tries to open the index.html file in content. Code: localhost - - [29/Aug/2008 07:43:32] code 404, message File not found localhost - - [29/Aug/2008 07:43:32] "GET http://bookshelf.ebooksystem.net/content/ HTTP/1.0" 404 -

08-29-2008, 09:31 AM	#8
derrell Jack O' Apes Posts: 208 Karma: 1843 Join Date: Dec 2007 Location: Oklahoma Device: Ebookwise 1150, Sony Clie Peg SJ22, Nokia N810, EZ-Reader	Seems just a touch slower, but its hard to say that just may be an impression. Tried it with the same book about 500k as close as I can tell they were exactly the same speed wise. Took about 8 seconds with a pause toward the middle of the progress bar for both impserve and linreb. I'm assuming that was when the 1150 was converting the imp to its internal format.

08-29-2008, 10:41 AM	#14
Ret Connoisseur Posts: 71 Karma: 480 Join Date: Dec 2004	IMPRESSIVE work! Congratulations ashkulz! Thank you for your effort! I downloaded Portable Python and in a minute Impserve was up and running! I'd change the first hard-coded web page to use an index.html file. It nows shows two links: local contents, and online library which I find to be unnecessary. Just open local contents page. I'm adding the HTML code I use as index.html to show a Google search, a link to an IMP book in mobileread and a link to the forum message where it was found. So far it seems you cannot directly download ebooks from Mobileread. As I said before, this is becausem Mobileread webservers (as almost ALL webservers) doesn't know the MIME type application/x-softbook and handles IMP files with type unknown/unknown. Is there a way to change those HTTP headers to "Conten-type: applicaction/x-sofbook"? Thanks again for your code. It's incredible that such few lines of code resolves HOURS of testing, settings, etc. Well done! Code: <html> <head> <title>Welcome to ImpServe</title> </head> <body> <p><h1> Welcome to Impserve</h1> </p> <p> </p> <p> </p> <center> <img alt="Google" src="http://www.google.com/intl/en/images/about_logo.gif" height=65 width=175> </center> <p> <form name=Search method=GET action="http://www.google.com/search?hl=en"> <input type=text name='q' size=22 maxlength=2048 value=""> <input type=submit name="btnG" value="Search"></form> </p> <p> </p> <center> <a href="http://www.mobileread.com/forums/attachment.php?attachmentid=15610&d=1219722410 ">Link to an IMP ebook in Mobileread</a> <a href="http://www.mobileread.com/forums/showthread.php?t=28232">Link to a Mobileread forum</a> </center> </body> </html>

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Accessing USB-sticks with 2.12?	Tommy	iLiad Troubleshooting	0	02-18-2008 05:18 PM
Accessing many files on an SD card	charliearmoryco	Kindle Accessories	8	01-25-2008 09:30 PM
Mobile content generates more revenue than internet content	Bob Russell	Handhelds and Smartphones	2	06-02-2007 07:46 PM
Mobile accessing your PC while on vacation	Colin Dunstan	Lounge	1	08-02-2005 03:15 PM
Accessing Home MP3s via WiFi?	Bob Russell	Portable Audio/Video	2	12-20-2004 12:52 PM