PRS-500 reverse engineering the Reader USB protocol - Page 6

kovidgoyal · 01-12-2007, 01:30 AM

Try the attached .dll

Xenophon · 01-12-2007, 01:38 PM

Quote:

Originally Posted by kovidgoyal

The automatic build wont work on OSX. Download the tarball
http://easynews.dl.sourceforge.net/s...b-0.3.5.tar.gz

Extract the files. In the pyusb directory run the commands
python2.5 setup.py build
sudo python2.5 setup.py install

If that works could you use http://cheeseshop.python.org/pypi/bdist_mpkg/
to create an mpkg that I can add to the wiki for other OSX users?

That didn't fix the problem. The fix that worked happened when I took a close look at setup.py and realized that it assumes that the libusb install was done by fink (and was thus placed in /sw/...). It turns out that the latest-and-greatest libusb gets installed into /usr/local/... instead. A quick editing of setup.py to add /usr/local/include and /usr/local/lib to the extra-foo-items, and I have a successful compilation. I'll try to get an mpkg back to you soon.

Xenophon

P.S. I'm now waiting for a qt build to complete so I can try the GUI along with all the rest.

kovidgoyal · 01-12-2007, 03:45 PM

Thats great. Thanks.

kovidgoyal · 01-12-2007, 11:19 PM

I've dropped the dependency on pyusb (basically re-implemented it in pure python using ctypes). THis needs testing especially on OSX. So please

Code:

easy_install -U libprs500
prs500 info

Xenophon · 01-13-2007, 12:25 PM

Kovid:

I've had some success. I can now talk to the reader via the command line interface. However, I get some interesting errors from the 'books' command and the ls -lh command:

Code:

[Scipio:~] dfsuther% prs500 books
Books in main memory:
Miles, Mystery & Mayhem by Lois McMaster Bujold at /Data/media/books/Miles Mystery and Mayhem.rtf
Thraxas and the Dance of Death by Martin Scott at /Data/media/books/Thraxas_and_the_Dance_of_D.rtf
Thraxas and the Sorcerers by Martin Scott at /Data/media/books/Thraxas_and_the_Sorcerers.rtf
Brilliance of the Moon by Lian Hearn at /Data/media/books/cbuscepgi000260u.lrx
A Mankind Witch by Dave Freer at /Data/media/books/A_Mankind_Witch.rtf
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/Current/bin/prs500", line 8, in <module>
    load_entry_point('libprs500==0.3.2', 'console_scripts', 'prs500')()
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.2-py2.5.egg/libprs500/cli/main.py", line 211, in main
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2019' in position 11: ordinal not in range(128)
[Scipio:~] dfsuther% prs500 ls /Data/media/books
Grantville_Gazette_Volume_6.rtf   March_Upcountry.rtf                
Go Tell the Spartans.rtf          cbuscerhi001ku04.lrx               
Komarr.rtf                        We_Few.rtf                         
The_Far_Side_of_The_Stars.rtf     This_Rough_Magic.rtf               
1633.rtf                          cbuscehcl0016o08.lrx               
cbuscerhi002mx0a.lrx              Grantville_Gazette-Volume_VIII.rtf 
Grantville_Gazette_Volume_I.rtf   Miles Mystery and Mayhem.rtf       
Grantville_Gazette_Volume_V.rtf   Thraxas_and_the_Dance_of_D.rtf     
1632.rtf                          Thraxas_and_the_Sorcerers.rtf      
Convergent Series.rtf             cbuscepgi000260u.lrx               
Grantville_Gazette-Volume_IX.rtf  A_Mankind_Witch.rtf                
Resurgence.rtf                    Grantville_Gazette_Volume_IIdt.rtf 
1635-The_Cannon_Law.rtf           CBUS12510000200K.lrf               
Transvergence.rtf                 Miles Errant.rtf                   
Thraxas_at_War (7).rtf            March to the Sea.rtf               
PRS500_OG.pdf                     cbuscerhi002f60c.lrx               
Turn_The_Other_Chick.rtf          Chicks n Chained Males.rtf         
CBUS12510000400M.lrf              1634_-_The_Galileo_Affair.rtf      
cbuscehcl0015i01.lrx              Prince of Mercenaries.rtf          
Thraxas.rtf                       1634-The_Ram_Rebellion.rtf         
High Justice.rtf                  King Davids Spaceship.rtf          
With the Lightnings.rtf           Grantville_Gazette_Volume_IV.rtf   
Some_Golden_Harbor.rtf            Grantville_Gazette-Volume_VII.rtf  
The Shadow of the Lion.rtf        cbuscerhi002o60l.lrx               
Young Miles.rtf                   Diplomatic_Immunity.rtf            
The Chicks in the Mail.rtf        Thraxas_Under_Siege (8).rtf        
Prince of Sparta.rtf              The Mote In Gods Eye.rtf           
cbuscerhi001ke0o.lrx              The Gripping Hand.rtf              
The Mercenary.rtf                 Lt. Leary, Commanding.rtf          
CBUS12511000600P.lrf              March to the Stars.rtf             
West of Honor.rtf                 cbuscepgi000mo0w.lrx               
The_Way_to_Glory.rtf              Cordelia's Honor.rtf               
cbuscepgi000cg0e.lrx              Universe_v1n2.rtf                  
CBUS12510000300L.lrf              Universe_v1n1.rtf                  
Death_and_Thraxas.rtf             A Civil Campaign.rtf
[Scipio:~] dfsuther% prs500 ls -lh /Data/media/books
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/Current/bin/prs500", line 8, in <module>
    load_entry_point('libprs500==0.3.2', 'console_scripts', 'prs500')()
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.2-py2.5.egg/libprs500/cli/main.py", line 231, in main
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.2-py2.5.egg/libprs500/cli/main.py", line 139, in ls
TypeError: object of type 'NoneType' has no len()
[Scipio:~] dfsuther%

Interesting that I can ls the contents of the directory that holds books in main memory, but I can't either ls -lh it or succeed with a prs500 books command.

Suggestions?

kovidgoyal · 01-13-2007, 02:10 PM

The ls -lh bug was a typo, fixed in svn. The books bug is basically related to character encodings and will need a little work. I've implemented a possible fix in svn. Could you checkout the svn version and try it.

Instructions are at:
https://libprs500.kovidgoyal.net/wiki/Development

Thanks.

EDIT: The possible fix has made it into version 0.3.3

chrissam42 · 01-15-2007, 12:24 AM

Quote:

Originally Posted by kovidgoyal

I've dropped the dependency on pyusb (basically re-implemented it in pure python using ctypes). THis needs testing especially on OSX.

Thanks for all your great work on this.

Trying on OS X, "info" works but any "books" or "ls" results in:

Code:

release_interface() takes exactly 2 arguments (1 given)
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/Current/bin/prs500", line 8, in <module>
    load_entry_point('libprs500==0.3.3', 'console_scripts', 'prs500')()
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.3-py2.5.egg/libprs500/cli/main.py", line 231, in main
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.3-py2.5.egg/libprs500/cli/main.py", line 128, in ls
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.3-py2.5.egg/libprs500/communicate.py", line 167, in run_session
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.3-py2.5.egg/libprs500/communicate.py", line 244, in open
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.3-py2.5.egg/libprs500/communicate.py", line 370, in _bulk_read
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.3-py2.5.egg/libprs500/communicate.py", line 360, in bulk_read_packet
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.3-py2.5.egg/libprs500/libusb.py", line 224, in bulk_read
libprs500.libusb.Error: Could not read 24 bytes on the bulk bus. Read: 0 bytes.

kovidgoyal · 01-15-2007, 12:50 AM

Hmm that's a strange error. First try unplugging your reader and reconnecting it. Then try
prs500 --log-packets ls /

chrissam42 · 01-16-2007, 07:15 AM

Tried it again on another computer just to be sure, and got the same error. But lo and behold, when I ran it with --log-packets, it worked, and now it works fine.

If I see it again I'll try and catch it.

chrissam42 · 01-16-2007, 07:27 AM

Here we go. "ls /" works pretty reliably now on the command line, but the gui fails consistently with the same error:

Code:

   MacBook:~ clewis$ prs500-gui --log-packets
   1 Command Type: GetUSBProtocolVersion
   00000000: 0000 0000 0100 0000 0000 0000 0400 0000	................
   00000010: 0000 0000								  ....
   --
   2 Response Type: Response
   00000000: 0010 0000 0100 0000 0000 0000 0c00 0000	................
   00000010: 0000 0000 0000 0000 0000 0000 0000 0000	................
   --
   3 Answer d->h Type: USBProtocolVersion
   00000000: 0500 0100 0000 0000 0000 0000 0800 0000	................
   00000010: 3031 3030 3030 3030						01000000
   --
   4 Command Type: AcknowledgeBulkRead
   00000000: 0010 0000 0000 0000 0000 0000 1000 0000	................
   00000010: 0500 0100 0000 0000 0000 0000 0000 0000	................
   --
   5 Response Type: Response
   00000000: 0010 0000 0000 0000 0000 0000 0c00 0000	................
   00000010: 0000 0000 0000 0000 0000 0000 0000 0000	................
   --
   6 Command Type: SetBulkSize
   00000000: 0701 0000 0100 0000 0000 0000 0400 0000	................
   00000010: 0080 0200								  ....
   --
   7 Response Type: Response
   00000000: 0010 0000 0100 0000 0000 0000 0c00 0000	................
   00000010: 0701 0000 0000 0000 0000 0000 0000 0000	................
   --
   8 Command Type: UnlockDevice
   00000000: 0601 0000 0100 0000 0000 0000 0400 0000	................
   00000010: 2d31 0000								  -1..
   --
   9 Response Type: Response
   00000000: 0010 0000 0100 0000 0000 0000 0c00 0000	................
   00000010: 0601 0000 0000 0000 0000 0000 0000 0000	................
   --
   10 Command Type: SetTime
   00000000: 0401 0000 0100 0000 0000 0000 1c00 0000	................
   00000010: 1c02 0000 d707 0000 0100 0000 1000 0000	................
   00000020: 0d00 0000 1300 0000 2a00 0000			  ........*...
   --
   11 Response Type: Response
   00000000: 0010 0000 0100 0000 0000 0000 0c00 0000	................
   00000010: 0401 0000 0000 0000 0000 0000 0000 0000	................
   --
   12 Command Type: DeviceInfoQuery
   00000000: 0101 0000 0100 0000 0000 0000 0000 0000	................
   --
   13 Response Type: Response
   00000000: 0010 0000 0100 0000 0000 0000 1000 0000	................
   00000010: 0101 0000 0000 0000 0400 0000 5801 0000	............X...
   --
   14 Answer d->h Type: DeviceInfo
   00000000: 0000 1000 0000 0000 0000 0000 5801 0000	............X...
   00000010: 536f 6e79 2052 6561 6465 7200 0000 0000	Sony Reader.....
   00000020: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000030: 5052 532d 3530 302f 5500 0000 0000 0000	PRS-500/U.......
   00000040: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000050: 312e 302e 3030 2e32 3130 3831 0000 0000	1.0.00.21081....
   00000060: 0000 0000 0100 0000 6170 706c 6963 6174	........applicat
   00000070: 696f 6e2f 782d 6262 6562 2d62 6f6f 6b00	ion/x-bbeb-book.
   00000080: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000090: 0000 0000 0000 0000 0000 0000 0000 0000	................
   000000a0: 0000 0000 0000 0000 0000 0000 0000 0000	................
   000000b0: 0000 0000 0000 0000 0000 0000 0000 0000	................
   000000c0: 0000 0000 0000 0000 0000 0000 0000 0000	................
   000000d0: 0000 0000 0000 0000 0000 0000 0000 0000	................
   000000e0: 0000 0000 0000 0000 0000 0000 0000 0000	................
   000000f0: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000100: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000110: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000120: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000130: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000140: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000150: 0000 0000 0000 0000 0000 0000 0000 0000	................
   00000160: 0000 0000 0000 0000						........
   --
   15 Command Type: AcknowledgeBulkRead
   00000000: 0010 0000 0000 0000 0000 0000 1000 0000	................
   00000010: 0000 1000 0000 0000 0000 0000 0000 0000	................
   --
   16 Response Type: Response
   00000000: 0010 0000 0000 0000 0000 0000 1000 0000	................
   00000010: 0101 0000 0000 0000 0400 0000 5801 0000	............X...
   --
   17 Command Type: FreeSpaceQuery
   00000000: 0301 0000 0100 0000 0000 0000 0400 0000	................
   00000010: 0000 0000								  ....
   --
   18 Response Type: Response
   00000000: 0010 0000 0100 0000 0000 0000 0c00 0000	................
   00000010: 0301 0000 0000 0000 0000 0000 0000 0000	................
   --
   release_interface() takes exactly 2 arguments (1 given)
   Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.4-py2.5.egg/libprs500/gui/main.py", line 538, in establish_connection
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.4-py2.5.egg/libprs500/gui/main.py", line 552, in update_availabe_space
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.4-py2.5.egg/libprs500/communicate.py", line 168, in run_session
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.4-py2.5.egg/libprs500/communicate.py", line 571, in free_space
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.4-py2.5.egg/libprs500/communicate.py", line 369, in _bulk_read
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.4-py2.5.egg/libprs500/communicate.py", line 359, in bulk_read_packet
  File "/Library/Frameworks/Python.framework/Versions/2.5/lib/python2.5/site-packages/libprs500-0.3.4-py2.5.egg/libprs500/libusb.py", line 224, in bulk_read
   libprs500.libusb.Error: Could not read 24 bytes on the bulk bus. Read: 0 bytes.

hn_88 · 01-16-2007, 10:01 AM

Quote:

Originally Posted by kovidgoyal

Try the attached .dll

OK, I copied this one to the system32 directory. Incidentally, it was different from the one I had, which was 2005 date and 600 kB, this one 612 kB. But now

prs500 info

gives a runtime error dialog from python.exe

R6034 - attempt to load C runtime library incorrectly. Then the following at the prompt:

C:\Documents and Settings\sgh>prs500 info
Traceback (most recent call last):
File "L:\Python25\scripts\prs500-script.py", line 8, in <module>
load_entry_point('libprs500==0.3.0b3', 'console_scripts', 'prs500')()
File "l:\python25\lib\site-packages\setuptools-0.6c3-py2.5.egg\pkg_resources.py", line 236, in load_entry_point
File "l:\python25\lib\site-packages\setuptools-0.6c3-py2.5.egg\pkg_resources.py", line 2097, in load_entry_point
File "l:\python25\lib\site-packages\setuptools-0.6c3-py2.5.egg\pkg_resources.py", line 1830, in load
File "l:\python25\lib\site-packages\libprs500-0.3.0b3-py2.5.egg\libprs500\cli\main.py", line 25, in <module>
File "l:\python25\lib\site-packages\libprs500-0.3.0b3-py2.5.egg\libprs500\communicate.py", line 49, in <module>
ImportError: DLL load failed: A dynamic link library (DLL) initialization routine failed.

kovidgoyal · 01-16-2007, 12:49 PM

@chrissam: Seems to be failing at the free space query. What does prs500 df give you?

@hn88: I've dropped the pyusb dependency. Try the latest version 0.3.5.

kovidgoyal · 01-16-2007, 05:14 PM

There was a bug fix that affect windows and potentially osx users, so please upgrade to 0.3.5.

chrissam42 · 01-17-2007, 01:27 AM

Quote:

@chrissam: Seems to be failing at the free space query. What does prs500 df give you?

Upgraded to 0.3.5. Command line works every time now, but prs500-gui still fails in the same spot.

hn_88 · 01-17-2007, 05:46 AM

Quote:

Originally Posted by kovidgoyal

@hn88: I've dropped the pyusb dependency. Try the latest version 0.3.5.

I'll be out of station in a day or two, and have many things to tie up. Will come back in 10 days and try.

01-13-2007, 02:10 PM	#81
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	The ls -lh bug was a typo, fixed in svn. The books bug is basically related to character encodings and will need a little work. I've implemented a possible fix in svn. Could you checkout the svn version and try it. Instructions are at: https://libprs500.kovidgoyal.net/wiki/Development Thanks. EDIT: The possible fix has made it into version 0.3.3 Last edited by kovidgoyal; 01-13-2007 at 02:29 PM.

01-16-2007, 12:49 PM	#87
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@chrissam: Seems to be failing at the free space query. What does prs500 df give you? @hn88: I've dropped the pyusb dependency. Try the latest version 0.3.5. Last edited by kovidgoyal; 01-16-2007 at 05:13 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
KDK Reverse Engineering - For Those who Cannot wait...	DairyKnight	Kindle Developer's Corner	0	05-14-2010 12:29 AM
Reverse-engineering the .IMP format	nrapallo	IMP	23	02-12-2009 01:44 PM
Reverse engineering the Cybook hard-/software	srml	Gen3 Developer's Corner	8	07-07-2008 04:27 PM
PC sync protocol	dumky	Which one should I buy?	2	01-04-2008 01:33 PM
Introduction to Reverse Engineering Software	Colin Dunstan	Deals and Resources (No Self-Promotion or Affiliate Links)	0	05-25-2004 11:31 AM

01-12-2007, 03:45 PM	#78
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Thats great. Thanks.

01-12-2007, 11:19 PM	#79
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	I've dropped the dependency on pyusb (basically re-implemented it in pure python using ctypes). THis needs testing especially on OSX. So please Code: easy_install -U libprs500 prs500 info

01-15-2007, 12:50 AM	#83
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	Hmm that's a strange error. First try unplugging your reader and reconnecting it. Then try prs500 --log-packets ls /

01-16-2007, 07:15 AM	#84
chrissam42 Member Posts: 11 Karma: 10 Join Date: Jan 2007 Location: Japan Device: Sony Reader PRS-500, Sharp/Vodafone/Softbank 904SH	Tried it again on another computer just to be sure, and got the same error. But lo and behold, when I ran it with --log-packets, it worked, and now it works fine. If I see it again I'll try and catch it.

01-16-2007, 05:14 PM	#88
kovidgoyal creator of calibre Posts: 43,866 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	There was a bug fix that affect windows and potentially osx users, so please upgrade to 0.3.5.

Advert

Advert