Replacing Kobo Bookstore - Page 2

sherman · 01-21-2017, 04:22 PM

Wow! I'm keeping my eye on this little project!

My dream would be able to browse and download (calibre) books from my H2O without having to use the (awful) browser, or KOreader.

I will be interested to see how far you get.

kido.resuri · 01-22-2017, 03:49 AM

I checked the newest 4.2.8283 upgrade file, and libnickel contains the same upgrade link, so I assume that this hack can be applied to that firmware too. I don't know the mechanism of the Sync there, but there shouldn't be too much change. If anyone owning a device capable of that firmware could test it to see if it works.
I also figured out a way (only in my mind yet) to only patch the libnickel and no need for a hosts file, even in a (semi-)automated way, so no need to set a fix IP.
Basicly you just need to modify the patch to point to your PC's hostname, and add some fill-up characters to the end to match the length. You could (and this is what I'm going to do) change the listening port of the webserver and add the port to the patch.

I'm using this now to apply modifications to my translation, if I find any glitches.

kido.resuri · 01-22-2017, 04:33 PM

Today's findings: the ebook sync is done through https://mobile.kobobooks.com
It is set in the Kobo eReader.conf
But it is rewritten by nickel on a sync to the original link, so this is currently a hard task to solve.

Another things I found, that the device sends the Collections created on it to the Kobo server, and Kobo keeps this info, if a change is made, then it is sent to the server on the next sync. The eReader can create the missing collections with the sync, if the removal was accidental (a database crash/recovery with old data). Normal removal of collections are also sent to the server. This could be useful - if I can break through the mobile.kobobooks.com

kido.resuri · 01-25-2017, 03:58 PM

Update: You must set apache's KeepAlive Timeout to some higher value, I tried with 100 instead of the default 5.
This is required as larger update files will be interrupted during download if the default low value is used. By large I mean a packed libnickel file. (~5MB)

kido.resuri · 01-31-2017, 01:10 PM

Anyone knows what .kobo/certificates is for?

kido.resuri · 01-31-2017, 03:40 PM

Could anyone please try to edit the Kobo eReader.conf file, in [Services] section, change RequestURL to anything, for example:

Code:

http://mobile.kobobooks.com/90104/mobilerequest.ashx/removethis

Then do a sync and check the .conf file if it has been changed back to the original entry

Spoiler:

Thank You in advance!

sherman · 01-31-2017, 05:34 PM

Quote:

Originally Posted by kido.resuri

Could anyone please try to edit the Kobo eReader.conf file, in [Services] section, change RequestURL to anything, for example:

Code:

http://mobile.kobobooks.com/90104/mobilerequest.ashx/removethis

Then do a sync and check the .conf file if it has been changed back to the original entry

Spoiler:

Thank You in advance!

Hi, just tried this, and yes Nickel reverts the change after a sync.

Kobo Aura H2O, firmware 3.19.571

Cheers,
Sherman

kido.resuri · 01-31-2017, 05:43 PM

Thanks! This is what i get. I wonder if other devices work the same way...

sherman · 01-31-2017, 05:56 PM

Quote:

Originally Posted by kido.resuri

Thanks! This is what i get. I wonder if other devices work the same way...

Most likely.

I'd say you will probably have to do some host file modifications, or if that doesn't work, some DNS trickery on the local network...

kido.resuri · 01-31-2017, 06:09 PM

The host, DNS is not a problem. https is the real problem here. This one actually does the.file sync from the bookstore. But only accepts trusted SSL sites, which is a pain in the arse when one wants to replace it with a locally hosted webserver... It's still able to mimic the bookstore, I assume that downloading books is also possible from within Kobo (not yet made it), but this particular one could make it available to add books with the sync feature. So it looks like I have to make a workaround, like the one discussed in the other thread, that use a virtual sd mount to add books to the library.

kido.resuri · 02-01-2017, 02:37 PM

Thanks to tshering, I'll soon release a "Send to Kobo" addin for Windows, which will work in the "Send to" right click menu for the previously released sync-hack, so hopefuly any book could be added to Kobo over wifi, with a simple right-click action in Windows and a Sync on the Kobo. It will need calibre to convert to epub if not in that format.

cramoisi · 02-03-2017, 05:59 AM

Great !

kido.resuri · 02-10-2017, 03:57 PM

I'm around 90% finished with the synchack content sender, which I mentioned in my previous post, so maybe I'll post it on this weekend. If I have time, I may test it on the new firmware, again, if I have time to upgrade my H2O.

Also, I will maybe add a feature (server-side) to proxy the official releases, according to the device's request. Upgrading of course would eliminate the synchack.

Another idea would be to host the custom sync server on - for example - mobileread.com, if that is possible. I don't know if the admins would be willing to do this. This way it would be possible to create a send-by-email feature for Kobo.
The conversion should be made by the user (most simple version) to epub format.
I don't know where would be the best way to contact the admins.

I may contact Kobo with this idea, but I have very little expectations with them.

It would also be possible to use some "free" hosting site for this little project.

Another thing, the Bookstore "protocol" reverse engineering looks as easy as a piece of cake, according to what I saw when I looked into it (had no time to parse it all), so it will be the next step. The hard part would be to integrate it into calibre, or any other book management software. So if calibre's developer is open for this, maybe it would be possible to integrate.

I'm also open for any comments, suggestions, help or any feedback at all on this project.

kido.resuri · 02-11-2017, 04:27 PM

Ok, I'm almost done.
I have a problem now with zipping. It seems that 7za creates a zip file that Kobo can't properly unzip, therefore the KoboRoot.tgz does not get to where it should be. If I compress it with something else, like Total Commander's internal zip, it works...
Anyone could help me with this one? I wouldn't use another tool if it can be done with 7za.

tshering · 02-11-2017, 04:45 PM

Quote:

Originally Posted by kido.resuri

Ok, I'm almost done.
I have a problem now with zipping. It seems that 7za creates a zip file that Kobo can't properly unzip, therefore the KoboRoot.tgz does not get to where it should be. If I compress it with something else, like Total Commander's internal zip, it works...
Anyone could help me with this one? I wouldn't use another tool if it can be done with 7za.

this is from a .bat file

Code:

SET the7zipexe=C:\7za920\7za.exe

REM --- make tar
"%the7zipexe%" a KoboRoot.tar -ttar  * -r
REM --- make tgz
"%the7zipexe%" a KoboRoot.tgz -tgzip  KoboRoot.tar

01-22-2017, 03:49 AM	#17
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	I checked the newest 4.2.8283 upgrade file, and libnickel contains the same upgrade link, so I assume that this hack can be applied to that firmware too. I don't know the mechanism of the Sync there, but there shouldn't be too much change. If anyone owning a device capable of that firmware could test it to see if it works. I also figured out a way (only in my mind yet) to only patch the libnickel and no need for a hosts file, even in a (semi-)automated way, so no need to set a fix IP. Basicly you just need to modify the patch to point to your PC's hostname, and add some fill-up characters to the end to match the length. You could (and this is what I'm going to do) change the listening port of the webserver and add the port to the patch. I'm using this now to apply modifications to my translation, if I find any glitches. Last edited by kido.resuri; 01-22-2017 at 03:51 AM.

01-31-2017, 03:40 PM	#21
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	Could anyone please try to edit the Kobo eReader.conf file, in [Services] section, change RequestURL to anything, for example: Code: http://mobile.kobobooks.com/90104/mobilerequest.ashx/removethis Then do a sync and check the .conf file if it has been changed back to the original entry Spoiler: Code: https://mobile.kobobooks.com/90104/mobilerequest.ashx Thank You in advance!

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Replacing Nook Simple Touch: Onyx T68 vs Kobo Aura vs Kobo Aura H2O	iNovelReader	Which one should I buy?	0	10-28-2014 01:40 AM
Kobo Bookstore?	TorontoJenny	Kobo Reader	1	07-15-2013 01:33 AM
Kobo bookstore on Kobo Touch not showing prices (Canada)	RobertJSawyer	Kobo Reader	13	09-23-2012 08:30 PM
Replacing my new Kobo - again!	objectman	Kobo Reader	7	09-20-2010 08:00 PM
Ratings on Kobo bookstore	kiwikobo	Kobo Reader	0	07-02-2010 03:39 AM

01-21-2017, 04:22 PM	#16
sherman Guru Posts: 876 Karma: 2676800 Join Date: Aug 2008 Location: Taranaki - NZ Device: Kobo Aura H2O, Kobo Forma	Wow! I'm keeping my eye on this little project! My dream would be able to browse and download (calibre) books from my H2O without having to use the (awful) browser, or KOreader. I will be interested to see how far you get.

01-22-2017, 04:33 PM	#18
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	Today's findings: the ebook sync is done through https://mobile.kobobooks.com It is set in the Kobo eReader.conf But it is rewritten by nickel on a sync to the original link, so this is currently a hard task to solve. Another things I found, that the device sends the Collections created on it to the Kobo server, and Kobo keeps this info, if a change is made, then it is sent to the server on the next sync. The eReader can create the missing collections with the sync, if the removal was accidental (a database crash/recovery with old data). Normal removal of collections are also sent to the server. This could be useful - if I can break through the mobile.kobobooks.com

01-25-2017, 03:58 PM	#19
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	Update: You must set apache's KeepAlive Timeout to some higher value, I tried with 100 instead of the default 5. This is required as larger update files will be interrupted during download if the default low value is used. By large I mean a packed libnickel file. (~5MB)

01-31-2017, 01:10 PM	#20
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	Anyone knows what .kobo/certificates is for?

01-31-2017, 05:43 PM	#23
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	Thanks! This is what i get. I wonder if other devices work the same way...

01-31-2017, 06:09 PM	#25
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	The host, DNS is not a problem. https is the real problem here. This one actually does the.file sync from the bookstore. But only accepts trusted SSL sites, which is a pain in the arse when one wants to replace it with a locally hosted webserver... It's still able to mimic the bookstore, I assume that downloading books is also possible from within Kobo (not yet made it), but this particular one could make it available to add books with the sync feature. So it looks like I have to make a workaround, like the one discussed in the other thread, that use a virtual sd mount to add books to the library.

02-01-2017, 02:37 PM	#26
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	Thanks to tshering, I'll soon release a "Send to Kobo" addin for Windows, which will work in the "Send to" right click menu for the previously released sync-hack, so hopefuly any book could be added to Kobo over wifi, with a simple right-click action in Windows and a Sync on the Kobo. It will need calibre to convert to epub if not in that format.

02-03-2017, 05:59 AM	#27
cramoisi Librarian Posts: 346 Karma: 72225 Join Date: Apr 2015 Location: Liège - Belgium Device: kobo gloHD - KA1	Great !

02-10-2017, 03:57 PM	#28
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	I'm around 90% finished with the synchack content sender, which I mentioned in my previous post, so maybe I'll post it on this weekend. If I have time, I may test it on the new firmware, again, if I have time to upgrade my H2O. Also, I will maybe add a feature (server-side) to proxy the official releases, according to the device's request. Upgrading of course would eliminate the synchack. Another idea would be to host the custom sync server on - for example - mobileread.com, if that is possible. I don't know if the admins would be willing to do this. This way it would be possible to create a send-by-email feature for Kobo. The conversion should be made by the user (most simple version) to epub format. I don't know where would be the best way to contact the admins. I may contact Kobo with this idea, but I have very little expectations with them. It would also be possible to use some "free" hosting site for this little project. Another thing, the Bookstore "protocol" reverse engineering looks as easy as a piece of cake, according to what I saw when I looked into it (had no time to parse it all), so it will be the next step. The hard part would be to integrate it into calibre, or any other book management software. So if calibre's developer is open for this, maybe it would be possible to integrate. I'm also open for any comments, suggestions, help or any feedback at all on this project.

02-11-2017, 04:27 PM	#29
kido.resuri Groupie Posts: 172 Karma: 4282 Join Date: Dec 2016 Location: Hungary Device: Kobo Aura H2O	Ok, I'm almost done. I have a problem now with zipping. It seems that 7za creates a zip file that Kobo can't properly unzip, therefore the KoboRoot.tgz does not get to where it should be. If I compress it with something else, like Total Commander's internal zip, it works... Anyone could help me with this one? I wouldn't use another tool if it can be done with 7za.

Advert

Advert