Register Guidelines E-Books Search Today's Posts Mark Forums Read

Go Back   MobileRead Forums > E-Book Readers > Kobo Reader > Kobo Developer's Corner

Notices

Reply
 
Thread Tools Search this Thread
Old 01-31-2017, 09:52 AM   #1
anarcat
Enthusiast
anarcat began at the beginning.
 
anarcat's Avatar
 
Posts: 45
Karma: 10
Join Date: Jul 2013
Location: Planet Ocean
Device: Kobo Glo HD
Wallabag (read it later app) automated synchronization

Hi!

I have been working for the last few days on a program to synchronize a Kobo device with a Wallabag instance. Wallabag, if you do not know, is a free software replacement for Pocket, a "read it later" app.

The software is available on Gitlab, where you can also download actual binaries that you can install directly on your Kobo, including an (untested) KoboRoot.tgz that you should be able to just drop on your SDcard and start syncing! (Some configuration is actually required to write your credentials.) More information is available in the project's README file.

This targets Kobo readers, but it may just work on other e-readers, provided they have an architecture supported by Golang and you can find a way to notify the OS about the new books. I posted this in a Kobo topic just because it's the tool I use right now, but it may be better in a different topic...

Feedback, testing and comments are very welcome.

Note: this is a followup to a thread I posted about a year ago, it's nice to finally scratch that itch. Also note that I had trouble making the books synchronize, and started a discussion about the best way to trigger a library rescan, so your feedback is welcome there as well.

Last edited by anarcat; 01-31-2017 at 09:56 AM. Reason: note this may not be kobo-specific
anarcat is offline   Reply With Quote
Old 01-31-2017, 10:13 AM   #2
Ken Maltby
Wizard
Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.Ken Maltby ought to be getting tired of karma fortunes by now.
 
Ken Maltby's Avatar
 
Posts: 4,334
Karma: 6272781
Join Date: Dec 2009
Location: The Heart of Texas
Device: JetBook Lite (retired), AuraHD, PDA,
"chrox" was considering adding a Wallabag plugin for KOReader , I don't know what might have been done on it though. You might want to contact him through the project at Github.

Luck;
Ken
Ken Maltby is offline   Reply With Quote
Advert
Old 01-31-2017, 10:37 AM   #3
anarcat
Enthusiast
anarcat began at the beginning.
 
anarcat's Avatar
 
Posts: 45
Karma: 10
Join Date: Jul 2013
Location: Planet Ocean
Device: Kobo Glo HD
Quote:
Originally Posted by Ken Maltby View Post
"chrox" was considering adding a Wallabag plugin for KOReader , I don't know what might have been done on it though. You might want to contact him through the project at Github.

Luck;
Ken
thanks Ken! i posted a comment in here and here.
anarcat is offline   Reply With Quote
Old 02-03-2017, 12:48 PM   #4
kido.resuri
Groupie
kido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura about
 
Posts: 172
Karma: 4282
Join Date: Dec 2016
Location: Hungary
Device: Kobo Aura H2O
I may be interested in this Wallabag, if it could efficiently convert the webpages to epub. Pocket sadly fails to be good at this, at least on the webpages that my fiancée would like to see on the reader (mostly cooking recipes that we cook together from).
Pocket is unable to save them or only parts, and the ingredients or even the whole recipe is left out when saved to pocket.
If you have Wallabag installed and properly configured, may I send you some links to test?
kido.resuri is offline   Reply With Quote
Old 02-03-2017, 05:13 PM   #5
anarcat
Enthusiast
anarcat began at the beginning.
 
anarcat's Avatar
 
Posts: 45
Karma: 10
Join Date: Jul 2013
Location: Planet Ocean
Device: Kobo Glo HD
Quote:
Originally Posted by kido.resuri View Post
I may be interested in this Wallabag, if it could efficiently convert the webpages to epub. Pocket sadly fails to be good at this, at least on the webpages that my fiancée would like to see on the reader (mostly cooking recipes that we cook together from).
Pocket is unable to save them or only parts, and the ingredients or even the whole recipe is left out when saved to pocket.
If you have Wallabag installed and properly configured, may I send you some links to test?
Sure. you can also try out public instances:
anarcat is offline   Reply With Quote
Advert
Old 02-03-2017, 05:32 PM   #7
anarcat
Enthusiast
anarcat began at the beginning.
 
anarcat's Avatar
 
Posts: 45
Karma: 10
Join Date: Jul 2013
Location: Planet Ocean
Device: Kobo Glo HD
i won't generate an epub for all of those - i encourage you to register to the free services to try them. here's the first one as an epub: https://share.riseup.net/#swMetLQNjm0nh8WcmVwpqg
anarcat is offline   Reply With Quote
Old 02-03-2017, 05:38 PM   #8
kido.resuri
Groupie
kido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura aboutkido.resuri has a spectacular aura about
 
Posts: 172
Karma: 4282
Join Date: Dec 2016
Location: Hungary
Device: Kobo Aura H2O
Thanks. It did generate, quite well from the page. Pocket had trouble with this particular site, only had link, not the content. I'm not totally satisfied with it tho, but it may change. Thank You!
kido.resuri is offline   Reply With Quote
Old 03-25-2017, 01:03 PM   #9
oschene
Junior Member
oschene is on a distinguished road
 
Posts: 1
Karma: 60
Join Date: Nov 2013
Device: Kobo Mini
Works on the Mini. Slick!
oschene is offline   Reply With Quote
Old 06-25-2017, 03:27 PM   #10
AmpersandNYC
Junior Member
AmpersandNYC began at the beginning.
 
Posts: 2
Karma: 10
Join Date: Jun 2017
Device: Kobo Aura One
Has anyone got this working on an Aura One with the latest firmware? And is there a way to get it to put the epub files into a directory that koreader can read? I have a .books directory at the top level of my Aura One that I'd prefer the articles go into.

What I really want is a full Pocket or Instapaper client that I can launch from KSM. But this is 100% open-source so I think it's worth working on.
AmpersandNYC is offline   Reply With Quote
Old 06-26-2017, 09:33 AM   #11
anarcat
Enthusiast
anarcat began at the beginning.
 
anarcat's Avatar
 
Posts: 45
Karma: 10
Join Date: Jul 2013
Location: Planet Ocean
Device: Kobo Glo HD
you can customize where the files are written with the -output parameter on the commandline or (more likely) the "Output" setting in the wallabako.js file.

can't help you with instagram or pocket, unfortunately. only free software here. you may want to look at that issue for KSM support in wallabako, however: https://gitlab.com/anarcat/wallabako/issues/15

Last edited by anarcat; 10-05-2018 at 09:14 AM.
anarcat is offline   Reply With Quote
Old 08-24-2017, 10:01 AM   #12
bhyde
Member
bhyde is on a distinguished road
 
Posts: 16
Karma: 60
Join Date: Jul 2017
Location: Boston, MA, USA
Device: Kobo Aura ONE
I've been using this for a week now, with framabag.org. I can't thank you enough. Awesome. FYI - setting up the android app first helped to be sure I had all the right settings.
bhyde is offline   Reply With Quote
Old 10-05-2018, 06:43 AM   #13
jasio
Junior Member
jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.
 
Posts: 7
Karma: 8796
Join Date: Aug 2009
Location: UK
Device: Kobo Clara HD (KOReader), Kindle PW1
I've been experimenting a bit with wallabako and KOReader.

Wallabag is a bit of a pain to install but there is an experimental package for Synology NAS so I used that (I didn't check if it's a recent version but it does the job for now). There are also public servers, of course.

Since I'm always in KOReader, I don't need the tricks to update the Kobo database. I extracted the wallabag executable from the archive and copied it to /mnt/onboard.

I created a link to the CA file that already exist in KOReader with:
Code:
mkdir -p /etc/ssl/certs
ln -s /mnt/onboard/.adds/koreader/common/turbo/ca-certificates.crt /etc/ssl/certs/ca-certificates.crt
My config file with the server details is in /etc/wallabako.js but I might use the -config option to move it somewhere else.

I use this simple script to launch wallabako, /mnt/onboard/.adds/koreader/wb:
Code:
/mnt/onboard/wallabako -output "/mnt/onboard/Documents/Wallabag" -delete
Since there is no UI I run the script with the Terminal Emulator plugin, just typing:
Code:
ash wb
It does work pretty well. Sure, a koreader plugin with a UI to set it up and run it on demand would be nice.

But the thing really missing is the ability to delete documents from the server if they have been marked as Finished locally. That would require some work on wallabako itself though.
jasio is offline   Reply With Quote
Old 10-05-2018, 09:14 AM   #14
anarcat
Enthusiast
anarcat began at the beginning.
 
anarcat's Avatar
 
Posts: 45
Karma: 10
Join Date: Jul 2013
Location: Planet Ocean
Device: Kobo Glo HD
Quote:
Originally Posted by jasio View Post
Since I'm always in KOReader, I don't need the tricks to update the Kobo database. I extracted the wallabag executable from the archive and copied it to /mnt/onboard.
Thanks for the review! I think it's the first report of Wallabako running on KOReader, so congratulations!

Quote:
Originally Posted by jasio View Post
I created a link to the CA file that already exist in KOReader with:
Code:
mkdir -p /etc/ssl/certs
ln -s /mnt/onboard/.adds/koreader/common/turbo/ca-certificates.crt /etc/ssl/certs/ca-certificates.crt
I should probably have documented this better, but the cryptographic libraries used by Wallabako Golang's crypto/x509 support reading other certificates databases:

Quote:
On UNIX systems the environment variables SSL_CERT_FILE and SSL_CERT_DIR can be used to override the system default locations for the SSL certificate file and SSL certificate files directory, respectively.
So instead of creating a symlink, you could have simply changed the environment to have SSL_CERT_FILE point at ca-certificates.crt...

Quote:
Originally Posted by jasio View Post
My config file with the server details is in /etc/wallabako.js but I might use the -config option to move it somewhere else.

I use this simple script to launch wallabako, /mnt/onboard/.adds/koreader/wb:
Code:
/mnt/onboard/wallabako -output "/mnt/onboard/Documents/Wallabag" -delete
... for example, the above would become:

Code:
#!/bin/sh
SSL_CERT_FILE=/mnt/onboard/.adds/koreader/common/turbo/ca-certificates.crt
export SSL_CERT_FILE
/mnt/onboard/wallabako -output "/mnt/onboard/Documents/Wallabag" -delete
Quote:
Originally Posted by jasio View Post
Since there is no UI I run the script with the Terminal Emulator plugin, just typing:
Code:
ash wb
It does work pretty well. Sure, a koreader plugin with a UI to set it up and run it on demand would be nice.
Yeah, I've been meaning to do this forever, but never got around to actually doing it. It doesn't help that I'm still using Nickel: the integration with Wallabako is horrible, but I find the basic UI much better, I'm sorry to say. I should probably give KOReader a try again, but I would need to reinstall as it seems recent Kobo updates broke KSM...

Quote:
Originally Posted by jasio View Post
But the thing really missing is the ability to delete documents from the server if they have been marked as Finished locally. That would require some work on wallabako itself though.
I made the deliberate choice, in Wallabako, to treat the Kobo as "disposable" (ie. we can add/remove files from it, if the -delete option is set of course, as you probably noticed) and the Wallabag server as "precious" (ie. we *don't* delete files there). We *do* mark files as read on the server when they are read locally, but that's as much "writing" we do on the server side. So you could make a job that would periodically remove the read Wallabag articles from the server to fix your problem...

I keep all my articles in Wallabag, even when they're read. I find it's a great feature as I often go back and read stuff later. It does mean I have thousands of entries in there, but it still manages well, at least so far.

That being said, deleting articles on the server shouldn't be that hard, feel free to open a feature request on the topic in the issue tracker, but I don't guarantee I'll have time to actually implement it. Some other passer-by who wants to learn Golang (it's not hard for a novice programmer!) might just do that!

Thanks for the review, it's always nice to hear from users!
anarcat is offline   Reply With Quote
Old 10-05-2018, 11:28 AM   #15
jasio
Junior Member
jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.jasio shines like a glazed doughnut.
 
Posts: 7
Karma: 8796
Join Date: Aug 2009
Location: UK
Device: Kobo Clara HD (KOReader), Kindle PW1
Thanks for the pointer to SSL_CERT_FILE. I have now changed my script to this (without the export step):
Code:
SSL_CERT_FILE=/mnt/onboard/.adds/koreader/common/turbo/ca-certificates.crt /mnt/onboard/wallabako -output "/mnt/onboard/Documents/Wallabag" -delete
This is much better since I was concerned that a software update would remove my link.

If I find the time, I'll try to do a minimalist koreader plugin to just run the script.

Nickel is pretty but KOReader is very powerful. I love the OPDS integration so I can get books from my own server or Feedbooks, ManyBooks... Now with a working Wallabag setup I'm super happy.

I'll open a request on the issue tracker for an option to delete files from the server. It would be a nice-to-have feature but I can live without.

Thank you for Wallabako!
jasio is offline   Reply With Quote
Reply

Tags
hack, plugin, synchronization, wallabag

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Wallabag, best web page saver, read it later service, free personal instapaper clone exachillus General Discussions 17 03-26-2017 04:10 AM
Wallabag on Kobo readers? anarcat Reading and Management 3 01-31-2017 09:53 AM
Which app is the best to read Aanya Apple Devices 6 08-30-2014 09:16 AM
Is There a Beta Read App? diremommy Android Devices 6 06-02-2013 08:05 AM
[Android App] Cannot view read/not read on CC....Help! Tan Devices 3 10-29-2012 01:53 AM


All times are GMT -4. The time now is 02:47 PM.


MobileRead.com is a privately owned, operated and funded community.