Wallabag (read it later app) automated synchronization - Page 2

jcn363 · 10-05-2018, 01:46 PM

Doesn't work on my KA1 with kfmon and koreader.
Perhaps I'm missing something.
Could you please write a step-by-step?
Thx in advance.
Good luck.

jasio · 10-06-2018, 05:26 AM

Quote:

Originally Posted by jcn363

Could you please write a step-by-step?

I'll try.

There are many ways to copy and edit files on your Kobo. My preference is to enable the SSH server.

Download the latest KoboRoot.tgz from wallabako's gitlab and extract the wallabako executable from it. Copy it to /mnt/onboard on your device.

Edit your config file with Wallabag details from the model below and copy it to /etc/wallabako.js on the Kobo.

Code:

{
  "WallabagURL": "https://app.wallabag.it",
  "ClientId": "your client id",
  "ClientSecret": "your client secret",
  "UserName": "your user name",
  "UserPassword": "your super password goes here"
}

Create the file /mnt/onboard/.adds/koreader/wb with the content below, changing the output directory to where you want the Wallabag documents to be downloaded to. Make sure it exists.

Code:

SSL_CERT_FILE=/mnt/onboard/.adds/koreader/common/turbo/ca-certificates.crt /mnt/onboard/wallabako -output "/mnt/onboard/Documents/Wallabag" -delete

That's it for the setup. If you are using SSH, you can try running the script directly to make sure it works.

To run wallabako from within KOReader, in the menu select the tools panel, then More plugins and Terminal emulator. Type the following command and Execute it.

Code:

ash wb

The terminal emulator remembers the last command executed so until you reboot, you don't have to re-type it. It is not as convenient as a menu entry but it's not too bad.

That's it really. I hope it works.

jcn363 · 10-06-2018, 06:42 AM

I'll try again.
Good luck.

EDIT: It works!

anarcat · 10-08-2019, 12:05 PM

Hi everyone,

Just a quick note to say I have done some minor improvements on Wallabako since I was here the last time. We're now at the 1.3.1 release, which has preliminary support for status changes in Plato, with Koreader hopefully coming next. You can see the releases here:

https://gitlab.com/anarcat/wallabako/-/tags

You can subscribe to the RSS feed here:

https://gitlab.com/anarcat/wallabako/-/tags?format=atom

And the full changelog is here:

https://gitlab.com/anarcat/wallabako...r/CHANGELOG.md

rebpdx · 05-31-2021, 01:49 AM

I recently got a Kobo reader and started using Wallabako today because I couldn't figure out how to get KOReader to work with my custom SSL cert. I don't see documentation matching my use case. Here's some info about what I did in case someone else has a local wallabag server running with HTTPS on a localhost cert and a router that doesn't support local DNS.

Custom Cert not publically signed:

Since I rolled my own certs and have them installed on my other devices I needed to supply that for Wallabako to work. I found in the golang source that there are a few places it looks for the custom .pem files. x509/root_linux.go

Similar to how the Wallabako docs mention you can copy your custom cert.pem file to /etc/ssl/certs right next to the .crt file that's copied in there for publically signed certs.

Local DNS without Router Support:

Normally I'd set my DNS settings on the computer but for some reason, the /etc/resolve.conf didn't work for me. But I was able to kind of fake it with /etc/hosts file similar to how the other thread on here redirects google analytics to localhost.

Code:

129.168.123.10 wallabag.server.lan

rebpdx · 06-02-2021, 02:14 AM

Update from my previous post, KOReader's Wallabag addon now works after the changes I did for Wallabako so looks like it applies for both.

amin021023 · 11-16-2021, 07:44 PM

How could I have a free hosting server for eallabag?

ajkessel · 10-21-2024, 05:16 PM

I'm using the latest wallabako build with nickelmenu on a Kobo Libra 2.

Is there any way to suppress the log output at the bottom of the screen if fbink is detected? I don't see a setting to completely suppress output in the config file.

Also, when I mark items as finished or remove them, they reappear with the next sync. Is that expected? I have "delete" as "true" in the configuration but it seems to have no effect. Am I only able to remove items from a web browser, not by deleting them on the Kobo?

Finally, is there something you need to do to enable koreader integration? I see that there are some koreader files in the github repository, but it's not clear to me if there is more to it than just navigating through the filesystem in koreader to the folder where the articles are stored.

Relatedly, is there a way to hide the wallabako content from the native book reader but just access it by folder in koreader? It's a little confusing/crorwded to have the wallabag articles grouped together with my eBooks. Or is there another way to keep them organized/separate?

anarcat · 10-22-2024, 10:44 AM

hi!

Quote:

Originally Posted by ajkessel

Is there any way to suppress the log output at the bottom of the screen if fbink is detected? I don't see a setting to completely suppress output in the config file.

Hmm... you're right, there isn't! I kind of assumed people who installed fbink knew what they were doing and would just be happy for the verbosity, but i guess i should have a setting to turn that off...

Do you mind finding an issue in https://gitlab.com/anarcat/wallabako/-/issues/new?

Quote:

Originally Posted by ajkessel

Also, when I mark items as finished or remove them, they reappear with the next sync. Is that expected? I have "delete" as "true" in the configuration but it seems to have no effect. Am I only able to remove items from a web browser, not by deleting them on the Kobo?

Deleting files won't delete or mark as read in wallabag. you need to mark them as read in the app your using. wallabako should support read status in nickel, koreader, and plato.

Quote:

Originally Posted by ajkessel

Finally, is there something you need to do to enable koreader integration? I see that there are some koreader files in the github repository, but it's not clear to me if there is more to it than just navigating through the filesystem in koreader to the folder where the articles are stored.

koreader integration is basically "is this file marked as read", and then syncing that to wallabag, that's it. you shouldn't need to do anything to make it work.

if it is not working (and it doesn't look like it is), send me the log output and i'll take a log.

Quote:

Originally Posted by ajkessel

Relatedly, is there a way to hide the wallabako content from the native book reader but just access it by folder in koreader? It's a little confusing/crorwded to have the wallabag articles grouped together with my eBooks. Or is there another way to keep them organized/separate?

i am not sure. i guess you could write outside of /mnt/onboard? you can pick a different directory in the wallabako config, i would try that.

thanks for using wallabako!

ajkessel · 10-23-2024, 04:58 PM

Quote:

Originally Posted by anarcat

Hmm... you're right, there isn't! I kind of assumed people who installed fbink knew what they were doing and would just be happy for the verbosity, but i guess i should have a setting to turn that off...

Do you mind finding an issue in https://gitlab.com/anarcat/wallabako/-/issues/new?

This is now done. Thanks!

Quote:

koreader integration is basically "is this file marked as read", and then syncing that to wallabag, that's it. you shouldn't need to do anything to make it work.

Is there any way to trigger a sync from koreader or do you need to exit out to the main interface first?

Quote:

Originally Posted by anarcat

Deleting files won't delete or mark as read in wallabag. you need to mark them as read in the app your using. wallabako should support read status in nickel, koreader, and plato.

if it is not working (and it doesn't look like it is), send me the log output and i'll take a log.

It is syncing fine but does not appear to reflect "finished" status back on Wallabag when marked as done with the native reader. I've pasted a log below.

I did just discover if I mark it finished in koreader, it is syncing back to Wallabag properly, though.

Quote:

Originally Posted by anarcat

i am not sure. i guess you could write outside of /mnt/onboard? you can pick a different directory in the wallabako config, i would try that.

This works for removing the Wallabag items from the native reader:

Code:

[FeatureSettings]
ExcludeSyncFolders=(\\.(?!kobo|adobe).+|([^.][^/]*/)+\\..+|.*wallabako.*)

Here's the log mentioned above:

Code:

2024/10/23 16:34:27 config after commandline parsing: main.wallabakoConfig{WallabagConfig:wallabago.WallabagConfig{REDACTED}, Debug:true, Delete:true, LogFile:"", Database:"/mnt/onboard/.kobo/KoboReader.sqlite", Concurrency:2, Count:-1, Exec:"", OutputDir:"/mnt/onboard/wallabako/", PidFile:"", RetryMax:4, Tags:"kobo", PlatoConfig:main.PlatoConfig{LibraryPath:""}, Fbink:false, FbinkInteractive:false}
2024/10/23 16:34:27 loaded configuration from /etc/wallabako.js
2024/10/23 16:34:27 trying lockfile path /var/run/wallabako.pid
2024/10/23 16:34:27 logging in to https://my-wallabag-domain-redacted
2024/10/23 16:34:27 username: REDACTED, password: REDACTED
2024/10/23 16:34:28 CSRF token found: 200 OK
2024/10/23 16:34:28 logged in successful: 302 Found
2024/10/23 16:34:59 found 26 unread entries, will check -1
2024/10/23 16:34:59 dispatching 110
2024/10/23 16:34:59 dispatching 109
2024/10/23 16:34:59 dispatching 105
2024/10/23 16:34:59 URL https://my-wallabag-domain-redacted/export/110.epub older than local file /mnt/onboard/wallabako/110.epub, skipped (2024-10-23 16:28:30 -0400 EDT > 2024-10-23 20:20:02 +0000 +0000)
2024/10/23 16:34:59 dispatching 108
2024/10/23 16:34:59 URL https://my-wallabag-domain-redacted/export/105.epub older than local file /mnt/onboard/wallabako/105.epub, skipped (2024-10-21 23:05:52 -0400 EDT > 2024-10-22 01:20:11 +0000 +0000)
2024/10/23 16:34:59 dispatching 107
2024/10/23 16:34:59 URL https://my-wallabag-domain-redacted/export/108.epub older than local file /mnt/onboard/wallabako/108.epub, skipped (2024-10-22 03:05:52 -0400 EDT > 2024-10-22 01:19:39 +0000 +0000)
2024/10/23 16:34:59 dispatching 106
2024/10/23 16:34:59 URL https://my-wallabag-domain-redacted/export/107.epub older than local file /mnt/onboard/wallabako/107.epub, skipped (2024-10-22 03:05:56 -0400 EDT > 2024-10-22 01:17:24 +0000 +0000)
2024/10/23 16:34:59 dispatching 103
2024/10/23 16:34:59 URL https://my-wallabag-domain-redacted/export/106.epub older than local file /mnt/onboard/wallabako/106.epub, skipped (2024-10-22 08:28:38 -0400 EDT > 2024-10-22 01:08:12 +0000 +0000)
2024/10/23 16:34:59 skipping 102 (not in Tags)
2024/10/23 16:34:59 skipping 101 (not in Tags)
2024/10/23 16:34:59 skipping 99 (not in Tags)
2024/10/23 16:34:59 skipping 97 (not in Tags)
2024/10/23 16:34:59 skipping 96 (not in Tags)
2024/10/23 16:34:59 skipping 88 (not in Tags)
2024/10/23 16:34:59 skipping 94 (not in Tags)
2024/10/23 16:34:59 skipping 95 (not in Tags)
2024/10/23 16:34:59 skipping 87 (not in Tags)
2024/10/23 16:34:59 skipping 85 (not in Tags)
2024/10/23 16:34:59 skipping 80 (not in Tags)
2024/10/23 16:34:59 skipping 73 (not in Tags)
2024/10/23 16:34:59 skipping 72 (not in Tags)
2024/10/23 16:34:59 skipping 68 (not in Tags)
2024/10/23 16:34:59 skipping 67 (not in Tags)
2024/10/23 16:34:59 skipping 66 (not in Tags)
2024/10/23 16:34:59 skipping 64 (not in Tags)
2024/10/23 16:34:59 skipping 63 (not in Tags)
2024/10/23 16:34:59 skipping 62 (not in Tags)
2024/10/23 16:34:59 URL https://my-wallabag-domain-redacted/export/103.epub older than local file /mnt/onboard/wallabako/103.epub, skipped (2024-10-22 08:28:40 -0400 EDT > 2024-10-21 20:30:45 +0000 +0000)
2024/10/23 16:34:59 URL https://my-wallabag-domain-redacted/export/109.epub older than local file /mnt/onboard/wallabako/109.epub, skipped (2024-10-22 08:28:38 -0400 EDT > 2024-10-22 01:26:05 +0000 +0000)
2024/10/23 16:34:59 local files to inspect: [/mnt/onboard/wallabako/103.epub /mnt/onboard/wallabako/105.epub /mnt/onboard/wallabako/106.epub /mnt/onboard/wallabako/107.epub /mnt/onboard/wallabako/108.epub /mnt/onboard/wallabako/109.epub /mnt/onboard/wallabako/110.epub] /mnt/onboard/wallabako/*.epub
2024/10/23 16:34:59 parsing Plato metadata file /mnt/onboard/.metadata.json and /mnt/onboard/.reading-states/
2024/10/23 16:34:59 could not load Plato metadata: open /mnt/onboard/.metadata.json: no such file or directory
2024/10/23 16:34:59 cannot read metadata file: /mnt/onboard/wallabako/103.sdr/metadata.epub.lua
2024/10/23 16:34:59 nickel book 103 status: 0
2024/10/23 16:34:59 path /mnt/onboard/wallabako/105.epub: fingerprint 2720593106042078941, mtime 1729566352, mtime tz Local, size 247517, diff 9223372036
2024/10/23 16:34:59 found koreader percent 0.518519 in /mnt/onboard/wallabako/105.sdr/metadata.epub.lua
2024/10/23 16:34:59 koread book /mnt/onboard/wallabako/105.sdr/metadata.epub.lua not complete: "reading"
2024/10/23 16:34:59 koreader status of /mnt/onboard/wallabako/105.sdr/metadata.epub.lua is 1
2024/10/23 16:34:59 koreader book 105 status not unread: 1
2024/10/23 16:34:59 path /mnt/onboard/wallabako/106.epub: fingerprint 2720593106041898045, mtime 1729600118, mtime tz Local, size 66621, diff 9223372036
2024/10/23 16:34:59 cannot read metadata file: /mnt/onboard/wallabako/106.sdr/metadata.epub.lua
2024/10/23 16:34:59 nickel book 106 status: 0
2024/10/23 16:34:59 path /mnt/onboard/wallabako/107.epub: fingerprint 2720593106042118421, mtime 1729580756, mtime tz Local, size 286997, diff 9223372036
2024/10/23 16:34:59 cannot read metadata file: /mnt/onboard/wallabako/107.sdr/metadata.epub.lua
2024/10/23 16:34:59 nickel book 107 status: 0
2024/10/23 16:34:59 path /mnt/onboard/wallabako/108.epub: fingerprint 2720593106041837818, mtime 1729580752, mtime tz Local, size 6394, diff 9223372036
2024/10/23 16:34:59 cannot read metadata file: /mnt/onboard/wallabako/108.sdr/metadata.epub.lua
2024/10/23 16:34:59 nickel book 108 status: 0
2024/10/23 16:34:59 path /mnt/onboard/wallabako/109.epub: fingerprint 2720593106042265426, mtime 1729600118, mtime tz Local, size 434002, diff 9223372036
2024/10/23 16:34:59 cannot read metadata file: /mnt/onboard/wallabako/109.sdr/metadata.epub.lua
2024/10/23 16:34:59 nickel book 109 status: 0
2024/10/23 16:34:59 path /mnt/onboard/wallabako/110.epub: fingerprint 2720593106041905474, mtime 1729715310, mtime tz Local, size 74050, diff 9223372036
2024/10/23 16:34:59 cannot read metadata file: /mnt/onboard/wallabako/110.sdr/metadata.epub.lua
2024/10/23 16:34:59 nickel book 110 status: 0
2024/10/23 16:34:59 14 open file descriptors: [/proc/self/fd/0 /proc/self/fd/1 /proc/self/fd/2 /proc/self/fd/3 /proc/self/fd/4 /proc/self/fd/5 /proc/self/fd/6 /dev/pts/0 /dev/pts/0 /dev/pts/0 socket:[17780] anon_inode:[eventpoll] anon_inode:[eventfd] readlink /proc/self/fd/6: no such file or directory]
2024/10/23 16:34:59 version 1.5.1-30-g4d92dfb completed in 32.655s, processed: 7, downloaded: 0, size: 0 B, deleted: 0, read: 0, unread: 26

DNSB · 10-23-2024, 05:08 PM

Quote:

Originally Posted by ajkessel

This is now done. Thanks!

It is syncing fine but does not appear to reflect "finished" status back on Wallabag. I've pasted a log below.

I thought it would work to add wallabako as follows in Kobo eReader.conf, but this doesn't seem to have any effect:

Code:

[FeatureSettings]
ExcludeSyncFolders=(\\.(?!kobo|adobe).+|([^.][^/]*/)+\\..+|wallabako)

You might want to try:

Code:

ExcludeSyncFolders=(\\.(?!kobo|adobe).+|([^.][^/]*/)+\\..+)|(wallabako)

ajkessel · 10-23-2024, 05:54 PM

Quote:

Originally Posted by DNSB

You might want to try:

Code:

ExcludeSyncFolders=(\\.(?!kobo|adobe).+|([^.][^/]*/)+\\..+)|(wallabako)

Thanks. I since modified my original post -- putting .*wallabako.* seems to do the trick. I guess the regexp must match the entire path, after /mnt/onboard?

DNSB · 10-23-2024, 06:15 PM

You can try running any regex for your Kobo through Regex101.com. Select the .Net 7.0 (C#) option before testing.

ajkessel · 10-23-2024, 08:39 PM

Quote:

Originally Posted by DNSB

You can try running any regex for your Kobo through Regex101.com. Select the .Net 7.0 (C#) option before testing.

My confusion wasn't the regexp itself but how it's applied by the built-in eReader. It appears that the eReader adds ^/mnt/onboard ... $ to whatever expression you put in the conf file.

DNSB · 10-23-2024, 11:19 PM

Quote:

Originally Posted by ajkessel

My confusion wasn't the regexp itself but how it's applied by the built-in eReader. It appears that the eReader adds ^/mnt/onboard ... $ to whatever expression you put in the conf file.

That is correct. What I was recommending Regex101 for was if you wanted to play with any other changes. It's a lot faster to check there than by endlessly editing Kobo eReader.conf.

10-06-2018, 06:42 AM	#18
jcn363 absolute beginner Posts: 323 Karma: 1750999 Join Date: May 2017 Location: Go with the wind (43°19'17.7"N 2°00'19.4"W) Device: ka1	I'll try again. Good luck. EDIT: It works! Last edited by jcn363; 10-06-2018 at 11:18 AM. Reason: It works

05-31-2021, 01:49 AM	#20
rebpdx Junior Member Posts: 3 Karma: 10 Join Date: May 2021 Device: Kobo Libra H2O	I recently got a Kobo reader and started using Wallabako today because I couldn't figure out how to get KOReader to work with my custom SSL cert. I don't see documentation matching my use case. Here's some info about what I did in case someone else has a local wallabag server running with HTTPS on a localhost cert and a router that doesn't support local DNS. Custom Cert not publically signed: Since I rolled my own certs and have them installed on my other devices I needed to supply that for Wallabako to work. I found in the golang source that there are a few places it looks for the custom .pem files. x509/root_linux.go Similar to how the Wallabako docs mention you can copy your custom cert.pem file to /etc/ssl/certs right next to the .crt file that's copied in there for publically signed certs. Local DNS without Router Support: Normally I'd set my DNS settings on the computer but for some reason, the /etc/resolve.conf didn't work for me. But I was able to kind of fake it with /etc/hosts file similar to how the other thread on here redirects google analytics to localhost. Code: 129.168.123.10 wallabag.server.lan

10-21-2024, 05:16 PM	#23
ajkessel Connoisseur Posts: 76 Karma: 10 Join Date: Jul 2017 Location: Boston Device: Kobo Libra 2	How to disable on-screen logging and mark items as read? I'm using the latest wallabako build with nickelmenu on a Kobo Libra 2. Is there any way to suppress the log output at the bottom of the screen if fbink is detected? I don't see a setting to completely suppress output in the config file. Also, when I mark items as finished or remove them, they reappear with the next sync. Is that expected? I have "delete" as "true" in the configuration but it seems to have no effect. Am I only able to remove items from a web browser, not by deleting them on the Kobo? Finally, is there something you need to do to enable koreader integration? I see that there are some koreader files in the github repository, but it's not clear to me if there is more to it than just navigating through the filesystem in koreader to the folder where the articles are stored. Relatedly, is there a way to hide the wallabako content from the native book reader but just access it by folder in koreader? It's a little confusing/crorwded to have the wallabag articles grouped together with my eBooks. Or is there another way to keep them organized/separate? Last edited by ajkessel; 10-21-2024 at 09:07 PM. Reason: additional question

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Wallabag, best web page saver, read it later service, free personal instapaper clone	exachillus	General Discussions	17	03-26-2017 04:10 AM
Wallabag on Kobo readers?	anarcat	Reading and Management	3	01-31-2017 09:53 AM
Which app is the best to read	Aanya	Apple Devices	6	08-30-2014 09:16 AM
Is There a Beta Read App?	diremommy	Android Devices	6	06-02-2013 08:05 AM
[Android App] Cannot view read/not read on CC....Help!	Tan	Devices	3	10-29-2012 01:53 AM

10-05-2018, 01:46 PM	#16
jcn363 absolute beginner Posts: 323 Karma: 1750999 Join Date: May 2017 Location: Go with the wind (43°19'17.7"N 2°00'19.4"W) Device: ka1	Doesn't work on my KA1 with kfmon and koreader. Perhaps I'm missing something. Could you please write a step-by-step? Thx in advance. Good luck.

10-08-2019, 12:05 PM	#19
anarcat Connoisseur Posts: 83 Karma: 192 Join Date: Jul 2013 Location: Planet Ocean Device: Kobo Glo HD, Onyx Boox Note Pro 2, Samsung Galaxy Tab S5e, Pixel 4a	Hi everyone, Just a quick note to say I have done some minor improvements on Wallabako since I was here the last time. We're now at the 1.3.1 release, which has preliminary support for status changes in Plato, with Koreader hopefully coming next. You can see the releases here: https://gitlab.com/anarcat/wallabako/-/tags You can subscribe to the RSS feed here: https://gitlab.com/anarcat/wallabako/-/tags?format=atom And the full changelog is here: https://gitlab.com/anarcat/wallabako...r/CHANGELOG.md

06-02-2021, 02:14 AM	#21
rebpdx Junior Member Posts: 3 Karma: 10 Join Date: May 2021 Device: Kobo Libra H2O	Update from my previous post, KOReader's Wallabag addon now works after the changes I did for Wallabako so looks like it applies for both.

11-16-2021, 07:44 PM	#22
amin021023 Enthusiast Posts: 42 Karma: 10 Join Date: Aug 2019 Device: Fidibook	How could I have a free hosting server for eallabag?

10-23-2024, 06:15 PM	#28
DNSB Bibliophagist Posts: 46,263 Karma: 168983734 Join Date: Jul 2010 Location: Vancouver Device: Kobo Sage, Libra Colour, Lenovo M8 FHD, Paperwhite 4, Tolino epos	You can try running any regex for your Kobo through Regex101.com. Select the .Net 7.0 (C#) option before testing.