Automatic news feeds uploading, How does it work?

[quisvir]

Nice! I've put in a few hours and rewritten and expanded the script. It now takes the date directly from the first download link on the page. Many other things have changed as well, so take a look

[Azeeman]

Hi guys,

As a subscriptor to the NRC this is a very interesting post. Unfortunately I can not get it all to work with the latest nrc_v2 script. The script just stops after changing the meta-data. Therefore the book will not be added to Calibre and more (rest of the script).

No warnings, but the file is created just fine. Any suggestions?

[quisvir]

Originally Posted by Azeeman

Hi guys,

As a subscriptor to the NRC this is a very interesting post. Unfortunately I can not get it all to work with the latest nrc_v2 script. The script just stops after changing the meta-data. Therefore the book will not be added to Calibre and more (rest of the script).

No warnings, but the file is created just fine. Any suggestions?

Are you sure the epub is downloaded correctly? Try opening it with Calibre's ebook viewer.

If it did download correctly, you may have stumbled upon the same problem that JvdW encountered, which I personally have not. What operating system and version of Calibre are you using? As a sort-of fix, you can add the following to the start of each calibre-related line (ebook-meta, calibredb, calibre-debug)

start /wait

This way, you can force the script to wait until it is done with each command before proceeding to the next.

[JvdW]

Originally Posted by quisvir

Are you sure the epub is downloaded correctly? Try opening it with Calibre's ebook viewer.

If it did download correctly, you may have stumbled upon the same problem that JvdW encountered, which I personally have not. What operating system and version of Calibre are you using? As a sort-of fix, you can add the following to the start of each calibre-related line (ebook-meta, calibredb, calibre-debug)

start /wait

This way, you can force the script to wait until it is done with each command before proceeding to the next.

The epubs download OK, if they are published on time that is.
The real problem is that since Calibre-0.6.17 this doesn't work anymore. Since that version Kovid has changed the layout of the Calibre folder, changed the installer and also changed the way Calibre is packaged. One of these changes is causing this problem.
A suggestion of Kovid is to use powershell to start the batch file, but I would like to keep the number of external programs needed to a minimum of zero if possible.


Regards,

Joop

[Azeeman]

The option 'start /wait' works for me. I guess the script was trying to add the epub to the database but was blocked by the previous proces.

Thanks! Now going to schedule this script for ma-vr 15:10 :-)

[JvdW]

Hello Kovid,

Hoping that you read posts on old threads, sorry to revive this one because of the context it supplies.

Originally Posted by kovidgoyal

Actually, I'm sorry, what happens is that when a news download completes, the id is recorded in a config file which is then used to sync

Assuming you can find out the id of the freshly added news (which should be easy to do using calibredb, the following command will mark it to be synced

calibre-debug -c "from calibre.gui2 import dynamic; ids = dynamic.get('news_to_be_synced', set([])); ids.add(35); dynamic.set('news_to_be_synced', ids)"

replace 35 with the id of the freshly added news

As can be seen of the posts in this thread all was (is) well until 0.7.24?
I had .7.23 on my computer at work and could run the batchfile and Calibre would automatically send the news to my reader (505). At home it didn't work anymore but there I try to keep up with the latest version.

There is mentioning in the changelog about a change in sending news to the reader with multiple libraries but I don't know if that is the cause but the line of code you suggested doesn't work anymore with versions above .7.23. I do see it being present in dynamic.pickle but can't see if its correct. Downloading news through a recipe works OK in .7.27

Do you have any idea what might be cause this and a pointer to fix it?

Thanks in advance,

Joop

[kovidgoyal]

Yeah this setting was moved inside the db (otherwise if you use multiple libraries, the ids can conflict).

from calibre.library import db; db = db(); import pprint; pprint.pprint(db.prefs)

will print out all the settings stored in the db, including the one you are interested in.

[JvdW]

Originally Posted by kovidgoyal

Yeah this setting was moved inside the db (otherwise if you use multiple libraries, the ids can conflict).

from calibre.library import db; db = db(); import pprint; pprint.pprint(db.prefs)

will print out all the settings stored in the db, including the one you are interested in.

Thanks voor the pointer. I have made the following change, line is broken into multiples for readability:

start /wait calibre-debug -c "
from calibre.library import db; 
db=db(); 
from calibre.utils.config import prefs; 
ids = db.prefs.get('news_to_be_synced', set([])); 
ids.append(%id%); 
db.prefs.set('news_to_be_synced', ids);
"

How does that look to you?
Any room for improvement?

Thanks,

Joop

[kovidgoyal]

in the get use [] as the default not set([])