Simple Passwort Authentification for RSS feed?

inte · 11-09-2017, 04:38 AM

Hello,

I did some crossreading but the NYT-Example from the manual seems too complex for what I want to do.
I want to subscribe to:
http://www.darc.de/home/rss.xml
While the feed itself is not password protected, the articles require one to be logged into the website in order to retrieve the content.
I could not find a simple "log into the website first" example but I guess this should be feasible in python.
It would be really nice if someone could point me to one of those simple setup.
Thank you.

kovidgoyal · 11-09-2017, 05:43 AM

The log into the website section of the new york times example in the manual is about as simple as it gets. It's about five lines of code, see the get_browser() function which is all that you need.

Although from your description you want to perform HTTP auth, not cookies based auth. In which case, you should look at the documentation of python-mechanize,as the browser object in calibre is a mechanize browser object.

inte · 11-09-2017, 06:14 AM

Quote:

Originally Posted by kovidgoyal

The log into the website section of the new york times example in the manual is about as simple as it gets. It's about five lines of code, see the get_browser() function which is all that you need.

Although from your description you want to perform HTTP auth, not cookies based auth. In which case, you should look at the documentation of python-mechanize,as the browser object in calibre is a mechanize browser object.

Jey, figured it out already.
The problem is that the form on the website neither has a name nor an id.
I eventually searched for the "action='login/'" part on the site.
Works fine now, great!
Now I only need to figure out how to configure my kindle not to sync everything I email to it into the amazon cloud...

inte · 11-09-2017, 06:23 AM

Only one more thing: It appears to me that calibre would convert and send a document again even if it has not changed. Can I tell Calibre to check for changes prior to spamming my kindle with identical documents?

kovidgoyal · 11-09-2017, 06:51 AM

recipes are arbitrary programs, you can do whatever you want in them. In https://www.mobileread.com/forums/sh...ad.php?t=70263 you will find examples of only downloading articles not previously downloaded.

inte · 11-09-2017, 02:38 PM

Yes, obviously, python is (all)mighty ;-) I guess I already found some appropriate examples and will hopefully find some time for a closer look at the weekend. Thanks again for pointing me to the right direction :-)

11-09-2017, 04:38 AM	#1
inte Member Posts: 11 Karma: 10 Join Date: Nov 2017 Device: Kindle Oasis	Simple Passwort Authentification for RSS feed? Hello, I did some crossreading but the NYT-Example from the manual seems too complex for what I want to do. I want to subscribe to: http://www.darc.de/home/rss.xml While the feed itself is not password protected, the articles require one to be logged into the website in order to retrieve the content. I could not find a simple "log into the website first" example but I guess this should be feasible in python. It would be really nice if someone could point me to one of those simple setup. Thank you.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
RSS feed	messiaen	Recipes	1	02-03-2016 09:55 PM
Recipe without rss feed?	nicolash	Recipes	10	09-09-2012 06:35 AM
RSS Feed	timezone	Feedback	8	01-02-2010 06:55 PM
RSS Feed Prob...	AKninja04	Calibre	6	08-25-2008 07:51 PM
Newsimages.com RSS Feed	Alexander Turcic	Lounge	0	08-27-2004 03:25 PM

11-09-2017, 05:43 AM	#2
kovidgoyal creator of calibre Posts: 43,858 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	The log into the website section of the new york times example in the manual is about as simple as it gets. It's about five lines of code, see the get_browser() function which is all that you need. Although from your description you want to perform HTTP auth, not cookies based auth. In which case, you should look at the documentation of python-mechanize,as the browser object in calibre is a mechanize browser object.

11-09-2017, 06:23 AM	#4
inte Member Posts: 11 Karma: 10 Join Date: Nov 2017 Device: Kindle Oasis	Only one more thing: It appears to me that calibre would convert and send a document again even if it has not changed. Can I tell Calibre to check for changes prior to spamming my kindle with identical documents?

11-09-2017, 06:51 AM	#5
kovidgoyal creator of calibre Posts: 43,858 Karma: 22666666 Join Date: Oct 2006 Location: Mumbai, India Device: Various	recipes are arbitrary programs, you can do whatever you want in them. In https://www.mobileread.com/forums/sh...ad.php?t=70263 you will find examples of only downloading articles not previously downloaded.

11-09-2017, 02:38 PM	#6
inte Member Posts: 11 Karma: 10 Join Date: Nov 2017 Device: Kindle Oasis	Yes, obviously, python is (all)mighty ;-) I guess I already found some appropriate examples and will hopefully find some time for a closer look at the weekend. Thanks again for pointing me to the right direction :-)