![]() |
#1 |
Junior Member
![]() Posts: 4
Karma: 10
Join Date: Aug 2013
Device: kindle
|
Recipe help for paid posts on blog
Hey
I have a little problem. I have recipe for www.dilemaveche.ro, it works well, it gives me all the content on that site in a magazine form on my kindle EXCEPT the PREMIUM posts (ex: http://dilemaveche.ro/sectiune/tilc-...marele-cirmaci) My question is what can i do so all the content (including the paid posts, which i do pay for- i have a paid account on that site) will be fetched from the rss? The recipe is : class DilemaVeche(BasicNewsRecipe): title = u'Dilema Veche' # apare vinerea, mai pe dupa-masa,depinde de Luiza cred (care se semneaza ca fiind creatorul fiecarui articol in feed-ul RSS) __author__ = 'song2' # inspirat din scriptul pentru Le Monde. Inspired from the Le Monde script description = '"Sint vechi, domnule!" (I.L. Caragiale)' publisher = 'Adevarul Holding' oldest_article = 7 max_articles_per_feed = 200 encoding = 'utf8' language = 'ro' masthead_url = 'http://www.dilemaveche.ro/sites/all/themes/dilema/theme/dilema_two/layouter/dilema_two_homepage/logo.png' publication_type = 'magazine' feeds = [ ('Editoriale si opinii - Situatiunea', 'http://www.dilemaveche.ro/taxonomy/term/37/0/feed'), ('Editoriale si opinii - Pe ce lume traim', 'http://www.dilemaveche.ro/taxonomy/term/38/0/feed'), ('Editoriale si opinii - Bordeie si obiceie', 'http://www.dilemaveche.ro/taxonomy/term/44/0/feed'), ('Editoriale si opinii - Talc Show', 'http://www.dilemaveche.ro/taxonomy/term/44/0/feed'), ('Tema saptamanii', 'http://www.dilemaveche.ro/taxonomy/term/19/0/feed'), ('La zi in cultura - Dilema va recomanda', 'http://www.dilemaveche.ro/taxonomy/term/58/0/feed'), ('La zi in cultura - Carte', 'http://www.dilemaveche.ro/taxonomy/term/14/0/feed'), ('La zi in cultura - Film', 'http://www.dilemaveche.ro/taxonomy/term/13/0/feed'), ('La zi in cultura - Muzica', 'http://www.dilemaveche.ro/taxonomy/term/1341/0/feed'), ('La zi in cultura - Arte performative', 'http://www.dilemaveche.ro/taxonomy/term/1342/0/feed'), ('La zi in cultura - Arte vizuale', 'http://www.dilemaveche.ro/taxonomy/term/1512/0/feed'), ('Societate - Ieri cu vedere spre azi', 'http://www.dilemaveche.ro/taxonomy/term/15/0/feed'), ('Societate - Din polul opus', 'http://www.dilemaveche.ro/taxonomy/term/41/0/feed'), ('Societate - Mass comedia', 'http://www.dilemaveche.ro/taxonomy/term/43/0/feed'), ('Societate - La singular si la plural', 'http://www.dilemaveche.ro/taxonomy/term/42/0/feed'), ('Oameni si idei - Educatie', 'http://www.dilemaveche.ro/taxonomy/term/46/0/feed'), ('Oameni si idei - Polemici si dezbateri', 'http://www.dilemaveche.ro/taxonomy/term/48/0/feed'), ('Oameni si idei - Stiinta si tehnologie', 'http://www.dilemaveche.ro/taxonomy/term/46/0/feed'), ('Dileme on-line', 'http://www.dilemaveche.ro/taxonomy/term/005/0/feed') ] remove_tags_before = dict(name='div',attrs={'class':'spacer_10'}) remove_tags = [ dict(name='div', attrs={'class':'art_related_left'}), dict(name='div', attrs={'class':'controale'}), dict(name='div', attrs={'class':'simple_overlay'}), ] remove_tags_after = [dict(id='facebookLike')] remove_javascript = True no_stylesheets = True remove_empty_feeds = True extra_css = """ body{font-family: Georgia,Times,serif } img{margin-bottom: 0.4em; display:block} """ def get_cover_url(self): cover_url = None soup = self.index_to_soup('http://dilemaveche.ro') link_item = soup.find('div',attrs={'class':'box_dr_pdf_picture '}) if link_item and link_item.a: cover_url = link_item.a['href'] br = BasicNewsRecipe.get_browser() try: br.open(cover_url) except: #daca nu gaseste pdf-ul self.log("\nPDF indisponibil") link_item = soup.find('div',attrs={'class':'box_dr_pdf_picture '}) if link_item and link_item.img: cover_url = link_item.img['src'] br = BasicNewsRecipe.get_browser() try: br.open(cover_url) except: #daca nu gaseste nici imaginea mica mica print('Mama lor de nenorociti! nu este nici pdf nici imagine') cover_url ='http://www.dilemaveche.ro/sites/all/themes/dilema/theme/dilema_two/layouter/dilema_two_homepage/logo.png' return cover_url cover_margins = (10, 15, '#ffffff') |
![]() |
![]() |
![]() |
#2 |
Junior Member
![]() Posts: 4
Karma: 10
Join Date: Aug 2013
Device: kindle
|
The guys froms calibre in the api documentation say that you have to use this code in your recipe for logging in for subscription based rss (they exemplify this with the new york times) .
Can someone integrate one of these two codes with dilemaveche recipe please? ![]() def get_browser(self): br = BasicNewsRecipe.get_browser(self) if self.username is not None and self.password is not None: br.open('http://www.nytimes.com/auth/login') br.select_form(name='login') br['USERID'] = self.username br['PASSWORD'] = self.password br.submit() return br OR def javascript_login(self, browser, username, password): browser.visit('http://some-page-that-has-a-login') form = browser.select_form(nr=0) # Select the first form on the page form['username'] = username form['password'] = password browser.submit(timeout=120) # Submit the form and wait at most two minutes for loading to complete for javascript login |
![]() |
![]() |
Advert | |
|
![]() |
#3 |
Junior Member
![]() Posts: 4
Karma: 10
Join Date: Aug 2013
Device: kindle
|
nobody ?
![]() |
![]() |
![]() |
![]() |
#4 |
creator of calibre
![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() ![]() Posts: 45,139
Karma: 27110892
Join Date: Oct 2006
Location: Mumbai, India
Device: Various
|
This should do it, though I haven't tested it
Code:
needs_subscription = 'optional' def get_browser(self): br = BasicNewsRecipe.get_browser(self) if self.username is not None and self.password is not None: br.open('http://dilemaveche.ro/user/login') br.select_form(nr=0) br['username'] = self.username br['password'] = self.password br.submit() return br |
![]() |
![]() |
![]() |
#5 |
Junior Member
![]() Posts: 4
Karma: 10
Join Date: Aug 2013
Device: kindle
|
hey, it gives me an error at line "needs_subscription = 'optional' ".
That's exactly what i've figured out i should put in my recipe (except the needs_subscription" but still didn't work :-? Try testing it with my username and pw Thank you for all the help, i apreciate it ( and i'm sure all the Dilema Veche readers will ) |
![]() |
![]() |
Advert | |
|
![]() |
Thread Tools | Search this Thread |
|
![]() |
||||
Thread | Thread Starter | Forum | Replies | Last Post |
EPUB Formatting Challenge: Embedding blog posts in the flow of story text | Morganucopia | ePub | 18 | 08-02-2013 04:47 PM |
Paid Recipe Request | rainrdx | Recipes | 1 | 07-26-2012 03:31 PM |
Blog posts about content server and other features | anoved | Calibre | 0 | 02-01-2012 03:21 PM |
How to improve browsing through archived posts in a book blog? | Frida Fantastic | General Discussions | 5 | 04-25-2011 01:49 AM |
Recipe Volkskrant paid version | prodsaaw | Calibre | 0 | 02-18-2010 04:00 PM |