Recipe request from uruguay

[nachalca]

Hello, I am from Uruguay, I've just started using calibre.
I am trying to create a recipe for a weakly uruguayan newspaper called Brecha (www.brecha.com.uy), but I am copletely lost.

The sites require subscription, I've tried use the new york times example
and the Folha do Sao Paulo example, but none of them sees to work here.

Could anybody create a recipe for Brecha ?

Thank you !!
nachalca

[kiklop74]

Send me your credentials in private message and I will do it.

[lrui]

Originally Posted by nachalca

Hello, I am from Uruguay, I've just started using calibre.
I am trying to create a recipe for a weakly uruguayan newspaper called Brecha (www.brecha.com.uy), but I am copletely lost.

The sites require subscription, I've tried use the new york times example
and the Folha do Sao Paulo example, but none of them sees to work here.

Could anybody create a recipe for Brecha ?

Thank you !!
nachalca

you can try this code

import mechanize, urllib
 
    def get_browser(self):
        br = BasicNewsRecipe.get_browser(self)
        if self.username is not None and self.password is not None:
            cookies = mechanize.CookieJar()
            br = mechanize.build_opener(mechanize.HTTPCookieProcessor(cookies))
            request = urllib.urlencode([('loginname', self.username), ('password', self.password),])
            response = br.open('http://www.brecha.com.uy/index.php/acceder-miembros', request)
        return br

does it works?

[nachalca]

thanks a lot for the responses !!
Irui, your suggestion does not work completely. I am not getting the error message but I can not see the complete articles. Is like I don't have a subscription for the website.


I guess probably the error is in other place, here is the recipe using your sugestion :

from calibre.web.feeds.recipes import BasicNewsRecipe
import mechanize, urllib

class General(BasicNewsRecipe):
title = u'brecha'
description = 'La brecha en tinta electronica'
language = 'es'
timefmt = '[%a, %d %b, %Y]'
needs_subscription = True
oldest_article = 7
max_articles_per_feed = 100
auto_cleanup = True
remove_tags_before = dict(id='article')
remove_tags_after = dict(id='article')


def get_browser(self):
br = BasicNewsRecipe.get_browser(self)
if self.username is not None and self.password is not None:
cookies = mechanize.CookieJar()
br = mechanize.build_opener(mechanize.HTTPCookieProcess or(cookies))
request = urllib.urlencode([('loginname', self.username), ('password', self.password),])
response = br.open('http://www.brecha.com.uy/index.php/acceder-miembros', request)
return br

feeds = [(u'tapa', u'www.brecha.com.uy/index.php/component/phocagallery/category/1-tapas?format=feed&type=rss'), (u'Politica', u'http://www.brecha.com.uy/index.php/politica-uruguaya?format=feed&type=rss'), (u'Internacionales', u'http://www.brecha.com.uy/index.php/mundo?format=feed&type=rss'), (u'Cultura', u'http://www.brecha.com.uy/index.php/cultura?format=feed&type=rss'), (u'cultura1', u'http://www.brecha.com.uy/index.php/cultura/vueltas-de-montevideo?format=feed&type=rss'), (u'cultura2', u'http://www.brecha.com.uy/index.php/cultura/secos-y-mojados?format=feed&type=rss'), (u'literarias', u'http://www.brecha.com.uy/index.php/cultura/literarias?format=feed&type=rss'), (u'Sociedad', u'http://www.brecha.com.uy/index.php/sociedad?format=feed&type=rss'), (u'Especiales', u'http://www.brecha.com.uy/index.php/especiales?format=feed&type=rss'), (u'Contratapa', u'http://www.brecha.com.uy/index.php/contratapa?format=feed&type=rss')]

[lrui]

Originally Posted by nachalca

thanks a lot for the responses !!
Irui, your suggestion does not work completely. I am not getting the error message but I can not see the complete articles. Is like I don't have a subscription for the website.


I guess probably the error is in other place, here is the recipe using your sugestion :

from calibre.web.feeds.recipes import BasicNewsRecipe
import mechanize, urllib

class General(BasicNewsRecipe):
title = u'brecha'
description = 'La brecha en tinta electronica'
language = 'es'
timefmt = '[%a, %d %b, %Y]'
needs_subscription = True
oldest_article = 7
max_articles_per_feed = 100
auto_cleanup = True
remove_tags_before = dict(id='article')
remove_tags_after = dict(id='article')


def get_browser(self):
br = BasicNewsRecipe.get_browser(self)
if self.username is not None and self.password is not None:
cookies = mechanize.CookieJar()
br = mechanize.build_opener(mechanize.HTTPCookieProcess or(cookies))
request = urllib.urlencode([('loginname', self.username), ('password', self.password),])
response = br.open('http://www.brecha.com.uy/index.php/acceder-miembros', request)
return br

feeds = [(u'tapa', u'www.brecha.com.uy/index.php/component/phocagallery/category/1-tapas?format=feed&type=rss'), (u'Politica', u'http://www.brecha.com.uy/index.php/politica-uruguaya?format=feed&type=rss'), (u'Internacionales', u'http://www.brecha.com.uy/index.php/mundo?format=feed&type=rss'), (u'Cultura', u'http://www.brecha.com.uy/index.php/cultura?format=feed&type=rss'), (u'cultura1', u'http://www.brecha.com.uy/index.php/cultura/vueltas-de-montevideo?format=feed&type=rss'), (u'cultura2', u'http://www.brecha.com.uy/index.php/cultura/secos-y-mojados?format=feed&type=rss'), (u'literarias', u'http://www.brecha.com.uy/index.php/cultura/literarias?format=feed&type=rss'), (u'Sociedad', u'http://www.brecha.com.uy/index.php/sociedad?format=feed&type=rss'), (u'Especiales', u'http://www.brecha.com.uy/index.php/especiales?format=feed&type=rss'), (u'Contratapa', u'http://www.brecha.com.uy/index.php/contratapa?format=feed&type=rss')]

sorry，my fault
I will try it again tomorrow， it's time to go to sleep

[lrui]

Originally Posted by nachalca

Hello, I am from Uruguay, I've just started using calibre.
I am trying to create a recipe for a weakly uruguayan newspaper called Brecha (www.brecha.com.uy), but I am copletely lost.

The sites require subscription, I've tried use the new york times example
and the Folha do Sao Paulo example, but none of them sees to work here.

Could anybody create a recipe for Brecha ?

Thank you !!
nachalca

you can download news from your website without login

Spoiler:

from calibre.web.feeds.recipes import BasicNewsRecipe class General(BasicNewsRecipe):
title = u'brecha'
description = u'La brecha en tinta electronica'
language = 'es'
timefmt = '[%a, %d %b, %Y]'
oldest_article = 7
max_articles_per_feed = 100
auto_cleanup = True
remove_tags_before = dict(id='article')
remove_tags_after = dict(id='article')
feeds = [
(u'tapa', u'http://www.brecha.com.uy/index.php/component/phocagallery/category/1-tapas?format=feed&type=rss'),
(u'Politica', u'http://www.brecha.com.uy/index.php/politica-uruguaya?format=feed&type=rss'),
(u'Internacionales', u'http://www.brecha.com.uy/index.php/mundo?format=feed&type=rss'),
(u'Cultura', u'http://www.brecha.com.uy/index.php/cultura?format=feed&type=rss'),
(u'cultura1', u'http://www.brecha.com.uy/index.php/cultura/vueltas-de-montevideo?format=feed&type=rss'),
(u'cultura2', u'http://www.brecha.com.uy/index.php/cultura/secos-y-mojados?format=feed&type=rss'),
(u'literarias', u'http://www.brecha.com.uy/index.php/cultura/literarias?format=feed&type=rss'),
(u'Sociedad', u'http://www.brecha.com.uy/index.php/sociedad?format=feed&type=rss'),
(u'Especiales', u'http://www.brecha.com.uy/index.php/especiales?format=feed&type=rss'),
(u'Contratapa', u'http://www.brecha.com.uy/index.php/contratapa?format=feed&type=rss')
]

[kiklop74]

Recipe for Brecha Digital was added to Calibre tracker. It will be included in the next release. Optional credential entry is provided.

https://bugs.launchpad.net/calibre/+bug/1038516

[nachalca]

OOhh !! Thanks a lot kiklop74 !!