Democracy Journal recipe?

[davidnye]

I'm interested in developing a recipe for Democracy Journal ( http://www.democracyjournal.org ), but I have no idea where to begin. Each article from the current issue appears as a .php link from the main page. RSS is not supported. Thanks for any help.

[Starson17]

Originally Posted by davidnye

I'm interested in developing a recipe for Democracy Journal ( http://www.democracyjournal.org ), but I have no idea where to begin. Each article from the current issue appears as a .php link from the main page. RSS is not supported. Thanks for any help.

If RSS is not available, then you must use parse_index. Read the sticky here for some links, or see here:
http://manual.calibre-ebook.com/news.html#news

[davidnye]

Here's a recipe for Democracy Journal:

class AdvancedUserRecipe1361743898(BasicNewsRecipe):
    title = u'Democracy Journal'
    description = '''A journal of ideas. Published quarterly.'''
    __author__ = u'David Nye'
    oldest_article = 90
    max_articles_per_feed = 30
    no_stylesheets = True
    auto_cleanup = True
    
    def parse_index(self):
        articles = []
        feeds = []
        soup = self.index_to_soup("http://www.democracyjournal.org")
        for x in soup.findAll(href=re.compile("http://www\.democracyjournal\.org/\d*/.*php$")):
            url = x.get('href')
            title = self.tag_to_string(x)
            articles.append({'title':title, 'url':url, 'description':'', 'date':''})
        feeds.append(('Articles', articles))
        return feeds
        
    def print_version(self, url):
        return url + '?page=all'

[davidnye]

BTW, thanks Starson17 for the tip about using parse_index. When I finally got down to it, writing the recipe was easier and more fun than I thought it would be.