Custom recipes (archive, read-only)

[kovidgoyal]

Since there have been a lot of custom recipe requests of late, I'm starting a sticky where they can be aggregated. Post requests for custom recipes here. Once you have a custom recipe that works well for you (please test both the LRF and EPUB versions), let me know and I'll include it into calibre so others can benefit from it as well.

[AprilHare]

I'd like a good recipe for The St. Petersberg Times (sister paper of The Moscow Times). http://www.sptimes.ru/

[kiklop74]

Originally Posted by AprilHare

I'd like a good recipe for The St. Petersberg Times (sister paper of The Moscow Times). http://www.sptimes.ru/

This looks like a tough one. I hate sites that use feedsportal...

[kiklop74]

OK here goes:

#!/usr/bin/env  python

__license__   = 'GPL v3'
__copyright__ = '2008, Darko Miletic <darko.miletic at gmail.com>'
'''
sptimes.ru
'''

from calibre import strftime
from calibre.web.feeds.news import BasicNewsRecipe

class Petersburgtimes(BasicNewsRecipe):
    title                 = u'The st.Petersburg Times'
    __author__            = 'Darko Miletic'
    description           = 'News from Russia'
    oldest_article        = 7
    max_articles_per_feed = 100
    no_stylesheets        = True
    use_embedded_content  = False
    INDEX = 'http://www.sptimes.ru'
    
    def parse_index(self):
        articles = []
        soup = self.index_to_soup(self.INDEX)
        
        for item in soup.findAll('a', attrs={'class':'story_link_o'}):
            if item.has_key('href'):
                url = self.INDEX + item['href'].replace('action_id=2','action_id=100')
                title = self.tag_to_string(item)
                c_date = strftime('%A, %d %B, %Y')
                description = ''
                articles.append({
                                 'title':title,
                                 'date':c_date,
                                 'url':url,
                                 'description':description
                                })
        return [(soup.head.title.string, articles)]

[drnkusv]

I would appreciate if anyone can come up with a recipe for the Financial Times -- ft.com.

Thanks.

[kiklop74]

Originally Posted by drnkusv

I would appreciate if anyone can come up with a recipe for the Financial Times -- ft.com.

Thanks.

I tested this with free account.

Here goes:

#!/usr/bin/env  python

__license__   = 'GPL v3'
__copyright__ = '2008, Darko Miletic <darko.miletic at gmail.com>'
'''
ft.com
'''

from calibre import strftime
from calibre.web.feeds.news import BasicNewsRecipe

class FinancialTimes(BasicNewsRecipe):
    title                 = u'Financial Times'
    __author__            = 'Darko Miletic'
    description           = 'Financial world news'
    oldest_article        = 2
    max_articles_per_feed = 100
    no_stylesheets        = True
    use_embedded_content  = False
    needs_subscription    = True
    simultaneous_downloads= 1
    delay                 = 1
    LOGIN = 'https://registration.ft.com/registration/barrier/login'
    
    def get_browser(self):
        br = BasicNewsRecipe.get_browser()
        if self.username is not None and self.password is not None:
            br.open(self.LOGIN)
            br.select_form(name='loginForm')
            br['username'] = self.username
            br['password'] = self.password
            br.submit()
        return br
    
    keep_only_tags    = [ dict(name='div', attrs={'id':'cont'}) ]
    remove_tags_after = dict(name='p', attrs={'class':'copyright'})
    remove_tags = [
                     dict(name='div', attrs={'id':'floating-con'})
                  ]
    
    feeds = [ 
               (u'UK'         , u'http://www.ft.com/rss/home/uk'        ) 
              ,(u'US'         , u'http://www.ft.com/rss/home/us'        ) 
              ,(u'Asia'       , u'http://www.ft.com/rss/home/asia'      ) 
              ,(u'Middle East', u'http://www.ft.com/rss/home/middleeast') 
            ]

    def preprocess_html(self, soup):
        content_type = soup.find('meta', {'http-equiv':'Content-Type'})
        if content_type:
            content_type['content'] = 'text/html; charset=utf-8'
        return soup

[drnkusv]

Thanks! Much appreciated.

[XanthanGum]

Hi,

I would like to have recipes created for the following online magazines:

Harper's at:

http://www.harpers.org/

Science News at:

http://sciencenews.org/

The Nation at:

http://www.thenation.com/

The online science news articles from Science (AAAS):

http://sciencenow.sciencemag.org/

Spiegel International Online in English at:

http://www.spiegel.de/international/

Thanks in advance...

[AprilHare]

Originally Posted by kiklop74

This looks like a tough one. I hate sites that use feedsportal...

Thanks for that! Much appreciated..

[hackettt]

I have been trying to get a few Premier League Football sources (BBC, Sky Sports, Sun, Daily Telegraph, etc.) using the custom recipes. However, when I use the basic mode, I rarely get beyond a headline. When I use the Advanced Mode, it usually ends in an error.

If anyone would be so kind to generate a recipe for any of the above, I would be greatly appreciative.

Cheers.

[AprilHare]

Hey: I'd like a recipe for Nature News: http://www.nature.com/news/rss-feeds.html

[kiklop74]

Originally Posted by XanthanGum

Hi,

I would like to have recipes created for the following online magazines:

Harper's at:

http://www.harpers.org/

Science News at:

http://sciencenews.org/

The Nation at:

http://www.thenation.com/

The online science news articles from Science (AAAS):

http://sciencenow.sciencemag.org/

Spiegel International Online in English at:

http://www.spiegel.de/international/

Thanks in advance...

Here goes:

See attachment

[kiklop74]

Originally Posted by AprilHare

Hey: I'd like a recipe for Nature News: http://www.nature.com/news/rss-feeds.html

This site requires payed access to almost all content and since I do not have the interest to purchase subscription no testing can be done to produce adequate recipe.

[kiklop74]

News recipe:

Pagina 12, Argentinian newspaper (in spanish) (http://www.pagina12.com.ar/)

[AprilHare]

Originally Posted by kiklop74

This site requires payed access to almost all content and since I do not have the interest to purchase subscription no testing can be done to produce adequate recipe.

Thanks for taking a look. I was only interested in free content (no subscription here either; I got used to nature news when I had access to a institutional subscription).