Custom recipes (archive, read-only)

[Starson17]

Originally Posted by nook.life

The website is http://www.explosm.net/comics/
and the RSS is: http://feeds.feedburner.com/Explosm
Any update on creating a recipe for this?

Creating recipes is a volunteer effort, so you only get a recipe if someone feels like creating it. I took a very brief look at this, but it's got some protection on the page. Have you looked at the two comics recipes I wrote to see if the comic you want is in one of those (comics.com and gocomics)? There are about 300 comics between them, but they have to be customized to turn on the comics of interest.

[gambarini]

Originally Posted by gambarini

infomotori

Italian Car and MotorCicle News

i don't find this recipe in new calibre version.

Is there any problem with this recipe?

[kovidgoyal]

Originally Posted by gambarini

i don't find this recipe in new calibre version.

Is there any problem with this recipe?

I must have missed your post, just post them again and I'll add them for the next release.

[square4761]

http://www.americanthinker.com/

I tried doing the RSS way and it only downloads a few articles but it gets the titles for all the articles. If you click on various articles on the webpage there is no password/username asked for on several that I tried. Any help would be appreciated.

[gambarini]

Originally Posted by kovidgoyal

I must have missed your post, just post them again and I'll add them for the next release.

oh, yeah!

[yamadharma]

Thanx. It's work.

[jbambridge]

Based almost 100% on the excellent Guardian recipe, this is my adapted version to allow the UK Sunday paper: The Observer to be added to Calibre.

[Starson17]

Originally Posted by nook.life

The website is http://www.explosm.net/comics/
and the RSS is: http://feeds.feedburner.com/Explosm
Any update on creating a recipe for this?

Try this:

from calibre.web.feeds.news import BasicNewsRecipe
from calibre.ebooks.BeautifulSoup import BeautifulSoup

class Explosm(BasicNewsRecipe):
    title               = 'Explosm'
    __author__          = 'Starson17'
    description         = 'Explosm'
    language            = 'en'
    use_embedded_content= False
    no_stylesheets      = True
    linearize_tables      = True
    oldest_article      = 24
    remove_javascript   = True
    remove_empty_feeds    = True
    max_articles_per_feed = 10

    feeds = [
             (u'Explosm Feed', u'http://feeds.feedburner.com/Explosm')
             ]

    def get_article_url(self, article):
        return article.get('link', None)

    keep_only_tags     = [dict(name='div', attrs={'id':'maincontent'})]

    def preprocess_html(self, soup):
        table_tags = soup.findAll('table')
        table_tags[1].extract() 
        NavTag = soup.find(text='« First') 
        NavTag.parent.parent.extract()
        return soup

    extra_css = '''
                    h1{font-family:Arial,Helvetica,sans-serif; font-weight:bold;font-size:large;}
                    h2{font-family:Arial,Helvetica,sans-serif; font-weight:normal;font-size:small;}
                    p{font-family:Arial,Helvetica,sans-serif;font-size:small;}
                    body{font-family:Helvetica,Arial,sans-serif;font-size:small;}
		'''

[Starson17]

Here's an updated Freakonomics Blog recipe. The built-in uses the print link, which, unfortunately, doesn't include images. This one has the images.

#!/usr/bin/env  python
__license__   = 'GPL v3'
__copyright__ = '2009, Kovid Goyal kovid@kovidgoyal.net'
__docformat__ = 'restructuredtext en'

from calibre.web.feeds.news import BasicNewsRecipe

class Freakonomics(BasicNewsRecipe):
    
    title = 'Freakonomics Blog'
    description = 'The Hidden side of everything'
    __author__ = 'Starson17'
    language = 'en'
    cover_url           = 'http://ilkerugur.files.wordpress.com/2009/04/freakonomics.jpg'
    
    feeds = [('Blog', 'http://feeds.feedburner.com/freakonomicsblog')]
    
    keep_only_tags     = [dict(name='div', attrs={'id':'header'}),
                          dict(name='h1'),
                          dict(name='h2'),
                          dict(name='div', attrs={'class':'entry-content'}),
                          ]
    extra_css = '''
                    h1{font-family:Arial,Helvetica,sans-serif; font-weight:bold;font-size:large;}
                    h2{font-family:Arial,Helvetica,sans-serif; font-weight:normal;font-size:small;}
                    p{font-family:Arial,Helvetica,sans-serif;font-size:small;}
                    body{font-family:Helvetica,Arial,sans-serif;font-size:small;}
		'''

[TouchToneTommy]

I'm just getting started with Calibre and news feeds - I'd like to get the local news from our local newspaper. Using the RSS method, the articles have a dark blue background, making them impossible to read. The print link should work fine, but I find that the extra code is inserted in the middle of the link, and I'm not sure how to do that. (The example on the Calibre Help site only covers how to add the extra code at the beginning of the url)


Here's the url's in question

http://www.sanluisobispo.com/2010/05/22/1150793/mixed-martial-arts-comes-to-poly.html

and

http://www.sanluisobispo.com/2010/05/22/v-print/1150793/mixed-martial-arts-comes-to-poly.html

You can see the "/v-print/ is inserted between the date and the article name.

Can anyone help or point me in the right direction?

Thanks!!!

[DoctorOhh]

Originally Posted by square4761

http://www.americanthinker.com/

I tried doing the RSS way and it only downloads a few articles but it gets the titles for all the articles. If you click on various articles on the webpage there is no password/username asked for on several that I tried. Any help would be appreciated.

Here you go.

@Kovid - New recipe - American Thinker.

[DoctorOhh]

Originally Posted by TouchToneTommy

http://www.sanluisobispo.com/2010/05/22/1150793/mixed-martial-arts-comes-to-poly.html

and

http://www.sanluisobispo.com/2010/05/22/v-print/1150793/mixed-martial-arts-comes-to-poly.html

You can see the "/v-print/ is inserted between the date and the article name.

Is there the option of using wildcards when subbing out for the print version?

Something like this

    def print_version(self, url):
        return url.replace('http://www.sanluisobispo.com/*/*/*/', 'http://www.sanluisobispo.com/*/*/*/v-print/')

That's my guess.

Good Luck

[gambarini]

InfoMotori
Italian Auto, Motor and Sport News.

[Starson17]

Originally Posted by dwanthny

Is there the option of using wildcards when subbing out for the print version?

I think the usual way to handle this type of situation is to use the split function and split on the slash character. That will give you a list, with each element in the list being text in the original URL that was separated by a slash. Then insert the "v-print" text into the list, then reassemble using slashes.
Like this:

    def print_version(self, url):
        parts = url.split('/')
        print_url = 'http://' + parts[2] + '/' + parts[3] + '/' + parts[4] + '/' + parts[5] + '/'  + parts[6] \
                + '/v-print/' + parts[7] + '/' + parts[8]
        return print_url

[DoctorOhh]

Originally Posted by Starson17

I think the usual way to handle this type of situation is to use the split function and split on the slash character.

Thanks for the pointer.

I am curious though, do wildcards work?

If they do what I wrote should return the print edition.