The Guardian, modified

[orcpac7]

Couldn't find the thread where Starson17 posted the original Fudzilla script so just tagging this on to a thread I found his comment on.
Fudzilla at some point changed the URL of their feed. It was a gentle introduction to the recipes for me when i wanted to change that. Ended up saving the code in a text file, modifying the code, delete the old recipe and import the new one from file.
The only line I changed was the feeds to point to "http://www.fudzilla.com/?format=feed'"

#!/usr/bin/env python

__license__ = 'GPL v3'
__copyright__ = '2010 Starson17'
'''
fudzilla.com
'''

import re
from calibre.web.feeds.news import BasicNewsRecipe

class Fudzilla(BasicNewsRecipe):
title = u'Fudzilla'
__author__ = 'Starson17'
language = 'en'

description = 'Tech news'
oldest_article = 7
remove_javascript = True
max_articles_per_feed = 100
no_stylesheets = True
use_embedded_content = False


remove_tags_before = dict(name='div', attrs={'class':['padding']})

remove_tags = [dict(name='td', attrs={'class':['left','right']}),
dict(name='div', attrs={'id':['toolbar','buttons']}),
dict(name='div', attrs={'class':['artbannersxtd','back_button']}),
dict(name='span', attrs={'class':['pathway']}),
dict(name='th', attrs={'class':['pagenav_next','pagenav_prev']}),
dict(name='table', attrs={'class':['headlines']}),
]

feeds = [
(u'Posts', u'http://www.fudzilla.com/?format=feed')
]

preprocess_regexps = [
(re.compile(r'<p class="MsoNormal"> Welcome.*</p> ', re.DOTALL|re.IGNORECASE), lambda match: '')
]

[NotTaken]

Made a few changes to the guardian recipe:

• Removed the adverts that appeared at the bottom of some articles - found that there were two html sections in the soup, with all the relevant stuff in the first.
• Removed some of the info under the headline. This includes: the author mugshot, "a version of this article appeared" spiel and the link to article history. I have put a comment by each of these in the remove_tags list to make it easy to re-enable if you choose.
• Removed the number next to the ratings stars (that appear in reviews) - you will probably want to remove this if you disable the images (just remove the relevant stuff in preprocess_html)

[dasym]

This works really well. Thanks for the updated recipe.

[mrjaded]

Thanks from me too!

I've made this little addition to my own version of the recipe which adds a nice graphic masthead for each of the titles. I always found that the text version was a bit ugly and was so big it got truncated on my Kindle...

    title = u'The Guardian & The Observer'
    if date.today().weekday() == 6:
        base_url = "http://www.guardian.co.uk/theobserver"
        cover_pic = 'Observer digital edition'
        masthead_url = 'http://static.guim.co.uk/sys-images/Guardian/Pix/site_furniture/2010/10/19/1287478087992/The-Observer-001.gif'
    else:
        base_url = "http://www.guardian.co.uk/theguardian"
        cover_pic = 'Guardian digital edition'
        masthead_url = 'http://static.guim.co.uk/static/f76b43f9dcfd761f0ecf7099a127b603b2922118/common/images/logos/the-guardian/titlepiece.gif'

[NotTaken]

Glad people are finding it useful. I made a few more changes:

• Hardcoded the encoding to utf-8 as I noticed a few artifacts when using auto detection
• Added mrjaded's masthead_url addition (see above)
• Removed embedded flash video/captions (possibly some use if you aren't using e-ink as provides link to video)

[paddyrm]

Originally Posted by ajnorman

2. There is a variable "ignore_sections" which skips sections you don't want to see (I have absolutely no interest in seeing the Sport section, for example).

I've had no luck with this: I've tried ignore_sections = ['Sport'] and many variations, eg sport, Sports, football etc, but the whole Sports section still arrives. Any suggestions?

Thanks

Paddy