New recipe for National Geographic Magazine

[terminalveracity]

This feed contains the main articles from the print magazine. Some of the miscellaneous topics (Your Shot, Wallpaper...) don't parse properly and are removed.

Spoiler:

import re
from calibre.web.feeds.recipes import BasicNewsRecipe

class NatGeoMag(BasicNewsRecipe):
    title                  = 'National Geographic Mag'
    __author__             = 'Terminal Veracity'
    description            = 'The National Geographic Magazine'
    publisher              = 'National Geographic'
    oldest_article         = 31
    max_articles_per_feed  = 50
    category               = 'geography, magazine'
    language               = 'en_US'
    publication_type       = 'magazine'
    cover_url              = 'http://www.yourlogoresources.com/wp-content/uploads/2011/09/national-geographic-logo.jpg'
    use_embedded_content   = False
    no_stylesheets         = True
    remove_javascript      = True
    recursions             = 1
    remove_empty_feeds     = True
    feeds                  = [('National Geographic Magazine', 'http://feeds.nationalgeographic.com/ng/NGM/NGM_Magazine')]
    remove_tags            = [dict(name='div', attrs={'class':['nextpage_continue', 'subscribe']})]
    keep_only_tags         = [dict(attrs={'class':'main_3narrow'})]
    extra_css              = """
                                h1 {font-size: large; font-weight: bold; margin: .5em 0; }
                                h2 {font-size: large; font-weight: bold; margin: .5em 0; }
                                h3 {font-size: medium; font-weight: bold; margin: 0 0; }
                                .article_credits_author {font-size: small; font-style: italic; }
                                .article_credits_photographer {font-size: small; font-style: italic; display: inline }
                             """

    def parse_feeds(self):
        feeds = BasicNewsRecipe.parse_feeds(self)
        for feed in feeds:
            for article in feed.articles[:]:
                if 'Flashback' in article.title:
                    feed.articles.remove(article)
                elif 'Desktop Wallpaper' in article.title:
                    feed.articles.remove(article)
                elif 'Visions of Earth' in article.title:
                    feed.articles.remove(article)
                elif 'Your Shot' in article.title:
                    feed.articles.remove(article)
                elif 'MyShot' in article.title:
                    feed.articles.remove(article)
                elif 'Field Test' in article.title:
                    feed.articles.remove(article)
        return feeds

Note:
The other National Geographic recipes make use of the news feed: http://feeds.nationalgeographic.com/ng/News/News_Main

This recipe uses the magazine feed: http://feeds.nationalgeographic.com/ng/NGM/NGM_Magazine

[Steven630]

Thank you. I was looking for a recipe for the magazine.

[Steven630]

This recipe seems to catch past articles as well. I just tried and one article was from 2005. Wouldn't it be better to use to official TOC for each month?

http://ngm.nationalgeographic.com/20...le-of-contents

[terminalveracity]

Originally Posted by Steven630

This recipe seems to catch past articles as well. I just tried and one article was from 2005.

It seems to be working properly for me and should only fetch articles from the last 31 days. Are you using the code I provided here? (The latest version of Calibre has it built in too as "National Geographic Mag".)

Originally Posted by Steven630

Wouldn't it be better to use to official TOC for each month?
http://ngm.nationalgeographic.com/20...le-of-contents

While I suppose it's theoretically possible to scrape that page for each article, it's a lot easier to use RSS. The RSS feed contains the bulk of the text from the print version. I've intentionally removed the image galleries (Your Shot, Flashback...) as they're too complex and aren't going to look good on a little e-ink device anyhow.

[Steven630]

Yes, I was using the recipe you provided. It worked fine except that one of the articles fetched was from 2005. Perhaps, it was the problem with rss, not the recipe.

[xfiles]

I have a Google Chrome browser extension for National Geographic Magazine (link Barry Welch autor), mobile version.

Is it possible to make a recipe based on this extension? At least use the feed. I think that this feed contains more content than the previous recipes.

[terminalveracity]

Originally Posted by xfiles

I have a Google Chrome browser extension for National Geographic Magazine (link Barry Welch autor), mobile version.

Is it possible to make a recipe based on this extension? At least use the feed. I think that this feed contains more content than the previous recipes.

That extension is a fraud. It's nothing more than a frame linking to the NatGeo mobile site with ads bolted on. Bookmark > Extension.

As for content, the 2 existing recipes are far superior. The NatGeo mobile site only has a small subset of articles from the main news feed. The recipe named "National Geographic" uses the full news feed (shorter articles, more frequent new content) and "National Geographic Mag" uses the magazine feed (longer articles, less frequent new content).