Request: New Scientist recipe

[AprilHare]

Hello,
I'd very much like a working recipe for New Scientist magazine from the RSS feeds here. I tried applying the feeds directly in calibre for a simple recipe however I end up with LRF files with nothing in them. It's a major magazine and it'd make a great addition to the calibre recipe collection.

[kiklop74]

Here goes:

#!/usr/bin/env  python

__license__   = 'GPL v3'
__copyright__ = '2008, Darko Miletic <darko.miletic at gmail.com>'
'''
newscientist.com
'''

from calibre.web.feeds.news import BasicNewsRecipe

class Newscientist(BasicNewsRecipe):
    title                 = u'New Scientist - Online News'
    __author__            = 'Darko Miletic'
    description           = 'News from Science'
    oldest_article        = 7
    max_articles_per_feed = 100
    no_stylesheets        = True
    use_embedded_content  = False
    
    keep_only_tags = [
                        dict(name='div'  , attrs={'id':'pgtop'   })
                       ,dict(name='div'  , attrs={'id':'maincol' })
                     ]
    remove_tags = [
                     dict(name='div'  , attrs={'class':'hldBd' })
                    ,dict(name='div'  , attrs={'id':'compnl' })
                    ,dict(name='div'  , attrs={'id':'artIssueInfo' })
                  ]

    feeds          = [
                        (u'Latest Headlines' , u'http://feeds.newscientist.com/science-news'              )
                       ,(u'Magazine'         , u'http://www.newscientist.com/feed/magazine'               )                      
                       ,(u'Health'           , u'http://www.newscientist.com/feed/view?id=2&type=channel' )
                       ,(u'Life'             , u'http://www.newscientist.com/feed/view?id=3&type=channel' )
                       ,(u'Space'            , u'http://www.newscientist.com/feed/view?id=6&type=channel' )
                     ]

[AprilHare]

She works! (Is code male, female or neuter?) Thankyou!

[kovidgoyal]

Definitely female considering the amount of time I spend staring at her

[AprilHare]

Originally Posted by kovidgoyal

Definitely female considering the amount of time I spend staring at her

Your mistress may need attention: she prints "None" underneath every article link.
Sample attached.
Just don't mention this to your wife and everything will be OK

[kiklop74]

Originally Posted by AprilHare

Your mistress may need attention: she prints "None" underneath every article link.

Are you having problems with this script?

[kovidgoyal]

Originally Posted by AprilHare

Your mistress may need attention: she prints "None" underneath every article link.
Sample attached.
Just don't mention this to your wife and everything will be OK

She just needed a little massaging. Will be in next release. As for my wife, we have a totally open relationship when it comes to code

[AprilHare]

Originally Posted by kiklop74

Are you having problems with this script?

No the script seems to be working fine New Scientist Good!
I am thinking about modifying it to add more of the feeds (the topic guides would be too much). Will give it a go later on.

[Derry]

Thanks so much for the feed, much appreciated

[Ler0y Jenkins]

Can someone explain to me how to use this code? I'm new to the e-book world and have no idea what a "feed" is or any of the other stuff in this thread. Does this allow you to view New Scientist Magazine on your Sony E-Reader? Please help, I'm lost...

Edit: Never mind. I saw the "fetch news" tab at the top and New Scientist is listed as a perodical. I'm downloading it now and I assume I'll just have to upload it to my ereader and that should be it.

[AprilHare]

Originally Posted by Ler0y Jenkins

Can someone explain to me how to use this code? I'm new to the e-book world and have no idea what a "feed" is or any of the other stuff in this thread. Does this allow you to view New Scientist Magazine on your Sony E-Reader? Please help, I'm lost...

Edit: Never mind. I saw the "fetch news" tab at the top and New Scientist is listed as a perodical. I'm downloading it now and I assume I'll just have to upload it to my ereader and that should be it.

It doesn't let you read the magazine exactly: it lets you read the articles referenced in NewScientist.com RSS feeds (NewScientist.com corresponds to New Scientist magazines' online presence and shares content).
As Wikipedia puts it, "RSS is a family of Web feed formats used to publish frequently updated works—such as blog entries, news headlines, audio, and video—in a standardized format." In this case, featured New Scientist articles.

It is doubtful you would get full articles that NewScientist.com requires you to buy a subscription to view, however. They've got to give us encouragement to pay somehow!

[AprilHare]

Here is an improvement: a few more feeds added:

#!/usr/bin/env  python

__license__   = 'GPL v3'
__copyright__ = '2008, Darko Miletic <darko.miletic at gmail.com>, AprilHare'
'''
newscientist.com
'''

from calibre.web.feeds.news import BasicNewsRecipe

class Newscientist(BasicNewsRecipe):
    title                 = u'New Scientist - Online News'
    __author__            = 'Darko Miletic'
    description           = 'News from Science'
    oldest_article        = 7
    max_articles_per_feed = 100
    no_stylesheets        = True
    use_embedded_content  = False
    
    keep_only_tags = [
                        dict(name='div'  , attrs={'id':'pgtop'   })
                       ,dict(name='div'  , attrs={'id':'maincol' })
                     ]
    remove_tags = [
                     dict(name='div'  , attrs={'class':'hldBd' })
                    ,dict(name='div'  , attrs={'id':'compnl' })
                    ,dict(name='div'  , attrs={'id':'artIssueInfo' })
                  ]

    feeds          = [
                        (u'Latest Headlines' , u'http://feeds.newscientist.com/science-news'              )
                       ,(u'Magazine'         , u'http://www.newscientist.com/feed/magazine'               )                      
                       ,(u'Health'           , u'http://www.newscientist.com/feed/view?id=2&type=channel' )
                       ,(u'Life'             , u'http://www.newscientist.com/feed/view?id=3&type=channel' )
                       ,(u'Space'            , u'http://www.newscientist.com/feed/view?id=6&type=channel' )
                       ,(u'Physics and Mathematics'            , u'http://www.newscientist.com/feed/view?id=4&type=channel' )
                       ,(u'Environment'            , u'http://www.newscientist.com/feed/view?id=1&type=channel' )
                       ,(u'Science in Society'            , u'http://www.newscientist.com/feed/view?id=5&type=channel' )
                       ,(u'Tech'            , u'http://www.newscientist.com/feed/view?id=7&type=channel' )
                     ]