NRC Handelsblad

[veezh]

This recipe will download the full epub version of NRC Handelsblad which is (temporarily?) available free without a login.

Thanks to Lars Jacob for his Taz Digiabo recipe, on which this is heavily based, and to Starson17, who posted a reference to it in the reusable code sticky.

#!/usr/bin/env  python
# -*- coding: utf-8 -*-
#Based on Lars Jacob's Taz Digiabo recipe

__license__   = 'GPL v3'
__copyright__ = '2010, veezh'

'''
www.nrc.nl
'''
import os, urllib2, zipfile
import datetime, time
from calibre.web.feeds.news import BasicNewsRecipe
from calibre.ptempfile import PersistentTemporaryFile


class NRCHandelsblad(BasicNewsRecipe):

    title = u'NRC Handelsblad'
    description = u'De EPUB-versie van NRC'
    language = 'nl'
    lang = 'nl-NL'

    __author__ = 'veezh'

    conversion_options = {
        'no_default_epub_cover' : True
    }

    def build_index(self):
        day = datetime.date.today()
        today = time.strftime("%Y%m%d")
        domain = "http://digitaleeditie.nrc.nl"

        url = domain + "/digitaleeditie/helekrant/epub/nrc_" + today + ".epub"
#        print url

        try:
            f = urllib2.urlopen(url)
        except urllib2.HTTPError:
            self.report_progress(0,_('Kan niet inloggen om editie te downloaden'))
            raise ValueError('Krant van vandaag nog niet beschikbaar')

        tmp = PersistentTemporaryFile(suffix='.epub')
        self.report_progress(0,_('downloading epub'))
        tmp.write(f.read())
        tmp.close()

        zfile = zipfile.ZipFile(tmp.name, 'r')
        self.report_progress(0,_('extracting epub'))

        zfile.extractall(self.output_dir)

        tmp.close()
        index = os.path.join(self.output_dir, 'content.opf')

        self.report_progress(1,_('epub downloaded and extracted'))

        return index

[Starson17]

Originally Posted by veezh

Thanks to Lars Jacob for his Taz Digiabo recipe, on which this is heavily based, and to Starson17, who posted a reference to it in the reusable code sticky.

And thanks to Kovid for telling us about Lars Jacob and his Taz Digiabo recipe. Without Kovid's pointer I don't think we'd have known it was possible to directly grab an EPUB with a recipe.

I surely didn't.

[Snaab]

Hi there,

The website of NRC Handelsblad has changed. Authentication is now required, but now you can download the digital edition even with a home subscription, so that's fair enough. I changed the script using the example from the New York Times:

#!/usr/bin/env  python2
# -*- coding: utf-8 -*-
#Based on veezh's original recipe and Kovid Goyal's New York Times recipe

__license__   = 'GPL v3'
__copyright__ = '2011, Snaab'

'''
www.nrc.nl
'''
import os, urllib2, zipfile
import time
from calibre.web.feeds.news import BasicNewsRecipe
from calibre.ptempfile import PersistentTemporaryFile


class NRCHandelsblad(BasicNewsRecipe):

    title = u'NRC Handelsblad'
    description = u'De ePaper-versie van NRC'
    language = 'nl'
    lang = 'nl-NL'
    needs_subscription = True

    __author__ = 'Snaab'

    conversion_options = {
        'no_default_epub_cover' : True
    }
    
    def get_browser(self):
        br = BasicNewsRecipe.get_browser()
        if self.username is not None and self.password is not None:
            br.open('http://login.nrc.nl/login')
            br.select_form(nr=0)
            br['username']   = self.username
            br['password'] = self.password
            br.submit()
        return br

    def build_index(self):
        
        today = time.strftime("%Y%m%d")
        
        domain = "http://digitaleeditie.nrc.nl"

        url = domain + "/digitaleeditie/helekrant/epub/nrc_" + today + ".epub"
        #print url

        try:
            br = self.get_browser()
            f = br.open(url)
        except:
            self.report_progress(0,_('Kan niet inloggen om editie te downloaden'))
            raise ValueError('Krant van vandaag nog niet beschikbaar')


        tmp = PersistentTemporaryFile(suffix='.epub')
        self.report_progress(0,_('downloading epub'))
        tmp.write(f.read())
        f.close()
        br.close()
        if zipfile.is_zipfile(tmp):
            try:
                zfile = zipfile.ZipFile(tmp.name, 'r')
                zfile.extractall(self.output_dir)
                self.report_progress(0,_('extracting epub'))
            except zipfile.BadZipfile:
                self.report_progress(0,_('BadZip error, continuing'))

        tmp.close()
        index = os.path.join(self.output_dir, 'metadata.opf')

        self.report_progress(1,_('epub downloaded and extracted'))

        return index

By the way, I added the exception handling for unzipping, because on Linux it threw an error during extraction although the ePub was extracted appropriately. Probably the archive is a little bit bad and windows doesn't care.

This way it works pretty well on my Linux machine (takes a bit long to run, although a walk to my mailbox takes longer), and thanks to an update a few months ago I now have my newspaper neatly in the "Periodics" section of my Sony E-reader.

Maybe someone can update this news feed, as the old one doesn't work anymore?

Cheers,

Snaab

[kovidgoyal]

Done .