India Today Magazine update

[unkn0wn]

it stopped working.. they changed stuff in their website.

[unkn0wn]

remove tags update.. they keep coming up with new tags.

[unkn0wn]

cover url method update

[unkn0wn]

eenadu_ap recipe cover_url update

https://github.com/kovidgoyal/calibr...nadu_ap.recipe

    def get_cover_url(self):
        from datetime import date
        cover = 'https://img.kiosko.net/' + str(
            date.today().year
        ) + '/' + date.today().strftime('%m') + '/' + date.today(
        ).strftime('%d') + '/in/eenadu.750.jpg'
        br = BasicNewsRecipe.get_browser(self)
        try:
            br.open(cover)
        except:
            index = 'https://es.kiosko.net/in/np/eenadu.html'
            soup = self.index_to_soup(index)
            for image in soup.findAll('img', src=True):
                if image['src'].endswith('750.jpg'):
                    return 'https:' + image['src']
            self.log("\nCover unavailable")
            cover = None
        return cover

[unkn0wn]

India Today Magazine articles have long dashes between words which show up as —

adding encoding utf-8 didn't work. So I added..

    def preprocess_raw_html(self, raw_html, url):
        return raw_html.replace('—', '--')

Is there another way to do this?

maybe add the code to the recipe!

also this bold part

    extra_css = '''
        #sub-d {font-style:italic; color:#202020;}
        .story__byline {font-size:small; text-align:left;}
        .body_caption, .mos__alt, .caption, .caption-drupal-entity {font-size:small; text-align:center;}
        blockquote{color:#404040;}
    '''

[kovidgoyal]

If encoding utf-8 didnt work then they likely arent encoded in utf-8. So you will need the correct encoding. Common ones to try are cp1252 and latin1

[unkn0wn]

I tried encoding = 'cp1252'

this makes the long dash show up as � and makes a lot of text unreadable.

i think the replace solution is much better than figuring out encoding, the problem is only with em dash & they use a lot of them.

also tried latin1 .. doesn;t work

[kovidgoyal]

ok, fine by me.