indian express update

[unkn0wn]

reordered feeds and #'d some .. the output is already large.
remove_tags updated and some other stuff.
https://github.com/kovidgoyal/calibr...express.recipe

[unkn0wn]

Can we italicize unresolved links to differentiate between it and resolved links

I've tried something like this in postprocess_html.. it didn't work. (changes even resolved links too) Is there another way?

def postprocess_html(self, soup):
        for unresolved in soup.findAll('a', href=lambda x: x and x.startswith('http')):
            unresolved['id'] = 'unres-d'
extra_css = '#unres-d{font-style:italic;}

I think this should be done after calibre stitches together all those html files it fetched..

[kovidgoyal]

No, that processing is done after postprocess is run. You could do it my implementing postprocess_book in the recipe but that isnt so easy.

[unkn0wn]

Indian Express

extra_css
add blockquote{text-align:center; color:#404040;}

to remove_tags
add dict(name='div', attrs={'class': lambda x: x and 'related-widget' in x}),
and' ie-first-publish adboxtop adsizes' to classes part.

EENADU indian language recipe update.

remove https://github.com/kovidgoyal/calibr.../eenadu.recipe

and add attached files.. they are updated and separated as per different states(provinces).

[unkn0wn]

https://github.com/kovidgoyal/calibr...ivemint.recipe

        def preprocess_raw_html(self, raw, *a):
            if '<script>var wsjFlag=true;</script>' in raw:
                m = re.search(r'type="application/ld\+json">[^<]+?"@type": "NewsArticle"', raw)
                raw1 = raw[m.start():]
                raw1 = raw1.split('>', 1)[1].strip()
                data = json.JSONDecoder().raw_decode(raw1)[0]
                value = data['hasPart']['value']
                body = data['articleBody'] + '</p> <p>' + re.sub(r'([a-z]\.|[0-9]\.)([A-Z])', r'\1 <p> \2', value)
                body = '<div class="FirstEle"> <p>' +  body  + '</p> </div>'
                raw = re.sub(r'<div class="FirstEle">([^}]*)</div>', body, raw)
                return raw
            else:
                return raw

add this to the else: part (non saturday).. some wsj articles wont load.

and this to extra_css = .summary{font-style:italic; color:#404040;} of same part.
and resolve_internal_links = True

[unkn0wn]

https://github.com/kovidgoyal/calibr...express.recipe

remove lines 110-112 and replace with

        h1 = soup.find('h1')
        if h1:
            h2 = h1.findNext('h2')
            if h2:
                h2.name = 'p' 
                h2['id'] = 'sub-d'

and add to remove_tags

dict(name='div', attrs={'class': lambda x: x and 'related-widget' in x}),

and 'immigrationimg' to remove_tags classes

extra_css additions

em{font-style:italic; color:#808080;}
#sub-d{color:#202020; font-style:italic;}

[unkn0wn]

https://github.com/kovidgoyal/calibr...autilus.recipe

    def preprocess_html(self, soup):
        for img in soup.findAll('img', attrs={'data-src': True}):
            img['src'] = img['data-src'].split('?')[0]
        for figcaption in soup.findAll('figcaption'):
            figcaption['id']='fig-c'
        for ul in soup.findAll('ul', attrs={'class':
            ['breadcrumb', 'article-list_item-byline', 'channel-article-author', 'article-author']}):
            ul.name = 'span'
            for li in ul.findAll('li'):
                li.name = 'p'
        return soup

    extra_css = '''
        .article-list_item-byline{font-size:small;}
        blockquote{color:#404040; text-align:center;}
        #fig-c{font-size:small;}
        em{color:#202020;}
        .breadcrumb{color:gray; font-size:small;}
        .article-author{font-size:small;}
    '''

and add 'article-collection_box' to remove_tags classes

[kovidgoyal]

Done and I suggest you just attach the modified recipe files, easier for you and me.

[unkn0wn]

Okay.. i thought for small changes this would be easier.