I wanted to create cover_url for
mint e-paper but it should be take after javascript is loaded, idk how to ask recipe to load js and then search for the jpg.
def get_cover_url(self):
soup = self.index_to_soup(
'https://epaper.livemint.com/Home/ArticleView')
=lambda x: x and x.
endswith('01_mr.jpg')):
https://epsfs.hindustantimes.com/MIN...3b35_01_mr.jpg
the link that ends with 01_mr.jpg is the front page (not the top page with ads but actual front page) it can be found in the default page html itself, even though you don't navigate to it.
masthead_url = 'https://images.livemint.com/static/livemint-logo-v2.svg'