Recipe fails to download some images due to slow loading of the images

[itssudipok]

Hi,

I have modified 'The Hindu' recipe already available to fetch news/articles from the Hindu for fetching news and articles from the Ananda Bazar Patrika, a bengali daily. The script works fine meaning the 'feeds' is okay, but it downloads some image place holders (a white image showing the newspaper name) instead of the real images, which take a bit of time to appear on the place holders in the webpage. As a result, with other images related to the articles, I am getting some annoying image place holders in the final epub version. Could anyone help me with this so that calibre could wait for a bit for appearing the images and then start fetching it from there?

Thanks in advance.
With Best Regards

[unkn0wn]

try adding this to the recipe and check.

def preprocess_html(self, soup):
        for img in soup.findAll('img', attrs={'data-src': True}):
            img['src'] = img['data-src']
        return soup

upload the recipe here. you'll most probably be the only bengali here using this recipe but might help others someday.

[itssudipok]

Originally Posted by unkn0wn

try adding this to the recipe and check.

def preprocess_html(self, soup):
        for img in soup.findAll('img', attrs={'data-src': True}):
            img['src'] = img['data-src']
        return soup

upload the recipe here. you'll most probably be the only bengali here using this recipe but might help others someday.

Thank you very much for your help. Yes, it works perfect for me.
Definitely I will upload it, actually I am trying to make the script clean. Once it is done, I will upload the recipe here.