Huffington post dload takes 70 mins - normal?

[thetonyclifton]

My Huffington Post download is taking 70 minutes and ends up at 7-8MB the rest of my downloads are closer to 1-2MB and take less than 20mins - Is there anything I can do about this - I need quick convenient downloads.

Thanks for any help/guidance.

I am using the standard Huffington Post news service built into cailbre.

[Starson17]

Originally Posted by thetonyclifton

My Huffington Post download is taking 70 minutes and ends up at 7-8MB the rest of my downloads are closer to 1-2MB and take less than 20mins - Is there anything I can do about this - I need quick convenient downloads.

Thanks for any help/guidance.

I am using the standard Huffington Post news service built into cailbre.

I looked at it. It's set for 100 articles per feed, a dozen feeds or so, and only 1.1 days of retention. You can try cutting down the number of feeds/articles. I'm not sure, but it may have to pull down 100 articles, then throw away 99. It's also possible they are detecting your scraping and throttling you. You can try throttling yourself with the number of connections or delay between requests. Sometimes that actually speeds things up. Or it may just be a slow site.