The throttle seems to have done the trick. I'm getting a good sampling of articles in each section (though the job details do show a number of items as not being downloaded). Thanks for your help with this.
I think I'll also try deleting the get_article_url function from a fresh recipe and see which produces a better product.
|