When/how often to schedule downloads?

[guspasho]

Recipes don't include this information. I don't know what sites are necessarily updated when a new edition is released, or daily, weekly, or monthly. I end up with a lot of copies with the same information because I can't figure this out. Shouldn't the recipe include appropriate times to schedule fetching, like the day a new edition is released, and help avoid fetching the same information twice?

Since it doesn't though, how do I manage this for the publications I download? I download Rolling Stone, The Atlantic, Harper's, The Economist, The New Yorker, Mother Jones, and New Scientist.

[kovidgoyal]

The economist description tells you it should be downloaded every friday morning. For the others, experiment, I know from personal experience that the atlantic has no fixed schedule, it's usually safe to download once every 35 days or so.