Quote:
Originally Posted by kovidgoyal
What website is this? None of the builtin plugins use an API. And yes if you are using a specific website then you will need to implement policies specific to it in the plugin. No time.sleep() wont work since downloads are threaded. You will need to use the rate_limit() decorator from sources/search_engines.py this is how the builtin plugins implement rate limiting.
|
Would time.sleep(20) work if I add multiple seperate jobs to the metadata download queue? It would add a 20 second delay to each start of a metadata download batch right?