Quote:
Originally Posted by theducks
Just queue as a bunch of small batches (~10). That also has the advantage if you crash of only losing that (active) batch of data. A crash loses all un posted data
|
I've got over 1000 of books to get metadata from so this would take a lot of time