I was silly. I shouldn't have used "test". Better is "ifempty" as it avoids passing the same parameter twice, making things clearer and having better performance.
Code:
{series:'ifempty($, field('author_sort'))'}/{series_index:0>2s|| - }{title} - {authors}