I understand.
Indeed, when using non-overlapping VLs there is no obvious point in attempting to preserving the context between VLs.
However
it would perhaps have been a nice feature to have while fixing newly added books. New books could be in the "Newly added" VL. By highlighting one and switching to All books you could quickly see what other books there are by the same author or in the same series. And what genres they are in and so on. Then edit the metadata for the new book, remove the tag "Newly added" and then switch back to Newly added for the next book.