not sure what your issue is
A VL does not remove books, It HIDES the ones that does not conform to the filter.
If you disable the filter (or switch to 'All Books'), you see the entire library.
One of the advantages of a VL is the Search/or Tag browser only operate on the active VL