The list is populated by those 'Known'
I f you have moved, detached the drive, or just deleted, You purge the entry using the Remove option. This only removes the linkage entry (was created with Create/Switch). If you really wan the Library gone, follow the advice displayed