Well technically, it's not an "empty" SIGIL WINDOW. It's a template epub (with no content) that hasn't been saved yet. It contains an html file, an ncx file and an opf file that are ready to be edited.
If it bugs you, you could launch Sigil by clicking an existing epub (like you mentioned), or you could forget about it until you're done using Sigil and then close all windows.