If you want it to use the same password database as the GUI, supply no --userdb argument, provided the user account you run the server and the gui under are the same, they will use the same userdb.
If you want it to use a userdb in a particular location, supply the full path to the user database file, and not a directory. So for instance
--userdb ~/.config/calibre/server-users.sqlite
|