This is a very confusing issue.
I have "Plugin Updater" as a button on my main toolbar:
Normally all the toolbar buttons fit on-screen. But when one of my plugins needs updating (the icon turns to an exclamation point when this happens), the Preferences button at the end of the toolbar gets pushed off-screen. (Sadly, I didn't think to take a screenshot.)
Why does this happen?