Interesting, and no, you are not thinking weird

. I used to had the same idea, and followed the following trail:
- FreeMind (development was long halted at version 0.9),
- FreePlane (much new functions and now to my opinion overloaded),
- SciPlot (now obsolete)
- Docear (successor of SciPlot and promising)
However, I wanted some quick storage around 2009 and start using calibre which much does what I need, save for the relations