Problem solved. I had to set url files to open with "Internet Browser". A variety of shortcuts that I made to actual websites, other apps etc... all then automatically recognized their app and the icon changed.
Hopefully this will help someone else in the future who might have the same problem.
Whether its even a useful thing to do is another question... It'll be more useful if i can figure out how to get it pinned to the taskbar.