I got mine from Wiki Commons. Just search the name of the character you need. eg...
https://commons.wikimedia.org/wiki/F...etter_Alef.svg
Some of them have duplicated characters like the above example, so it needs a bit of fiddling. Maybe you can search a better site.
But you don't even need to use svg. A png works just as well.
Just treat the svg like an image. Surround it in a
<span class="svg"></span> and use something like this in the css...
.svg {
display: inline;
height: 1em;
}