Yes, this is covered in the regex chapters in the Sigil User Guide.
These are page break marks. You kight want to keep them and add a space after each to prevent smushed words.
In Find and Replace, you want to enable Regex mode and use a wildcard specific to digits.
Simple way to do that is to use the string:
which should capture 1 or more digits in a row.