It doesn't seem a calibre issue. I may be wrong but it seems a Kobo setting. Go to reading settings and see if there is a check mark in "Show Adobe page number" (or something like that, my Kobo is in Italian). If there is, disable it.
Edit: while I was writing @DNSB answered first