its simple to run the pdf through a free on line solution, like
https://www.ilovepdf.com/compress_pdf
then put it back into calibre library, exactly as you found it.
calibre will not then notice the change, and the onl ine compression is very fast and effective. i have done several large files, which shrank a lot, and I could not detect any difference on visual inspection.