If you do decide to ditch your publisher, I'd
strongly urge you to retain the services of a professional copy editor. That, above all else, is the service that's most valuable to the independent author. Perhaps 5% of authors can actually write well enough to be published directly without the services of an editor. The problem is that 95% of authors think that they are a member of that 5%

.