To each their own. You asked if anyone saw problems. I mentioned what I thought were some. I would say you're limiting your ability to tweak your complex content layout by overzealously worrying about bloat. There's bloat, and then there's p tags.
Glad you figured out the load time issue. Thanks for reporting back on what the problem was.
Oh, and as one-half of the current "Mr. Sigil" ... you're welcome.