There's a way to do that, and I've done it, militarily, several times. There's a way to deliver that exact message, and not get in trouble doing it. The delivery is key, word choice is paramount, and it all works out. Just fine.
Once told a brand new Detachment Commander that he was the worst Commissioned Officer that I'd ever been forced to work with in my life - about one day into his command... Private meeting, me, that shiitbag, and my Warrant Officer. My Warrant kicked the fukc out my leg, under the table, when I let that one rip...
Took us about 10 months to get that motherfucker relieved...