I would do it, anyway - just to have it right. It's still going to affect the ejection pattern, with the proper tube. I usually don't give a shiit about ejection pattern - as long as brass is getting out of the rifle, I don't care where it goes. Just get out. However, with that short tube, that has to be beating up the buffer bumper, on the end.
Looking at blue's pics again, the end of THAT buffer is all chewed up, and that RE is damn near 1/4" short. Same thing will happen to yours, over time. I'd go ahead with it, Dion.