swapping barrel and caliber accuracy

[wideopen231]

 Stupid question ,especially   since I think I know answer.  Can you swap barrle while using same upper with a mounted scope and be  fairly close on accuracy.Mean sayin 10 clicks up or down and same right to left.  Just wondering since there are so damn many options caliber wise. Like any good gun nut I want them all. Real cost comes in with scopes.

[98Z5V]

Should be okay...  

[sketch]

same installation as the first than you should be good...ish

Edited July 15, 2019 by sketch
shits of course..