The brackets need to be changed in order for those gaps to be fixed. If you do not care about the gaps, then you do not need to change them. Just file/shave here and there like you plan. Just hope you do it straight and symmetric on both sides. As long as you like it--go for it!
