My two cents --
I was lucky enough to have driven or ride shotgun in some really fast cars. Now I break down cars into 3 categories -- fast, decently quick, and slow. For me both 328 and 335 are in the "decently quick" category. So I could do without a N54 in my E91.
Aim higher, if you really wanna go fast.