Smoothness From Fourier Coefficient Decay