Contractivity of $\operatorname{EVI}_\lambda$ Wasserstein Gradient Flows