[step:Prove that a unique Bayes rule is admissible by contradiction]Let $\delta_\pi$ be the unique Bayes rule under prior $\pi$ and loss $L$, meaning $\delta_\pi$ is the unique minimizer of the Bayes risk
\begin{align*}
R_\pi(\delta) = \int_\Theta R(\delta, \theta) \, \pi(\theta) \, d\theta,
\end{align*}
where $R(\delta, \theta) = \mathbb{E}_\theta[L(\delta(X), \theta)]$ is the frequentist risk.
Suppose for contradiction that $\delta_\pi$ is inadmissible. Then there exists a decision rule $\delta'$ that dominates $\delta_\pi$: $R(\delta', \theta) \leq R(\delta_\pi, \theta)$ for all $\theta \in \Theta$, with strict inequality for at least one $\theta_1 \in \Theta$.
Integrating against $\pi$:
\begin{align*}
R_\pi(\delta') = \int_\Theta R(\delta', \theta) \, \pi(\theta) \, d\theta \leq \int_\Theta R(\delta_\pi, \theta) \, \pi(\theta) \, d\theta = R_\pi(\delta_\pi).
\end{align*}
If $\pi(\theta_1) > 0$ (which holds on a set of positive $\pi$-measure near $\theta_1$ since $R(\delta', \cdot)$ is measurable and strictly below $R(\delta_\pi, \cdot)$ on a set containing $\theta_1$), the inequality is strict: $R_\pi(\delta') < R_\pi(\delta_\pi)$. But this contradicts $\delta_\pi$ being a Bayes rule (a minimizer of the Bayes risk).
If $\pi(\theta_1) = 0$, we need the following refinement. Since $R(\delta', \theta) \leq R(\delta_\pi, \theta)$ for all $\theta$ with equality $\pi$-a.e., we have $R_\pi(\delta') = R_\pi(\delta_\pi)$, so $\delta'$ is also a Bayes rule. But $\delta'$ dominates $\delta_\pi$ with $R(\delta', \theta_1) < R(\delta_\pi, \theta_1)$, so $\delta' \neq \delta_\pi$. This contradicts the uniqueness of the Bayes rule $\delta_\pi$.
In either case we reach a contradiction. Therefore $\delta_\pi$ is admissible.[/step]