[step:Establish the terminal-function identity by induction]For each integer $n\geq 0$, let $P(n)$ denote the following assertion: for all sets $A_0,\dots,A_{n-1}\in\mathcal E$ when $n\geq 1$, and for every bounded $\mathcal E$-measurable function $g:E\to\mathbb R$,
\begin{align*}
\mathbb E\left[\left(\prod_{j=0}^{n-1}\mathbb 1_{A_j}(X_j)\right)g(X_n)\right]
=
\int_{A_0}\mu(dx_0)\int_{A_1}K(x_0,dx_1)\cdots\int_{A_{n-1}}K(x_{n-2},dx_{n-1})\int_E g(x_n)\,K(x_{n-1},dx_n),
\end{align*}
with the convention that, when $n=0$, the empty product on the left is $1$ and the right-hand side is $\int_E g(x_0)\,d\mu(x_0)$.
For $n=0$, since $\mathbb P\circ X_0^{-1}=\mu$, the change-of-variables formula for pushforward measures gives
\begin{align*}
\mathbb E[g(X_0)]
=
\int_E g(x_0)\,d\mu(x_0).
\end{align*}
Thus $P(0)$ holds.
Assume $P(n)$ holds for some $n\geq 0$. Let $A_0,\dots,A_n\in\mathcal E$ and let $g:E\to\mathbb R$ be bounded and $\mathcal E$-measurable. Define the bounded $\mathcal F_n$-measurable [random variable](/page/Random%20Variable)
\begin{align*}
Y_n:\Omega&\to\mathbb R
\end{align*}
\begin{align*}
\omega&\mapsto \prod_{j=0}^{n}\mathbb 1_{A_j}(X_j(\omega)).
\end{align*}
The measurability follows because the process is adapted, so $X_j$ is $\mathcal F_j$-measurable and hence $\mathcal F_n$-measurable for every $0\leq j\leq n$.
By the pull-out property and the [tower property of conditional expectation](/theorems/1150),
\begin{align*}
\mathbb E[Y_n g(X_{n+1})]
=
\mathbb E\left[Y_n\,\mathbb E[g(X_{n+1})\mid\mathcal F_n]\right].
\end{align*}
The assumed one-step kernel identity applies to $g$, since $g$ is bounded and $\mathcal E$-measurable. Hence
\begin{align*}
\mathbb E[Y_n g(X_{n+1})]
=
\mathbb E\left[Y_n\int_E g(x_{n+1})\,K(X_n,dx_{n+1})\right].
\end{align*}
Define the bounded $\mathcal E$-measurable function
\begin{align*}
h:E&\to\mathbb R
\end{align*}
\begin{align*}
x&\mapsto \mathbb 1_{A_n}(x)\int_E g(x_{n+1})\,K(x,dx_{n+1}).
\end{align*}
Define the finite constant $\|g\|_\infty:=\sup_{z\in E}|g(z)|$. The function $x\mapsto \int_E g(x_{n+1})\,K(x,dx_{n+1})$ is $\mathcal E$-measurable by the defining measurability property of a transition kernel, and its absolute value is bounded by $\|g\|_\infty$. Therefore $h$ is bounded and $\mathcal E$-measurable.
Using the definition of $h$, we rewrite the last expectation as
\begin{align*}
\mathbb E[Y_n g(X_{n+1})]
=
\mathbb E\left[\left(\prod_{j=0}^{n-1}\mathbb 1_{A_j}(X_j)\right)h(X_n)\right].
\end{align*}
If $n=0$, applying $P(0)$ to the terminal function $h$ gives
\begin{align*}
\mathbb E[Y_0 g(X_1)]
=
\int_E h(x_0)\,d\mu(x_0).
\end{align*}
Substituting the definition of $h$ and restricting the $x_0$-integration to $A_0$ because of the factor $\mathbb 1_{A_0}(x_0)$ gives
\begin{align*}
\mathbb E[Y_0 g(X_1)]
=
\int_{A_0}\mu(dx_0)\int_E g(x_1)\,K(x_0,dx_1).
\end{align*}
This is $P(1)$.
If $n\geq 1$, applying the induction hypothesis $P(n)$ to the terminal function $h$ gives
\begin{align*}
\mathbb E[Y_n g(X_{n+1})]
=
\int_{A_0}\mu(dx_0)\int_{A_1}K(x_0,dx_1)\cdots\int_{A_{n-1}}K(x_{n-2},dx_{n-1})\int_E h(x_n)\,K(x_{n-1},dx_n).
\end{align*}
Substituting the definition of $h$ and restricting the final $x_n$-integration to $A_n$ because of the factor $\mathbb 1_{A_n}(x_n)$, we obtain
\begin{align*}
\mathbb E[Y_n g(X_{n+1})]
=
\int_{A_0}\mu(dx_0)\int_{A_1}K(x_0,dx_1)\cdots\int_{A_n}K(x_{n-1},dx_n)\int_E g(x_{n+1})\,K(x_n,dx_{n+1}).
\end{align*}
Thus $P(n+1)$ holds. By induction, $P(n)$ holds for every $n\geq 0$.[/step]