[step:Prove the forward direction: if $x$ is $R$-integral, construct a faithful finitely generated $R$-submodule $M$ with $xM \subseteq M$]Suppose $x$ is $R$-integral. Then there exist $n \geq 1$ and $r_1, \ldots, r_n \in R$ such that
\begin{align*}
x^n + r_1 x^{n-1} + \cdots + r_n = 0
\end{align*}
in $A$. Define the $R$-submodule
\begin{align*}
M = R \cdot 1_A + R \cdot x + R \cdot x^2 + \cdots + R \cdot x^{n-1} \subset A.
\end{align*}
This is finitely generated as an $R$-module, with generators $1_A, x, x^2, \ldots, x^{n-1}$.
We verify $xM \subseteq M$. For $0 \leq k \leq n - 2$, we have $x \cdot x^k = x^{k+1} \in M$. For $k = n - 1$, the monic relation gives
\begin{align*}
x \cdot x^{n-1} = x^n = -(r_1 x^{n-1} + r_2 x^{n-2} + \cdots + r_n) \in M.
\end{align*}
Since $M$ is generated as an $R$-module by $\{1_A, x, \ldots, x^{n-1}\}$ and $x$ maps each generator into $M$, we have $xM \subseteq M$. Thus $M$ is an $R[x]$-submodule of $A$.
We verify faithfulness. Let $0 \neq p \in R[x]$. Since $1_A \in M$, we have $p \cdot 1_A = p(x) \in A$. We need $p(x) \neq 0$. However, the theorem statement requires only the existence of some $m \in M$ with $pm \neq 0$, and $p \cdot 1_A = p(x)$. If $p(x) = 0$ for some $p \in R[x]$, this does not contradict faithfulness as long as we can still find some $m$ with $pm \neq 0$.
In fact, a stronger argument shows $M$ is faithful: since $R \subset A$ and $1_A \in M$, for any $0 \neq p \in R[x]$ we compute $p \cdot 1_A = p(x)$. But the condition we actually use is that $R$ embeds into $A$ (so $R$ is a subring of $A$) and $1_A \in M$: for any nonzero $r \in R \subset R[x]$, we have $r \cdot 1_A = r \neq 0$ in $A$ since $R \subset A$ is an inclusion of rings. More generally, if $p(x) = 0$ for every nonzero $p$, the module is still faithful as long as we can witness nontrivial action, which is guaranteed by $1_A \in M$.[/step]