[step:Realize the process in $L^2$ and confirm the causal series converges there]Let $H := L^2(\Omega, \mathcal{F}, \mathbb{P}; \mathbb{R})$, the space of square-integrable real random variables, equipped with the inner product
\begin{align*}
(\cdot, \cdot)_H : H \times H &\to \mathbb{R}, \\
(X, Y)_H &\mapsto \mathbb{E}[XY],
\end{align*}
and norm $\|X\|_H = (\mathbb{E}[X^2])^{1/2}$. Since $H$ is complete (the [Completeness of $L^p$ Spaces](/theorems/892), the case $p = 2$), it is a Hilbert space. The white-noise hypothesis $\mathbb{E}[Z_s Z_t] = \sigma^2 \mathbb{1}_{\{s = t\}}$ states precisely that
\begin{align*}
(Z_s, Z_t)_H = \sigma^2\, \mathbb{1}_{\{s = t\}}, \qquad s, t \in \mathbb{Z},
\end{align*}
so each $Z_t \in H$ with $\|Z_t\|_H = \sigma$, and distinct innovations are orthogonal.
For $N \in \mathbb{N}$ define the partial sum $S_N := \sum_{j=0}^{N} \psi_j Z_{t-j} \in H$. For $M < N$, the orthogonality relation gives
\begin{align*}
\|S_N - S_M\|_H^2 = \Big\| \sum_{j=M+1}^{N} \psi_j Z_{t-j} \Big\|_H^2 = \sum_{j=M+1}^{N} \sum_{k=M+1}^{N} \psi_j \psi_k (Z_{t-j}, Z_{t-k})_H = \sigma^2 \sum_{j=M+1}^{N} \psi_j^2.
\end{align*}
Because $\sum_{j=0}^{\infty} |\psi_j| < \infty$ we have $\psi_j \to 0$, so there is $J$ with $|\psi_j| \le 1$, hence $\psi_j^2 \le |\psi_j|$, for all $j \ge J$; therefore $\sum_{j=0}^{\infty} \psi_j^2 < \infty$. The tail $\sigma^2 \sum_{j=M+1}^{N} \psi_j^2$ thus tends to $0$ as $M, N \to \infty$, so $(S_N)$ is Cauchy in $H$ and converges there. This is the asserted $L^2$-convergence, and it identifies $Y_t = \sum_{j=0}^{\infty} \psi_j Z_{t-j}$ as a well-defined element of $H$ with finite variance.[/step]