[guided]The square identity is not only an optimality identity; it also controls the Riccati solution itself. Fix $t_0 \in (\tau,T]$ and $z\in\mathbb{R}^n$. Let $x_P: [t_0,T]\to\mathbb{R}^n$ be the unique absolutely continuous solution of
\begin{align*}
x_P'(t) = \left(A - BR^{-1}B^\top P(t)\right)x_P(t), \qquad x_P(t_0)=z.
\end{align*}
Define $u_P: (t_0,T)\to\mathbb{R}^m$ by
\begin{align*}
u_P(t) := -R^{-1}B^\top P(t)x_P(t).
\end{align*}
Because $P$ and $x_P$ are continuous on the compact interval $[t_0,T]$, the control $u_P$ is continuous and hence belongs to $L^2((t_0,T);\mathbb{R}^m)$. Substituting this pair into the square identity makes the square term vanish, so
\begin{align*}
z^\top P(t_0)z = x_P(T)^\top Sx_P(T) + \int_{t_0}^\top x_P(t)^\top Qx_P(t)\,d\mathcal{L}^1(t).
\end{align*}
Since $S\geq 0$ and $Q\geq 0$, the right-hand side is non-negative. Therefore $z^\top P(t_0)z\geq 0$ for every $z\in\mathbb{R}^n$, which proves $P(t_0)\geq 0$.
To prevent blow-up, use the zero control. Define
\begin{align*}
u_0: (t_0,T)\to\mathbb{R}^m.
\end{align*}
Set $u_0(t)=0$ for $\mathcal{L}^1$-almost every $t\in(t_0,T)$. For $r\in\mathbb R$, define the matrix exponential $e^{Ar}:=\sum_{k=0}^{\infty}A^k r^k/k!$. Let $x_{\mathrm{zero},z}:[t_0,T]\to\mathbb{R}^n$ be given by
\begin{align*}
x_{\mathrm{zero},z}(t):=e^{A(t-t_0)}z.
\end{align*}
The square term in the identity is non-negative because $R>0$, so
\begin{align*}
z^\top P(t_0)z \leq (x_{\mathrm{zero},z}(T))^\top Sx_{\mathrm{zero},z}(T) + \int_{t_0}^\top (x_{\mathrm{zero},z}(t))^\top Qx_{\mathrm{zero},z}(t)\,d\mathcal{L}^1(t).
\end{align*}
Here $|\cdot|$ denotes the Euclidean norm on $\mathbb{R}^n$, and $\|\cdot\|_{\mathrm{op}}$ denotes the operator norm induced by the Euclidean norm. Define
\begin{align*}
C_T := \sup_{0 \leq r \leq T} \|e^{Ar}\|_{\mathrm{op}}^2\left(\|S\|_{\mathrm{op}} + T\|Q\|_{\mathrm{op}}\right).
\end{align*}
The supremum is finite because $r\mapsto e^{Ar}$ is continuous on the compact interval $[0,T]$. The preceding estimate gives
\begin{align*}
0 \leq z^\top P(t_0)z \leq C_T |z|^2.
\end{align*}
Since $P(t_0)$ is symmetric and non-negative, this implies $\|P(t_0)\|_{\mathrm{op}}\leq C_T$.
Now we turn the bound into extension. Suppose $\tau>0$. Define the compact set
\begin{align*}
K_T:=\{Y\in\operatorname{Sym}_n(\mathbb{R}):\|Y\|_{\mathrm{op}}\le C_T\}.
\end{align*}
The estimate gives $P((\tau,T])\subset K_T$. Because $F$ is continuous, it is bounded on $K_T$; define
\begin{align*}
D_T:=\sup_{Y\in K_T}\|F(Y)\|_{\mathrm{op}}<\infty.
\end{align*}
For any $s,t\in(\tau,T]$, the integral form of the differential equation gives
\begin{align*}
\|P(t)-P(s)\|_{\mathrm{op}}\le D_T|t-s|.
\end{align*}
Thus $P(t)$ is Cauchy as $t\downarrow\tau$, so there is $P_\tau\in K_T$ with $P(t)\to P_\tau$. Define $P(\tau):=P_\tau$ to extend the old solution continuously to the endpoint. The integral equation on $(\tau,T]$ is
\begin{align*}
P(t)=P(s)+\int_s^t F(P(r))\,d\mathcal L^1(r)
\end{align*}
for $\tau<s<t\leq T$. Letting $s\downarrow\tau$ is justified as follows: $P(s)\to P_\tau$, and the integrands $r\mapsto F(P(r))\mathbb{1}_{(s,t)}(r)$ converge pointwise to $r\mapsto F(P(r))\mathbb{1}_{(\tau,t)}(r)$ while being dominated by the integrable constant function $D_T$ on $(\tau,t)$. By the [Dominated Convergence Theorem](/theorems/4), the integrals converge. Hence
\begin{align*}
P(t)=P_\tau+\int_\tau^t F(P(r))\,d\mathcal L^1(r)
\end{align*}
for every $t\in[\tau,T]$. Since $F$ is locally Lipschitz on the whole finite-dimensional space, the [Picard-Lindelöf Theorem](/theorems/69) applied at the initial value $P_\tau$ gives a local solution through time $\tau$. On the part of its interval lying to the right of $\tau$, uniqueness identifies that local solution with the continuous extension just constructed. Therefore the local solution glues to the old one and extends it to times strictly smaller than $\tau$, contradicting maximality of $(\tau,T]$. Hence $\tau=0$, and the solution extends uniquely to $P\in C^1([0,T];\operatorname{Sym}_n(\mathbb{R}))$ with $P(t)\geq 0$ for all $t\in[0,T]$.[/guided]