[step:Prove the Engel fixed vector lemma for nilpotent linear transformations]
[claim:Engel fixed vector lemma]
Let $V$ be a nonzero finite-dimensional [vector space](/page/Vector%20Space) over $F$, and let $\mathfrak l \subseteq \mathfrak{gl}(V)$ be a Lie subalgebra such that every $T \in \mathfrak l$ is nilpotent as an endomorphism of $V$. Then there exists $0 \neq v \in V$ such that $T(v)=0$ for every $T \in \mathfrak l$.
[/claim]
[proof]
We argue by induction on $d:=\dim_F \mathfrak l$. If $d=0$, then $\mathfrak l=0$, and every nonzero vector of $V$ has the required property.
Assume $d>0$ and that the result holds for all Lie algebras of nilpotent endomorphisms of dimension smaller than $d$. Choose a maximal proper Lie subalgebra $\mathfrak m \subsetneq \mathfrak l$. Such a subalgebra exists because $0$ is a proper Lie subalgebra when $d>0$ and $\mathfrak l$ is finite-dimensional. By the induction hypothesis applied to $\mathfrak m$, the subspace
\begin{align*}
W := \{v \in V : S(v)=0 \text{ for every } S \in \mathfrak m\}
\end{align*}
is nonzero.
We prove that $\mathfrak m$ is an ideal of codimension $1$ in $\mathfrak l$. Define its normalizer in $\mathfrak l$ by
\begin{align*}
N_{\mathfrak l}(\mathfrak m) := \{T \in \mathfrak l : [T,S] \in \mathfrak m \text{ for every } S \in \mathfrak m\}.
\end{align*}
It suffices to show $N_{\mathfrak l}(\mathfrak m) \neq \mathfrak m$, because maximality of $\mathfrak m$ then implies $N_{\mathfrak l}(\mathfrak m)=\mathfrak l$.
Let $Q:=\mathfrak l/\mathfrak m$ be the quotient vector space. For each $S \in \mathfrak m$, define the [linear map](/page/Linear%20Map)
\begin{align*}
\rho(S): Q &\to Q \\
T+\mathfrak m &\mapsto [S,T]+\mathfrak m.
\end{align*}
This is well-defined because $\mathfrak m$ is a Lie subalgebra: if $T-T' \in \mathfrak m$, then $[S,T-T'] \in \mathfrak m$. The assignment $S \mapsto \rho(S)$ is a Lie algebra homomorphism from $\mathfrak m$ to $\mathfrak{gl}(Q)$.
For each $S \in \mathfrak m$, the map $\rho(S)$ is nilpotent. Indeed, $S:V\to V$ is nilpotent by hypothesis. Let $L_S:\mathfrak{gl}(V)\to\mathfrak{gl}(V)$ and $R_S:\mathfrak{gl}(V)\to\mathfrak{gl}(V)$ be the left and right multiplication maps $L_S(A)=SA$ and $R_S(A)=AS$. If $S^q=0$, then $L_S^q=0$ and $R_S^q=0$, and $L_S$ commutes with $R_S$. Hence $L_S-R_S$ is nilpotent, since
\begin{align*}
(L_S-R_S)^{2q-1} = \sum_{j=0}^{2q-1} (-1)^j \binom{2q-1}{j} L_S^{2q-1-j}R_S^j =0;
\end{align*}
in every summand either $2q-1-j \geq q$ or $j \geq q$. The restriction of $L_S-R_S$ to $\mathfrak l$ is $\operatorname{ad}S:T\mapsto [S,T]$, and $\rho(S)$ is the induced map on the quotient $Q$. Therefore $\rho(S)$ is nilpotent.
If $Q$ were zero, then $\mathfrak m=\mathfrak l$, contrary to the choice of $\mathfrak m$; hence $Q\neq 0$. Since $\dim_F\mathfrak m<d$, the induction hypothesis applied to the Lie algebra $\rho(\mathfrak m)\subseteq\mathfrak{gl}(Q)$ gives a nonzero coset $T+\mathfrak m\in Q$ such that
\begin{align*}
\rho(S)(T+\mathfrak m)=0
\end{align*}
for every $S\in\mathfrak m$. This means $T\notin\mathfrak m$ and $[S,T]\in\mathfrak m$ for every $S\in\mathfrak m$. Since $[T,S]=-[S,T]$, we have $T\in N_{\mathfrak l}(\mathfrak m)\setminus\mathfrak m$. Thus $N_{\mathfrak l}(\mathfrak m)$ strictly contains $\mathfrak m$, so maximality gives $N_{\mathfrak l}(\mathfrak m)=\mathfrak l$. Therefore $\mathfrak m$ is an ideal of $\mathfrak l$.
The quotient Lie algebra $\mathfrak l/\mathfrak m$ has no nonzero proper Lie subalgebras, because the inverse image of any such subalgebra would be a Lie subalgebra strictly between $\mathfrak m$ and $\mathfrak l$. Since every one-dimensional subspace of a Lie algebra is a Lie subalgebra, it follows that $\dim_F(\mathfrak l/\mathfrak m)=1$. Choose $A\in\mathfrak l$ whose image spans $\mathfrak l/\mathfrak m$; then
\begin{align*}
\mathfrak l = \mathfrak m \oplus F A
\end{align*}
as vector spaces.
Because $\mathfrak m$ is an ideal, $W$ is stable under $A$. Indeed, if $v \in W$ and $S \in \mathfrak m$, then
\begin{align*}
S(A(v)) = A(S(v)) - [A,S](v) = 0 - 0 = 0,
\end{align*}
since $S(v)=0$ and $[A,S]\in\mathfrak m$. Thus $A(W)\subseteq W$.
The restriction $A|_W:W\to W$ is nilpotent because $A$ is nilpotent on $V$. Since $W\neq 0$, the kernel of $A|_W$ is nonzero. Choose $0\neq v\in W$ with $A(v)=0$. Then every element of $\mathfrak m$ kills $v$ by the definition of $W$, and $A$ kills $v$ by construction. Since $\mathfrak l=\mathfrak m\oplus F A$, every element of $\mathfrak l$ kills $v$.
[/proof]
[/step]