[step:Find a nonzero vector killed by the whole Lie algebra]
We prove the following auxiliary statement.
[claim:Engel invariant-vector lemma]
Let $W$ be a nonzero finite-dimensional [vector space](/page/Vector%20Space) over $F$, and let $\mathfrak a \subseteq \mathfrak{gl}(W)$ be a finite-dimensional Lie subalgebra. Suppose every $u \in \mathfrak a$ is nilpotent as an endomorphism $u: W \to W$. Then there exists $0 \neq w \in W$ such that $u(w) = 0$ for every $u \in \mathfrak a$.
[/claim]
[proof]
We argue by induction on $d = \dim_F \mathfrak a$.
If $d = 0$, then every nonzero $w \in W$ is killed by all elements of $\mathfrak a$. If $d = 1$, choose a basis element $z \in \mathfrak a$ if $\mathfrak a \neq \{0\}$. Since $z: W \to W$ is nilpotent and $W \neq \{0\}$, the kernel $\ker z$ is nonzero; any $0 \neq w \in \ker z$ is killed by all elements of $\mathfrak a$.
Assume $d \geq 2$ and assume the lemma is known for Lie algebras of dimension smaller than $d$. Choose a maximal proper Lie subalgebra $\mathfrak h \subsetneq \mathfrak a$, which exists because $\mathfrak a$ is finite-dimensional and contains proper subalgebras.
We first show that $\mathfrak h$ is an ideal of codimension $1$ in $\mathfrak a$. For each $y \in \mathfrak h$, define the adjoint endomorphism
\begin{align*}
\operatorname{ad}_y: \mathfrak a &\to \mathfrak a, \\
z &\mapsto [y,z].
\end{align*}
Since $y: W \to W$ is nilpotent, choose $r \in \mathbb N$ such that $y^r = 0$. Define
\begin{align*}
L_y: \operatorname{End}_F(W) &\to \operatorname{End}_F(W), &
T &\mapsto y \circ T, \\
R_y: \operatorname{End}_F(W) &\to \operatorname{End}_F(W), &
T &\mapsto T \circ y.
\end{align*}
The endomorphisms $L_y$ and $R_y$ commute, and $\operatorname{ad}_y = L_y - R_y$ on $\operatorname{End}_F(W)$. For every $k \geq 2r - 1$ and every $T \in \operatorname{End}_F(W)$,
\begin{align*}
(\operatorname{ad}_y)^k(T)
=
\sum_{i=0}^{k} (-1)^i \binom{k}{i} y^{k-i} \circ T \circ y^i
=
0,
\end{align*}
because for each $i$ either $i \geq r$ or $k-i \geq r$. Hence $\operatorname{ad}_y$ is nilpotent on $\operatorname{End}_F(W)$, and its restriction to the invariant subspace $\mathfrak a$ is nilpotent.
Let $\mathfrak a/\mathfrak h$ denote the quotient vector space, and let $\rho_y: \mathfrak a/\mathfrak h \to \mathfrak a/\mathfrak h$ be the [linear map](/page/Linear%20Map) induced by $\operatorname{ad}_y$, whenever the expression is defined modulo $\mathfrak h$. To avoid assuming invariance, apply the induction hypothesis to the representation of $\mathfrak h$ on the quotient vector space $\mathfrak a/\mathfrak h$ given by the maps induced by $\operatorname{ad}_y$ after restricting to the normalizer construction below. Equivalently, define the normalizer
\begin{align*}
N_{\mathfrak a}(\mathfrak h)
=
\{z \in \mathfrak a : [z,\mathfrak h] \subseteq \mathfrak h\}.
\end{align*}
The preceding nilpotence of all $\operatorname{ad}_y$ and the induction hypothesis applied to the natural action of $\mathfrak h$ on $\mathfrak a/\mathfrak h$ give an element $z \in \mathfrak a \setminus \mathfrak h$ such that $[y,z] \in \mathfrak h$ for every $y \in \mathfrak h$. Thus $z \in N_{\mathfrak a}(\mathfrak h)$, so $N_{\mathfrak a}(\mathfrak h)$ properly contains $\mathfrak h$. By maximality of $\mathfrak h$, we get $N_{\mathfrak a}(\mathfrak h) = \mathfrak a$, which means $[\mathfrak a,\mathfrak h] \subseteq \mathfrak h$. Therefore $\mathfrak h$ is an ideal of $\mathfrak a$.
Since $\mathfrak h$ is a maximal proper Lie subalgebra and an ideal, the quotient $\mathfrak a/\mathfrak h$ has no nonzero proper Lie subalgebra. If $\dim_F(\mathfrak a/\mathfrak h) \geq 2$, then any one-dimensional subspace of $\mathfrak a/\mathfrak h$ is a proper Lie subalgebra, because the bracket of an element with itself is zero. This contradicts maximality. Hence $\dim_F(\mathfrak a/\mathfrak h) = 1$.
By the induction hypothesis applied to $\mathfrak h \subseteq \mathfrak{gl}(W)$, there exists a nonzero subspace
\begin{align*}
W_0
=
\{w \in W : y(w) = 0 \text{ for every } y \in \mathfrak h\}
\end{align*}
with $W_0 \neq \{0\}$. Choose $z \in \mathfrak a$ such that $\mathfrak a = \mathfrak h \oplus Fz$ as vector spaces. We show that $W_0$ is stable under $z$. If $w \in W_0$ and $y \in \mathfrak h$, then
\begin{align*}
y(z(w))
=
z(y(w)) + [y,z](w)
=
z(0) + 0
=
0,
\end{align*}
because $[y,z] \in \mathfrak h$ and every element of $\mathfrak h$ kills $w$. Therefore $z(w) \in W_0$.
The restriction $z|_{W_0}: W_0 \to W_0$ is nilpotent because $z: W \to W$ is nilpotent. Since $W_0 \neq \{0\}$, there exists $0 \neq w \in W_0$ with $z(w) = 0$. Every element $u \in \mathfrak a$ has the form $u = y + \lambda z$ for some $y \in \mathfrak h$ and $\lambda \in F$, so
\begin{align*}
u(w) = y(w) + \lambda z(w) = 0.
\end{align*}
This proves the lemma.
[/proof]
[/step]