[guided]Assume that $C$ is convex. To prove that $\iota_C$ is convex, we must verify the defining inequality for arbitrary $x,y\in V$ and arbitrary $t\in[0,1]$:
\begin{align*}
\iota_C((1-t)x+ty)\le (1-t)\iota_C(x)+t\iota_C(y).
\end{align*}
The point of using the extended-valued indicator is that most cases are automatic. The value of $\iota_C$ is always either $0$ or $+\infty$. We use the standard extended-real arithmetic convention: $a(+\infty)=+\infty$ for $a>0$, $0(+\infty)=0$, and adding $+\infty$ to any extended-real value gives $+\infty$.
If
\begin{align*}
(1-t)\iota_C(x)+t\iota_C(y)=+\infty,
\end{align*}
then the desired inequality is immediate, because the left-hand side is either $0$ or $+\infty$, and both are at most $+\infty$ in the extended order.
So suppose instead that
\begin{align*}
(1-t)\iota_C(x)+t\iota_C(y)<+\infty.
\end{align*}
Since both summands are nonnegative, neither summand can be $+\infty$. Thus $(1-t)\iota_C(x)<+\infty$ and $t\iota_C(y)<+\infty$. The first condition means that either $1-t=0$, so $t=1$, or else $\iota_C(x)=0$, so $x\in C$. Similarly, the second condition means that either $t=0$ or $y\in C$.
Now separate the interior and endpoint cases. If $0<t<1$, then neither coefficient is zero, so the preceding paragraph gives $x\in C$ and $y\in C$. Since $C$ is convex, the convex combination $(1-t)x+ty$ belongs to $C$. Therefore
\begin{align*}
\iota_C((1-t)x+ty)=0.
\end{align*}
Also $\iota_C(x)=0$ and $\iota_C(y)=0$, so
\begin{align*}
(1-t)\iota_C(x)+t\iota_C(y)=0.
\end{align*}
Hence the required inequality holds.
If $t=0$, then the combination is $x$. The finite right-hand side condition forces $x\in C$, so $\iota_C(x)=0$ and the inequality holds with both sides equal to $0$. If $t=1$, then the combination is $y$. The finite right-hand side condition forces $y\in C$, so again both sides are equal to $0$. Therefore the extended-valued convexity inequality holds in every case, and $\iota_C$ is convex.[/guided]