[guided]The dual Slater case should not be reduced to the first part by pretending that the free variable $y\in F$ is constrained by the cone $K^*$. Instead we repeat the separation argument directly on the dual value function. Define
\begin{align*}
\psi:E\to\mathbb{R}\cup\{-\infty,+\infty\}
\end{align*}
by
\begin{align*}
\psi(u):=\sup\{(b,y)_F : y\in F,\ c+u-A^*y\in K^*\}.
\end{align*}
The original dual value is $\psi(0)=d^*$. The Slater point gives an actual neighbourhood of feasible perturbations: since $s_0=c-A^*y_0\in\operatorname{int}K^*$, there is $\varepsilon>0$ such that $s_0+r\in K^*$ whenever $r\in E$ and $|r|<\varepsilon$. Thus $y_0$ is feasible for $\psi(u)$ for every $u\in E$ with $|u|<\varepsilon$, so every sufficiently small $u$ lies in $\operatorname{dom}\psi$.
We must also rule out the possibility that $\psi(u)=+\infty$ near $0$. Fix $u\in E$ with $|u|<\varepsilon$, and suppose $y\in F$ is feasible for $\psi(u)$. Define
\begin{align*}
s:=c+u-A^*y\in K^*.
\end{align*}
Because $s_0-u\in K^*$ and $K^*$ is convex, the average multiplier $\bar y:=(y+y_0)/2$ satisfies
\begin{align*}
c-A^*\bar y=\frac{1}{2}s+\frac{1}{2}(s_0-u)\in K^*.
\end{align*}
Thus $\bar y$ is feasible for the original unperturbed dual problem. Since $d^*\in\mathbb{R}$ is the finite supremum of the original dual objective, we have $(b,\bar y)_F\leq d^*$. Expanding the average gives
\begin{align*}
(b,y)_F\leq 2d^*-(b,y_0)_F.
\end{align*}
This bound is independent of the feasible $y$, so $\psi(u)\leq 2d^*-(b,y_0)_F$ for every $|u|<\varepsilon$. Therefore $\psi$ is finite-valued on a neighbourhood of $0$. Since $\psi$ is concave, $-\psi$ is a proper convex function finite near $0$, and [Convex Functions Are Locally Lipschitz](/theorems/3086) gives upper semicontinuity of $\psi$ at $0$.
Now form the hypograph
\begin{align*}
H:=\{(u,t)\in E\times\mathbb{R}:\text{ there exists }y\in F\text{ with }c+u-A^*y\in K^*\text{ and }(b,y)_F\geq t\}.
\end{align*}
This set is convex because $K^*$ is convex and the constraint and objective are affine in $(u,y,t)$. Let $D:=\overline{H}$. Since $d^*=\psi(0)$, the point $(0,d^*)$ lies in $D$, even if the dual supremum is not attained. No point $(0,\alpha)$ with $\alpha>d^*$ lies in $D$: if such a point lay in $D$, then there would be a sequence $(u_k,t_k)\in H$ with $u_k\to0$ and $t_k\to\alpha$. The Slater condition and the finite value $d^*\in\mathbb{R}$ proved above that $\psi$ is finite on a neighbourhood of $0$. Applying [Convex Functions Are Locally Lipschitz](/theorems/3086) to the convex function $-\psi$ gives upper semicontinuity of $\psi$ at $0$. Since $t_k\leq\psi(u_k)$, passing to the limit gives $\alpha\leq\psi(0)=d^*$, contradicting $\alpha>d^*$. Therefore $(0,d^*)$ is a boundary point of $D$.
Apply the [Supporting Hyperplane Theorem](/theorems/2551) for finite-dimensional closed convex sets to $D$ at this boundary point. We obtain $z\in E$ and $\mu\in\mathbb{R}$, not both zero, such that
\begin{align*}
(z,u)_E+\mu t\leq \mu d^*
\end{align*}
for every $(u,t)\in D$. The hypograph is downward closed in the $t$-direction, so replacing $t$ by $t-\rho$ with $\rho\geq0$ forces $\mu\geq0$. If $\mu=0$, then the inequality says $(z,u)_E\leq0$ on a neighbourhood of $0$ in $E$. Testing both $su$ and $-su$ for small $s>0$ gives $(z,u)_E=0$ for every $u\in E$, so $z=0$, contradicting that the normal is nonzero. Hence $\mu>0$.
Normalise by defining
\begin{align*}
w:=\frac{z}{\mu}\in E.
\end{align*}
Then
\begin{align*}
(w,u)_E+t\leq d^*
\end{align*}
for every $(u,t)\in H$. To extract a primal point, choose arbitrary $y\in F$ and $s\in K^*$, and set $u:=s-c+A^*y$ and $t:=(b,y)_F$. This pair lies in $H$, so
\begin{align*}
(w,s-c+A^*y)_E+(b,y)_F\leq d^*.
\end{align*}
Using $(w,A^*y)_E=(Aw,y)_F$, this becomes
\begin{align*}
(w,s)_E-(w,c)_E+(Aw+b,y)_F\leq d^*.
\end{align*}
Since $y\in F$ is unrestricted, the linear coefficient $Aw+b$ must be zero. Hence $Aw+b=0$.
Define $x^*:=-w$. The sign comes from $Aw+b=0$: since $Aw=-b$, we have
\begin{align*}
Ax^*=A(-w)=-Aw=b.
\end{align*} The same inequality, with $Aw+b=0$, holds for every $s\in K^*$. Since $s$ can be replaced by $\lambda s$ for every $\lambda>0$, it follows that $(w,s)_E\leq0$ for every $s\in K^*$. Equivalently, $(-w,s)_E\geq0$ for every $s\in K^*$, so $x^*=-w$ belongs to the dual cone of $K^*$. Because $K$ is closed and convex in finite dimensions, the [Finite-Dimensional Bipolar Theorem](/theorems/4108) for closed convex cones identifies this cone with $K$. Thus $x^*\in K$.
Finally set $s=0$ in the inequality. Since $Aw+b=0$, we get
\begin{align*}
-(w,c)_E\leq d^*.
\end{align*}
This is
\begin{align*}
(c,x^*)_E\leq d^*.
\end{align*}
The point $x^*$ is primal feasible, so $p^*\leq(c,x^*)_E$. Weak duality gives $d^*\leq p^*$. Combining the inequalities yields
\begin{align*}
d^*=p^*=(c,x^*)_E.
\end{align*}
Therefore the primal optimum is attained at $x^*$ and there is no duality gap.[/guided]