[example: Left and Right Cosets in $S_3$]
Let $G = S_3$, let $H = \{e,(12)\} \le S_3$, and take $g=(123)$. By the definition of a left coset,
\begin{align*}
gH &= (123)H\\
&= \{(123)e,\,(123)(12)\}\\
&= \{(123),\,(123)(12)\}.
\end{align*}
To compute $(123)(12)$, compose right to left:
\begin{align*}
1 &\mapsto 2 \mapsto 3,\\
3 &\mapsto 3 \mapsto 1,\\
2 &\mapsto 1 \mapsto 2.
\end{align*}
Thus $(123)(12)$ swaps $1$ and $3$ and fixes $2$, so
\begin{align*}
(123)(12) &= (13),
\end{align*}
and therefore
\begin{align*}
(123)H &= \{(123),(13)\}.
\end{align*}
By the definition of a right coset,
\begin{align*}
Hg &= H(123)\\
&= \{e(123),\,(12)(123)\}\\
&= \{(123),\,(12)(123)\}.
\end{align*}
Again composing right to left,
\begin{align*}
1 &\mapsto 2 \mapsto 1,\\
2 &\mapsto 3 \mapsto 3,\\
3 &\mapsto 1 \mapsto 2.
\end{align*}
Thus $(12)(123)$ swaps $2$ and $3$ and fixes $1$, so
\begin{align*}
(12)(123) &= (23),
\end{align*}
and therefore
\begin{align*}
H(123) &= \{(123),(23)\}.
\end{align*}
Since $(13) \neq (23)$ in $S_3$, the subsets $\{(123),(13)\}$ and $\{(123),(23)\}$ are not equal. Thus the left and right cosets of the same subgroup by the same element can differ in a non-abelian group.
[/example]