Two-Sided Inverse Modulo Smoothing Operators