Damping of giant resonances in a stochastic two-level model