Extrinsic control of the exchange bias