We study the geometry of the set of closed extensions of index 0 of an elliptic cone operator and its model operator in connection with the spectra of the extensions, and give a necessary and sufficient condition for the existence of rays of minimal growth for such operators.