Structure of shape derivatives for nonsmooth domains