Damping pathways of mid-infrared plasmons in graphene nanostructures