The strong evanescent field around ultra-thin unclad optical fibers bears a high potential for detecting, trapping, and manipulating cold atoms. Introducing such a fiber into a cold atom cloud, we investigate the interaction of a small number of cold Caesium atoms with the guided fiber mode and with the fiber surface. Using high resolution spectroscopy, we observe and analyze light-induced dipole forces, van der Waals interaction, and a significant enhancement of the spontaneous emission rate of the atoms. The latter can be assigned to the modification of the vacuum modes by the fiber.