The expiry dates printed on the merchandise have a distinct background, font, alignment, and color in comparison with the available handwritten digit datasets. In this paper, an expiry date dataset is used, and also a convolutional neural network (CNN) model is proposed to recognize expiry dates out of images. This model may be employed together with our previously proposed smart expiry architecture to get an automated notification to the smartphone for the foods which are expiring soon. The suggested deep learning model is tested and has a classification accuracy of 90%.