Snap, Eat, RepEat
- 16 October 2016
- conference paper
- conference paper
- Published by Association for Computing Machinery (ACM)
Abstract
We present a system to assist users in dietary logging habits, which performs food recognition from pictures snapped on their phone in two different scenarios. In the first scenario, called \"Food in context\", we exploit the GPS information of a user to determine which restaurant they are having a meal at, therefore restricting the categories to recognize to the set of items in the menu. Such context allows us to also report precise calories information to the user about their meal, since restaurant chains tend to standardize portions and provide the dietary information of each meal. In the second scenario, called \"Foods in the wild\" we try to recognize a cooked meal from a picture which could be snapped anywhere. We perform extensive experiments on food recognition on both scenarios, demonstrating the feasibility of our approach at scale, on a newly introduced dataset with 105K images for 500 food categories.Keywords
This publication has 41 references indexed in Scilit:
- Recipe recognition with large multimodal food datasetPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Geolocalized Modeling for Dish RecognitionIEEE Transactions on Multimedia, 2015
- “Snap-n-Eat”Journal of Diabetes Science and Technology, 2015
- Barriers and Negative NudgesPublished by Association for Computing Machinery (ACM) ,2015
- Computer Vision-Based Carbohydrate Estimation for Type 1 Patients With Diabetes Using SmartphonesJournal of Diabetes Science and Technology, 2015
- What’s Cookin’? Interpreting Cooking Videos using Text, Speech and VisionPublished by Association for Computational Linguistics (ACL) ,2015
- Food-pics: an image database for experimental research on eating and appetiteFrontiers in Psychology, 2014
- FoodCam: A real-time food recognition system on a smartphoneMultimedia Tools and Applications, 2014
- FoodCam: A Real-Time Mobile Food Recognition System Employing Fisher VectorLecture Notes in Computer Science, 2014
- Adherence to a Smartphone Application for Weight Loss Compared to Website and Paper Diary: Pilot Randomized Controlled TrialJournal of Medical Internet Research, 2013