Grab, Pay, and Eat: Semantic Food Detection for Smart Restaurants

The increase in awareness of people toward their nutritional habits has drawn considerable attention to the field of automatic food analysis. Focusing on self-service restaurants environment, automatic food analysis is not only useful for extracting nutritional information from foods selected by cus...

ver descrição completa

Detalhes bibliográficos
Autores: Aguilar Torres, Eduardo; Remeseiro López, Beatriz; Bolaños Solà, Marc; Radeva, Petia
Tipo de documento: Artigo
Estado:Accepted version
Data de publicação:2018
País:España
Recursos:Universidad de Barcelona
Repositório:Dipòsit Digital de la UB
OAI Identifier:oai:diposit.ub.edu:2445/144810
Acesso em linha:https://hdl.handle.net/2445/144810
Nível de acesso:Acesso aberto
Palavra-chave:Nutrició
Hàbits alimentaris
Restaurants
Nutrition
Food habits
Descrição
Resumo:The increase in awareness of people toward their nutritional habits has drawn considerable attention to the field of automatic food analysis. Focusing on self-service restaurants environment, automatic food analysis is not only useful for extracting nutritional information from foods selected by customers, it is also of high interest to speed up the service solving the bottleneck produced at the cashiers in times of high demand. In this paper, we address the problem of automatic food tray analysis in canteens and restaurants environment, which consists in predicting multiple foods placed on a tray image. We propose a new approach for food analysis based on convolutional neural networks, we name Semantic Food Detection, which integrates in the same framework food localization, recognition and segmentation. We demonstrate that our method improves the state-of-art food detection by a considerable margin on the public dataset UNIMIB2016, achieving about 90% in terms of F-measure, and thus provides a significant technological advance toward the automatic billing in restaurant environments.