Food Intake Detection and Classification Using a Necklace-Type Piezoelectric Wearable Sensor System

Ghulam HUSSAIN  Kamran JAVED  Jundong CHO  Juneho YI  

Publication
IEICE TRANSACTIONS on Information and Systems   Vol.E101-D   No.11   pp.2795-2807
Publication Date: 2018/11/01
Online ISSN: 1745-1361
DOI: 10.1587/transinf.2018EDP7076
Type of Manuscript: PAPER
Category: Artificial Intelligence, Data Mining
Keyword: 
wearable sensor,  nutrition monitoring,  machine learning,  wireless health,  

Full Text: PDF(3.6MB)
>>Buy this Article


Summary: 
Automatic monitoring of food intake in free living conditions is still an open problem to solve. This paper presents a novel necklace-type wearable system embedded with a piezoelectric sensor to monitor ingestive behavior by detecting skin motion from the lower trachea. Detected events are incorporated for food classification. Unlike the previous state-of-the-art piezoelectric sensor based system that employs spectrogram features, we have tried to fully exploit time-domain based signals for optimal features. Through numerous evaluations on the length of a frame, we have found the best performance with a frame length of 70 samples (3.5 seconds). This demonstrates that the chewing sequence carries important information for food classification. Experimental results show the validity of the proposed algorithm for food intake detection and food classification in real-life scenarios. Our system yields an accuracy of 89.2% for food intake detection and 80.3% for food classification over 17 food categories. Additionally, our system is based on a smartphone app, which helps users live healthy by providing them with real-time feedback about their ingested food episodes and types.