Foodfx Inc

Skoopmagic, Inc.

Weijun Zhang

Jun Du

Fengmin Gong

Min Fan

Methods, systems, and apparatuses, including computer programs encoded on computer storage media, for dietary tracking with instant dietary feedback using a portable multi-sensor device are described. An example method may include: obtaining a first machine learning model trained based on a plurality of food images and corresponding labels; receiving a series of images from one or more cameras capturing a user taking food out of a food-serving storage; determining, using the first machine learning model based on the series of images, an identification of the food being taken by the user; determining, using a second machine learning model based on the series of images and the identification of the food, an estimated weight of the food being taken by the user; determining and displaying portion-based food information of the food being taken by the user.

Multi-sensor device for dietary tracking

Methods, systems, and apparatuses, including computer programs encoded on computer storage media, for automated foodservice are described. An example method includes receiving one or more images from one or more cameras capturing a food container comprising a plurality of compartments; determining, using a first machine learning model based on the one or more images, a user action comprising a user taking food from a first compartment of the plurality of compartments; receiving a plurality of pieces of weight sensor data from a plurality of weight sensors coupled to a frame hosting the food container; determining, using a second machine learning model based on the plurality of pieces of weight sensor data, a second compartment of the plurality of compartments; in response to the first compartment being the same as the second compartment, displaying the weight and the food information of the food taken by the user.

Growing community of inventors

SAN JOSE, CA, United States of America

Weijun Zhang