Tracking Eating & Drinking


Dementia can cause a patient to forget to drink enough. One of the goals of the Smart Teddy project is to determine whether elderly people with dementia are able to continue to live independently. One of the indicators for this is the extent to which the patient is drinking enough.

Project goal

The aim of this project is to measure this using the sensors that are present in the Smart Teddy and the base station.

At the moment it is not yet certain where this can best be measured. Research has already been done to use camera images to draw a bounding box for cups, glasses and cutlery. One possible direction is to detect moving cups and glasses in a series of camera images of the base station. Movement thereof could be a (weak) indication that drinking is taking place.

Another possibility that is being considered is to have the Teddy learn in the combination of image and sound which sounds are indicative for placing cups and glasses. Namely by training on the sounds when cups and glasses stop moving. In this way, a Smart Teddy could learn which sounds are associated with the use of cups and glasses and eliminate the dependence on camera images. Research is needed to determine to what extent this is possible. A training set can be put together by making use of existing A / V recordings in which the aforementioned recognition for glasses and cups is used to collect audio fragments on which the placing of glasses and cups can be heard

Needed qualifications

  • Interest in doing research
  • Good English reading and writing skills
  • Background in programming or mathematics

If you are interested then please contact one of the leading researchers

Dr. Jeroen Vuurens

Dr. Hani Al-Ers

Further information: Please visit the page for the Smart Teddy