ISLAMABAD: Researchers at the University of Rochester have developed a computer based app that can analyze selfie videos as the person engages with social media and monitor his or her mental health.
The device “quietly observes your behavior” while a person uses the computer or phone as usual.
It does not require the user to explicitly state what he or she is feeling, input any extra information or wear any special gear, Khaleej Times reported.
For example, the team was able to measure a user’s heart rate simply by monitoring very small, subtle changes in the user’s forehead color.
“The system does not grab other data that might be available through the phone such as the user’s location,” said Jiebo Luo, professor of computer science.
The researchers were able to analyze the video data to extract a number of “clues” such as heart rate, blinking rate, eye pupil radius and head movement rate.
At the same time, the program also analyzed both what the users posted on Twitter, what they read, how fast they scrolled, their keystroke rate and their mouse click rate.
“Not every input is treated equally though: what a user tweets, for example, is given more weight than what the user reads because it is a direct expression of what that user is thinking and feeling,” Luo noted.
For the study, they enrolled 27 participants and “sent them messages, real tweets, with sentiment to induce their emotion.”