Well before Affectiva had an on-device mobile SDK for smartphones, Affectiva collaborated with Lumi Mobile in order to conduct an in the field study using Nokia phones as a data collection vehicle. This enabled a study to be conducted in the field in India, where participants were took part in the study without having to be brought into a central testing facility. In total, 6 ads were tested in 2 cities, with 300 participants yielding facial video as well as self-reported data.

The resulting work was presented at the 2012 ESOMAR Congress where it won the “Best Methodological Paper” award.


Measuring emotion is no longer solely the domain of desktops, or laptops for that matter. Mobile devices have increasingly become a robust platform in which to capture consumer insight into ads and other forms of media. Mobile devices are ubiquitous and are ideal for delivering rich media while capturing people’s response to the media. This enables advanced computer vision technology to identify the facial expressions captured in the face videos and to map these expressions to emotional states such as enjoyment, confusion, surprise and attention. This paper documents an iterative process to develop, test, and validate the use of mobile as a powerful way to test ad recall and to assess the emotional impact a given ad has on a group of people through facial coding. This paper shares findings from initial iterations, namely testing ad recall of a battery of TV ads in Brazil and other emerging markets, and then proceeds to test six ads in the beverage category in two cities in India (Hyderabad and Delhi), highlighting differences in ad responses by demographics and location. This innovative use of mobile devices creates many opportunities for innovation in market research.