Face The Nation: How Sensory Logic Sees Secrets In Candidates' Mugs

The likely Republican candidates for president might not be saying much about their candidacies just yet. But, as the saying goes, the medium is the message. Facial decoding firm Sensory Logic has figured out ways to interpret their messages.

GOP pres candidates faces

Although President Barack Obama is substantially boosted by the killing of Osama Bin Laden, and a relatively unknown few Republicans debated in Greenville, South Carolina, Campaign 2012 nevertheless is starting to take shape. During the campaign, many Americans will meet GOP contenders for the first time. But what the presidential hopefuls say may not matter that much. Their faces may be doing the heavy lifting. A scientific, emotional "facial coding" of the candidates and their expressions may determine who gains traction and who gets the nomination.

Campaigns and the public will soon be inundated with information on how candidates are tracking and their odds for success ('the horse race'). Politicians and the populace will turn to social media to influence and gauge our opinions and moods. But few candidates and voters are likely aware of "facial media" (you heard it here first) and the science of "facial coding."

After the 2010 the midterm elections, more campaigns than ever began using neuromarketing techniques, that is, studying the brains of voters to aid in crafting messages that would appeal to them and win votes at the polls. Turning the tables in 2011, neuromarketing researchers can now measure candidates’ own brain-driven facial movements and emotions, in order to assess their performance, fine-tune campaign marketing, or even predict election outcomes.

Dan Hill, president of Sensory Logic and author of Emotionomics and About Face, is a facial coding expert who works with leading Fortune 150 companies, professional sports teams, and government agencies (e.g. TSA). Sensory Logic helps clients who market to consumers by measuring their emotional facial responses to various stimuli in an effort maximize appeal. Companies also hire Hill to assist in employee recruitment and talent management.

Hill has been diagnosing candidates and predicting elections since 2004. In October 2007, he had Obama 2-1 emerging as the Democratic presidential nominee when a famous former White House advisor and current GOP pundit had him at 20-1. He was ahead of the pack in predicting the demises of Fred Thompson and Rudy Giuliani. Historically, Hill says, the happier candidate triumphs (think frowny losers Dole, Kerry, McCain...). Sensory Logic uses proprietary Cartesian Graphs to measure and score the impact, appeal, and engagement, emoted and emitted, by the candidate’s face. A person can show four types of smiles but a "’true smile’ which is a strong natural smile seen around the eyes and mouth" is more rare, distinctive, and powerful. Hill’s analysis suggests when a politician should drop out or not even enter the race (when his heart, or face, is not in it).

(Update: A prediction Hill shared with Fast Company in March based on his initial coding of would-be Republican presidential candidates for 2012: "Mike Huckabee doesn't look as engaged as before. I personally don't expect him to run. He had the great true smile among the GOP candidates in 2008, but it's not in evidence lately."

On May 14, Huckabee announced on his Fox News Channel show he would not run, concluding "All the factors say go, but my heart says no.")

Fast Company, exclusively, met with Hill to understand his methodology and get an initial read and deconstruction of the Republican faces of 2012. This is the first-ever facial coding and scoring of a presidential field based on Hill’s methodology, which correlates 23 Facial Action Units to 7 Core Emotions plus the widely accepted Big 5 Personality Traits model producing Sensory Logic’s EmoTraits®. [The methodology builds off of a 19th century foundation laid by biologist Charles Darwin and refined more recently with Paul Ekman's Facial Action Coding System, or FACS.]

Several of Hill’s conclusions drawn from the candidate analysis:

• "Chris Christie (who says he won't run for president) is the most negative, making him a logical VP choice to tap into the Tea Party's anti-establishment anger."

• "Mitch Daniels and John Huntsman are the antithesis of Trump: Trump is most intense, while they are the least intense and the most understated."

• "If Romney wins the nomination, Buddy Roemer could be a natural VP choice—fellow businessman and the same emotional profile while adding regional diversity."

For our own visualization of Hill's full analysis of the current crop of prospective candidates—and what their faces are saying about their mood and their odds, click here.

But how reliable and useful are the analyses and findings? Hill tells Fast Company he has not been hired by political campaigns; but his client list is growing, diversifying, and becoming more global, he says. Recently Sensory Logic clients asked that their names be removed from the firm’s Web site due to project confidentiality and competitive reasons. With the assistance of Ekman, the CIA uses their own facial coding and "microexpressions" analysis in recruiting and conducting espionage. What did they recently glean from Bin Laden’s facial gestures? Hill also revealed he was asked though the BBC by an unknown sponsor to interview and code people in Karachi, Pakistan (he declined).

Fred Davis, a seasoned political consultant who has advised George W. Bush and John McCain on their presidential campaigns (he will soon work for former US Ambassador to China, Jon Huntsman, Jr., whose entry into the presidential race is all but assured), extols the tactics of neuromarketing and has confirmed their use in his past campaign work. He thinks Hill’s facial coding method and findings are interesting but says perhaps just a "clearly written analysis of what people feel in their gut when they see a candidate … I'd put this technology in the category of extensive focus groups on demeanor and personality. Nice to have, but quite a luxury. [It] probably never would be given significance."

Hill concedes some challenges and limitations of political facial coding. The data is based on his own observation, and coding and using other (not as proficient or expert) coders might mean less reliability and consistency. Also, the analysis and findings derive from a limited sample of candidate speeches. What if the data set relies on a candidate’s few bad hair days? And while politicians cannot fake their facial muscle movements and those corresponding "core emotions," they could fudge to a degree and manipulate the "personality traits" they want to project.

Darryl Howard, who has applied the neuromarketing methods of "muscle, pupil, and skin response" on a number of successful GOP campaigns, finds the facial coding approach useful and the data valuable. "Hill’s understanding of how the human body gives information both voluntarily and involuntary is brilliant. And this [facial coding] information can be very helpful to the voter in making their choice in an election."

Hill thinks the data can also help a candidate understand how to differentiate from the field—as a brand, (e.g. if the pack shows anger, then stand out as bright), or to assess the competition, strengths, and weaknesses. The coding may point to the need for a candidate to be truer to his or her authentic emotions versus being staged (think Gore), or to be more singular and polar emotionally and personality-wise, instead of all over the map and bland.

The 1960 Nixon-Kennedy debates famously underscored the power of mass media and ascendant television to shape elections and shined a harsh light on candidate facial expressions. In 2008, no one exploited the power of emerging social media channels more effectively than Barack Obama. In 2012, who can turn facial media and smiles into victory?

Add New Comment

1 Comments

  • Steve Cummings

    ...
    But few candidates and voters are likely aware of “facial media” (you heard it here first) and the science of “facial coding.”...

    Or, possibly here, but this was from just one Google query...

    Proposal of new facial media and improvement of human interfaceAccession number;06A1021217Title;Proposal of new facial media and improvement of human interfaceAuthor; FUNAHASHI TAKUMA (Chukyo Univ.) FUJIWARA TAKAYUKI (Chukyo Univ.) KOSHIMIZU HIROYASU (Chukyo Univ.)Journal Title;Papers of Technical Meeting on Information Oriented Industrial System, IEE JapanJournal Code:X0579AISSN:VOL.IIS-06;NO.45-49;PAGE.11-16(2006)Figure&Table&Reference;FIG.13, TBL.2, REF.9Pub. Country;JapanLanguage;JapaneseAbstract;We developed the facial caricaturing robot "COOPER", that was exhibited at the Prototype Robot Exhibition of EXPO 2005, Aichi Japan during 11 days from Jun. 9 to Jun. 19. COOPER watches the face of a person seated at the chair, obtains facial images, and analyzes the images to extract 251 feature points to generate his facial line drawings with deformation. It is noted that the caricature was drawn on the specialized "Shrimp rice cracker" in 4 minutes. To do this we customized the original system PICASSO by coping with the illumination circumstances in EXPO pavilion. This paper illustrates the outline of the COOPER and the details of the image processing in it. And we discuses on the prospects of the future subjects based on more than 352 facial caricatures obtained at EXPO2005. We Would like to prospect the future paradigm of human interface media by introducing such technologies that were developed in the project of COOPER. (author abst.)