This Simple Khan Academy Interface Hack Improved Learning By 5%

In a recent demo, Khan Academy showed how analytics are being used to reinvent learning—massively and online.

Sal Khan's website Khan Academy applies everything from graphical modeling to "brute force empirics" and a/b testing to test tweaks that can make all the difference in students' learning. The ultimate hope is to providing a free, accessible education to 140 million children around the world who are not in school, not to mention one in four American kids who drop out of high school.

In the video above, one of Khan's quants, Jace Kohlmeier, explains a test in which a seemingly innocuous slogan was added to the page next to, say, a math problem: "The more you learn today, the smarter you'll be tomorrow." That simple line of text, along with a link to further explanation, led to a 5% increase in problems attempted, proficiencies earned, and return visits to the site.

How can this be?

The explanation starts at 11:35 in the video below, which is part of a regular in-house educational series hosted by Mixpanel. Basically, Khan Academy is borrowing from the groundbreaking work of Stanford's Carol Dweck, who has found in a series of studies that inducing a "growth mindset"—an awareness of the brain's flexibility and plasticity, based in neuroscience—has a lasting and positive effect on mental performance.

"Measuring learning is a nontrivial task," Kohlmeier says, as you have to get into trade-offs like breadth vs. depth and speed vs. accuracy. Nevertheless, tracking each problem solved and answer submitted allows Khan Academy to map a literal "learning curve" to model the acquisition of a concept such as fractions. They found that carefully matching the next problem offered to the student's demonstrated level of skill led to faster acquisition of a concept.

One day, better analytics could even free our school system from the tyranny of high-stakes testing. If students did all their homework within a smart platform like this rather than using pencil and paper, rich, up to the minute feedback to students, teachers, and parents could replace those end-of-year bubble tests.

[Image: Flickr user Abstract Duck]

Add New Comment

2 Comments

  • Ellen Konar

    Great article.  Love to know more about the study.  What percent of the student's clicked through to get the material on growth mindset?  Were those the students that evidenced the largest benefit?  If anyone has access to more info, please post, or send this way.

  • Marshall Kirkpatrick

    Awesome! One could call it the instrumentation of the experience of learning. I'm going to go add that text to the top of our website.