# Barbell strategy for learning

I recently reread Cal Newport’s So Good They Can’t Ignore You (notes here). He’s a big believer in deliberate practice, or his term of choice, “deep work”, as he calls his new book. His thesis is that we should devote our learning efforts to striving as hard as possible.

Does this square with my experience? I was struck by a comment in an interview with Matt Webb about learning programming: “I got a book about “idiomatic Python”, and I didn’t concentrate very hard. I just copied it out. I literally typed in everything that was idiomatic.”  I do a lot of learning like that. My newest learning experience is yoga, and it’s all kinda like this: watch what the instructor does and try to do it. This brings us to the first part of the strategy…

## The first plate: mindless mimicking

Mindless mimicking is observing an expert or an expert’s work and copying what they do. Mindless doesn’t mean do whatever — I believe there are several components to mimicking effectively. 1. It involves an expert, whether that is an expert’s code typed out in a book, or an expert working the same moves in front of you. 2. It’s active. I don’t believe that just watching or just reading has no learning benefit, but active learning has at least one huge benefit: your attempt is tested, providing you feedback about what’s going wrong. Feedback requires the right conditions: learning to drive in an open field is very different from learning to drive on a road with a curb, not to mention short-tempered drivers. 3. There are gaps to fill in. These are often incidental: in yoga, you won’t see every tiny movement that the instructor makes. You also won’t immediately know the exact path to perform something. This variation lets you find the edges for feedback.

Another example that I came across recently is the Goldlist method for learning language. The method makes a strong claim that creating mnemonics aren’t worth the (decidedly not mindless) effort. Furthermore, we should strive to be comfortable and pleasant while learning — far from the pained efforts that Newport suggests!

## Forming the barbell: deliberate practice

But I also agree with Newport and the researchers he cites: this kind of practice will lead to plateaus. Mindlessness, of course, makes you a zombie, not an engaged and productive member of society. Mathematical zombies have been discussed recently in the MathTwitterBlogosphere: students who can do the steps but don’t have an understanding of the concepts.*

So what is the barbell strategy? Described by Nassim Taleb, it’s the use of two divergent strategies parallel rather than one in the middle. The canonical example is financial investment. One strategy is a very safe investment for most of your money: bonds or index funds. The other is a high-risk/high-reward use of the rest of your money to make occasional big jumps.

If mindless mimicking forms the first plate of the barbell and deliberate practice forms the plate on the other end of the bar. Unfortunately, for all the talk about deliberate practice, it can be hard to nail down a good definition. One aspect that may be helpful here is to think of it being highly conscious rather than mindless: both about the goals of what you’re practicing and the level of effort you’re putting in. If playing music, make sure you are 1) choosing a technique that is difficult but not beyond your ability to play to perfection 2) repeat until you play it perfectly.

## The hollowed-out middle

A critical aspect of the barbell strategy is that any time spent between the two plates would be better spent on one or the other. Another analogy is rock climbing: you should either stay where you are, or reach out and grab a rock. Spending time flailing your arms and legs around is just going to wear you out.

Think about playing chess. Having an expert tell you what to do while you’re playing along is a shortcut to developing a great deal of long-term memory. Doing study of difficult problems and working them out to the end is how to stretch and strengthen your chess skills. Between the two is what a lot of people will do to get better: think pretty hard while playing. This uncontrolled scenario can lead to problems: spending too little effort to reach the correct conclusion about a given position, or spending too much effort thinking about a position that doesn’t teach you anything new.

Generally speaking, the spectrum between mindless mimicking and deliberate practice is the level of consciousness, a powerful tool that can also trip us up. (See also: The Inner Game of Tennis.)

*This isn’t a perfect example because I don’t think deliberate practice is the antidote to weak conceptual knowledge. I had originally considered the opposite side of mindless mimicking to be more abstract learning. After all, you tend to observe more concrete things. But I think mindless mimicking actually works at different levels of abstraction, depending on your current ability and the techniques of the teacher. For example, in yoga, the teacher might cue the students to “create space in your chest”, which rests on more concrete moves like widening shoulders, focused breathing, etc., that were introduced earlier.

I bookmark my favorite articles using Pinboard. Pinboard provides a feed that I’ve been using to share them on my website at learnstream.org/links.

Even better would be to send out a weekly newsletter with recent articles. I was able to set this up through Google Sheets and Apps Script. A warning: Apps Script has a limit on sending email of 100 recipients per day (1500 for Google Apps for Edu), so this wouldn’t accommodate a large number of users, but it works perfectly well to send to myself and a few friends.

First you need to determine the URL of your Pinboard links feed. You’ll use one of the following, filling in the bold parts:

If you choose the second option, this will only return bookmarks with that tag. For example, my newsletter will only include my items tagged “education” so that readers won’t get my links about programming or animal GIFs. So mine looks like https://feeds.pinboard.in/rss/u:cicatriz/t:education/. Feel free to use that one if you haven’t set up Pinboard but just want to see a newsletter with some entries.

You can also find these URLs on pinboard.in under the link labeled “RSS”, either on your main page or under a specific tag. However, you’ll want to remove the secret:... part or else people will see your private links.

Other bookmarking services like Delicious have a similar RSS feature. You can even use Reddit.

Open the Script Editor from your sheet. First I’ll demonstrate looping through the data and building up a list of titles.

function mailer() {
var data = sheet.getRange("A1:E50").getValues();
var titles = [];

for (var row = 0; row < 50; row++) {
var title = data[row][0];
// Exit loop if title is blank
if (!title) {
break;
}
titles.push(title);
}

Logger.log(titles.join(", "));
}

The first couple lines of the mailer function grab all the data we’ve loaded. We use the for loop to access each of the 50 rows. We push the title, which is the first item of data[row], into the titles array. However, if there are less than 50 links, we want to detect an empty title and break out of the loop. At the end we log all of titles, joined together with a comma and space separating them.

If you go to Run > mailer, then View > Logs, you should see the list of titles.

Nice! However, we haven’t accounted for the fact that this is a weekly newsletter: we only want links from the last week. Working with dates can be a huge pain, so I’ll show the added code without much comment. Like with the empty titles, it uses the date column to break out of the loop.

function mailer() {
var data = sheet.getRange("A1:E50").getValues();
var titles = [];
var now = new Date();

for (var row = 0; row < 50; row++) {
var title = data[row][0];
// Exit loop if title is blank
if (!title) {
break;
}

var date = getDate(data[row][3]);
// Exit loop if the link is older than 7 days
if ((now - date)/(24*60*60*1000) > 7) {
break;
}

titles.push(title);
}

Logger.log(titles.join(", "));
}

function getDate(datetimeString) {
var dateString = datetimeString.split("T")[0];
var dateParts = dateString.split("-");
return new Date(parseInt(dateParts[0]),
parseInt(dateParts[1]) - 1,
parseInt(dateParts[2]));
}

Run this again and your list of titles will only include those added in the last 7 days.

The next change just grabs more of the data and formats it into my newsletter, which starts with a list of titles then shows each of the articles with title, description, and URL. I’ve replaced the Logger call with MailApp, so this will actually send the email when you enter your own address and run it!

function mailer() {
var HR = "\n\n---\n\n";
var data = sheet.getRange("A1:E50").getValues();
var now = new Date();
var titles = [];
var items = [];
var body;

for (var row = 0; row < 50; row++) {
var title = data[row][0];
// Exit loop if title is blank
if (!title) {
break;
}

var date = getDate(data[row][3]);
// Exit loop if the link is older than 7 days
if ((now - date)/(24*60*60*1000) > 7) {
break;
}

var url = data[row][2];
var desc = data[row][4];

titles.push(" * " + title);
items.push([title, desc, url].join("\n\n"));
}

body = titles.length + " items:\n\n"
+ titles.reverse().join("\n")
+ HR
+ items.reverse().join(HR);

}

function getDate(datetimeString) {
var dateString = datetimeString.split("T")[0];
var dateParts = dateString.split("-");
return new Date(parseInt(dateParts[0]),
parseInt(dateParts[1]) - 1,
parseInt(dateParts[2]));
}

One more thing! You don’t want to have to come to the sheet and fire it off every week. Instead, use a trigger to run mailer each week. Go to Resources > Current project's triggers then Add a new trigger. My settings are below. If you choose a different frequency be sure to adjust the for loop.

## Using a mailing list

The example only sends to one person. Let’s use a list of email addresses that you enter on another sheet. Note that you could also use Google Forms to collect the emails, but I won’t get into that here.

Call this sheet “emails” and enter them in the A column with no header. We’ll load the email data just like the links data and use another for loop to send each email. Here is the final code.

function mailer() {
var HR = "\n\n---\n\n";
var data = sheet.getRange("A1:E50").getValues();
var mailData = mailSheet.getRange("A1:A100").getValues();
var now = new Date();
var titles = [];
var items = [];
var body;

for (var row = 0; row < 50; row++) {
var title = data[row][0];
// Exit loop if title is blank
if (!title) {
break;
}

var date = getDate(data[row][3]);
// Exit loop if the link is older than 7 days
if ((now - date)/(24*60*60*1000) > 7) {
break;
}

var url = data[row][2];
var desc = data[row][4];
titles.push(" * " + title);
items.push([title, desc, url].join("\n\n"));
}

body = titles.length + " items:\n\n"
+ titles.reverse().join("\n")
+ HR
+ items.reverse().join(HR);

for (var row = 0; row < 100; row++) {
var recipient = mailData[row][0];
// Exit loop if the cell is blank
if (!recipient) {
break;
}
}
}

function getDate(datetimeString) {
var dateString = datetimeString.split("T")[0];
var dateParts = dateString.split("-");
return new Date(parseInt(dateParts[0]),
parseInt(dateParts[1]) - 1,
parseInt(dateParts[2]));
}

Remember to add yourself so you can see the result of your work!

Blogging has been a struggle lately (well, always). I have another outlet that feels better for me right now: link blogging. Get it at learnstream.org/links.

A quick note about how it works: I’m collecting the links on Pinboard. Between extensions and bookmark-by-mail this is easy whether I’m on laptop or offline mobile. Pinboard automatically creates an RSS feed of my links. I use SimplePie to display that RSS feed on my site. You can also access the RSS feed directly.

And a quick reflection on my blogging: I tend to think about blogging as helping me make sense of things. The link descriptions are a way of getting more practice without having to write the narrative that a post requires. On the other hand, some of my best blogging comes from tying multiple things together, so I’ll keep thinking about ways to do that. Before the link blog I tried some experiments inspired by Mike Caulfield’s proliferation of federated wiki (e.g. for WordPress). As much as I like the wiki as a knowledge artifact, I found that writing style more difficult than it was worth for me.

# Fire type learning, earth type learning

I went through life wanting to be a fire type. You probably know some. They’re your friends who quickly pass you up in video games. They’re some of the stars in your field with a deep knowledge and endless energy toward their projects. I wanted that relentless focus that would propel me to excellence. But when it came to practice I could never maintain my fire.

Then I discovered that I’m not a fire type but an earth type. What I always thought this was an issue of discipline — building “willpower muscles” or applying productivity hacks — is probably more a fixed part of my nature.

Fire and earth are two of the five Chinese elements, the others being wood, water, and metal. I actually heard about the relationship of these types to training styles through a French strength trainer, Charles Poliquin. I haven’t found any historical or scientific scholarship around them yet, but my results on online personality quizzes have at least been consistent (meanwhile I can’t even figure out if I’m Luke or Rory from the Gilmore Girls).

I think about the elements primarily as dynamics of energy allocation. In that area we tend to have a view that does little to differentiate individuals. We talk about needing to increase motivation for everyone and apply ideas that supposedly apply to the whole population, like favoring intrinsic motivation. Perhaps those are useful but we also should think about how different people respond to different energy demands.

In his book Scott Adams talked about this distinction though without using the fire/earth terms: “my observation is that some people are born with a natural impulse to practice things and some people find mindless repetition without immediate reward to be a form of torture.” He acknowledges that fire types probably aren’t even reading the book but for people like him, where there’s a better strategy: “I’m a perfect example of the power of leveraging multiple mediocre skills. I’m a rich and famous cartoonist who doesn’t draw well.”

Lesson learned: when making decisions about skill development (and these decisions are really important) or taking life advice, remember that your personality may be quite different from others.

P.S. You may have seen the draft form of my last post. Go look now for the complete version that links to Alan Kay’s talk.

# What isn’t remembering in context is invention

In his talk the Power of Simplicity, Alan Kay managed to express much more elegantly what I was trying to say in the last post:

1. Most human learning is remembering in context
2. Learning a new idea requires almost as much creativity as the original invention

In the Pythagorean example, we were asking students to remember Pythagorean theorem but the context was completely wrong. The context of two points on a grid is one that is totally unfamiliar to students hence there is nothing for them to remember (point #1).

The first act of applying geometric theorems to points on a grid was a legitimate invention by mathematicians — a blue escape from the pink world — and Alan Kay’s point with #2 is that for a student to rediscover it during an exam is a crazy standard.

An example from my own experience. I’m in my first month as an Android programmer so I’m in the process of learning a lot of new things. Last week I had some unexpected behavior in my program regarding a text edit field. Most of my effort involved looking at the values of certain variables at certain times. This was like better observing my context. My coworkers who have strong understanding of Android presented a few ideas that I could quickly eliminate. A coworker had the idea that there were two Views (a text edit field is a kind of View) with the same ID so my code was targeting another View. We actually rejected this idea for a while, but I used a tool called the View Hierarchy to find out that was true — another case of enriching my context.

The “missing” understanding behind my problem was that two views in a hierarchy have the same root. My coworkers certainly had this understanding but didn’t have the context to apply it immediately to a solution. This idea is really simple as an experienced programmer (hierarchies, better known as tree structures, are everywhere). But the difficulty came from lots of wondering around in the context to spot the issue. (Another insight from Kay from the same talk is that problem solving is a weak heuristic.) Finally we were able to target the point in the code that was finding the ID from the root of the hierarchy and fix it.

Top down understanding was useless here. There are way too many potential “tops”.

Does this apply to most tasks in life or is top down understanding useful if you’re in a field that is less pedantic than computer programming? I don’t know the answer to that. Maybe I don’t have the top down understanding to problem solve this one.

Note: I originally accidentally published this as a partial draft. Apologies for the confusion, especially for misquoting Alan Kay and not crediting him.

# Breaking down understanding: Pythagorean theorem example

What does it mean to understand? In learning and teaching, often we are worried about whether what’s been learned involves true understanding or is just facts and skills that can’t be “applied” or “transferred”.

In Understanding by Design, Wiggins & McTighe present many examples of lack of understanding. One example was a question about the distance between two points on a grid. Let’s say (2,8) and (6,5). Students were assumed to know the Pythagorean theorem: $a^2 + b^2 = c^2$. They could solve the problem by finding the number of units between the points on the x-axis: $|2-6|=4$, finding the number of units between the points of the y-axis: $|8-5|=3$, and then applying Pythagorean theorem: $\sqrt{4^2+3^2} = 5$. But most students could not solve the problem! Their takeaway is that students knew but didn’t understand Pythagorean theorem.

I challenge these students even know the Pythagorean theorem. Is the Pythagorean theorem “$a^2 + b^2 = c^2$“, as we stated, and as most of the students could probably tell you? No!! The statement “$a^2 + b^2 = c^2$” by itself means nothing at all. Let’s do better: “the Pythagorean theorem states that for any right triangle with legs of length $a$ and $b$, and hypotenuse of length $c$, the relation $a^2 + b^2 = c^2$ is true”. Ok, there is a statement that a mathematician and maybe even a logician would be happy with, but students may need some prodding to get to if they knew it at all.

We aren’t done because our audience is students rather than mathematicians. Mathematicians are a slightly crazy type of person who is happy with this statement. If students realized what we’ve just done, they would be appalled–and for good reason. Why? We said “any right triangle…”. That is an infinite class of things. If we made a similar statement like “any New Yorker is rude” or “any Vikings team will not win the Super Bowl”, that would be called ignorant and awful. But the mathematician is comfortable because they have extreme confidence that they can spot any right triangle in any context and say a few definitely true things about it. Now, most of our students are probably able to see a right triangle and say, yes, that is a right triangle, no, that is not a right triangle. But they may not have a fluent perceptual skill of running out in the wild and eagerly seeing right triangles like mathematicians (remember: slightly crazy).

And yet being able to detect right triangles like a boss still isn’t enough! As the student, when sitting down in front of this problem, we enter a very strange place: a grid. We can we do in grid world? We could draw a smiley face with the two points as eyes, color in squares, or make mazes. Creating a right triangle with legs parallel to the axes and hypotenuse that is the line between points (2,8) and (6,5) is just one of countless possibilities. That is legitimately considered an invention when it’s not a practiced skill, and a vast majority students who have never even encountered the idea of creating shapes to support their geometric reasoning are not going to invent it on the spot.  “Find the distance” might spark me to draw a straight between them (“‘the shortest distance between two points…’ wait, do I want the shortest distance?”). But the creation of that triangle, then the detection of the right triangle (since we may have drawn the correct lines without necessarily thinking “triangle”), then the application of Pythagorean are all steps needed to solve the problem.

So boiling down the issue here to a lack of understanding of Pythagorean theorem is, if not wrong, totally unhelpful. Nor is it helpful to say that the students are “failing to apply their knowledge”, or the student just needs to “learn more transferable knowledge”. All those sound like the responses of an obnoxious politician.

There are times when recognizing and pointing to a lack of understanding is a useful communication. There is some pattern to the student’s actions where people who know better can agree they don’t have “understanding”, even if we don’t have a perfect description of what that entails. Call this the gestalt perspective on understanding.

The philosophy here is that we can attempt to break down a lack of understanding into knowledge and skills that are missing. Call this the reductionist perspective. In this case I choose to consider the problem like some kind of environment where the student can perceive things and take actions while applying some of their existing beliefs about the world. I’m not sure it’s an accurate look inside the mind of a student, but I think it helps bridge to ideas like perceptual learning and affordance that we otherwise might not recognize.

# Clickers for the mind

I had taken for granted that feedback is a critical part of learning: it’s information that we use to adjust our performance and incrementally get better. However, Dan Meyer gave an excellent example of when feedback goes wrong. When working through an algebraic equation in a computer program, the student writes a step and the equation turns red: the equation is wrong. They flip a sign and then it’s green: the equations is correct! And yet the student doesn’t understand anything.

I finally have a better framework for thinking about feedback: reinforcement learning, the theory behind animal training, particularly via a technique called clicker training.

In clicker training, animal trainers help an animal associate the “click!” of a clicker (just a small object that makes a click when pressed by the trainer) with positive reinforcement like a small treat for a dog or a fish for a killer whale. The purpose of the clicker is that the trainer can time the click exactly to when the animal performs a correct step. The positive reinforcement is a very powerful way to instill the behavior in the animal, and it works from household pets to performance animals.

Back to our algebra software: the program turns green, click!, positively reinforcing the student’s step. The problem is that we’re reinforcing the wrong action: “keep flipping signs until it’s right”. How Children Fail is a whole book of these kind of training failures in the classroom setting. The author explores how students he’s observed fall into patterns of trying to get to right answer, whether that is saying “I don’t know” or probing for the right answer like our student in the computer program. Anything but doing the hard work of understanding and working out the real problem!

It’s like reinforcing the dog for dragging every item in the house to your lap because those happened to include her fetch stick. Instead, we can break down the actions into a chain of tiny parts, and reinforce these one at a time. The principles of reinforcement learning, which I’ve been reading about (after getting a dog of my own) in the book Don’t Shoot the Dog, tell us how to do this kind of training. Here’s one example from the book:

We were watching a horse being trainer to bow, or kneel on one knee, by a traditional method involving two men and a lot of ropes and whips; the horse under this method is repeatedly forced onto one knee until it learns to go down voluntarily.

I said it didn’t have to be done that way and asserted that I could train a horse to bow without ever touching the animal. (One possibility: Put a red spot on the wall; use food and a marker signal to shape the horse to touch its knee to the spot; then lower the spot gradually to the floor so that to touch it correctly and earn a reinforcer the horse has to kneel.)

This act of shaping is a subtle art. Even training my puppy to sit wasn’t a straightforward procedure — I almost wanted to reach for the ropes and whips after twenty minutes without her ever getting in the right position. In animal training, trainers understand that verbal communication is starting from scratch. The dog has no idea what “sit” means when we start. The math student likewise has no idea what the concept of “equality across the sign” means. (Actually the task is even harder because we don’t know whether the observed behavior of flipping the sign comes from understanding the mistake or from trying all the possibilities. Meanwhile a sit is a sit.)

I believe that successful teaching practices are those that use effective shaping. It applies no matter what perspective you bring to education. Discovery learning shapes using affordances in the learning environment as I’ve talked about before with Portal. Explicit instruction shapes through worked examples that slowly build on previous understanding and have clear points of failure when applying misconceptions like the sign of a unit.

The link to animal training and its behavioral history has been quite surprising to me. Behavioralism has been a relegated branch of psychology, particularly by the cognitive science training that I had. The example of applied behavioralism that I see is in the design of addictive but meaningless games like Cow Clicker, where you are reinforced for clicking an invisible cow. But there’s no question that human minds respond to the same effects and they can be used for good. (Another amusing application: relationships.) There is still more to explain in terms of when concepts are understood versus when we’re just grinding through procedures, but this is where I’m at for now.

# The Silicon Valley vision of education

In a Tim Ferriss Show podcast episode, Peter Diamandis, entrepreneur extraordinaire, answers a listener question: How can we disrupt our education system? I think it’s articulate and representative of the typical “Silicon Valley Vision” for education, so let’s dig into it.

First of all, education’s got a couple different parts. There’s the part of socialization, of getting to know kids, getting to know people, how to be a good citizen, how to interact with people socially. Then there’s the part about learning.

I will stick to the “learning” part, as much as that division is legitimate.

And the challenge with our education system, and you know this, we all know this, is, it is 150 or 200 years old. And it just sucks. I don’t know how else to put it.

I’m not here to talk history either, but I recommend The Invented History of ‘The Factory Model of Education’ to get a richer perspective on the “education is old and broken” talking point.

In any classroom, half the class is bored, the other half of the class is lost, and even the best teachers can only teach to the median. As classroom sizes grow, our ability to provide personalized educations just isn’t happening. So for me, the ability to scale is the use of technology.

I agree with this critique of classroom learning in general. Tutoring, on the other hand, is something like a gold standard in the research community ever since Benjamin Bloom’s 1984 study that tutored students performed at the 98% percentile level(!) of a control group (Bloom’s 2 Sigma Problem). I don’t believe the 98% has quite held up in replication, but I do have a strong belief in the power of personalization.

For better or worse I’m going to base my position on an analogy to medicine. Like the illnesses we see a doctor to treat, the misconceptions, lack of knowledge, or motivational breakdowns that hinder our academic performance are issues in the realm of teachers and schools. At least both occur mostly within our fleshy membrane.

Just like we wouldn’t want to be treated for an illness in a room of dozens of our peers, we would likely benefit from a masterful teacher that could work individually to diagnose our missteps and provide the right “treatment” (maybe an item of knowledge, but perhaps a motivating example, practice maneuver, or perceptual cue) to advance our learning.

You may or may not agree that this is a more desirable state but I think we can all agree that we (the American public school system, or any system of K-12 education) don’t have the resources for anything like this — enough individual attention for all students to learn all the standard curriculum.

The Silicon Valley Vision is that technology-based education can provide education that is not only better than one-on-one human teachers, but can also scale to accommodate every student, up to and including, yes, the poor African villager.

Big goals.

I always ask the question, how do you dematerialize, demonetize, and democratize different systems. In the case of education what I believe is going to happen is that we’re going to develop artificial intelligence systems, AIs, that are using the very best teaching techniques.

Let’s establish some common ground.

First, it’s not clear to me what it means that the AI is “using teaching techniques. Is the AI selecting and sequencing some pre-existing content, or is it actually constructing pedagogic material and enacting the delivery on its own (whether through generated text or Siri voice or even a robot)? The former is more realistic in the near term — for example, it’s the role that Knewton plays for the content of publishers it works with — and seems hinted at by later answers, so let’s stick with that.

Next, I don’t know how these “best” teaching techniques are determined. If these techniques are known, what has stopped us from applying them already?

I’ll give the Silicon Valley Vision the benefit of the doubt here: the “best teaching technique” is highly context dependent, and except perhaps for our imagined individualized 2-sigma teacher, the only practical way to map from context to technique at scale is with automated technology. That leaves us with one question: can technology do that?

An AI can understand a child’s language abilities, their experience, their cognitive capabilities, where they’ve grown up, even know what their experiences are through the days, and give that individual an education that is so personalized and so perfect for their needs in that moment that you couldn’t buy it.

Diamandis starts by enumerating of these contexts for personalization. In our medical analogy this would be like asking for a piece of software we switch on that tells us everything that could be wrong with us. Instead, we have countless scans, tests, and measurements that give hints at what could be going on. Is there reason to believe that the mind is more scrutable? I haven’t seen one.

Our state of the art in learning “diagnostics” is to hand-code the units of knowledge for a particular domain, ask tons of assessment questions, and infer a small amount of information of from each of these about how likely the student knows of each of the units of knowledge. For a typical case, a multiple choice question, the information content is very low — there’s already a 25% chance the student just guessed the right answer — for maybe a minute of the student’s time. That isn’t nearly the information bandwidth that a good teacher achieves, even working with a large class. (Don’t get me wrong, there is cool work that is building domain and student modeling in environments like games or inquiry learning, but the point is that this progress is incredibly slow — for example, a block stacking game that has been individually designed, programmed, and modeled over several years.)

And the beautiful thing about computers and AI is that it can scale at minimum incremental cost. So you can imagine a world in the future in which the son or daughter of a billionaire, or the son or daughter of a poor African villager, have equal access to the best education. We’re seeing that today in knowledge, right, because Larry Page, founder of Google, has access to the same knowledge and information that the poorest person on Google has. It’s a flattening of this capability.

Let’s ignore the issues of access to technology for now, that is, assume our villager does have internet access (uncensored and not prohibitively slow). Do they choose to access the knowledge? When they access the knowledge, do they have the background to understand it, or the means to put the knowledge into action? Sometimes, yes, and the whole project may be worth it for those cases, but when we’re talking about education being solved and done for everyone, there is no precedent here.

So AI for me is the answer to global dematerialized, demonetized, and democratized education. We have to separate learning things from actually socialization and being inspired and so forth. Humans are going to be part of that — always will be — but AI is going to be the way that I learn something. Or an AI can really deliver the information in a way that’s compelling and meaningful. In fact we’re going to have a situation where an AI may be watching my pupilary dilation or how I tilt my head or asking me questions to really understand, did I understand that concept, or was I just faking it by nodding my head. I mean how many times are you speaking to someone and they’re trying to teach you something and you say, “Yeah yeah yeah”, and really in the back of your mind you’re going, “I have no idea what this person just said.” I think education driven by neuroscience and by artificial intelligence will know that you didn’t get it, will back up to the point where you lost the idea, and then bring you step by step so you really do learn these things.

By now our picture in the medical world is rather comical. Imagine an personalized medicine system that, upon checking your vitals and determining the effects of the medication aren’t taking hold, retracts its robotic arm, refills the syringe, and injects you again, over and over, hoping one of these times will work.

If this AI vision doesn’t just mean repeating the instruction at the point of (detected) failure, then is there a map from the context that technology could infer to something “more meaningful” for the student? That’s a challenge for a fully empathetic human who knows the life story of one of their students. Well beyond Turing test level.

I think we’re really going to transform education very quickly. And it’s a huge and critically important part of our society, so as the father of two four-year-olds, I am personally passionate and excited about solving that challenge.

The language of “solving that challenge” sums up what’s most flawed in the Silicon Valley vision of education. There is no “education solved” checkbox. To the extent such a solution is envisioned, it is well beyond the grasp of the foreseeable future in the science of human learning or existing AI-driven technology in the field.

I do think there are tremendous opportunities for technology in education. If our goal is to provide a better personalized education, that means we need to be better at diagnosing and treating deficiencies in knowledge and skills. Just as there has been no disruption of medicine by the use of technology, there won’t be for education. But we can get better practice by practice, and tool by tool.

# How We Learn: Learning Without Thinking

I’m enjoying How We Learn for tying together quite of bit of what I learned during my year in grad school. The effects of spacing (chapter 4), testing (chapter 5), and interleaving (chapter 8, covered earlier) are powerful for learning, but we know a reasonable way to implement all of them: throw everything you want to learn into a spaced repetition system. What’s been most exciting is chapter 9, Learning Without Thinking, which covers perceptual learning.

School education is skewed to verbal and symbolic learning: tests require you to explain your answer or work out steps of math. Perceptional learning changes the focus to visual information. I’ve covered perceptual learning previously in the rather obscure realms of Stepmania and chick sexing, but it applies to almost anything. To see how powerful perception as a component of domain expertise, consider chess. Quoting Carey:

On a good day, a chess grand master can defeat the world’s most advanced supercomputer, and this is no small thing. Every second, the computer can consider more than 200 million possible moves, and draw on a vast array of strategies developed by leading scientists and players. By contrast, a human player–even a grand master–considers about four move sequences per turn in any depth, playing out the likely series of parries and countermoves to follow. That’s four per turn, not per second. Depending on the amount of time allotted for each turn, the computer might search one billion more possibilities than its human opponents. And still, the grand master often wins. How?

He quotes a sketch of an answer from Chase and Simon’s 1973 study of perception in chess, “The superior performance of stronger players derives from the ability of those players to encode the position into larger perceptual chunks, each consisting of a familiar configuration of pieces.”

What does that mean? We don’t have a verbal or symbolic understanding of this ability, eluding the primary mode of computers, education, and–unfortunate for me–blog posts. We see the visual information of the board, and it activates different sizes of “chunks” in our mind. These chunks perhaps roughly correspond to levels of abstraction. A small chunk is that there is a black pawn on g4. A little larger is seeing the king in check. A big, powerful, supercomputer-beating chunk is some kind of dominant offensive pattern that is observed by white’s combination of positions across the board.

…And how do we learn these chunks–in a way that hasn’t translated to the performance and algorithmic sophistication of computer systems? I think we’re still in the early stages of understanding that, but the next stop on my reading list is papers from the Human Perception Lab.

# Miracles through empathy and persistence

For me the first principle of teaching, using John Holt’s metaphor from How Children Fail: “To rescue a man lost in the woods, you must get to where he is.”

I’ve been hearing many stories about very nontraditional “students” who seem lost beyond hope. The Radiolab episode “Juicervose” (covering a story I first heard about from NYT), tells about how an autistic boy used Disney movies to start communicating with his family. After endless watching of movie after movie, repeated time after time, the boy finds the first phrase to reach out. Once his father figures out what’s going on, he takes the role of a Disney character to start really speaking with his son for the first time in years.

Some other examples (for some reason all podcasts): from the same episode, parents spend 900 hours imitating the self-stimulating behaviors of their autistic child before achieving eye contact. In Radiolab’s “Hello”, a woman lives with a dolphin in order to teach it to talk. In This American Life’s “Magic Words”, a couple use improv to speak to their mother who suffers from dementia. In Invisibilia’s “The Secret History of Thoughts”, a boy in a vegetative state is cared for everyday by his father until things start to turn around (this one is a must listen).

In all these case, the lost man is very deep in the woods indeed. For a while, it looks to the searchers like all of the walking in the woods is getting nowhere. They call out his name for the hundredth or the thousandth time, and this time, finally, there’s a response.

I think the principle applies not just to teaching but to self-learning as well. As learners, we must be mindful of where resources assume we are currently in the process. When we practice skills, we must have enormous patience and allow ourselves to slowly work our way forward from wherever we happen to start (instead of comparing ourselves to others).