Saturday, July 12, 2014

A Reservation about Kahn Academy

Salman Khan has developed outstanding lessons that communicate content concepts very well. I have watched a number of his tutoring videos as well as his TED talk and both have added to my respect for what he is doing. I join many others in believing that the Khan Academy is making an important contribution to contemporary education.

Such statements always seem to call for a "but" or a "however" and I offer mine here based on my own experience.

The problem I see about Khan Academy is that, in addition to serving a useful tutoring role, it purports to offer a complete educational experience: that is, for example, it claims to teach a high school algebra course. And a number of schools are now using the Khan materials to teach such courses with classroom teachers playing, at best, supportive roles. We also have an evaluation of the program being undertaken by the SRI Foundation with the support, as it has of the academy itself, of the Bill and Melinda Gates Foundation.

Whatever the outcome of that early research study, I predict that school adoptions of Khan Academy materials will ultimately fail and be withdrawn. My prediction is based largely on the infamous Raleigh Experiment of the early 1960s. I believe that considering the history of that too long forgotten experiment has lessons for us today and I offer it here.

The Raleigh experiment involved the use of another purported educational panacea, programmed instruction. Programmed instruction was the ultimate behavioral approach to teaching. A school subject was broken down into tiny elements and those elements were taught in a question-answer (paper-and-pencil at that time) dialog with immediate feedback. Although each question gained only a minute amount of ground, over time the gains mounted up and concepts were inculcated. And, as with the Khan Academy program, students learned.

To implement this process mathematician Jack Forbes of the University of Illinois Chicago Circle, prepared a programmed text that covered the content of a first year algebra course for Encyclopedia Britannica Press (EBP) through which students would independently work their way.

The publisher talked the Raleigh, North Carolina school system into undertaking a carefully designed year-long study of Forbes' product. Three groups were identified: (1) a control group of classes taught using standard resources by their regular classroom instructors, (2) a group of classes that used the Forbes materials with a teacher serving as a back-up mentor for students, and (3) a group of classes that used the Forbes materials with only a clerk in the classroom to pass out and receive materials and to administer tests.

At the end of the year the students were tested and the results were explosive. Programmed instruction was the big winner. There were significant differences in the test scores with group (3) best, (2) second and (1) last. You can just imagine how teachers, and Raleigh teachers in particular, were embarrassed by these results.

Of course, this made national headlines, schools fought to sign up for EBP programs, and publishers everywhere established their own author teams to write similar materials. (I headed up one of those teams for Prentice Hall.)

But then reality set in. The results could not be duplicated. The experiment was a perfect realization of the Hawthorne Effect. Students in groups (2) and (3) had been identified as participants in an important experiment and that year of study was their championship season. They put up with the day after day of drudgery and they temporarily took responsibility for mid-numbing hours of addressing atom-sized bits of self-instruction.

Without the special attention and contest-like atmosphere, the program failed with all but a few highly motivated students and the result was predictable. Publishers withdrew their interest - our contract was among those canceled - and EBP was left with a failed program. There were, of course, no corresponding national headlines about this turn-around.

I predict that the same fate will befall those who substitute full time use of the Khan materials for more traditional classroom instruction. Universal panaceas like this that place all the load on students' shoulders simply do not work over the long haul.

There is a more important aspect of the history I have described, however. Despite this failure, the EBP materials were of excellent quality and served very well when used in appropriate settings. For example, at the time the project took place I was math coordinator for the Norwalk, Connecticut schools where we had absence problems. Students missed school when they were hospitalized or took extended vacations with their families. When we identified these situations, we offered students and parents sections of those EBP programmed materials that covered the content they were missing. And this worked very well in many of these short-term settings. Thus the materials had a useful contribution to make.

Sadly, that possibility, or in fact any other use of those books, is no longer an option. Those materials are gone. Try eBay or Amazon and you will not find them. In fact, you will be hard put to find any programmed instruction materials anywhere. I expect that course sets today would be worth hundreds of dollars simply for their historical value.

That is what bothers me about the excellent Khan materials. While I predict that schools that go whole hog with this approach will soon meet the barrier that the Raleigh schools did, that doesn't mean that the materials have no value. They will continue to provide another instructional tool to be used in individual classroom settings and by individual students and parents.

I just hope that they will not suffer the fate of the EBP books, but I worry that the industrial model for our schools imposed by foundations like that of Bill and Melinda Gates will mean withdrawal of support when test results don't confirm their prior expectations.

The bottom line: the Khan materials are excellent and they deserve our continuing support but only for appropriate use.

No comments:

Post a Comment