Blacks start school with weaker skills and the ones who start with equal skills proceed to learn less. What did you think about it when you compiled all this data and presented it?

 I actually felt much more optimistic after working on all this than I felt before I started. This has always been viewed as an intractable problem by people since the late 60's and in the early 60's we thought we knew the answers and it became pretty clear that the answers we thought we knew were not anywhere near sufficient and then I think people kind of got very pessimistic. And they have stayed pessimistic.

 When I started working at this, I was pessimistic too. And after looking at it for a couple of years, I actually became much more encouraged about what was possible and also about what we accomplished.

Why more optimist?

 Well, the biggest thing is that there was this enormous closing of the black/white test score gap during the 1980's. I mean just for a ten year period we made more progress than I think you have in any comparable period of history on almost any test of anything. And there was just this phenomenal improvement in the national assessment of educational progress and reading and somewhat less but still quite marked improvements in math.

 And given all the pessimism that had been out there, nobody had predicted this, but it happened. Well that sort of says, you know, something can be done. That can't be attributed to biology, it can't be attributed to some intractable cultural problem. You can argue about why it happened, there's lots of room for that, but something good took place that was both a surprise and I think reason to think, you know, if we worked at it, maybe we could make more good things take place.

Claude Steele said,"Look, Blacks not only know about this (the black/white test score gap),they have been hounded by it." Why is this gap so important to society?

 The test score gap is important for two big reasons. One is that it's really got real economic consequences. Makes a big difference economically. How people do on basic skills, I mean it isn't so important how they do on a test, but it's important that they have the skills the test measure. And it does seem pretty clear that blacks who acquire these skills do, not quite as well as whites economically, but very close. So that's a big factor.

But the other thing is exactly what Claude Steele is talking about, namely, Blacks have been hounded by this gap for ages and ages and ages. And if you could eliminate it, I think it would change the stereotypes that affect the whole society and in a really important way. And it would also eliminate the need for a whole series of programs that nobody feels very good about. I mean you wouldn't need to have racial preferences for admissions to elite colleges if you actually had applicants who had comparable test scores. Well, that would solve a big political problem and a big social problem and a big psychological problem all at once. How to do it is a tough question.

How big is the gap, when does it start? How long does it last?

 Well, the easiest way to describe the gap is probably to say, if you take a typical Black student, what percentage of Whites does he score above and below? And the typical Black student is probably scoring below something between 70 and 80 percent of the White students of the same age. So that's quite a disparity. Obviously if they were the same typical Black student would be below 50% of the White students and if it's 70 or 80, that's a big difference.

That is typically true when kids enter kindergarten and it's still typically more or less true when they graduate from high school, so the pattern is kind of fairly consistent at the cross ages. Not exactly, but close enough. Now that doesn't mean that nothing has happened in between obviously, because the difference between kids who are in kindergarten are pretty small in the absolute sense. So there's a huge amount of learning that takes place and in any absolute sense, those gaps have widened a lot.

Now, did you find that people have preconceptions or conceptions about what makes the gap happen?

Back in the 60's I think the traditional liberal ideas were, first, school segregation was a big explanation and we all knew or certainly thought we knew that segregated schools put Blacks at a big disadvantage and thought that if we desegregated the schools that would play substantially well with closing the gap. Now it does seem to me, from the evidence, that it plays some role in closing the gap but it's much, much smaller than we expected 30 years ago

 And the other thing that we thought 30 years ago, pretty clearly, was we thought that the resources going to schools that Black kids attended were much less adequate. The teachers were less well-trained and the classes were bigger and all this kind of thing. And although I think that too plays some role, it's hard to argue it plays a big role these days because the resources--although they're not by any means completely equal--they're pretty equal. The big difference that you see is in the actual skills of the teachers who are teaching Black and White children. Most of the other measures like class size and so forth you don't see very big differences at all.

Unfortunately the things that are unequal like the skills of the teachers turned out to be more important than most of the other things. So that's a very worrisome and troubling situation.

What would you say if somebody asks, 'Is the score gap genetic?'

 I'd say the evidence as we have it now is pretty overwhelming that most of it is not. k You can't rule out that there could ever be any tiny little genetic component to differences between any group of people, but the evidence here is pretty strong, I think, that most, if not all of the gap is environmental in origin.

There's also a conservative bias that explains it through the culture of poverty. Can you talk about that?

 Well there's been a story about the test score gap being related to the culture of poverty and Black culture and so forth; it's been karound for at least a generation and probably much longer than that. And I think the story is a story about something you can't see. It's a little like the story about genes. You know, people have genes, you can't actually observe them but they might explain something.

 But this too, is a story about something about Black culture, depresses Black kids test performance. And of course, at some level, when you see that the Black kids are not doing well when they're coming into school, you've got to say well, 'there must be some reason for this, and if it isn't biological, then it's got to be something about their environments and their upbringing and the way their parents treat them and so forth.' And that's been a kind of a standard conservative explanation.

 I think that the politics of this are not really so much about whether it's culture, but about whether there's anything you can do about it. And for some people, when you say it's cultural, that means it's just there. There's nothing else to be said. There's nothing else to be done. For other people you say, 'well this is a cultural difference, but it's something that we can intervene and change, and there's no reason to accept these differences as if they were written in stone, just because you put the label cultural on them.'

What can be done? Put the effort on K through 12? Or maybe we should be looking at how much parents read to a child versus how much money they make?

 I think actually both the home and the school are really important. I don't think the schools alone can do this. But actually I don't think the homes alone can do it either. All big social problems have lots of causes, otherwise they wouldn't be big problems. And this is a perfect example.

It's a big problem because a whole lot of different things are all working in the same direction. And you have to kind of deal with all of them if you want to come to grips with the problem. You know, if you had to make an arbitrary guess, I'd say well, maybe the schools could do half of it and half of it would have to be the home. But this is kind of pulling numbers out of the air. I mean it might be one-third and two-thirds, or two-thirds and one-third. We don't really know the answer to that.

But surely a big piece of this problem is the home and the big piece of the problem is the schools. The reason for emphasizing the home is partly because the most important thing you have to change is what teachers expect of kids--and if the kids come in already at a disadvantage, then changing the teacher's expectations to make them expect more of kids who aren't doing well when they arrive in school is incredibly difficult. It's easy to change expectations when your expectations are just a fantasy based on nothing in particular. But if your expectations are low because the kids are arriving in school without the skills that you're used to, then it's very hard to change teachers around and say to them, 'well you may not see it now, but these kids could really do a lot better.'

Your co-editor presented findings which seemed to show that maybe even two-thirds, if not all, of the gap, can be explained by environmental differences if you change how you're defining socio-economic conditions. Can you talk about what she was trying to get across there and what you, or she, found?

 The question of what the environment can explain is always complicated because different people mean different things by the environment. So let me start with the narrowest definition, which is just sort of economic and educational differences between parents. And if you just compare Black and White kids whose parents have the same amount of income and the same education, and the same family structure, and that kind of thing, the gap drops by maybe a quarter to a third and that's consistent with what The Bell Curve says. And that's a very consistent finding across many different studies by people on all sides of the political spectrum.

 So then the question is, well what do you make of the rest? Well, a big chunk of the rest seems to be statistically explained by differences in things like child-rearing practices or what kind of families the parents themselves grew up in, which is probably related to child-rearing practices and what kinds of schools they attended and so forth, which aren't just parental education and income, but are part of a broader way of thinking about the environment that involves subtler things, like how often do you read to your kids, or, do you have grandparents who were better educated, or that sort of thing.

 So if you expand the environmental definition to include all that stuff, you can explain more. Well then you can say, well what happens to Black kids who are actually adopted by White parents? Now presumably, those kids are in environments that are even more like White kids environments, but of course we don't really know because the White parents who adopt Black kids are not random parents--they're atypical parents. We do have a study that compares Black kids adopted by middle class Black parents and Black kids adopted by middle class White parents and the Black kids do better on these tests when they're adopted by the White parents. But it's a small study.

 But all of this suggests, at least to me, that the subtler the way you think about the environment gets, the more it can explain. Of course to the people on the other side, you can read it in a very different way and say, 'oh well, all those environmental differences that you're looking at are really just proxies for these genetic differences that we believe explain all this.

In what way are standardized tests biased?

 I think the biggest problem was a lot of these tests is what we call them, not what they actually measure. When you call a test an intelligence test, people think they're measuring something that's inborn, genetic, biological, fixed in time, unchangeable, and we know that what intelligence tests actually measure isn't entirely any of those things.

It is partly determined by genes and it gets relatively stable as people get older and so forth, but it's not the case that what an intelligence test measures is your genes or your heredity or something... It's partly that and partly lots of other things to do with your family background and your schooling and your experiences and so forth.

 If we change the names of the tests, they still measure the same thing but it wouldn't convey this idea that somehow you've gotten the potential of somebody when you measured their IQ. And I think that creates a big bias, because the people who do badly on the tests are labeled as people with low potential in many people's minds and they sometimes even believe that about themselves.

 Psychologists don't believe that, but they stick to the label, nonetheless. I mean no psychologist would tell you that these tests measure genetic potential, pure and simple. But they will tell you that they were measuring intelligence, and then they'll tell you that that's a perfectly good thing to say that it measures, because that's what they've said it measures for 100 years. And they just don't worry much about what other people think that word means.

Isn't one of the criticisms of the SAT is that nobody's quite sure of what it does measure? Is it because ETS can't say, or don't want to say, what it measures?

 I think it's hard to say exactly what it measures. And I'm very sympathetic. It's especially hard to say what the SAT measures if you want to keep the acronym SAT, which is most successful marketing tool in testing history. Well IQ is right up there too, but SAT is what everybody knows you have to take to go to college and it's the test that's marketed by ETS. So if they change the name in any way that does reproduce SAT, they're in real trouble. So I think they've got a constraint there.

But in fact, if it had been called, say the Scholastic Achievement Test, I think it would've taken the political curse off the thing. It isn't exactly an achievement test, it's certainly not exactly an aptitude test. But if you recognize in the label that this involves achievement, then people will say, okay, well it may not be the kind of achievement we should test, but it's reasonable that you should give a test if it measures achievement.

Whenever Henry Chauncey, who was working with James Conant, ever got close to the word "achievement," Conant would say that's not what I want, because achievement was then the privilege of the guys who went at that time to Exeter and Andover.

I think when these tests were originally developed, people really believed if they did the job right, they would be able measure this sort of underlying, biological potential. And they often called it aptitude. Sometimes they called it genes. Sometimes they called it intelligence. But whatever they called it, they though that there was something there and if they just tweaked and fiddled and worked at it a little harder, they would get pretty close to being able to measure it.

I don't think people believe that anymore. They believe that how you do on almost any test is substantially affected by both your heredity and your environment and both things make a difference. Any psychologist would tell you that. But, the problem of finding a label for something which is both A and B, is a tough one and you could say it's the Scholastic Aptitude and Achievement Test for instance, but that doesn't sound good when you're selling it. Especially to someone like Conant who wanted a test that measured aptitude.

What's the only way to eliminate labeling bias in tests?

 I think you've got to re-label these tests. You need to call these tests things that really reflect what it is that they measure. And then it's also a question of what kinds of things the tests should really measure. But that's a different question.

Do the SAT's do a good job of predicting academic performance?

 I think they really don't do a good job of predicting. They do a pretty poor job of predicting, but they're the best we've got. Well that means the people who are good at those things, high school grades and test taking, are going to do well in getting into good colleges. And other people who would do equally well in college are just not going to make it because we have no way of picking out the kid who will do well, even though his high grades weren't so great and even though his SAT scores weren't so great.

 There are lots of kids out there like that and on the average they won't do as well as the other ones and the ones who will, are going to lose out because we can't identify. They come with little tags. If we knew what else it was--if we could say, 'well, it's stick-to-itiveness or, it's getting excited by a teacher or something,'--then we could measure it. That would help a lot. And it would probably help minority kids in particular because they don't do well on these tests and they are put at a disadvantage by that, and that's even more of an issue on the job where we know that tests are not terribly strong predictors of job performance and we know that lots of other stuff counts, But we don't know how to measure most of the stuff except by hiring somebody and seeing how they do.

Would you say it's fair to say that standardized testing has been harmful to Blacks and Latinos?

 Yes. The standardize tests that we give I do think have been a handicap for Blacks and Latinos in the job market. They've allowed us to measure something that a Black and Latino job applicant does unusually badly on, and it's not that they're used deliberately just to exclude Blacks and Latinos, but we just don't have any ability to measure the other things that they would do better on. And it's partly because it's most of the other things that count are easier to fake. You know, if you say, 'well I really want somebody to be responsible in this job.' Well, everybody can come in and tell you how responsible they are, and you know, they can get 3 letters that say how responsible they are too, so it's really hard to screen the people who are responsible and separate them from the people who aren't, although we all know that there are big differences in that respect.

In terms of the SAT, is the United States unique in its use of the SAT and the kind of test it is?

 I think there's no other country that I know of that uses the test quite like the SAT for college admissions. Some other countries have used tests of a somewhat similar character elsewhere in their system, the old 11-plus exam in England where they sorted kids into academic high schools and the comprehensive high schools was a bit like the SAT. But I don't know of any other large industrial country at least, that uses a test like the SAT for college admissions.

Do you think we're misguided in using them?

 I think we'd be way better off if we gave achievement tests and didn't emphasize the so-called aptitude test or now, just the mysteriously unlabeled SAT. I don't think it would change the results in favor of minorities to any great extent in the short run, but I do think it would have a good effect in the long run.

 And the reason it would have a good effect is that if you start testing achievement you send a measure to people that this is what you've got to learn to go to a good college, or to any college, whatever. And we know from all kinds of evidence that if you actually set a task like that, the minority students can do better than they're now doing. So I think that if we kind of change the way we set up the task and said this is a question of achievement, it's just like lots of other forms of achievement. You've got to work hard it, you've got to practice, you've got to get good at it.

You would have a very different state of mind than when it seems to people that this is something that is aptitude, unchangeable, inborn, you know--if I can't do, I just can't do it. That's a signal for defeat and giving up. And of course, it's not just a signal to minorities for giving up. It's a signal to any kid who tests badly and says, 'gee, I just don't get good scores on these kinds of tests.' Whereas if you tell him, 'this is a math test. You have to understand the test. Lots of people can learn that math if they work hard at it.'

Is the SAT the primary problem for minority students applying to college?

 In the case of a test like the SAT, I don't think we have much reason to believe that the SAT underestimates the academic skills that minority kids have acquired at the end of twelth grade. I think they really are behind and that we need to do something about that.

So when you say, 'well it's a problem with the test.' The problem isn't just with the test. The problem is that there actually has not been the same kind of academic achievement in the schools these kids attend, or in many cases even when they're attending schools with non-minority kids. Many of them haven't been working as hard, they haven't been taking these demanding courses. They're not applying themselves to these tasks in the same way and therefore they're not learning as much. That's a problem you shouldn't blame on the test. We need to blame that on the whole system that led to the result that they didn't actually know as much.

At the University of California right now, there's a debate going on with some recommending scrapping the SAT because the minority enrollments are down so much.

When people ask, 'should you get rid of the SAT?' The question is--well, what are you going to put in its place? What's the alternative?

 There's almost nothing that works better than the SAT. Grades in high school work a little better, but they don't work much better. They might be 20%, so we're kind of left with the problem of picking a selection system that won't work very well and will have a lot of consequences nonetheless.

There are two consequences of a selection system that I think really matter. One is--who does it let in and who does it not let in? We've been talking a lot about that.

The other consequence is--what does it do to encourage or discourage kids in school doing the work you'd like them to do?

Well, if you give a test like the SAT, which you say you can't study for, that doesn't encourage anybody to do anything useful in school. In fact it tells them if you've got good scores and don't work too hard, you'll probably get into a pretty good school anyway. And if you've got bad scores and really work really hard and get A's, you may not get into a good school nonetheless. This is not the message that you'd want to send if you were running a school or a school system or a country, I think.

 Then you look at it the other way, and say-- well, who gets in and who doesn't get in under this system? Well, high school grades give you a somewhat more diverse set of kids who will qualify for a place like Harvard or Berkeley or whatever than these tests do. And I think it would be better to use the grades than the test. But you do have to address the problem of how you're going to keep the schools honors in some way and not have them just inflate their grades so that they'll get more people into top schools.

Beginning in 1988 the black/white test score gap widened. And for the last ten years, it's been pulling apart. Is there any explanation for why that happened?

 Actually the gap started to widen in 1988 and it continued to widen for about six years. Since then, it looks like it's beginning to go back again. It looks like we're more on track then when we were.

What seems to have happened, there was a big cultural change of some kind in the Black community. The percentage of kids who said that they ever read a book for pleasure or talked about a book to a friend, or who went and bought a book with their own money among Black kids fell very precipitously starting after 1988. Now, Ron Ferguson who discovered this fact about what had happened, argues that this was related to sort of rap music and all this kind of thing. Obviously there's no hard evidence about what the cause was. But it's not at all surprising that if people read a lot less books and are spending less time talking about books and so forth, their reading scores will go down and interestingly their reading scores went down way more than the math scores during this period. The math scores actually didn't fall appreciably and I think that reflects partly the fact that we're doing a better job teaching math in school.

You mentioned that the reason Blacks lag behind is because they are not as committed as whites, to achievement academically and so there's just this aversion to acting White. Is that really true?

 I think the evidence that Blacks are more averse to doing well academically than whites is pretty weak. But the problem is that everybody in America is kind of nervous about looking like a nerd, or looking like an A-student. I mean high school kids don't treat A-students as kindly as they treat some other people--football stars for instance.

The thing is that Black students start out behind. So if they're going to catch up, in order to catch up, they've actually got to do more than the White students and, if they're no more academically motivated than most White students and they start out behind, they're going to stay behind. Ron Ferguson uses this wonderful analogy which I think is right. You see a track race. There's a White runner and a Black runner. The White runner is ahead and the White runner isn't running very hard, he's kind of jogging along, and then you look behind and you see the Black runner, but he's not running very hard either, he's just kind of jogging along. Well, in that circumstance you could say well, there's not the fact that the Black runner isn't trying very hard doesn't explain why he's losing, because the White runner isn't trying very hard either. But if you say what would it take for the Black runner to catch up, the answer is pretty obvious, you'd have to run faster. And it wouldn't be that hard to do it. Now, of course, then the White runner might start to run faster too.

Was it Ferguson's chapter that mentioned the evidence against "acting White?"

 Most of the survey evidence about Black student's behavior suggests that there aren't big differences in the kind of standard objective measures that the surveys collected on--like cutting classes. Black and White students both cut a fair number of classes and that the Blacks are not much more likely to do that than the White students. The social cost of doing well in school--at least as best you can measure them--don't seem to be terribly different and so forth. So if you just say is there a big difference between Blacks and Whites in high school in this regard, I think the answer is, it doesn't seem to be a big difference in high school, but of course, as I said, the Black students are coming into high school with relatively low test scores and relatively poor academic preparation.

So, if they don't work harder than the White students, they're in trouble, and basically, they don't work very hard and neither do the White students. Hardly anybody does any homework in American high schools, except a tiny number of people who want to go to Ivy League colleges. This is a big problem. But it's an equal opportunity problem.

You talk about two different versions of merit. One is a prize and the other is a more subjective judgment of future performance. Can you talk about that?

 When colleges talk about admission, they often talk about diversity and so forth and then conservatives say, 'no, no, no, we should be admitting on merit.'

When admissions officers think about applicants, they typically aren't thinking about what the student has already done. They're thinking about what the student might do in the future. They're kind of trying to pick horses, if you will. They're kind of looking at this kid and saying, 'well, this kid's done this and this and I think he's going to go a long way and do well and so on and so we want to admit him.' And-- 'this is a kid who did well in high school, but I don't see any spark.' They use all kinds of words you know, and so the admissions business is sort of a horse picking business. Well when you start to think about what are people going to be doing in the future, you immediately have to recognize that all kinds of things that don't have to do with academic achievement are likely to be relevant.

There's a fear now that at places like the University of California and University of Texas that these schools will now re-segregate. And you say that if we choose solely on the basis of test scores, that selective schools will be 97% White nation. What if this happens?

I think if we end up with a system in which the top schools are 97% or 98% White, this has very serious political implications for the country. Because you've got to convince people that they have some reasonable shot at making it and although most people obviously aren't thinking, will I ever get to go to Harvard, because they know pretty early on that you know, they probably won't.

The symbolism of having the top schools be almost all White and Asian is quite likely to have a real re-enforcing effect--'well, it doesn't matter what you do, you don't get there.'

 And that sort of feeds back to--'well, do people do the work they need to do to go--not to Harvard--but to the University of Massachusetts or to Framingham or something? There are places that many more students are going to go to. And if they start off thinking--'well, nobody who looks like me is an academic success.'--they're not likely to get to college at all. So I think there's a ripple effect through the whole system. And of course, then there's a ripple effect into the political and economic elite as well.

Summarize what you think reducing the test gap would mean for America.

 I think if we reduce the test score gap, that three big things that can happen. One is, you open up the best colleges and universities to Black and also Latino students on a basis that doesn't involve racial preferences or affirmative action or anything, but is purely on the basis of merit. I think that would solve lots of political problems in the country and it would also change the opportunity structure in a way that would make it much more equal.

 The second big thing that would happen, even bigger in a way, I think, is that all the evidence we have suggests that wage disparities would shrink very dramatically. My strong guess is that at the same time the level of discrimination in the labor market against minorities will go way down if people weren't coding that dark skin means you can't do the reading or you can't do the math and so forth, to the degree that they now do.

 And the third, a really huge thing that would flow from getting rid of this gap is that I think the gap now plays a big role in maintaining the sense that the self-doubt in the minority community about ability to compete in these kinds of arenas and that in turn sort of supports all kinds of separatism and the feeling, you know, 'we're never going to actually manage to make it in a integrated society, that Whites will never accept us.' All this kind of stuff, which is completely understandable in the kind of racial environment that many people now live in. And I think getting rid of these disparities and academic performance would go a long way towards changing that, just as it has for the Asians.

And you think that based on the evidence, we shouldn't be pessimistic, we should be optimistic?

 I think we be should optimistic that we can do something. Now there's a question of, 'do we want to do something? Does anybody want to do something?' But I'm much more optimistic than I was 20 years ago about our capacity to do something if we want to. And I'm also very encouraged by what happened during the 1980's. I think that that suggests that you can really move this disparity in the right direction.

Now that doesn't mean it was effortless, the biggest factor in what happened in the 1980's is probably that Black parents were much better educated for the next, you know the parents of the kids who were graduating at the end of the 80's were better educated than the ones who had graduated in the end of the 70's, and that made a difference, but we got there by hard work. A lot of people fought really hard to make those things happen and they did happen. And I think the experience of the 1980's for the kids' test scores tells you that if people work at it, they can make a difference. But they actually have to have some kind of faith in the possibility in order for that to happen and we've been a little short on that in the last 20 years.

 I'd say this is a case where everybody needs to do something. I don't think that the African-American community can do this without a lot of support from the White community and the political leadership. I also don't think that the White community and the political leadership in the country can do something without a lot of help from the African-American community. If this isn't everybody in it together, it isn't going to work. And it hasn't worked in the past and it won't work on this one in the future. This is like a marriage. You know, if you get into one of these cycles in which everybody is looking for, well, who's going to fix it? You're in trouble. You both got to fix it.

What does the SAT measure?

 The SAT is a scam. It has been around for 50 years. It has never measured anything. And it continues to measure nothing. And the whole game is that everybody who does well on it, is so delighted by their good fortune that they don't want to attack it. And they are the people in charge. Because of course, the way you get to be in charge is by having high test scores. So it's this terrific kind of rolling scam that every so often, somebody sort of looks and says--well, you know, does it measure intelligence? No. Does it predict college grades? No. Does it tell you how much you learned in high school? No. Does it predict life happiness or life success in any measure? No. It's measuring nothing. It is a test of very basic math and very basic reading skill. Nothing that a high school kid should be taking.

Is it an IQ test?

 No.

Why isn't it an IQ test?

 It's not an IQ test because it doesn't measure IQ. It is used that way. And it was developed from the army IQ test. But even the College Board will refuse to say that this is an intelligence test. And I'd love to see them say it. I'd love to see them say anything because then you can attack it. But there's this kind of mushy response that when you work your way through it, there's sort of nothing left. Well, it has a slight predictive validity to freshman year grades in college. We spend a 100 million dollars a year for that? You know, your grades in high school predict college grades better than this and we didn't have to spend anything.

They say the SAT provides a common yardstick for comparing grades at different schools.

 Right. That's where all of the anti test people, I think, are wrong. And where the testing folks are right. You do need a common yardstick. You do need some way to judge an A at this school or this teacher versus an A at this school or this teacher. But there are lots of common yardsticks. Again, you could use blood type. You could use height. Anything is a common yardstick. What you have to say is, fine, it's common. But it is useful? And there are lots of tests that are more useful than the SAT that are also common.

Like?

 Well, for instance, the Advanced Placement Tests. They are rigorous. They're difficult. There are lots of them. You can say, my interest is history. And so I'm going to take a history Advanced Placement test. And I'm going to get--I want kids to be rigorous. I want curricula to be rigor to be rigorous. But I want them to be not one size fits all and not mindless. Like, let's have kids studying hard but let's have them studying something useful, hard.

Let's talk about what you do.

We're here to raise your scores. And depending on what class you walk into--if you're a 600 level math student and we want to get you a 700, then this course has nothing to do with math. It is--you know the math. It has to do with being a good test taker. If you're a 300 level math student and you really don't know how to add fractions, then we're a math course. It really depends on where you walk in. But the fact is, that for most of our students the problem is more the SAT itself than it is their math skill, their English skill or their ability to do college level work. Not every student.

When you walk into a Princeton class, do they tell you that there are certain tricks?
 

People would like to think that it's a multiple choice test that's scored by a computer. So it's objective. It was written by a computer. It's measuring something that is important and objective. It's not. This test was written by people. Mostly failed educators. Right? It wasn't by like Nobel physicists. It was written by a bunch of teachers who got together and said, well, you know, why don't we ask it this way? There's a certain idiom to the test. There's a certain way they ask questions. There's a certain way to create wrong answers. And if you're good at that idiom, then you're going to do well on testing in general. Not just the SAT but all of these tests, are kind written with the same tools and with the same types of people.

 And if you're bad at test taking--you always think that's sort of, you know--a parent says, my kid just can't take tests. And in the back of your mind is, well what you're saying is, your kid is an idiot. But it's really true--some people can't take tests, because they don't speak that language.

The tricks we teach are common sense to a good test taker. It's what you do. We're just saying, this is what kids who do well on tests do. They might not know they're doing it. But they're doing it.

Does it really just boil down to test taking strategies?

A kid's coming in to get higher scores. All right? We're not there to teach Shakespeare because the test doesn't measure Shakespeare. We're not there to teach trigonometry because it's not on the SAT. We're there to teach you to score better on this exam because this exam is going to determine where you go to college and how much financial aid you get. It's also going to determine how you feel about yourself in some large measure. You still remember your SAT scores. And everybody else does too. Everybody's forgotten everything about themselves, everything else about high school. They remember their SAT scores.

What were yours?

 I remember. They were about 1500.

Princeton Review's model is Joe Bloggs, who is Joe Bloggs?

 Joe Bloggs is the average American student. He's not stupid and he's not smart. He's average. Right? He scores a 500 in math and a 500 in English. And what you've got to do when you take the SAT is realize--people will tell you it's in order of difficulty. What they really mean or what's really true is that, they gave each question to a couple thousand kids. Right? Some of the questions--everybody got them right. How did they know if a question's easy or tough? Everybody got it right, it must be easy. Everybody got it wrong, it must be tough. Joe Bloggs got the easy ones right and got the tough ones wrong. So there you are on an easy question and you know everyone in the country got it right. Whatever you want to do, whatever you gut answer is, do that. Don't second guess yourself. Just do it. Because it'll be right. When you're on a tough question though, whatever you want to do--whatever Joe Bloggs would do--don't do it. Because it for sure is a wrong answer. If it were right, how come this question's at the end of the test? Why is, why did everybody manage to get this question wrong and somehow it came to you in a flash? It didn't come to you in a flash. The wrong answer came to you in a flash. It's a trick answer. The--give me the first word that comes to your mind. Cat.

Dog.

 Hello.

Bye-bye.

 Up.

Down.

 Peanut butter.

Jam.

 Table.

Cloth.

 Hmm. Grass.

Green.

Okay. There's certain words that come to everybody's mind. There's certain things everybody does. That's Joe Bloggs. It's knowing that my gut answer is the same as the gut answer of everybody else in this room. And on an easy question, go with the gut answer because it works. And on a tough question, eliminate it because for sure it's wrong.

But it sounds so cynical--forgive the expression.

 No. It's common sense. It's the way you live your life, your whole life. Honestly. Like, all the time in real life, you know, you handle the question in context. You're at a parking meter and you've just parked. And your wife says do you have a quarter? Right? The only thing that runs through you mind is, well, do I have a quarter? You know, and you look. Now, you're in the middle of the park and it's dead of night. And someone big is heading towards you. And he sort of leans and he says, hey, do you have a quarter? And the first thought in your mind is not, well, do I have a quarter? And start looking. It's, well, do I have problem here? It's common sense.

On a tough question--you're in the middle of the park and it's dead of night. You know, and you just go to-- well, why are they putting that question? Why am I putting this answer?

When we were in one of the classes, the instructor sat there and said, you can eliminate this Joe Bloggs answer. Now you're left with three. Don't you think if we were to put that much instruction into real instruction, the kid could get the right answer?

 If you were put that much time into writing a good test, then we would spend the time teaching it. If this were an essay test measuring how well you understood current events, we would teach current events. Like, don't shoot us. Like, we'll go where ever they want us to go. If you write a test that has little trap answers all over the place, then we're going to teach kids how to get around the traps. Because that's what we're paid to do. Our job isn't to teach you Shakespeare because that's not going to help you get into college.

How is your business? Is it growing? Is it booming? Would you safely characterize America's view of the SAT as being obsessed with it?

There are a couple different things going on. Number one, college admissions is much more difficult, much more selective, than it was 20 years ago. So these tests are more important. Number two, college is a lot more expensive. And more kids are going to state schools. They're not going to spend a lot of time reading your essays. It's your scores and your grades. And so the test is even more important at a large state institution than it is at a small school. And more kids are going to large state schools. Number three, people still have an emotional attachment to the SAT. It's still your first kind of mono-a-mono experience. Like you against the whole country. But back then they thought, this is an IQ test. I can't do anything about it. So you sort of had a little nervousness about it. But it was no big deal. It was like, it was like a blood test. You know? It was something you had to go in and do. It made, made you a little nervous but it is what it is. Now you realize that this is a very coachable test. And so it's no longer just a little bit of nervousness. Now it's like three months of preparation.

ETS says it's not a coachable test...

 ETS has refused easily 50 times to do an independent study that we both get involved in, because it would be so easy, right? We say, here's a list of our kids. Here's exactly when they took the course from and to. Go put it in a computer. ETS, you supply all the numbers. And let's look at the prior and the post and we'll know. Right? We know that as a country, kids who start where my kids start--which is around 1100 ah, better than the average--ah, go up about 20 points. And these kids go up this many points. And the difference is us. Right? It's an easy study. And they don't want to do it. The only time they do a study is by themselves, not asking for any help, not showing anybody their methodology or showing anybody the raw data.

Why won't they participate?

 Let's say that they acknowledged, after 50 years of lying, that the SAT was very coachable. Number one, they've got to account for 50 years of lying. And number two, they've got to deal with, with the implications of successful coaching to race and gender bias issues. Okay. Rich kids all coach. Poor kids don't. There's a widening gap between rich kids and poor kids. We can no longer say it's because of the schools or because of the unfairness of society. Now we have to admit that we're part of the problem. There's a gap between men and women that's substantial--that they can just sort of laugh off. And you'll watch as you interview them and they do a dance. Why do men out perform women on the SAT? The SAT's supposed to predict college grades. Women do better in high school and they do better in college. What's the problem here? Ah, the more you use, the more you start accepting that the SAT's coachable, the more problems you have with it.

Do you think that it's fair to have so many kids actually paying to bring their scores up and other kids who can't afford to?

 First of all, I'll tell you--I mean, there's an appropriate amount of studying to do for the SAT. Like kids in our course are spending hundreds of dollars and a lot of time. We also have the best selling books and software. And those are like $20. But somewhere in between the books or the software and the course, that's a reasonable amount of money to spend for a pretty important test. There are also kids spending a year and 20 or 30 thousand dollars prepping for the SAT. So the problem sort of magnifies as a different strata of society--no coaching, a little coaching, more coaching, a ridiculous amount of coaching. Scores just get pulled apart. And then you set social policy on people's scores and you've got a big problem.

Second--I have a big problem with these laws. These are politicians getting involved in decisions that they have no business being involved in. Being an admissions officer is like being a casting director. It's about choosing a class that's going to work well together. You want men and women. You want blacks and whites. You want a diverse class. You want people who are great athletes to be on your teams. People who are great journalists to be on your papers. And people who are great actors to be in your acting department. You're building a team. To say to them, look, all you can do is use this score, this measure of performance--that's all that's important--is making their job into a joke. These are very serious professionals. And you're saying, look you can be replaced by--hell, not a computer--like a calculator. Right? Just punch it in and, and you get a number. And I think that's ridiculous.

Your competitor says the test is flawed but it's the best we have and we should keep it. Do you think we should keep it?

 We should get rid of the SAT as fast as we can. Look, there are bigger problems in society. This is not the biggest problem we have. But it's so easy to get rid of it. Right? Just pull the plug.

Can we return to the correlation between the SAT and socioeconomic status. The higher the income the higher the score. Is this fair that this is what it's measuring?

 Well, it is very fair that rich people have nicer clothes than poor people. If you believe in capitalism, you got to go with that. The problem with the SAT is that it pretends to be a meritocracy. Right? Again, if it's in the back of a magazine and rich people do better than poor people, who cares? But this is a test where everybody's saying, look, we're just being an incredibly fair society here. Everybody takes this test. And the better kids go to the better schools. And it's just bullshit. You know, the better kids hire me.

Tell me about it.

 I couldn't agree more with their findings. The SAT is a bad test. It is biased. It measures nothing. And we should get rid of it. We do need a common yardstick. We do need a good test of some sort or several tests. The Princeton Review can prep kids for just about anything. We have kids working with us for the medical boards on a test of, like, anatomy. It's a real serious content test. And we teach real serious content. I think we're pretty good teachers. If you give us a really good test, I think we can be really good teachers for that test. The SAT will never be a really good test. It is a scam.

You say it doesn't measure intelligence. What does it measure?

 The SAT is said to predict freshman year grades in college, a little. And it does. It measures it a little. Almost anything you do, including family income, will measure freshman year grades a little. But the point is that it doesn't measure intelligence. It doesn't measure anything that's worth a 100 million dollars a year prepping for it.

But the man who started ETS, started it with a noble purpose.

 Yes. To prove that white northern Europeans were smarter than everybody else. That was his men were smarter than everybody else. That was his goal.

Every problem starts out as a solution to a problem. And the SAT is no exception. The world before the SAT--it was kids from Andover and Exeter got into these top colleges. And the rest of us didn't.This was a leveling. But it was a leveling among upper middle class white men. Because that was the population who took it. And as the rest of society started taking it, the SAT became more and more irrelevant. And the tragedy about the SAT is not its invention. It's as the world changed, the SAT didn't.

You look even ten years ago--before the Internet, you know, before any number of things--the SAT looks exactly the same. You look 50 years ago and the SAT is still the same. This test is a dinosaur.

They're saying that the early bird gets the worm. If it's a coachable test, then let's start coaching yearsahead.

 I got to tell you--we strongly discourage students from working with us before the end of sophomore year. Like strongly. If you call up the Princeton Review office and say, I'm a freshman and I want to start working for the SAT. We will turn you away, because we think that you shouldn't spend your entire high school life thinking about the SAT. That there is a limit to the neurosis that even we can tolerate.

But the problem with these tests--and the state exams as well as the SAT--is that as you ratchet up the stakes, this becomes more and more important. Can you really blame people for taking it very seriously? And you can't look at the people who are spending a ridiculous amount of money and time obsessing about the SAT. You have to look to the test and say, why are setting the stakes like this? Why are making a test of something that has nothing to do with high school?

Can you walk us through a question from the SAT?

 P, Q, R and S are four towns. P is farther north than Q and R. S is farther south than P. Q is farther south than R. Which town is the farthest south? P, Q, R, S or it cannot be determined. Like, is it, would you consider that an IQ question?

A logic question.

 Is it a logic question? I think it's....

A trick question?

 The first time you see it, you might be confused or you might have seen something enough like it or you might be good with maps. Once someone has explained this question to you, you will never get it wrong again. Right? I mean, there's a simple way to do it.

What kind of a question does it strike you as?

 A, very coachable. B, not really math, certainly nothing you learn in high school and nothing that will be useful in college. Plausibly a little bit of logic, I'll accept that. But I think more just a little trick. I mean, what they're trying to see is that just because two things are south of you, you can't really determine if one is further south than the other just because it's Q instead of R. It's the kind of question that they do a lot. There are four towns. A, B, C, D.

Let me start.

 It's the kind of thing they do a lot. There are three towns--A, B and C. The distance from A to B is four. The distance from B to C is three. What's the distance from A to C? And of course if you're kind of linear, you would say, well it's seven. It's the two together. But of course, they don't have to be in order. So it could be one. Does it measure what you learned in high school? No. Is that useful in college? No. It's a little trick thing. You'll get it wrong once. Someone will explain it. And then you'll be ready for it.

Why develop a question like that if it's only measuring a test-taking technique?

 Because the point of writing an SAT question is not measuring what you learn in high school or how well you'll do in college. It's separating out kids. There are kids who will get that right. And they're generally the kids who have been in math courses where they play with this kind of stuff. Which is to say, upper income. And there are kids who will get it wrong because they don't play with this stuff.

So the question is very good at separating kids. And that's why they have it here.

 Let's do some more.

 Money is to bank, as food is to basket, park is to city, cash is to store, book is library and article is to magazine. So what you're supposed to do is say, I put money in a bank. And I guess the, ah--or money is kept in a bank in the same way that a book is kept in a library. Maybe it's a vocab question. Do you know the word bank or the word money. I can't believe that it's a logic question. And I can't believe the kid who gets that right is going to be better in college than the kid who gets it wrong. Ah, especially since there are some wrong answers that are pretty attractive here. You know, you sort of think of banks and money. And there's an answer with cash. And you sort of--you know, you're stressed. This is important. You're in a rush. You're in the middle of the SAT, which is a pretty important test. It's nine in the morning on a Saturday. You're probably hung over. And a lot of kids who get that wrong--it's not because they don't speak English. And it's not because they won't do well in college. Our experience is, a kid who doesn't do well on the SAT--it's not because he gets the toughest questions wrong. It's because they make lots of careless mistakes on easy questions. They get sucked into trap answers a lot. Because they don't have their footing. They don't understand the question. It's not that they can't do it.

So a lot of the course isn't focusing on the toughest questions. It's focusing on making sure you don't get that question wrong.

How did you come up with the Joe Bloggs technique?

 I met a fellow I started the country named Adam Robinson. Who was working with this girl, and every time she would get it down to two, and every time she would get it wrong. And she was going nuts. And finally he said, get it down to two. Guess something. And then answer the other thing. Because whatever you do is wrong. And then he realized that's actually not random. A bad test taker isn't bad randomly. He's bad because he believes that there's an easy answer there. He moves towards the attractive answer on a difficult question.

Let's find some questions.

 Okay. I got a question that I pulled, that I, that I sort of think is useful. Did they do the doughnut question in class? It's sort of a quintessential SAT question.

What about the doughnut question?

 You got a doughnut here. And the question reads, in the figure above, what's the greatest number of non overlapping regions into which the shaded region--the doughnut--can be cut with two straight lines? In other words, how many pieces can you cut the doughnut into with two straight lines?

This is the last question on the test. It's Saturday morning. You're very stressed. You're very tired. And this is really important. So what Joe Bloggs does is, he'll just cross lines. Right? The easy answer there is four. I can make four pieces pretty easily. What are the odds that on the toughest question on the SAT that you've done enough work? Right? They're zero. No way. And again, a good test taker's sitting there. And he answers four and goes, god, there must be tougher than this. And he's right. So you cancel four. And of course, since you're able to get four, you cancel three and two also. That's not the greatest number you're able to cut it into. You're able to cut it into at least four. The answer's got to be five or six. And then you sit back for a second and you say, what else would Joe Bloggs do? He'd say, well, they want the greatest number possible. So maybe it's six. Maybe it's the greatest number. So it's not that either. The answer's got to be five.

On the one hand you might way, well that's kind of a goofy way to take the test. That's all testmanship. On the other hand you might say, what is this question telling you about a kids math skill or his ability to do college level work? This is just a good question. And goofy questions deserve goofy preparation.

And another one...

 There are three roads from Plattsville to Ocean Heights. And 4 roads from Ocean Heights to Bay Cove. If Martina drives from Plattsville to Bay Cove and back, passes through Ocean Heights in both directions and does travel any road twice, how many different routes for the trip are possible? 72, 36, 24, 18 and 12?

Like, what is this telling you about your son. Like, is it telling you he's stupid that he got it wrong? Is it telling you he shouldn't go to college or he should? What is it telling you? And I would claim it tells you almost nothing. A great question for Games Magazine but a lousy question for Harvard.