The Illusion of Culture-free Intelligence Testing

For almost as long as there have been IQ tests, there have been psychologists who believe that it is possible to construct "culture free" tests (Jensen, 1980). The desire for such tests springs directly out of the purposes for which tests of general intellectual ability were constructed in the first place: to provide a valid, objective, and socially unbiased measure of intellectual ability. Our society, founded upon the principle that all people are created equal, has never lived easily with the recognition of enormous de facto social inequality. We need a rationale for such inequality and our traditions strongly bias us to seek the causes of inequality in properties of the individual, not society. At the same time, we realize that social and economic conditions, by shaping people's experiences, can be the causes of individual intellectual differences, as well as their consequences. Can' t we find universals in human experience and construct a test on this basis?

What would be more ideal than a psychological test that could measure intellectual potential independently of the specific experience provided by sociocultural and economic circumstance? Such a test would provide an excellent tool for insuring that unfortunate social circumstances would not prevent the identification of intellectual potential. Some psychologists have claimed not only that such tests are possible in principle, but have been applied in practice (Hernnstein & Murray, 1994).

In this chapter, I will argue that the notion of culture-free intelligence is a contradiction in terms. I begin by reviewing the historical background of efforts to understand the relation between culture and thought that formed the scholarly background against which IQ testing came into being. After summarizing briefly the strategy developed by the pioneers of IQ testing, I will present a "thought experiment" to help clarify the issues and some empirical evidence from research which has sought to approximate the conditions of the thought experiment. I close by offering some comments on how to think about culture and IQ testing given the impossibility of a culture-free test of intellectual ability.

Beliefs About Culture and Cognitive Ability in the 19th Century

The several decades just proceeding this century provide a useful starting point from which to trace theories of culture and cognitive development, because it was during this period that both anthropology and psychology, the disciplines assigned the roles of studying culture and cognition, took shape as disciplines. Until this time there was no distinctive body of methods for the study of the "humane sciences," nor had scholars with different theories been institutionally divided into separate disciplines, each with its own methods of studying human nature.

Obvious differences in technological achievement between peoples living in different parts of the world were common knowledge among European scholars. Their theorizing about sources of these differences had produced rather general acceptance of the notion that it is possible to study the history of humanity by a study of contemporary peoples at different "levels of progress." The "father of anthropology," E. B. Tylor, summarized (in which he called a "mythic fashion") the general course of culture that most of his fellow scholars would have adhered to:

We may fancy ourselves looking on Civilization, as in personal figure she traverses the world; we see her lingering or resting by the way, and often deviating into paths that bring her toiling back to where she had passed by long ago; but direct or devious, her path lies forward, and if now and then she tries a few backward steps, her walk soon falls into a helpless stumbling. It is not according to her nature, her feet were not made to plant uncertain steps behind her, for both in her forward view and in her onward gait she is of truly human type. (Taylor, 1958, p. 69)

Tylor made another assumption that also won general acceptance: there is an intimate connection between socio-cultural progress and mental progress. "...the condition of culture among various societies of mankind," he wrote, "..is a subject apt for the study of laws of human thought and action" (Tylor, 1874, p. 1). He even adopted the notion of a "mental culture," which he expected to be high or low depending upon the other conditions of culture with which it was associated.

Herbert Spencer, writing at about the same time, shared Tylor's belief in the fusion of mental and sociocultural progress. He argued that the circumstances under which the earliest human beings lived provided only a limited number and variety of experiences. "Consequently," he argued, " there can be no considerable exercise of faculties which take cognizance of the general truths displayed throughout many special truths." (Spencer, 1886, p. 521)

Spencer invites us to consider the most extreme case; suppose that only one experience were repeated over and over again, such that this single event comprised all of the person's experiences. In this case, as he put it, "the power of representation is limited to reproduction of the experience" in the mind. There isn't anything else to think about! Next we can imagine that life consists of two experiences, thus allowing at least elementary comparison. Three experiences add to the elementary comparisons, and elementary generalizations that we make on the basis on our limited (three) experiences. We can keep adding experience to our hypothetical culture until we arrive at the rich variety of experiences that characterizes our lives. It follows from this line of reasoning that generalizations, the "general truths" attainable by people, will be more numerous and more powerful the greater one's experience. Since cultures provide experience, and some cultures (Spencer claimed) provide a greater diversity of experience than others, a neat bond between cultural progress and mental progress is cemented.

Although such evolutionary schemes seemed almost transparently obvious in the enthusiasm following publication of Darwin's Origin of Species. events toward the close of the nineteenth century proved that there could be a great deal of disagreement about the relation between culture and thought, despite the compelling story constructed by scholars like Tylor and Spencer. One set of disagreements arose when researchers started to examine more closely the data used to support conclusions about relations between cultures, especially claims for historical or evolutionary sequences. A different set of disagreements arose around conflicting claims about mental processes.

The source of these disagreements concerning sociocultural sequences can be found in Tylor's own work. The main criteria he used for judging the stage of a culture were the sophistication of industrial arts (including manufacturing techniques for metal tools, agricultural practices) and "the extent of scientific knowledge, the definitions of moral principles, the conditions of religious belief and ceremony, the degree of social and political organization, and so forth." However, in Tylor's words, "If not only knowledge and art, but at the same time moral and political excellence, be taken into consideration it becomes more difficult to scale societies from lower to higher stages of culture" (Tylor, 1874, p. 29).

This undeveloped theme in Tylor's work was taken up by Franz Boas, who submitted the cultural evolution position to a devastating critique at the close of the nineteenth century. On the basis of his own ethnographic work, Boas (1911) concluded that a great deal of the evidence apparently supportive of evolutionary schemes was so deeply flawed that no clear conclusions ranking one culture above another could be accepted. Boas did more than show the flaws in evolutionists' data and arguments concerning culture; he also delighted in showing that examples of "primitive mind" produced as part of this argument were based on misunderstandings.
Consider the following example from Boas's classic, The Mind of Primitive Man, which repeats evidence used by Spencer to make some generalizations about properties of primitive mind:
In his description of the natives of the west coast of Vancouver Island, Sproat says, "The native mind, to an educated man, seems generally to be asleep....On his attention being fully aroused, he often shows much quickness in reply and ingenuity in argument. But a short conversation wearies him, particularly if questions are asked that require efforts of thought or memory on his part. The mind of the savage then appears to rock to and fro out of mere weakness." (Boas, 1911, p. 111)
Spencer's text goes on to cite a number of similar anecdotes corroborating this point. But Boas produces an anecdote of his own.

I happen to know through personal contact the tribes mentioned by Sproat. The questions put by the traveller seem mostly trifling to the Indian, and he naturally soon tires of a conversation carried on in a foreign language, and one in which he finds nothing to interest him. As a matter of fact, the interest of these natives can easily be raised to a high pitch, and I have often been the one who was wearied out first. Neither does the management of their intricate system of exchange prove mental inertness in matters which concern them. Without mnemonic aids to speak of, they plan the systematic distribution of their property in such a manner as to increase their wealth and social position. These plans require great foresight and constant application. (Boas, 1911, p. 128)

Thus, Boas tells us that the entire scheme was wrong. Cultures cannot be ranked using evolutionary age as a basis for comparison, and "mind" cannot be seen as rank in developmental age. (Boas also demonstrates the total hopelessness of deducing cultural differences from any differences, real or imagined, in genetic makeup.)

Finally, and very importantly, Boas was a leader in a subtle, but essential change in anthropological thinking about the concept of culture itself. Educated in Germany, Boas had begun his career imbued with the romantic concept of "Kultur," the expression of the highest attainments of human experience, as expressed in the arts, music, literature, and science. This is the conception of culture that allowed Tylor to talk about "the conditions of culture among various societies." Tylor, like Boas as a young man, conceived of culture as something groups and individuals had more or less of. It was a singular noun: one talked of higher or lower culture, not more or fewer cultures. By the same route that led him to deny the basis for ranking cultures in terms of a hypothetical, evolutionary sequence, Boas arrived at the idea that different societies create different "designs for living," each representing a uniquely adapted fit between their past and their present circumstances in the world. This point of view is central to contemporary anthropology, and it clearly has to be taken into account if we want to rank the intellectual achievements (levels of mental development) of people growing up with different cultural experiences. It renders simple more/less comparisons of cultures difficult and restricted, with parallel effects on our inferences about mind.

Enter Psychology

The birth of psychology is usually dated back to 1879, when Wilhelm Wundt officially opened an experimental laboratory in Leipzig. The exact date is not important, because several laboratories opened almost simultaneously in different industrialized countries. But the reasons for these laboratory openings are important for understanding the problems of understanding the relation between culture and intelligence.

Boas's critique of developmental theories, whether of mind or culture, produced controversy in both domains of inquiry. Boas earned the enmity of anthropologists who believed his criticisms of their general theories unjust; they sought to rescue the more general theories, criticizing Boas and his students for "historical particularism" (Harris, 1968). Psychologists were people who took up the other half of the equation, the problem of specifying mental mechanisms.

The major difficulty facing psychologists was to devise methods for specifying pretty exactly what happens when an individual when some sort of "thinking" is going on. Competing claims were evaluated by constructing settings to control as exactly as possible the kinds of events a person experienced and to record the kinds of responses these experiences evoked. Since the presumed processes were not observable (they were, as we say, "psychological"), psychologists spent a great deal of time and ingenuity devising ways to pin down what these nonobservable processes might be.

The rapidly growing ability to control electricity and to build precision machinery was exploited to the fullest; the early psychology laboratories were marvels of inventions. Their instruments allowed psychologists to present people carefully controlled lights and tones for carefully controlled intervals and to measure precisely the time it took to respond. In their search for ways to make mind observable, they used electrophysiological devices to record internal, organic functioning. The discipline of "psychophysics" advanced appreciably in its quest to relate psychological phenomena of an elementary order (discriminating tones, judging hues). There were even hopes of uncovering a "cognitive algebra" by carefully comparing reaction times to stimuli of various complexities arranged to reveal steps in the thought process.

The activities of psychologists and anthropologists soon contrasted very dramatically. Psychologist brought people into the laboratory where behavior could be constrained, events controlled, and mind made visible. Whereas the anthropologists continued to concentrate on gathering data that would permit them firm statements about historical relations between cultures, scholars who came to identify themselves as psychologists concentrated on resolving arguments about thinking such as those illustrated in the passage quoted by Boas. Just as anthropology evolved careful field techniques to disambiguate competing claims about "culture," psychologists developed the laboratory experiment as a way to test competing claims about "mind."
There occurred, in effect, a division of labor in the "humane sciences," a division that was primarily a matter of scientific strategy in the beginning: progress required some concentrated work on specialized subtopics. The overall task remained the same for everyone: how do human beings come to be the way they are?

Enter Testing

Despite an increasing gulf between scholars who called themselves psychologists and those who called themselves anthropologists, it was not long before those two areas of inquiry were brought together again. At the end of the nineteenth century, Francis Galton, in England, set out to test hypotheses about mental differences among people, using the newly devised psychological techniques. His concern was not differences between people growing up in different cultures. Rather, he studied people growing up in different families. Significantly, his tests were theoretically motived; he believed that speed of mental processing was central to intelligence so he created tests to measure the rapid processing of elementary signals. Galton succeeded in finding differences among Englishmen on such tests as simple reaction time to a pure tone, but he did not succeed in relating these "psychological test" differences to human characteristics of greater interest to him such as scientific excellence or musical ability. Galton's tests, based on an oversimplified model of the human mind and the highly controlled procedures adopted from the laboratory appropriate to testing his theory, were not taken up by society. However, in creating an early precursor of existing IQ tests, Galton did begin the development of the statistical techniques that would be necessary to show how test differences correlate with interesting behavioral differences.

Galton did all of his work in England, but other Englishmen, including W. H. R. Rivers (1901), traveled to the Torres Strait northeast of Australia, to see if psychological tests could be used to settle disputes over cultural differences in cognition. Rivers was in some senses an antique. He was both anthropologist and psychologist, which meant that he considered both the evidence of his tests and evidence provided by observation of the people he went to study when he made statements about culture and thought. His conclusions were consistent with Galton's data on individual differences; natives differed from each other on such simple tasks as their ability to detect a gap in a line, or their recognition of colors. But there were no impressive differences between the natives of the Torres Strait and Englishmen.

It would appear on the basis of this evidence that there are no cultural differences in thinking, at least no differences consistent with the pattern proposed by Tylor, Spencer, and others. However, it could be (and was) argued, that the important ways in which cultural differences cause mental differences were not even tested by Rivers and his associates. After all, Galton had found no relation between responses to his psychological tests and other presumed indicators of intelligence. Why would anyone, then, expect cultural differences in elementary senory abilities since these depended on a physiological mechanisms common to all people? What seemed necessary were tests of higher psychological processes that could be used to compare people from different cultures or different people in the same culture.

This distinction between elementary and higher processes pinpoints a weakness in the basic foundations of experimental psychology, a weakness acknowledged by Wundt, its founder. It is impossible , Wundt believed, to study higher psychological functions in experiments because such functions always depend on prior, culturally organized, experience that differs from one individual and society to another, and these differences undermine the purity of the experiment. Wundt believed that scientists should use ethnological evidence and folklore if they want to discover the properties of the mind that get constructed on the basis of the elementary processes that he studied in the laboratory.

Wundt's doubts about the experimental method were not accepted because they put psychologists in a difficult bind. Psychology had been founded on the principle that carefully controlled environments are required to make legitimate statements about how the mind works. But a great many of the questions about how the mind works that interested psychologists and anthropologists alike clearly refer to "higher" psychological processes such as logical reasoning and inference. When Wundt gave up on the idea that such processes could be studied in the laboratory, he was, it seemed, robbing psychology of most of its interesting subject matter. For psychologists, the inability to study higher psychological processes in the laboratory meant that they could not be studied at all.

Binet's Strategy

The major push for a way to measure mental ability apart from culturally-conditioned experience came from a source seemingly remote from theoretical disputes among anthropologists about the possibility of reconstructing history through a study of contemporary cultural variation or issues of cross-cultural experimentation among psychologists. Early in this century, Alfred Binet was asked to deal with a practical, social problem. With the growth of public education in France, there was a growing problem of school failure, or at least severe school under achievement. It seemed not only that some children learned more slowly than others, but that some children, who otherwise appeared perfectly normal, did not seem to benefit much from instruction at all. Binet and his colleagues were asked to see if they could find a way to identify slow-learning children at an early stage in their education. If such identification were possible, special education could be provided them, and the remaining children could be more efficiently taught.

The subsequent history of IQ testing has been described too frequently to bear repetition here, but a sketch of the basic strategy of research is necessary as background to understand just how deeply IQ tests are embedded in cultural experience.
To begin with, early test makers had to decide what to test for. The decision seemed straightforward. They wanted to test people's ability to perform the kinds of tasks that are required by schools. They observed classrooms, looked at textbooks, talked to teachers, and used their intuitions to arrive at some idea of the many different kinds of knowledge and skills that children are eventually expected to master in school.

What Binet and his colleagues found was not easy to describe briefly, as anyone who has looked into a classroom can quickly testify (and all of us have done so, or we would not be reading these words). There was a very obvious need to understand graphic symbols, such as alphabets and number systems. So recognition of these symbols was tested. But mastery of the rudiments of these symbols was not enough. Children were also expected to manipulate these symbols to store and retrieve vast amounts of information, to rearrange this information according to the demands of the moment, and to use the information to solve a great variety of problems that had never arisen before in the experience of the individual pupil. Thus, children's abilities to remember and carry out sequences of movements, to define words, to construct plausible event sequences from jumbled picture sequences, and to recognize the missing element in graphic designs were tested (along with many other components of school-based problems).

It was also obvious that to master more and more esoteric applications of the basic knowledge contained in alpha-numeric writing systems, pupils had to learn to master their own behavior. They had not only to engage in a variety of "mental activities" directed at processing information; they also had to gain control over their own attention, applying it not according to the whim of the moment, but according to the whim of the teacher and the demands of the text.

It was clearly impossible to arrive at a single sample of all the kinds of thinking required by "the" school. Not only was there too much going on in any one classroom to make this feasible; it was equally clear that the school required different abilities from children of different ages. Binet realized that estimates of "basic aptitude" for this range of material would depend upon how much the child had learned about the specific content before he or she arrived at school, but he felt knowing the child's current abilities would be useful to teachers anyway.

In the face of these difficulties, Binet decided to construct a sample of school-like tasks appropriate for each year of education, starting with elementary grades, and reaching into higher levels of the curriculum. He would have liked to sample so that all the essential activities were included in his test and that tasks at one level of difficulty would be stepping stones to tasks at the next higher level. But because no firmly based theory of higher based psychological functions existed, Binet had to rely on a combination of his own common sense and a logical analysis of tasks that different classrooms seem to require (for example, you have to be able to remember three random digits before you can remember four; you have to know the alphabet before you can read). He also hit on the handy strategy of letting the children themselves tell him when an item selected for the test was appropriate. Beginning with a large set of possible test questions, Binet hunted for items that half the children at a given age level could solve. An "average" child would then be the one who solved problems appropriate to his or her age level. Keeping items that discriminated between children of different ages (as well as items that seemed to sample the activities demanded of kids in their classrooms), he arrived, with help from his colleagues, at the first important prototype of the modern IQ test.
Of course a great deal of work has gone into the construction of tests since Binet's early efforts, but the underlying logic has remained pretty much the same: sample the kinds of activities demanded by the culture (in the form of problems it requires that its children master in school) and compare children's performance to see how many of these activities they have mastered. Children who have mastered far less than we would expect given a comparable sample of kids their own age are those who will need extra help if they are to reach the level expected by the culture.

This strategy is perfectly reasonable, so long as we stay within the framework that generated the item selection procedures in the first place. However, much to the disapproval of Binet, people found new uses for the tests of school-based knowledge that carried with them the seeds of the current disputes over IQ testing.

Although Binet specifically warned against the procedure, his test and tests like it began to be used a measures of an overall aptitude for solving problems in general, rather than samples of problem-solving ability and knowledge in particular. Those engaged in such extrapolations acknowledged that in principle it is important to make certain that everyone given the test has an equal opportunity to learn the material that the test demands. But in practice there was no way to guarantee this essential prerequisite for making comparative judgments about basic abilities.

These are important issues in thinking about applications of IQ testing, and they are extensively discussed in the psychological literature. However, it is not until we back up and examine the possible significance of Binet's work in the light of anthropological scholarship that we can see just how limited an enterprise IQ testing was at the beginning, and how restricted it remains today.

A Thought Experiment in Test Construction

A good starting point for this reexamination is to think about what sort of activity Binet would have engaged in if he had been a member of a cultural group vastly different from his own. As a sort of "thought experiment" let us suppose that a "West African" Binet has taken an interest in the kinds of knowledge and skills that a child has growing up in his part of the world would need to master as an adult. To make the thought experiment somewhat concrete, I will do my supposing about the tribal groups inhabiting the interior of Liberia, principally the Kpelle people, among whom I have worked and about whom a good deal of relevant information is available.

Following in the footsteps of his French model, our Liberian Binet would want to make a catalogue of the kinds of activities that children are expected to master by their parents and the village elders . People in rural Liberia make their living by growing rice and other crops, which they supplement with meat and fish when these scarce commodities can be obtained. Rice farming is physically difficult work that demands considerable knowledge and planning for its success, but as practiced by the Kpelle, it is not a technologically sophisticated enterprise. It is carried out using simple tools such as a machete to cut the underbrush; fire to burn the dry bush; vines to tie together fence posts in order to keep out animals, and slingshots to harass (Gay, 1973). Other aspects of Kpelle material culture are relatively simple, although in every case the proper use of tools requires a good deal of knowledge about how the tools are supposed to be used. There is division of labor among Kpelle adults (men hunt, women do most of the fishing; men cut the bush on the farms, women plant the seed, children guard the crops), but far more than is true of contemporary American, everyone pretty well knows what there is to know about adult economic activities. There are some specialists (blacksmiths, bonesetters, weavers) whose work is an exception to the generalization, and study of their activities would certainly be important.

Of course, there is more to getting through life as a Kpelle than growing rice or weaving cloth. All descriptions of the social organization of Kpelle life stress that, as in America, knowledge of the social world is essential to adult statue (Bellman, 1975). Kpelle people are linked by a complex set of relations that control how much of the resources available to the society actually get to the individual.

Faced with this situation, how should our West African Binet proceed? Should he sample all the kinds of activities valued by adults? This strategy is almost certainly unrealistic. Even allowing for the possibility that aspects of technology make it reasonable to speak of the Kpelle as a "less complex" society than our own, it is very complex indeed. No anthropologist would claim to have achieved a really thorough description of even one such society. Moreover, like Tylor, he would have to admit the possibility that in some respects Kpelle society provides members with more complex tasks than we are likely to face.
Since it is unreasonable in Liberia, as it is in the United States to think that we can come up with a test that samples all types of Kpelle adult activities, why not follow Binet's example and sample an important subset of those activities? From an anthropological perspective, schools are social institutions for assuring that adult knowledge of highly valued kinds gets transmitted to a society's next generation (it must be transmitted, or there would be no later generations!). While the school is not likely to be a random sample of life's tasks, it is certainly a convenient place to sample activities that adults consider important, activities that are complex enough to make it unlikely that kids would learn what they need to know simply by "hanging around."

So, our Liberian Binet might decide to search for some institutions in his society that correspond roughly with the basic goals of schooling in ours. Not all societies readily manifest such institutions, so that anthropologists are led to speak of "socialization" as the broadest relevant category. Fortunately for discussion, in the case of Liberia, he would undoubtedly discover the existence of institutions called "bush schools" in the Liberian English vernacular.

There are no detailed accounts of the curriculum of the bush school. The three or four years that youngsters spend are organized by town elders who are leaders in the secret societies that control a variety of esoteric information. This material cannot, on pain of death, be communicated to outsiders. However, we know enough about aspects of bush school activities to continue our hypothetical research (Bellman, 1975; Gay, 1973); we know that youngsters learn to farm, construct houses, track animals, shoot birds, and carry out a variety of adult economic activities (children live apart from their home villages in something like a scouting cap during their time in bush school). They are also interested in the important lore of the group. This lore is communicated not only in a variety of ceremonies, but in stories, myths, and riddles. So, let us suppose that our West African Binet decided to use "successful execution of bush school activities" as the abilities he wanted to sample.

Again, like Binet, our researcher would not be able to sample all such activities for his test, nor would he want to. He would not, for example, want to sample activities that all children knew how to accomplish before they got to school, nor would he want to sample activities considered so universally accessible that everyone mastered them well before the end of schooling. This information would not help him pick out those children who needed extra instruction. Instead, he would seek those activities that discriminated among children, activities that some mastered far earlier than others, and perhaps activities that some mastered only in later life. Once these Binet-like restrictions had been placed upon the activities selected for study, our hypothetical researcher could begin selecting tasks on which he could base test items.

In considering what sort of test would emerge, it is useful first to consider what activities would be excluded as well as those included. Cutting brush or sowing rice seed probably would not be the test; everyone knows how to do that before he or she gets to school. Nor would anyone spend time explicitly teaching children common vocabulary. However, there would be explicit instruction in such tasks as constructing houses and identifying leaves that are useful in different kinds of medicine. There would also be some mechanism for insuring that the history of the group and its laws and customs were taught to everyone in the form of stories and dances. Finally, some children would be selected for specialist roles that would require special tests (bonesetter, weaver, midwife, blacksmith, hunter, and so on). These children would receive additional instruction.

Looking at those areas where instruction might be considered important, we can see many candidate activities for testing. We might want to see if children had learned all of the important leaf names for making medicine (Bowen, 1964). Riddles are often important parts of stories and arguments, so we could test to see how many riddles children know and how adept they are at interpreting them (Kulah, 1977). The specialties would be a rich source of test material, especially if we thought that rational testing of ability to perform like adults would improve the quality of our cloth or machetes. In short, it seems possible, in principle, to come up with test items that could perform functions in Kpelle society similar to the way that Binet wanted to use IQ tests.

Could we carry out such a program of research in practice? There is no simple answer to this question, but it is useful to consider the obstacles. For some activities such as naming leaves or remembering riddles, it should be relatively easy to make the relevant observations because the Kpelle have already arranged for them: several researchers have described children's games that embody precisely these activities (Cole, Gay, Glick, and Sharp, 1971; Lancy, 1977). We could also test people's skills at constructing houses, weaving designs, and forging sturdy hoes. However, from a Kpelle point of view, tests of such skills would not be particularly interesting. The real stuff of using one's wits to get along in the world has been excluded.

This point was made very explicitly by a Kpelle anthropological acquaintance of mine who was versed in the more esoteric aspects of Kpelle secret societies and medicine (or magic, according to American stereotypes). We had been talking about what it means to be intelligent in Kpelle society (the most appropriate term is translated as "clever"). "Can you be a clever farmer?" I asked. "No," came the reply. "You can be a hardworking farmer, or you can be a lucky farmer, but we couldn't say that someone is a clever farmer. Everyone knows how to farm. We use 'clever' when we talk about the way someone gets other people to help him. Some people always win arguments. Some people know how to deal with strangers. Some people know powerful medicine. These are the things we talk about as clever."

In this bit of dialogue we see an emphasis on activities that require social interaction as the arena where intelligence is an appropriate concept. (Among the Kpelle and many other nontechnological groups, display of a good memory for use in discussions is often considered an important component of intelligence, Dube, 1977) This usage is quite consistent with Binet's analysis; it is those activities that differentiate among people in terms of the way they manipulate information that the Kpelle, like the French, use to mark intelligence.

However, once we reach this point, we face two important difficulties. First, the situations that we have selected for our study of Kpelle intelligence are exceedingly difficult to describe. Second, these contexts are very difficult to arrange. It is not enough to know riddles, everyone knows riddles. What is important about riddles is how they are used to get one's way with other people. Riddles are a resource to be used in a variety of social interactions where people's status's and rights are at issue.

Consider the first difficulty. Bellman (1978) recounts an occasion when an elder member of a secret society t old a long story about how he came to be a high ranking shaman. He followed this (presumably autobiographical) story with a long riddle, which was also in story form. A novice such as myself would have no way of figuring out what part of the story was true, and I certainly would not have responded to the riddle as if its interpretation depended upon the autobiographical story; the two monologues appear to be about quite different topics. Bellman succeeds in demonstrating, however, that the riddle is closely linked to the autobiography. Not only are there formal, structural similarities (once one understands the basic categories of the relevant Kpelle belief systems). There is a rhetorical link as well. The autobiographical story actually represents a bit of self-aggrandizement by the person who told it. The man is claiming special knowledge and special power in a convert manner. The riddle reinforces the main point of the story (which raises the teller above his fellow shaman), giving the story "logical" as well as "historical" validity. The fact that listeners are constrained to agree with the riddle also gets them to agree, at least in part, with the message of the autobiographical story.

By almost any account, this man's autobiographical account plus riddle is a clever bit of behavior. It is exactly the kind of thing that our West African Binet ought to be sampling. But, at precisely this point, our cross-cultural thought experiment in IQ testing comes apart. As I have already pointed out, in order to construct a test Binet needed to be able to select a large number of items. But the "item" we have just described (very loosely) is not easily constructable. The participants in this scene were doing social work on each other; the shaman, in particular, was attempting to establish his preeminence using an account of his past history that would be difficult to check up on, a riddle whose structure was designed to reinforce his account, and his knowledge of his listener's state of knowledge concerning both the shaman's past and Kpelle social structure. This was one item; it was constructed by the subject, not the "tester." It is very difficult for me to imagine how to insure that a test includes one or more items "of this type." Furthermore, because the example's structure and content depend upon the special circumstances surrounding it, how could I insure that I would be able to present the test to the subject since it was the "subject" who did a lot of the presenting in the example I have described?

Here the contrast with Binet's situation is very strong. Like Binet, we have proceeded by figuring out what sorts of activities differentiate people according to some notion of what it means to behave intelligently. Unlike Binet, the activities we need to sample n West Africa to accomplish this goal lead us into domains that are systematically absent from Binet's tests. These domains involve interactions among people in which flexibly employed social knowledge is of paramount importance. They are not domains of hypothetical knowledge; rather, they always involve some real operations on the world, operations that require a great deal of care simply to describe. We have no good notion of how to make such activities happen in a manner analogous to the way that teachers make vocabulary tests and multiplication problems happen. Furthermore, even if we solved all these problems, we would have no real theory of the psychological processes that our subject engaged in. Such problems have not been studied by cognitive psychologists.

On both practical and theoretical grounds, then, it appears virtually impossible to come up with a way of testing Kpelle intelligence in a manner really equivalent to what we understand to be intelligence tests in our society. So long as we restrict our attention to Kpelle culture, this conclusion should not cause much consternation. After all, the idea of a West African Binet is rather absurd; Kpelle people have managed to pass on their culture for many years without IQ tests to help them select clever children and give extra assistance to the dull.

Some Implications for the Notion of a Culture-Free Test

Our characterization of what one has to do to be clever in Kpelle culture and what it would take to sample such cleverness in a test must be discomforting for anyone who imagines that one can construct a culture-free test of intelligence. Imagine, for example, that by some quirk it was our imaginary Liberian Binet who constructed the first IQ test, and that other West African tribal people had adopted it. Next, imagine that American children were posed items from the West African test. Even items considered too simple for Kpelle eight-year-olds would cause our children severe problems. Learning the names of leaves, for example, has proven too difficult for more than one American Ph.D.14 Our children know some riddles, but little use is made of such knowledge in our society except for riddling, which would put them at a severe disadvantage on more "advanced" items.

If our children were forced to take a test constructed by a West African Binet, we might object that these Kpelle-derived items were unfairly biased toward Kpelle culture. If the eventual incomes of our children depended in any way on their ability to interpret Kpelle riddles, we would be outraged. Nor would we be too happy if their incomes depended upon their use of their own riddles as rhetorical devices. At the very minimum, we would want a culture-free test if real life outcomes depended upon test performance. However, what kind of test is a West African Binet likely to dream up that we would consider culture-free? It would not involve a set of drawings of geometrically precise figures, because Kpelle, a preliterate group, do not engage in much graphic representation and they have no technology for drawing straight lines. It would not be recall of lists of nonsense syllables or even lists of words, because there are no corresponding activities in Kpelle adult life. We might try a memory test like recalling all of one's family, but here the Kpelle, who teach their children genealogies, would have a distinct advantage: what is the name of your grandmother's father on your father's side of the family? In fact, if we run down the list of presumably culture-free items that our mental experiment on Kpelle IQ testing turned up, we would almost certainly find none of the subtests that have been claimed as culture-free tests of intelligence in our society. The reason is very simple; our West African Binet, having scientifically sampled his culture, would have come up with items that reflect valued activities and that differentiate people in his culture, while Binet and all his successors have come up with items that do the same job in their culture. They are different kinds of activities.

Our imagined study of cross-cultural test construction makes it clear that tests of ability are inevitably cultural devices. This conclusion must seem dreary and disappointing to people who have been working to construct valid, culture-free tests. But from the perspective of history and logic, it simply confirms the fact, stated so clearly by Franz Boas half a century ago, that "mind, independent of experience, is inconceivable."

References

Bellman, B.L. (1975). Village of Curers and Assassins: On the Production of Fala Kpelle Cosmological Categories: The Hague: Mouton.

Bellman, B.L. (1978), "Ethnohermeneutics: On the Interpretation of Subjective Meaning," in W.C. McCormack and S. A. Wurm (Eds.), Language and the Mind. The Hague: Mouton and Co.

Boas, F. (1911), The Mind of Primitive Man. New York: Macmillan,

Bowen, E.S. (1964). Return to Laughter. New York: Doubleday, 1964).

Cole, M., Gay, J. Glick, J.A., Sharp, D.W. (1971). The Cultural Context of Learning and Thinking: New York: Basic Books

Dube, E.F. (1977). A Cross-cultural Study of the Relationship between 'Intelligence" Level and Story Recall . Doctoral dissertation, Cornell University.

Gay, J. (1973). Red Dust on the Green Leaves (Thompson, Conn: Inter-Culture Associates, 1973)

Gibbs, J.L., (1965), The Kpelle of Liberia, in J.L. Gibbs (Ed.), Peoples of Africa, New York: Holt, Rinehart and Winston.

Hernnstein, R.J., & Murray, C. (1994). The bell curve: Intelligence and class structure in American life. New York: Free Press.

Jensen, A. (1980). Bias in mental testing. New York: Free Press.

Kulah, A.A. (1973), The Organization and Learning of Proverbs among the Kpelle of Liberia. Doctoral dissertation, University of California, Irvine

Lancy, D. (1977),Studies of Memory in Culture, Annals of the New York Academy of Science, 307, 285-297.

Rivers, W.H.R. (1901). Vision. In A.C. Haddon (Ed.) Report of the Cambridge anthropological expedition to the Torres Straits,Vol. 2. Cambridge: Cambridge University Press.

Spencer, H. (1886). The Principles of Psychology, vol. 5. New York: D. Appleton.

Tylor, E.B. (1958). The Origins of Culture. York: Harper and Row.