Main Body
Chapter 2. Sociological Research
Learning Objectives
2.1. Approaches to Sociological Research
- Define and describe the scientific method
- Explain how the scientific method is used in sociological research
- Understand the difference between positivist and interpretive approaches to the scientific method in sociology
- Define what reliability and validity mean in a research study
- Differentiate between four kinds of research methods: surveys, experiments, field research, and secondary data and textual analysis
- Understand why different topics are better suited to different research approaches
- Understand why ethical standards exist
- Demonstrate awareness of the Canadian Sociological Association’s Code of Ethics
- Define value neutrality
- Outline some of the issues of value neutrality in sociology
Introduction to Sociological Research
In the university cafeteria, you set your lunch tray down at a table, grab a chair, join a group of your classmates, and hear the start of two discussions. One person says, “It’s weird how Justin Bieber has 48 million followers on Twitter.” Another says, “Disney World is packed year round.” Those two seemingly benign statements are claims, or opinions, based on everyday observation of human behaviour. Perhaps the speakers had firsthand experience, talked to experts, conducted online research, or saw news segments on TV. In response, two conversations erupt. “I don’t see why anyone would want to go to Disney World and stand in those long lines.” “Are you kidding?! Going to Disney World is one of my favourite childhood memories.” “It’s the opposite for me with Justin Bieber. Seeing people camp out outside his hotel just to get a glimpse of him; it doesn’t make sense.” “Well, you’re not a teenage girl.” “Going to a theme park is way different than trying to see a teenage heart throb.” “But both are things people do for the same reason: they’re looking for a good time.” “If you call getting crushed by a crowd of strangers fun.”
As your classmates at the lunch table discuss what they know or believe, the two topics converge. The conversation becomes a debate. Someone compares Beliebers to Beatles fans. Someone else compares Disney World to a cruise. Students take sides, agreeing or disagreeing, as the conversation veers to topics such as crowd control, mob mentality, political protests, and group dynamics. If you contributed your expanding knowledge of sociological research to this conversation, you might make statements like these: “Justin Bieber’s fans long for an escape from the boredom of real teenage life. Beliebers join together claiming they want romance, except what they really want is a safe place to explore the confusion of teenage sexual feelings.” And this: “Mickey Mouse is a larger-than-life cartoon celebrity. Disney World is a place where families go to see what it would be like to live inside a cartoon.” You finish lunch, clear away your tray, and hurry to your next class. But you are thinking of Justin Bieber and Disney World. You have a new perspective on human behaviour and a list of questions that you want answered. That is the purpose of sociological research—to investigate and provide insights into how human societies function.
Although claims and opinions are part of sociology, sociologists use empirical evidence (that is, evidence corroborated by direct experience and/or observation) combined with the scientific method or an interpretive framework to deliver sound sociological research. They also rely on a theoretical foundation that provides an interpretive perspective through which they can make sense of scientific results. A truly scientific sociological study of the social situations up for discussion in the cafeteria would involve these prescribed steps: defining a specific question, gathering information and resources through observation, forming a hypothesis, testing the hypothesis in a reproducible manner, analyzing and drawing conclusions from the data, publishing the results, and anticipating further development when future researchers respond to and retest findings.
An appropriate starting point in this case might be the question “What do fans of Justin Bieber seek that drives them to follow his Twitter comments so faithfully?” As you begin to think like a sociologist, you may notice that you have tapped into your observation skills. You might assume that your observations and insights are valuable and accurate. But the results of casual observation are limited by the fact that there is no standardization—who is to say one person’s observation of an event is any more accurate than another’s? To mediate these concerns, sociologists rely on systematic research processes.
2.1. Approaches to Sociological Research
When sociologists apply the sociological perspective and begin to ask questions, no topic is off limits. Every aspect of human behaviour is a source of possible investigation. Sociologists question the world that humans have created and live in. They notice patterns of behaviour as people move through that world. Using sociological methods and systematic research within the framework of the scientific method and a scholarly interpretive perspective, sociologists have discovered workplace patterns that have transformed industries, family patterns that have enlightened parents, and education patterns that have aided structural changes in classrooms. The students at that university cafeteria discussion put forth a few loosely stated opinions.
If the human behaviours around those claims were tested systematically, a student could write a report and offer the findings to fellow sociologists and the world in general. The new perspective could help people understand themselves and their neighbours and help people make better decisions about their lives. It might seem strange to use scientific practices to study social trends, but, as we shall see, it’s extremely helpful to rely on systematic approaches that research methods provide. Sociologists often begin the research process by asking a question about how or why things happen in this world. It might be a unique question about a new trend or an old question about a common aspect of life. Once a question is formed, a sociologist proceeds through an in-depth process to answer it. In deciding how to design that process, the researcher may adopt a positivist approach or an interpretive approach. The following sections describe these approaches to knowledge.
The Scientific Method
Sociologists make use of tried-and-true methods of research, such as experiments, surveys, field research, and textual analysis. But humans and their social interactions are so diverse that they can seem impossible to chart or explain. It might seem that science is about discoveries and chemical reactions or about proving ideas right or wrong rather than about exploring the nuances of human behaviour. However, this is exactly why scientific models work for studying human behaviour. A scientific process of research establishes parameters that help make sure results are objective and accurate. Scientific methods provide limitations and boundaries that focus a study and organize its results. This is the case for both positivist or quantitative methodologies and interpretive or qualitative methodologies. The scientific method involves developing and testing theories about the world based on empirical evidence. It is defined by its commitment to systematic observation of the empirical world and strives to be objective, critical, skeptical, and logical. It involves a series of prescribed steps that have been established over centuries of scholarship.
But just because sociological studies use scientific methods does not make the results less human. Sociological topics are not reduced to right or wrong facts. In this field, results of studies tend to provide people with access to knowledge they did not have before—knowledge of other cultures, knowledge of rituals and beliefs, knowledge of trends and attitudes. No matter what research approach is used, researchers want to maximize the study’s reliability (how likely research results are to be replicated if the study is reproduced). Reliability increases the likelihood that what is true of one person will be true of all people in a group. Researchers also strive for validity (how well the study measures what it was designed to measure).
Returning to the Disney World topic, reliability of a study would reflect how well the resulting experience represents the average experience of theme park-goers. Validity would ensure that the study’s design accurately examined what it was designed to study, so an exploration of adults’ interactions with costumed mascots should address that issue and not veer into other age groups’ interactions with them or into adult interactions with staff or other guests.
In general, sociologists tackle questions about the role of social characteristics in outcomes. For example, how do different communities fare in terms of psychological well-being, community cohesiveness, range of vocation, wealth, crime rates, and so on? Are communities functioning smoothly? Sociologists look between the cracks to discover obstacles to meeting basic human needs. They might study environmental influences and patterns of behaviour that lead to crime, substance abuse, divorce, poverty, unplanned pregnancies, or illness. And, because sociological studies are not all focused on problematic behaviours or challenging situations, researchers might study vacation trends, healthy eating habits, neighbourhood organizations, higher education patterns, games, parks, and exercise habits.
Sociologists can use the scientific method not only to collect but to interpret and analyze the data. They deliberately apply scientific logic and objectivity. They are interested in but not attached to the results. Their research work is independent of their own political or social beliefs. This does not mean researchers are not critical. Nor does it mean they do not have their own personalities, complete with preferences and opinions. But sociologists deliberately use the scientific method to maintain as much objectivity, focus, and consistency as possible in a particular study. With its systematic approach, the scientific method has proven useful in shaping sociological studies. The scientific method provides a systematic, organized series of steps that help ensure objectivity and consistency in exploring a social problem. They provide the means for accuracy, reliability, and validity. In the end, the scientific method provides a shared basis for discussion and analysis (Merton 1963). Typically, the scientific method starts with these steps—1) ask a question, 2) research existing sources, 3) formulate a hypothesis—described below.
Ask a Question
The first step of the scientific method is to ask a question, describe a problem, and identify the specific area of interest. The topic should be narrow enough to study within a geography and timeframe. “Are societies capable of sustained happiness?” would be too vague. The question should also be broad enough to have universal merit. “What do personal hygiene habits reveal about the values of students at XYZ High School?” would be too narrow. That said, happiness and hygiene are worthy topics to study.
Sociologists do not rule out any topic, but would strive to frame these questions in better research terms. That is why sociologists are careful to define their terms. In a hygiene study, for instance, hygiene could be defined as “personal habits to maintain physical appearance (as opposed to health),” and a researcher might ask, “How do differing personal hygiene habits reflect the cultural value placed on appearance?” When forming these basic research questions, sociologists develop an operational definition; that is, they define the concept in terms of the physical or concrete steps it takes to objectively measure it. The concept is translated into an observable variable, a measure that has different values. The operational definition identifies an observable condition of the concept.
By operationalizing a variable of the concept, all researchers can collect data in a systematic or replicable manner. The operational definition must be valid in the sense that it is an appropriate and meaningful measure of the concept being studied. It must also be reliable, meaning that results will be close to uniform when tested on more than one person. For example, “good drivers” might be defined in many ways: those who use their turn signals, those who don’t speed, or those who courteously allow others to merge. But these driving behaviours could be interpreted differently by different researchers and could be difficult to measure. Alternatively, “a driver who has never received a traffic violation” is a specific description that will lead researchers to obtain the same information, so it is an effective operational definition.
Research Existing Sources
The next step researchers undertake is to conduct background research through a literature review, which is a review of any existing similar or related studies. A visit to the library and a thorough online search will uncover existing research about the topic of study. This step helps researchers gain a broad understanding of work previously conducted on the topic at hand and enables them to position their own research to build on prior knowledge. It allows them to sharpen the focus of their research question and avoid duplicating previous research. Researchers—including student researchers—are responsible for correctly citing existing sources they use in a study or that inform their work. While it is fine to build on previously published material (as long as it enhances a unique viewpoint), it must be referenced properly and never plagiarized. To study hygiene and its value in a particular society, a researcher might sort through existing research and unearth studies about childrearing, vanity, obsessive-compulsive behaviours, and cultural attitudes toward beauty. It’s important to sift through this information and determine what is relevant. Using existing sources educates a researcher and helps refine and improve a study’s design.
Formulate a Hypothesis
A hypothesis is an assumption about how two or more variables are related; it makes a conjectural statement about the relationship between those variables. It is an “educated guess” because it is not random but based on theory, observations, patterns of experience, or the existing literature. The hypothesis formulates this guess in the form of a testable proposition. However, how the hypothesis is handled differs between the positivist and interpretive approaches. Positivist methodologies are often referred to as hypothetico-deductive methodologies. A hypothesis is derived from a theoretical proposition. On the basis of the hypothesis a prediction or generalization is logically deduced. In positivist sociology, the hypothesis predicts how one form of human behaviour influences another.
Successful prediction will determine the adequacy of the hypothesis and thereby test the theoretical proposition. Typically positivist approaches operationalize variables as quantitative data; that is, by translating a social phenomenon like “health” into a quantifiable or numerically measurable variable like “number of visits to the hospital.” This permits sociologists to formulate their predictions using mathematical language like regression formulas, to present research findings in graphs and tables, and to perform mathematical or statistical techniques to demonstrate the validity of relationships.
Variables are examined to see if there is a correlation between them. When a change in one variable coincides with a change in another variable there is a correlation. This does not necessarily indicate that changes in one variable causes a change in another variable, however, just that they are associated. A key distinction here is between independent and dependent variables. In research, independent variables are the cause of the change. The dependent variable is the effect, or thing that is changed. For example, in a basic study, the researcher would establish one form of human behaviour as the independent variable and observe the influence it has on a dependent variable. How does gender (the independent variable) affect rate of income (the dependent variable)? How does one’s religion (the independent variable) affect family size (the dependent variable)? How is social class (the dependent variable) affected by level of education (the independent variable)? For it to become possible to speak about causation, three criteria must be satisfied:
- There must be a relationship or correlation between the independent and dependent variables.
- The independent variable must be prior to the dependent variable.
- There must be no other intervening variable responsible for the causal relationship.
Table 2.1. Examples of Dependent and Independent Variables Typically, the independent variable causes the dependent variable to change in some way.
Hypothesis | Independent Variable | Dependent Variable |
---|---|---|
The greater the availability of affordable housing, the lower the homeless rate | Affordable Housing | Homeless Rate |
The greater the availability of math tutoring, the higher the math grades | Math Tutoring | Math Grades |
The greater the police patrol presence, the safer the neighbourhood | Police Patrol Presence | Safer Neighbourhood |
The greater the factory lighting, the higher the productivity | Factory Lighting | Productivity |
The greater the amount of public auditing, the lower the amount of political dishonesty | Auditing | Political dishonesty |
At this point, a researcher’s operational definitions help measure the variables. In a study asking how tutoring improves grades, for instance, one researcher might define “good” grades as a C or better, while another uses a B+ as a starting point for “good.” Another operational definition might describe “tutoring” as “one-on-one assistance by an expert in the field, hired by an educational institution.” Those definitions set limits and establish cut-off points, ensuring consistency and replicability in a study. As the chart shows, an independent variable is the one that causes a dependent variable to change. For example, a researcher might hypothesize that teaching children proper hygiene (the independent variable) will boost their sense of self-esteem (the dependent variable). Or rephrased, a child’s sense of self-esteem depends, in part, on the quality and availability of hygienic resources.
Of course, this hypothesis can also work the other way around. Perhaps a sociologist believes that increasing a child’s sense of self-esteem (the independent variable) will automatically increase or improve habits of hygiene (now the dependent variable). Identifying the independent and dependent variables is very important. As the hygiene example shows, simply identifying two topics, or variables, is not enough: Their prospective relationship must be part of the hypothesis. Just because a sociologist forms an educated prediction of a study’s outcome doesn’t mean data contradicting the hypothesis are not welcome. Sociologists analyze general patterns in response to a study, but they are equally interested in exceptions to patterns.
In a study of education, a researcher might predict that high school dropouts have a hard time finding a rewarding career. While it has become at least a cultural assumption that the higher the education, the higher the salary and degree of career happiness, there are certainly exceptions. People with little education have had stunning careers, and people with advanced degrees have had trouble finding work. A sociologist prepares a hypothesis knowing that results will vary.
While many sociologists rely on the positivist hypothetico-deductive method in their research, others operate from an interpretive approach. While systematic, this approach does not follow the hypothesis-testing model that seeks to make generalizable predictions from quantitative variables. Instead, an interpretive framework seeks to understand social worlds from the point of view of participants, leading to in-depth knowledge. It focuses on qualitative data, or the meanings that guide people’s behaviour. Rather than relying on quantitative instruments like questionnaires or experiments, which can be artificial, the interpretive approach attempts to find ways to get closer to the informants’ lived experience and perceptions. Interpretive research is generally more descriptive or narrative in its findings. It can begin from a deductive approach, by deriving a hypothesis from theory and then seeking to confirm it through methodologies like in-depth interviews.
However, it is ideally suited to an inductive approach in which the hypothesis emerges only after a substantial period of direct observation or interaction with subjects. This type of approach is exploratory in that the researcher also learns as he or she proceeds, sometimes adjusting the research methods or processes midway to respond to new insights and findings as they evolve. Once the preliminary work is done, it’s time for the next research steps: designing and conducting a study, and drawing conclusions. These research methods are discussed below.
2.2. Research Methods
Sociologists examine the world, see a problem or interesting pattern, and set out to study it. They use research methods to design a study—perhaps a positivist, quantitative method for conducting research and obtaining data, or perhaps an ethnographic study utilizing an interpretive framework. Planning the research design is a key step in any sociological study. When entering a particular social environment, a researcher must be careful. There are times to remain anonymous and times to be overt. There are times to conduct interviews and times to simply observe. Some participants need to be thoroughly informed; others should not know they are being observed. A researcher would not stroll into a crime-ridden neighbourhood at midnight, calling out, “Any gang members around?” And if a researcher walked into a coffee shop and told the employees they would be observed as part of a study on work efficiency, the self-conscious, intimidated baristas might not behave naturally.
In the 1920s, leaders of a Chicago factory called Hawthorne Works commissioned a study to determine whether or not changing certain aspects of working conditions could increase or decrease worker productivity. Sociologists were surprised when the productivity of a test group increased when the lighting of their workspace was improved. They were even more surprised when productivity improved when the lighting of the workspace was dimmed. In fact almost every change of independent variable—lighting, breaks, work hours—resulted in an improvement of productivity. But when the study was over, productivity dropped again.
Why did this happen? In 1953, Henry A. Landsberger analyzed the study results to answer this question. He realized that employees’ productivity increased because sociologists were paying attention to them. The sociologists’ presence influenced the study results. Worker behaviours were altered not by the lighting but by the study itself. From this, sociologists learned the importance of carefully planning their roles as part of their research design (Franke and Kaul 1978). Landsberger called the workers’ response the Hawthorne effect—people changing their behaviour because they know they are being watched as part of a study.
The Hawthorne effect is unavoidable in some research. In many cases, sociologists have to make the purpose of the study known for ethical reasons. Subjects must be aware that they are being observed, and a certain amount of artificiality may result (Sonnenfeld 1985). Making sociologists’ presence invisible is not always realistic for other reasons. That option is not available to a researcher studying prison behaviours, early education, or the Ku Klux Klan. Researchers cannot just stroll into prisons, kindergarten classrooms, or Ku Klux Klan meetings and unobtrusively observe behaviours. In situations like these, other methods are needed. All studies shape the research design, while research design simultaneously shapes the study. Researchers choose methods that best suit their study topic and that fit with their overall goal for the research.
In planning a study’s design, sociologists generally choose from four widely used methods of social investigation: survey, experiment, field research, and textual or secondary data analysis (or use of existing sources). Every research method comes with plusses and minuses, and the topic of study strongly influences which method or methods are put to use.
Surveys
As a research method, a survey collects data from subjects who respond to a series of questions about behaviours and opinions, often in the form of a questionnaire. The survey is one of the most widely used positivist research methods. The standard survey format allows individuals a level of anonymity in which they can express personal ideas.
At some point or another, everyone responds to some type of survey. The Statistics Canada census is an excellent example of a large-scale survey intended to gather sociological data. Customers also fill out questionnaires at stores or promotional events, responding to questions such as “How did you hear about the event?” and “Were the staff helpful?” You’ve probably picked up the phone and heard a caller ask you to participate in a political poll or similar type of survey: “Do you eat hot dogs? If yes, how many per month?” Not all surveys would be considered sociological research. Marketing polls help companies refine marketing goals and strategies; they are generally not conducted as part of a scientific study, meaning they are not designed to test a hypothesis or to contribute knowledge to the field of sociology. The results are not published in a refereed scholarly journal, where design, methodology, results, and analyses are vetted.
Often, polls on TV do not reflect a general population, but are merely answers from a specific show’s audience. Polls conducted by programs such as American Idol or Canadian Idol represent the opinions of fans but are not particularly scientific. A good contrast to these are the BBM Ratings, which determine the popularity of radio and television programming in Canada through scientific market research. Sociologists conduct surveys under controlled conditions for specific purposes. Surveys gather different types of information from people. While surveys are not great at capturing the ways people really behave in social situations, they are a great method for discovering how people feel and think—or at least how they say they feel and think. Surveys can track attitudes and opinions, political preferences, reported individual behaviours (such as sleeping, driving, or texting habits), or factual information such as employment status, income, and education levels. A survey targets a specific population, people who are the focus of a study, such as university athletes, international students, or teenagers living with type 1 (juvenile-onset) diabetes.
Most researchers choose to survey a small sector of the population, or a sample: that is, a manageable number of subjects who represent a larger population. The success of a study depends on how well a population is represented by the sample. In a random sample, every person in a population has the same chance of being chosen for the study. According to the laws of probability, random samples represent the population as a whole. For instance, an Ipsos Reid poll, if conducted as a nationwide random sampling, should be able to provide an accurate estimate of public opinion whether it contacts 2,000 or 10,000 people. However the validity of surveys can be threatened when part of the population is inadvertently excluded from the sample (e.g., telephone surveys that rely on land lines exclude people that use only cell phones) or when there is a low response rate. After selecting subjects, the researcher develops a specific plan to ask questions and record responses.
It is important to inform subjects of the nature and purpose of the study upfront. If they agree to participate, researchers thank subjects and offer them a chance to see the results of the study if they are interested. The researcher presents the subjects with an instrument (a means of gathering the information). A common instrument is a structured questionnaire, in which subjects answer a series of set questions. For some topics, the researcher might ask yes-or-no or multiple-choice questions, allowing subjects to choose possible responses to each question.
This kind of quantitative data—research collected in numerical form that can be counted—is easy to tabulate. Just count up the number of “yes” and “no” answers or tabulate the scales of “strongly agree,” “agree,” disagree,” etc. responses and chart them into percentages. This is also their chief drawback however: their artificiality. In real life, there are rarely any unambiguously yes-or-no answers. Questionnaires can also ask more complex questions with more complex answers—beyond “yes,” “no,” “agree,” “strongly agree,” or an option next to a checkbox. In those cases, the answers are subjective, varying from person to person. How do you plan to use your university education? Why do you follow Justin Bieber around the country and attend every concert? Those types of questions require short essay responses, and participants willing to take the time to write those answers will convey personal information about religious beliefs, political views, and morals.
Some topics that reflect internal thought are impossible to observe directly and are difficult to discuss honestly in a public forum. People are more likely to share honest answers if they can respond to questions anonymously. This type of information is qualitative data—results that are subjective and often based on what is seen in a natural setting. Qualitative information is harder to organize and tabulate. The researcher will end up with a wide range of responses, some of which may be surprising. The benefit of written opinions, though, is the wealth of material that they provide.
An interview is a one-on-one conversation between the researcher and the subject, and is a way of conducting surveys on a topic. Interviews are similar to the short answer questions on surveys in that the researcher asks subjects a series of questions. However, participants are free to respond as they wish, without being limited by predetermined choices. In the back-and-forth conversation of an interview, a researcher can ask for clarification, spend more time on a subtopic, or ask additional questions. In an interview, a subject will ideally feel free to open up and answer questions that are often complex. There are no right or wrong answers. The subject might not even know how to answer the questions honestly. Questions such as “How did society’s view of alcohol consumption influence your decision whether or not to take your first sip of alcohol?” or “Did you feel that the divorce of your parents would put a social stigma on your family?” involve so many factors that the answers are difficult to categorize. A researcher needs to avoid steering or prompting the subject to respond in a specific way; otherwise, the results will prove to be unreliable. And, obviously, a sociological interview is not an interrogation. The researcher will benefit from gaining a subject’s trust, from empathizing or commiserating with a subject, and from listening without judgment.
Experiments
You’ve probably tested personal social theories. “If I study at night and review in the morning, I’ll improve my retention skills.” Or, “If I stop drinking soda, I’ll feel better.” Cause and effect. If this, then that. When you test the theory, your results either prove or disprove your hypothesis. One way researchers test social theories is by conducting an experiment, meaning they investigate relationships to test a hypothesis—a scientific approach. There are two main types of experiments: lab-based experiments and natural or field experiments.
In a lab setting, the research can be controlled so that perhaps more data can be recorded in a certain amount of time. In a natural or field-based experiment, the generation of data cannot be controlled but the information might be considered more accurate since it was collected without interference or intervention by the researcher. As a research method, either type of sociological experiment is useful for testing if-then statements: if a particular thing happens, then another particular thing will result.
To set up a lab-based experiment, sociologists create artificial situations that allow them to manipulate variables. Classically, the sociologist selects a set of people with similar characteristics, such as age, class, race, or education. Those people are divided into two groups. One is the experimental group and the other is the control group. The experimental group is exposed to the independent variable(s) and the control group is not. This is similar to pharmaceutical drug trials in which the experimental group is given the test drug and the control group is given a placebo or sugar pill. To test the benefits of tutoring, for example, the sociologist might expose the experimental group of students to tutoring while the control group does not receive tutoring. Then both groups would be tested for differences in performance to see if tutoring had an effect on the experimental group of students. As you can imagine, in a case like this, the researcher would not want to jeopardize the accomplishments of either group of students, so the setting would be somewhat artificial. The test would not be for a grade reflected on their permanent record, for example.
The Stanford Prison Experiment is perhaps one of the most famous sociological experiments ever conducted. In 1971, 24 healthy, middle-class male university students were selected to take part in a simulated jail environment to examine the effects of social setting and social roles on individual psychology and behaviour. They were randomly divided into 12 guards and 12 prisoners. The prisoner subjects were arrested at home and transported blindfolded to the simulated prison in the basement of the psychology building on the campus of Stanford University. Within a day of arriving the prisoners and the guards began to display signs of trauma and sadism respectively. After some prisoners revolted by blockading themselves in their cells, the guards resorted to using increasingly humiliating and degrading tactics to control the prisoners through psychological manipulation. The experiment had to be abandoned after only six days because the abuse had grown out of hand (Haney, Banks, and Zimbardo 1973). While the insights into the social dynamics of authoritarianism it generated were fascinating, the Stanford Prison Experiment also serves as an example of the ethical issues that emerge when experimenting on human subjects.
Making Connections: Sociological Research
An Experiment in Action: Mincome
A real-life example will help illustrate the experimental process in sociology. Between 1974 and 1979 an experiment was conducted in the small town of Dauphin, Manitoba (the “garden capital of Manitoba”). Each family received a modest monthly guaranteed income—a “mincome”—equivalent to a maximum of 60 percent of the “low-income cut-off figure” (a Statistics Canada measure of poverty, which varies with family size). The income was 50 cents per dollar less for families who had incomes from other sources. Families earning over a certain income level did not receive mincome. Families that were already collecting welfare or unemployment insurance were also excluded. The test families in Dauphin were compared with control groups in other rural Manitoba communities on a range of indicators such as number of hours worked per week, school performance, high school dropout rates, and hospital visits (Forget 2011). A guaranteed annual income was seen at the time as a less costly, less bureaucratic public alternative for addressing poverty than the existing employment insurance and welfare programs. Today it is an active proposal being considered in Switzerland (Lowrey 2013).
Intuitively, it seems logical that lack of income is the cause of poverty and poverty-related issues. One of the main concerns, however, was whether a guaranteed income would create a disincentive to work. The concept appears to challenge the principles of the Protestant work ethic (see the discussion of Max Weber in Chapter 1). The study did find very small decreases in hours worked per week: about 1 percent for men, 3 percent for wives, and 5 percent for unmarried women. Forget (2011) argues this was because the income provided an opportunity for people to spend more time with family and school, especially for young mothers and teenage girls. There were also significant social benefits from the experiment, including better test scores in school, lower high school dropout rates, fewer visits to hospital, fewer accidents and injuries, and fewer mental health issues.
Ironically, due to lack of guaranteed funding (and lack of political interest by the late 1970s), the data and results of the study were not analyzed or published until 2011. The data were archived and sat gathering dust in boxes. The mincome experiment demonstrated the benefits that even a modest guaranteed annual income supplement could have on health and social outcomes in communities. People seem to live healthier lives and get a better education when they do not need to worry about poverty. In her summary of the research, Forget notes that the impact of the income supplement was surprisingly large given that at any one time only about a third of the families were receiving the income and, for some families, the income amount would have been very small. The income benefit was largest for low-income working families but the research showed that the entire community profited. The improvement in overall health outcomes for the community suggest that a guaranteed income would also result in savings for the public health system.
Field Research
The work of sociology rarely happens in limited, confined spaces. Sociologists seldom study subjects in their own offices or laboratories. Rather, sociologists go out into the world. They meet subjects where they live, work, and play. Field research refers to gathering primary data from a natural environment without doing a lab experiment or a survey. It is a research method suited to an interpretive approach rather than to positivist approaches. To conduct field research, the sociologist must be willing to step into new environments and observe, participate, or experience those worlds. In fieldwork, the sociologists, rather than the subjects, are the ones out of their element. The researcher interacts with or observes a person or people, gathering data along the way. The key point in field research is that it takes place in the subject’s natural environment, whether it’s a coffee shop or tribal village, a homeless shelter or a care home, a hospital, airport, mall, or beach resort.
While field research often begins in a specific setting, the study’s purpose is to observe specific behaviours in that setting. Fieldwork is optimal for observing how people behave. It is less useful, however, for developing causal explanations of why they behave that way. From the small size of the groups studied in fieldwork, it is difficult to make predictions or generalizations to a larger population. Similarly, there are difficulties in gaining an objective distance from research subjects. It is difficult to know whether another researcher would see the same things or record the same data. We will look at three types of field research: participant observation, ethnography, and the case study.
Making Connections: Sociology in the Real World
When Is Sharing Not Such a Good Idea?
Choosing a research methodology depends on a number of factors, including the purpose of the research and the audience for whom the research is intended. If we consider the type of research that might go into producing a government policy document on the effectiveness of safe injection sites for reducing the public health risks of intravenous drug use, we would expect public administrators to want “hard” (i.e., quantitative) evidence of high reliability to help them make a policy decision. The most reliable data would come from an experimental or quasi-experimental research model in which a control group can be compared with an experimental group using quantitative measures.
This approach has been used by researchers studying InSite in Vancouver (Marshall et al. 2011; Wood et al. 2006). InSite is a supervised safe-injection site where heroin addicts and other intravenous drug users can go to inject drugs in a safe, clean environment. Clean needles are provided and health care professionals are on hand to intervene in the case of overdose or other medical emergency. It is a controversial program both because heroin use is against the law (the facility operates through a federal ministerial exemption) and because the heroin users are not obliged to quit using or seek therapy. To assess the effectiveness of the program, researchers compared the risky usage of drugs in populations before and after the opening of the facility and geographically near and distant to the facility. The results from the studies have shown that InSite has reduced both deaths from overdose and risky behaviours, such as the sharing of needles, without increasing the levels of crime associated with drug use and addiction.
On the other hand, if the research question is more exploratory (for example, trying to discern the reasons why individuals in the crack smoking subculture engage in the risky activity of sharing pipes), the more nuanced approach of fieldwork is more appropriate. The research would need to focus on the subcultural context, rituals, and meaning of sharing pipes, and why these phenomena override known health concerns. Graduate student Andrew Ivsins at the University of Victoria studied the practice of sharing pipes among 13 habitual users of crack cocaine in Victoria, B.C. (Ivsins 2010). He met crack smokers in their typical setting downtown and used an unstructured interview method to try to draw out the informal norms that lead to sharing pipes. One factor he discovered was the bond that formed between friends or intimate partners when they shared a pipe. He also discovered that there was an elaborate subcultural etiquette of pipe use that revolved around the benefit of getting the crack resin smokers left behind. Both of these motives tended to outweigh the recognized health risks of sharing pipes (such as hepatitis) in the decision making of the users. This type of research was valuable in illuminating the unknown subcultural norms of crack use that could still come into play in a harm reduction strategy such as distributing safe crack kits to addicts.
Participant Observation
In 2000, a comic writer named Rodney Rothman wanted an insider’s view of white-collar work. He slipped into the sterile, high-rise offices of a New York “dot com” agency. Every day for two weeks, he pretended to work there. His main purpose was simply to see if anyone would notice him or challenge his presence. No one did. The receptionist greeted him. The employees smiled and said good morning. Rothman was accepted as part of the team. He even went so far as to claim a desk, inform the receptionist of his whereabouts, and attend a meeting. He published an article about his experience in The New Yorker called “My Fake Job” (2000). Later, he was discredited for allegedly fabricating some details of the story and The New Yorker issued an apology. However, Rothman’s entertaining article still offered fascinating descriptions of the inside workings of a “dot com” company and exemplified the lengths to which a sociologist will go to uncover material.
Rothman had conducted a form of study called participant observation, in which researchers join people and participate in a group’s routine activities for the purpose of observing them within that context. This method lets researchers study a naturally occurring social activity without imposing artificial or intrusive research devices, like fixed questionnaire questions, onto the situation. A researcher might go to great lengths to get a firsthand look into a trend, institution, or behaviour. Researchers temporarily put themselves into “native” roles and record their observations. A researcher might work as a waitress in a diner, or live as a homeless person for several weeks, or ride along with police officers as they patrol their regular beat. Often, these researchers try to blend in seamlessly with the population they study, and they may not disclose their true identity or purpose if they feel it would compromise the results of their research.
At the beginning of a field study, researchers might have a question: “What really goes on in the kitchen of the most popular diner on campus?” or “What is it like to be homeless?” Participant observation is a useful method if the researcher wants to explore a certain environment from the inside. Field researchers simply want to observe and learn. In such a setting, the researcher will be alert and open minded to whatever happens, recording all observations accurately. Soon, as patterns emerge, questions will become more specific, observations will lead to hypotheses, and hypotheses will guide the researcher in shaping data into results. In a study of small-town America conducted by sociological researchers John S. Lynd and Helen Merrell Lynd, the team altered their purpose as they gathered data. They initially planned to focus their study on the role of religion in American towns. As they gathered observations, they realized that the effect of industrialization and urbanization was the more relevant topic of this social group. The Lynds did not change their methods, but they revised their purpose. This shaped the structure of Middletown: A Study in Modern American Culture, their published results (Lynd and Lynd 1959).
The Lynds were upfront about their mission. The townspeople of Muncie, Indiana, knew why the researchers were in their midst. But some sociologists prefer not to alert people to their presence. The main advantage of covert participant observation is that it allows the researcher access to authentic, natural behaviours of a group’s members. The challenge, however, is gaining access to a setting without disrupting the pattern of others’ behaviour. Becoming an inside member of a group, organization, or subculture takes time and effort. Researchers must pretend to be something they are not. The process could involve role playing, making contacts, networking, or applying for a job. Once inside a group, some researchers spend months or even years pretending to be one of the people they are observing. However, as observers, they cannot get too involved. They must keep their purpose in mind and apply the sociological perspective. That way, they illuminate social patterns that are often unrecognized. Because information gathered during participant observation is mostly qualitative, rather than quantitative, the end results are often descriptive or interpretive. The researcher might present findings in an article or book, describing what he or she witnessed and experienced.
This type of research is what journalist Barbara Ehrenreich conducted for her book Nickel and Dimed. One day over lunch with her editor, as the story goes, Ehrenreich mentioned an idea. How can people exist on minimum-wage work? How do low-income workers get by? she wondered. Someone should do a study. To her surprise, her editor responded, Why don’t you do it? That is how Ehrenreich found herself joining the ranks of the low-wage service sector. For several months, she left her comfortable home and lived and worked among people who lacked, for the most part, higher education and marketable job skills. Undercover, she applied for and worked minimum wage jobs as a waitress, a cleaning woman, a nursing home aide, and a retail chain employee. During her participant observation, she used only her income from those jobs to pay for food, clothing, transportation, and shelter. She discovered the obvious: that it’s almost impossible to get by on minimum wage work. She also experienced and observed attitudes many middle- and upper-class people never think about. She witnessed firsthand the treatment of service work employees. She saw the extreme measures people take to make ends meet and to survive. She described fellow employees who held two or three jobs, worked seven days a week, lived in cars, could not pay to treat chronic health conditions, got randomly fired, submitted to drug tests, and moved in and out of homeless shelters. She brought aspects of that life to light, describing difficult working conditions and the poor treatment that low-wage workers suffer.
Ethnography
Ethnography is the extended observation of the social perspective and cultural values of an entire social setting. Researchers seek to immerse themselves in the life of a bounded group, by living and working among them. Often ethnography involves participant observation, but the focus is the systematic observation of an entire community.
The heart of an ethnographic study focuses on how subjects view their own social standing and how they understand themselves in relation to a community. An ethnographic study might observe, for example, a small Newfoundland fishing town, an Inuit community, a village in Thailand, a Buddhist monastery, a private boarding school, or Disney World. These places all have borders. People live, work, study, or vacation within those borders. People are there for a certain reason and therefore behave in certain ways and respect certain cultural norms. An ethnographer would commit to spending a determined amount of time studying every aspect of the chosen place, taking in as much as possible, and keeping careful notes on his or her observations.
A sociologist studying a tribe in the Amazon might learn the language, watch the way villagers go about their daily lives, ask individuals about the meaning of different aspects of activity, study the group’s cosmology and then write a paper about it. To observe a spiritual retreat centre, an ethnographer might sign up for a retreat and attend as a guest for an extended stay, observe and record how people experience spirituality in this setting, and collate the material into results.
Making Connections: Sociology in the Real World
The Feminist Perspective: Institutional Ethnography
Dorothy Smith elaborated on traditional ethnography to develop what she calls institutional ethnography (2005). In modern society the practices of everyday life in any particular local setting are often organized at a level that goes beyond what an ethnographer might observe directly. Everyday life is structured by “extralocal,” institutional forms; that is, by the practices of institutions that act upon people from a distance. It might be possible to conduct ethnographic research on the experience of domestic abuse by living in a women’s shelter and directly observing and interviewing victims to see how they form an understanding of their situation. However, to the degree that the women are seeking redress through the criminal justice system a crucial element of the situation would be missing. In order to activate a response from the police or the courts, a set of standard legal procedures must be followed, a “case file” must be opened, legally actionable evidence must be established, forms filled out, etc. All of this allows criminal justice agencies to organize and coordinate the response.
The urgent and immediate experience of the domestic abuse victims needs to be translated into a format that enables distant authorities to take action. Often this is a frustrating and mysterious process in which the immediate needs of individuals are neglected so that needs of institutional processes are met. Therefore to research the situation of domestic abuse victims, an ethnography needs to somehow operate at two levels: the close examination of the local experience of particular women and the simultaneous examination of the extralocal, institutional world through which their world is organized. In order to accomplish this, institutional ethnography focuses on the study of the way everyday life is coordinated through “textually mediated” practices: the use of written documents, standardized bureaucratic categories, and formalized relationships (Smith 1990).
Institutional paperwork translates the specific details of locally lived experience into a standardized format that enables institutions to apply the institution’s understandings, regulations, and operations in different local contexts. The study of these textual practices reveal otherwise inaccessible processes that formal organizations depend on: their formality, their organized character, and their ongoing methods of coordination, etc. An institutional ethnography often begins by following the paper trail that emerges when people interact with institutions: how does a person formulate a narrative about what has happened to him or her in a way that the institution will recognize? How is it translated into the abstract categories on a form or screen that enable an institutional response to be initiated? What is preserved in the translation to paperwork and what is lost? Where do the forms go next? What series of “processing interchanges” take place between different departments or agencies through the circulation of paperwork? How is the paperwork modified and made actionable through this process (e.g., an incident report, warrant request, motion for continuance)?
Smith’s insight is that the shift from the locally lived experience of individuals to the extralocal world of institutions is nothing short of a radical metaphysical shift in worldview. In institutional worlds, meanings are detached from directly lived processes and reconstituted in an organizational time, space, and consciousness that is fundamentally different from their original reference point. For example, the crisis that has led to a loss of employment becomes a set of anonymous criteria that determines one’s eligibility for Employment Insurance.
The unique life of a disabled child becomes a checklist that determines the content of an “individual education program” in the school system, which in turn determines whether funding will be provided for special aid assistants or therapeutic programs. Institutions put together a picture of what has occurred that is not at all the same as what was lived. The ubiquitous but obscure mechanism by which this is accomplished is textually mediated communication. The goal of institutional ethnography therefore is to making “documents or texts visible as constituents of social relations” (Smith 1990). Institutional ethnography is very useful as a critical research strategy. It is an analysis that gives grassroots organizations, or those excluded from the circles of institutional power, a detailed knowledge of how the administrative apparatuses actually work. This type of research enables more effective actions and strategies for change to be pursued.
The Case Study
Sometimes a researcher wants to study one specific person or event. A case study is an in-depth analysis of a single event, situation, or individual. To conduct a case study, a researcher examines existing sources like documents and archival records, conducts interviews, engages in direct observation, and even participant observation, if possible. Researchers might use this method to study a single case of, for example, a foster child, drug lord, cancer patient, criminal, or rape victim. However, a major criticism of the case study as a method is that a developed study of a single case, while offering depth on a topic, does not provide enough evidence to form a generalized conclusion. In other words, it is difficult to make universal claims based on just one person, since one person does not verify a pattern. This is why most sociologists do not use case studies as a primary research method.
However, case studies are useful when the single case is unique. In these instances, a single case study can add tremendous knowledge to a certain discipline. For example, a feral child, also called “wild child,” is one who grows up isolated from human beings. Feral children grow up without social contact and language, elements crucial to a “civilized” child’s development. These children mimic the behaviours and movements of animals, and often invent their own language. There are only about 100 cases of “feral children” in the world. As you may imagine, a feral child is a subject of great interest to researchers. Feral children provide unique information about child development because they have grown up outside of the parameters of “normal” child development. And since there are very few feral children, the case study is the most appropriate method for researchers to use in studying the subject. At age three, a Ukrainian girl named Oxana Malaya suffered severe parental neglect. She lived in a shed with dogs, eating raw meat and scraps. Five years later, a neighbour called authorities and reported seeing a girl who ran on all fours, barking. Officials brought Oxana into society, where she was cared for and taught some human behaviours, but she never became fully socialized. She has been designated as unable to support herself and now lives in a mental institution (Grice 2006). Case studies like this offer a way for sociologists to collect data that may not be collectable by any other method.
Secondary Data or Textual Analysis
While sociologists often engage in original research studies, they also contribute knowledge to the discipline through secondary data or textual analysis. Secondary data do not result from firsthand research collected from primary sources, but are drawn from the already-completed work of other researchers. Sociologists might study texts written by historians, economists, teachers, or early sociologists. They might search through periodicals, newspapers, or magazines from any period in history. Using available information not only saves time and money, but it can add depth to a study. Sociologists often interpret findings in a new way, a way that was not part of an author’s original purpose or intention. To study how women were encouraged to act and behave in the 1960s, for example, a researcher might watch movies, televisions shows, and situation comedies from that period. Or to research changes in behaviour and attitudes due to the emergence of television in the late 1950s and early 1960s, a sociologist would rely on new interpretations of secondary data. Decades from now, researchers will most likely conduct similar studies on the advent of mobile phones, the Internet, or Facebook.
One methodology that sociologists employ with secondary data is content analysis. Content analysis is a quantitative approach to textual research that selects an item of textual content (i.e., a variable) that can be reliably and consistently observed and coded, and surveys the prevalence of that item in a sample of textual output. For example, Gilens (1996) wanted to find out why survey research shows that the American public substantially exaggerates the percentage of African Americans among the poor. He examined whether media representations influence public perceptions and did a content analysis of photographs of poor people in American news magazines. He coded and then systematically recorded incidences of three variables: (1) Race: white, black, indeterminate; (2) Employed: working, not working; and (3) Age. Gilens discovered that not only were African Americans markedly overrepresented in news magazine photographs of poverty, but that the photos also tended to underrepresent “sympathetic” subgroups of the poor—the elderly and working poor—while overrepresenting less sympathetic groups—unemployed, working age adults. Gilens concluded that by providing a distorted representation of poverty, U.S. news magazines “reinforce negative stereotypes of blacks as mired in poverty and contribute to the belief that poverty is primarily a ‘black problem’” (1996).
Social scientists also learn by analyzing the research of a variety of agencies. Governmental departments and global groups, like Statistics Canada or the World Health Organization, publish studies with findings that are useful to sociologists. A public statistic that measures inequality of incomes might be useful for studying who benefited and who lost as a result of the 2008 recession; a demographic profile of different immigrant groups might be compared with data on unemployment to examine the reasons why immigration settlement programs are more effective for some communities than for others. One of the advantages of secondary data is that it is nonreactive (or unobtrusive) research, meaning that it does not include direct contact with subjects and will not alter or influence people’s behaviours. Unlike studies requiring direct contact with people, using previously published data does not require entering a population and the investment and risks inherent in that research process. Using available data does have its challenges. Public records are not always easy to access. A researcher needs to do some legwork to track them down and gain access to records. In some cases there is no way to verify the accuracy of existing data. It is easy, for example, to count how many drunk drivers are pulled over by the police. But how many are not? While it’s possible to discover the percentage of teenage students who drop out of high school, it might be more challenging to determine the number who return to school or get their GED later.
Another problem arises when data are unavailable in the exact form needed or do not include the precise angle the researcher seeks. For example, the salaries paid to professors at universities is often published. But the separate figures do not necessarily reveal how long it took each professor to reach the salary range, what their educational backgrounds are, or how long they have been teaching. In his research, sociologist Richard Sennett uses secondary data to shed light on current trends. In The Craftsman (2008), he studied the human desire to perform quality work, from carpentry to computer programming. He studied the line between craftsmanship and skilled manual labour. He also studied changes in attitudes toward craftsmanship that occurred not only during and after the Industrial Revolution, but also in ancient times. Obviously, he could not have firsthand knowledge of periods of ancient history; he had to rely on secondary data for part of his study. When conducting secondary data or textual analysis, it is important to consider the date of publication of an existing source and to take into account attitudes and common cultural ideals that may have influenced the research. For example, Robert S. Lynd and Helen Merrell Lynd gathered research for their book Middletown: A Study in Modern American Culture in the 1920s. Attitudes and cultural norms were vastly different then than they are now. Beliefs about gender roles, race, education, and work have changed significantly since then. At the time, the study’s purpose was to reveal the truth about small American communities. Today, it is an illustration of 1920s attitudes and values.
2.3. Ethical Concerns
Sociologists conduct studies to shed light on human behaviours. Knowledge is a powerful tool that can be used toward positive change. And while a sociologist’s goal is often simply to uncover knowledge rather than to spur action, many people use sociological studies to help improve people’s lives. In that sense, conducting a sociological study comes with a tremendous amount of responsibility. Like any researchers, sociologists must consider their ethical obligation to avoid harming subjects or groups while conducting their research. The Canadian Sociological Association, or CSA, is the major professional organization of sociologists in Canada. The CSA is a great resource for students of sociology as well.
The CSA maintains a code of ethics—formal guidelines for conducting sociological research—consisting of principles and ethical standards to be used in the discipline. It also describes procedures for filing, investigating, and resolving complaints of unethical conduct. These are in line with the Tri-Council Policy Statement on Ethical Conduct for Research Involving Humans (2010), which applies to any research with human subjects funded by one of the three federal research agencies – the Canadian Institutes of Health Research (CIHR), the Natural Sciences and Engineering Research Council of Canada (NSERC), and the Social Sciences and Humanities Research Council of Canada (SSHRC).
Practising sociologists and sociology students have a lot to consider. Some of the guidelines state that researchers must try to be skillful and fair-minded in their work, especially as it relates to their human subjects. Researchers must obtain participants’ informed consent, and inform subjects of the responsibilities and risks of research before they agree to participate. During a study, sociologists must ensure the safety of participants and immediately stop work if a subject becomes potentially endangered on any level. Researchers are required to protect the privacy of research participants whenever possible. Even if pressured by authorities, such as police or courts, researchers are not ethically allowed to release confidential information. Researchers must make results available to other sociologists, must make public all sources of financial support, and must not accept funding from any organization that might cause a conflict of interest or seek to influence the research results for its own purposes. The CSA’s ethical considerations shape not only the study but also the publication of results.
Pioneer German sociologist Max Weber (1864–1920) identified another crucial ethical concern. Weber understood that personal values could distort the framework for disclosing study results. While he accepted that some aspects of research design might be influenced by personal values, he declared it was entirely inappropriate to allow personal values to shape the interpretation of the responses. Sociologists, he stated, must establish value neutrality, a practice of remaining impartial, without bias or judgment, during the course of a study and in publishing results (1949). Sociologists are obligated to disclose research findings without omitting or distorting significant data. Value neutrality does not mean having no opinions. It means striving to overcome personal biases, particularly subconscious biases, when analyzing data. It means avoiding skewing data in order to match a predetermined outcome that aligns with a particular agenda, such as a political or moral point of view. Investigators are ethically obligated to report results, even when they contradict personal views, predicted outcomes, or widely accepted beliefs. Is value neutrality possible?
Many sociologists believe it is impossible to set aside personal values and retain complete objectivity. Individuals inevitably see the world from a partial perspective. Their interests are central to the types of topics they choose, the types of questions they ask, the way they frame their research and the research methodologies they select to pursue it. Moreover, facts, however objective, do not exist in a void. As we noted in Chapter 1, Jürgen Habermas (1972) argues that sociological research has built-in interests quite apart from the personal biases of individual researchers. Positivist sociology has an interest in pursuing types of knowledge that are useful for controlling and administering social life. Interpretive sociology has an interest in pursuing types of knowledge that promote greater mutual understanding and the possibility of consensus among members of society. Critical sociology has an interest in types of knowledge that enable emancipation from power relations and forms of domination in society. In Habermas’ view, sociological knowledge is not disinterested knowledge. This does not discredit the results of sociological research but allows readers to take into account the perspective of the research when judging the validity and applicability of its outcomes.
Key Terms
case study in-depth analysis of a single event, situation, or individual
code of ethics a set of guidelines that the Canadian Sociological Association has established to foster ethical research and professionally responsible scholarship in sociology
content analysis a quantitative approach to textual research that selects an item of textual content that can be reliably and consistently observed and coded, and surveys the prevalence of that item in a sample of textual output
control group an experimental group that is not exposed to the independent variable
correlation when a change in one variable coincides with a change in another variable, but does not necessarily indicate causation
dependent variable variable changed by another variable
empirical evidence evidence corroborated by direct experience and/or observation
ethnography observing a complete social setting and all that it entails
experiment the testing of a hypothesis under controlled conditions
field research gathering data from a natural environment without doing a lab experiment or a survey
Hawthorne effect when study subjects behave in a certain manner due to their awareness of being observed by a researcher
hypothesis an educated guess with predicted outcomes about the relationship between two or more variables hypothetico-deductive methodologies methodologies based on deducing a prediction from a hypothesis and testing the validity of the hypothesis by whether it correctly predicts observations
independent variable variable that causes change in a dependent variable
inductive approach methodologies that derive a general statement from a series of empirical observations
institutional ethnography the study of the way everyday life is coordinated through institutional, textually mediated practices
interpretive approach a sociological research approach that seeks in-depth understanding of a topic or subject through observation or interaction
interview a one-on-one conversation between a researcher and a subject
literature review a scholarly research step that entails identifying and studying all existing studies on a topic to create a basis for new research
nonreactive unobtrusive research that does not include direct contact with subjects and will not alter or influence people’s behaviours
operational definitions specific explanations of abstract concepts that a researcher plans to study
participant observation immersion by a researcher in a group or social setting in order to make observations from an “insider” perspective
population a defined group serving as the subject of a study
positivist approach a research approach based on the natural science model of knowledge utilizing a hypothetico-deductive formulation of the research question and quantitative data
primary data data collected directly from firsthand experience
qualitative data information based on interpretations of meaning
quantitative data information from research collected in numerical form that can be counted
random sample a study’s participants being randomly selected to serve as a representation of a larger population reliability a measure of a study’s consistency that considers how likely results are to be replicated if a study is reproduced research design a detailed, systematic method for conducting research and obtaining data
sample small, manageable number of subjects that represent the population
scientific method a systematic research method that involves asking a question, researching existing sources, forming a hypothesis, designing and conducting a study, and drawing conclusions
secondary data analysis using data collected by others but applying new interpretations
surveys data collections from subjects who respond to a series of questions about behaviours and opinions, often in the form of a questionnaire
textually mediated communication institutional forms of communication that rely on written documents, texts, and paperwork
validity the degree to which a sociological measure accurately reflects the topic of study
value neutrality a practice of remaining impartial, without bias or judgment during the course of a study and in publishing results
variable a characteristic or measure of a social phenomenon that can take different values
Section Summary
2.1. Approaches to Sociological Research
Using the scientific method, a researcher conducts a study in five phases: asking a question, researching existing sources, formulating a hypothesis, conducting a study, and drawing conclusions. The scientific method is useful in that it provides a clear method of organizing a study. Some sociologists conduct scientific research through a positivist framework utilizing a hypothetico-deductive formulation of the research question. Other sociologists conduct scientific research by employing an interpretive framework that is often inductive in nature. Scientific sociological studies often observe relationships between variables. Researchers study how one variable changes another. Prior to conducting a study, researchers are careful to apply operational definitions to their terms and to establish dependent and independent variables.
2.2. Research Methods
Sociological research is a fairly complex process. As you can see, a lot goes into even a simple research design. There are many steps and much to consider when collecting data on human behaviour, as well as in interpreting and analyzing data in order to form conclusive results. Sociologists use scientific methods for good reason. The scientific method provides a system of organization that helps researchers plan and conduct the study while ensuring that data and results are reliable, valid, and objective. The many methods available to researchers—including experiments, surveys, field studies, and secondary data analysis—all come with advantages and disadvantages. The strength of a study can depend on the choice and implementation of the appropriate method of gathering research. Depending on the topic, a study might use a single method or a combination of methods. It is important to plan a research design before undertaking a study. The information gathered may in itself be surprising, and the study design should provide a solid framework in which to analyze predicted and unpredicted data.
Table 2.2. Main Sociological Research Methods. Sociological research methods have advantages and disadvantages.
Method | Implementation | Advantages | Challenges |
---|---|---|---|
Survey |
|
|
|
Fieldwork |
|
|
|
Experiment | Deliberate manipulation of social setting to compare experimental and control groups. Tests cause and effect relationships
|
||
Secondary Data Analysis |
Makes good use of previous sociological information
|
2.3. Ethical Concerns
Sociologists and sociology students must take ethical responsibility for any study they conduct. They must first and foremost guarantee the safety of their participants. Whenever possible, they must ensure that participants have been fully informed before consenting to be part of a study. The CSA (Canadian Sociological Association) maintains ethical guidelines that sociologists must take into account as they conduct research. The guidelines address conducting studies, properly using existing sources, accepting funding, and publishing results. Sociologists must try to maintain value neutrality. They must gather and analyze data objectively, setting aside their personal preferences, beliefs, and opinions. They must report findings accurately, even if they contradict personal convictions.
Section Quiz
2.1. Approaches to Sociological Research
1. A measurement is considered ______ if it actually measures what it is intended to measure, according to the topic of the study.
- reliable
- sociological
- valid
- quantitative
2. Sociological studies test relationships in which change in one ______ causes change in another.
- test subject
- behaviour
- variable
- operational definition
3. In a study, a group of 10-year-old boys are fed doughnuts every morning for a week and then weighed to see how much weight they gained. Which factor is the dependent variable?
- the doughnuts
- the boys
- the duration of a week
- the weight gained
4. Which statement provides the best operational definition of “childhood obesity”?
- children who eat unhealthy foods and spend too much time watching television and playing video games
- a distressing trend that can lead to health issues including type 2 diabetes and heart disease
- body weight at least 20 percent higher than a healthy weight for a child of that height
- the tendency of children today to weigh more than children of earlier generations
2.2. Research Methods
5. Which materials are considered secondary data?
- photos and letters given to you by another person
- books and articles written by other authors about their studies
- information that you have gathered and now have included in your results
- responses from participants whom you both surveyed and interviewed
6. What method did Andrew Ivsins use to study crack users in Victoria?
- survey
- experiment
- field research
- content analysis
7. Why is choosing a random sample an effective way to select participants?
- Participants do not know they are part of a study
- The researcher has no control over who is in the study
- It is larger than an ordinary sample
- Everyone has the same chance of being part of the study
8. What research method did John S. Lynd and Helen Merrell Lynd mainly use in their Middletown study?
- secondary data
- survey
- participant observation
- experiment
9. Which research approach is best suited to the positivist approach?
- questionnaire
- case study
- ethnography
- secondary data analysis
10. The main difference between ethnography and other types of participant observation is:
- ethnography isn’t based on hypothesis testing
- ethnography subjects are unaware they’re being studied
- ethnographic studies always involve minority ethnic groups
- there is no difference
11. Which best describes the results of a case study?
- it produces more reliable results than other methods because of its depth
- its results are not generally applicable
- it relies solely on secondary data analysis
- all of the above
12. Using secondary data is considered an unobtrusive or ________ research method.
- nonreactive
- nonparticipatory
- nonrestrictive
- nonconfrontive
2.3. Ethical Concerns
13. Which statement illustrates value neutrality?
- Obesity in children is obviously a result of parental neglect and, therefore, schools should take a greater role to prevent it.
- In 2003, states like Arkansas adopted laws requiring elementary schools to remove soft drink vending machines from schools.
- Merely restricting children’s access to junk food at school is not enough to prevent obesity.
- Physical activity and healthy eating are a fundamental part of a child’s education.
14. Which person or organization defined the concept of value neutrality?
- Institutional Review Board (IRB)
- Peter Rossi
- Canadian Sociological Association (CSA)
- Max Weber
15. To study the effects of fast food on lifestyle, health, and culture, from which group would a researcher ethically be unable to accept funding?
- a fast-food restaurant
- a nonprofit health organization
- a private hospital
- a governmental agency like Health and Social Services
Short Answer
2.1. Approaches to Sociological Research
- Write down the first three steps of the scientific method. Think of a broad topic that you are interested in and which would make a good sociological study—for example, ethnic diversity in a college, homecoming rituals, athletic scholarships, or teen driving. Now, take that topic through the first steps of the process. For each step, write a few sentences or a paragraph: 1) Ask a question about the topic. 2) Do some research and write down the titles of some articles or books you’d want to read about the topic. 3) Formulate a hypothesis.
- What type of data do surveys gather? For what topics would surveys be the best research method? What drawbacks might you expect to encounter when using a survey? To explore further, ask a research question and write a hypothesis. Then create a survey of about six questions relevant to the topic. Provide a rationale for each question. Now define your population and create a plan for recruiting a random sample and administering the survey.
- Imagine you are about to do field research in a specific place for a set time. Instead of thinking about the topic of study itself, consider how you, as the researcher, will have to prepare for the study. What personal, social, and physical sacrifices will you have to make? How will you manage your personal effects? What organizational equipment and systems will you need to collect the data?
- Create a brief research design about a topic in which you are passionately interested. Now write a letter to a philanthropic or grant organization requesting funding for your study. How can you describe the project in a convincing yet realistic and objective way? Explain how the results of your study will be a relevant contribution to the body of sociological work already in existence.
- Why do you think the CSA crafted such a detailed set of ethical principles? What type of study could put human participants at risk? Think of some examples of studies that might be harmful. Do you think that, in the name of sociology, some researchers might be tempted to cross boundaries that threaten human rights? Why?
- Would you willingly participate in a sociological study that could potentially put your health and safety at risk, but had the potential to help thousands or even hundreds of thousands of people? For example, would you participate in a study of a new drug that could cure diabetes or cancer, even if it meant great inconvenience and physical discomfort for you or possible permanent damage?
Further Research
2.1. Approaches to Sociological Research
For a historical perspective on the scientific method in sociology, read “The Elements of Scientific Method in Sociology” by F. Stuart Chapin (1914) in the American Journal of Sociology: http://openstaxcollege.org/l/Method-in-Sociology
2.2. Research Methods
For information on current real-world sociology experiments, visit: http://openstaxcollege.org/l/Sociology-Experiments
2.3. Ethical Concerns Founded in 1966, the CSA is a nonprofit organization located in Montreal, Quebec, with a membership of 900 researchers, faculty members, students, and practitioners of sociology. Its mission is to promote “research, publication and teaching in Sociology in Canada.” Learn more about this organization at http://www.csa-scs.ca/.
References
2.1. Approaches to Sociological Research
Merton, Robert. 1968 [1949]. Social Theory and Social Structure. New York: Free Press.
2.2. Research Methods
Forget, Evelyn. 2011. “The Town with no Poverty: Using Health Administration Data to Revisit Outcomes of a Canadian Guaranteed Annual Income Field Experiement.” Canadian Public Policy. 37(3): 282-305.
Franke, Richard and James Kaul. 1978. “The Hawthorne Experiments: First Statistical Interpretation.” American Sociological Review 43(5):632–643.
Gilens, Martin. 1996. “Race and Poverty in America: Public Misperceptions and the American News Media.” The Public Opinion Quarterly 60(4):515–541. Grice, Elizabeth. 2006. “Cry of an Enfant Sauvage.” The Telegraph. Retrieved July 20, 2011 (http://www.telegraph.co.uk/culture/tvandradio/3653890/Cry-of-an-enfant-sauvage.html).
Haney, C., Banks, W. C., and Zimbardo, P. G. 1973. “Interpersonal Dynamics in a Simulated Prison.” International Journal of Criminology and Penology 1:69–97.
Ivsins, A.K. 2010. “’Got a pipe?’ The social dimensions and functions of crack pipe sharing among crack users in Victoria, BC.” MA thesis, Department of Sociology, University of Victoria. Retrieved February 14, 2014 (http://dspace.library.uvic.ca:8080/bitstream/handle/1828/3044/Full%20thesis%20Ivsins_CPS.2010_FINAL.pdf?sequence=1)
Lowrey, Annie. 2013. “Switzerland’s Proposal to Pay People for Being Alive.” The New York Times Magazine. Retrieved February 17, 2014 (http://www.nytimes.com/2013/11/17/magazine/switzerlands-proposal-to-pay-people-for-being-alive.html?pagewanted=1&_r=2).
Lynd, Robert S. and Helen Merrell Lynd. 1959. Middletown: A Study in Modern American Culture. San Diego, CA: Harcourt Brace Javanovich.
Lynd, Staughton. 2005. “Making Middleton.” Indiana Magazine of History 101(3):226–238.
Marshall, B.D.L., M.J. Milloy, E. Wood, J.S.G. Montaner, and T. Kerr. 2011. “Reduction in overdose mortality after the opening of North America’s first medically supervised safer injecting facility: A retrospective population-based study.” Lancet 377(9775):1429–1437.
Rothman, Rodney. 2000. “My Fake Job.” The New Yorker, November 27, 120.
Sennett, Richard. 2008. The Craftsman. New Haven, CT: Yale University Press. Retrieved July 18, 2011 (http://www.richardsennett.com/site/SENN/Templates/General.aspx?pageid=40).
Smith, Dorothy. 1990. “Textually Mediated Social Organization” Pp. 209–234 in Texts, Facts and Femininity: Exploring the Relations of Ruling. London: Routledge.
Smith, Dorothy. 2005. Institutional Ethnography: A Sociology for People. Toronto: Altamira Press.
Sonnenfeld, Jeffery A. 1985. “Shedding Light on the Hawthorne Studies.” Journal of Occupational Behavior 6:125.
Wood, E., M.W. Tyndall, J.S. Montaner, and T. Kerr. 2006. “Summary of findings from the evaluation of a pilot medically supervised safer injecting facility.” Canadian Medical Association Journal 175(11):1399–1404.
2.3. Ethical Concerns
Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, and Social Sciences and Humanities Research Council of Canada. 2010. Tri-Council Policy Statement: Ethical Conduct for Research Involving Humans. Retrieved February 15, 2014 (http://www.pre.ethics.gc.ca/pdf/eng/tcps2/TCPS_2_FINAL_Web.pdf).
Canadian Sociological Association. 2012. Statement of Professional Ethics. Retrieved February 15, 2014 (http://www.csa-scs.ca/files/www/csa/documents/codeofethics/2012Ethics.pdf).
Habermas, Jürgen. 1972. Knowledge and Human Interests. Boston: Beacon Press
Weber, Max. 1949. Methodology of the Social Sciences. Translated by H. Shils and E. Finch. Glencoe, IL: Free Press.
Solutions to Section Quiz
1. C | 2. C | 3. D | 4. C | 5. B | 6. C | 7. D | 8. C | 9. A | 10. A | 11. B | 12. A | 13. B | 14. D | 15. A
Image Attributions
Figure 2.3. Didn’t they abolish the mandatory census? Then what’s this? by Khosrow Ebrahimpour (https://www.flickr.com/photos/xosrow/5685345306/in/photolist-9EoT5W-ow4tdu-oeGG4m-oeMEcK-oy2jM2-ovJC8w-oePSRQ-9J2V24-of1Hnu-of243u-of2K2B-of2FHn-owiBSA-owtQN3-of1Ktd-oitLSC-oeVJte-oep8KX-ovEz8w-oeohhF-oew5Xb-oewdWN-owavju-oeMEnV-oweLcN-ovEPGG-ovAQUX-oeo2eL-oeo3Fd-oeoqxh-oxCKnv-ovEzA5-oewFHa-ovHRSz-ow8QtY-oeQY6Y-oeZReR-oeQmHw-oeKXid-oeQLKa-oy6fNT-ow4sVT-oeQMQq-oeQPPr-oeQYbL-ow8hS1-ow4n8v-owiPKS-oeQF41-oeiH5z) used under CC BY 2.0 (https://creativecommons.org/licenses/by/2.0/)
Figure 2.4. Dauphin Canadian Northern Railway Station by Bobak Ha’Eri (http://commons.wikimedia.org/wiki/File:2009-0520-TrainStation-Dauphin.jpg) used under CC BY 3.0 license (http://creativecommons.org/licenses/by/3.0/deed.en)
Figure 2.5. Punk Band by Patrick (https://www.flickr.com/photos/lordkhan/181561343/in/photostream/) used under CC BY 2.0 (https://creativecommons.org/licenses/by/2.0/)
Figure 2.6. Crack Cocaine Smokers in Vancouver Alleyway (http://commons.wikimedia.org/wiki/File:Crack_Cocaine_Smokers_in_Vancouver_Alleyway.jpg) is in the public domain (http://en.wikipedia.org/wiki/Public_domain)
Figure 2.8. Muncie, Indiana High School: 1917 by Don O’Brien (https://www.flickr.com/photos/dok1/3694125269/) used under CC BY 2.0 license (https://creativecommons.org/licenses/by/2.0/)