LINKING COMPLEX EMERGENCY RESPONSE AND TRANSITION INITIATIVE

 

 

 

 

CERTI Crisis and Transition Tool Kit

 

INTERVIEWERS GUIDE

RAPID ASSESSMENT PROCEDURES (RAP):

Addressing the Perceived Needs of Refugees & Internally

Displaced Persons Through Participatory Learning and Action

 

 

Manual

 

            Center for Refugee and Disaster Studies

            The Johns Hopkins University School of Public Health

 

 

September 2000.

 

This project was made possible through Cooperative Agreement Number HRN-A-00-96-9006 between the US Agency for International Development and Tulane University

 

Table of Contents

 

Introduction             3

Overview of RAP             9

Interviewing in Qualitative Research             23

RAP Methods             34

Management of Qualitative Data             68

Action Planning             76

References                 89

 

 

Section I.

Introduction.

 

 

Today’s Agenda

AM

Opening the workshop

bullet
Introductions
bullet
Objectives of the study
bullet
Schedule of the study
bullet
Expectations

 

PM

• Overview of qualitative research

• Interviewing principles.

 

 

Introductions

•  Who are you?

•  Where are you from?

•  What do you do?

•  Any experience with studies?

 

Study Objectives

bulletTo understand refugee/IDP priorities, challenges and aspirations.

      This information is used to decide what priority problem(s) to address.

bulletTo learn who are the significant persons and organizations among the refugee/IDPs (and external to them) who have the greatest stake in addressing refugee priorities.

      This information is used to decide who needs to work on the priority problem(s).

   •  To facilitate participatory planning, problem solving and taking action with refugees/IDPs.

      This process is used as a basis to reinforce or build capacity of IDPs to carry out organized problem solving activities using existing resources.

 

Tentative Schedule

Day 1 & 2: Initial Training

Day 3: Introduction to community Participatory Map

Day 4: Walkabout

Day 5: Free Listing

Day 6 - 8: Data collection continued; methods to be determined (Pile Sorting,Pair Wise Ranking, Venn Diagram, Key Informant Interviews)

Day 9: Data management & analysis

Day 10: Public meeting (identify settlement action tea - SAT)

Day 11 & 12: Action planning with SAT

Day 13: Public meeting (approve action plan)

Day 14: Data management.

 

Expectations

HOPES CONCERNS
           

 

Section II.

Overview of the RAP

 

RAP Research Approach

• More qualitative than quantitative

• More participatory than top-down

wpe8.jpg (19285 bytes)

Source of diagram: Freudenberger KS, 1999. RRA/PRA Manual for CRS Field Workers and Counterparts.

Qualitative Research Methods

bulletThese are research methods which obtain in-depth information from people. The aim is to understand WHY people think and behave the way they do. Because it requires a lot of time with people to get in-depth information, we usually can only talk with a FEW people.
bulletThis is different from quantitative research methods like surveys. Here we obtain relatively little detailed information from each person. This is because with quantitative research we are interested in describing HOW MANY people know or do something (how many people have had vaccinations, how many people know about ORS). Quantitative research is less useful for describing WHY people know or do something. And, because we want to find out HOW MANY people think and do something, we interview A LOT OF people in quantitative research.
bulletBoth qualitative and quantitative methods are important, and whether we use one or the other depends on what we are trying to learn.

Use of Qualitative Research in Refugee/IDP Programs

bulletIdentify the refugees/IDP’s overall priorities for action and the ranking of specific sectors among  priorities
bulletIdentify priorities within specific sectors/issues
bulletIdentify the underlying reasons for specific problems before developing solutions
bulletIdentify the refugee/IDP’s language, concepts and beliefs surrounding specific behaviors/situations targeted for change; and,
bulletAssess community reactions to programs to adapt implementation.

BIAS

DEFINITION:

CAUSES:

x

x

x

x

Triangulation

(From Freudenberger, 1998)

Reduce bias by:

bulletUsing team members with different experiences and perspectives
bulletContinuously cross-checking information using different methods and types of informants
bulletActively identify bias at the end of each day
bulletDecide how to manage bias in days ahead

wpe2.jpg (42365 bytes)

Note: See the CRS Manual for RRA and PRA, pages 16-26.

Things We Do in Qualitative Research

• Triangulate our information - by methods, makeup of team, type of informant

• Be flexible - take out or add in questions/methods as the study progresses

• Use an iterative process - within & between interviews, within the study

• Use open-ended approaches - allow understanding of the wider context; let the informant lead.

Purposive Sampling

• Choose informants who have special knowledge of what you want to study

• Sampling Units:

bulletPersons
bulletTimes/days (e.g. morning vs. evening activities)
bulletEvents/Episodes (e.g. births, illnesses, meals)
bulletSites/microsites

• Those with special local knowledge of our training study topics:

X

X

X

X

X

X

X

X

Site Selection

(from Gittelsohn et.al., 1998; Freudenberger, 1998)

• Study area(s) should represent the target population

bullet    An alternative is to focus on vulnerable groups

• If there are different ethnic groups within the target population, select an area representing each group.

Location of the study area should be logistically feasible as long as it does not compromise representativeness

• Triangulate within each study area

bulletRepeat data gathering activities in a second or third location of the same ethnic background
bulletPurpose of this is to confirm what was learned in the first location within the study area
bulletSince the purpose is confirmatory rather than explanatory, the amount of data-collecting activities needed is less than in the first location

Examples of Site Selection

Example 1: 2 primary locations studied at the same time, with a possible secondary location for confirmation

wpe19.jpg (9837 bytes)

 

Example 2: 1 primary location, 1 - 2 secondary locations studied later for confirmation

wpe1A.jpg (7445 bytes)

 

Example 3: 1 primary location studied over time (for monitoring & evaluation or exploring new topics)

wpe1B.jpg (4447 bytes)

Participatory Approaches

(PLA or PRA, RRA, RAP)

Three foundations:

• The behavior and attitudes of outsiders, who facilitate, not dominate.

• The methods, which shift the normal balance from closed to open, from individual to group, from verbal to visual, and from measuring to comparing.

• The partnership and sharing of information and experience between insiders and outsiders, and between organizations.

Source: Chambers R. 1997. Whose Reality Counts? Putting the first last.

Participatory Approaches

(PLA or PRA, RRA, RAP)

Key Principles:

Reversal of learning: learn directly from the community, gaining from their knowledge;

Offsetting biases: minimize biases by being relaxed and not rushing, listening not lecturing, probing instead of passing on to the next topic, being unimposing, and seeking out marginalized groups within the community to learn from;

Triangulate, be flexible, iterative, & open-ended

Handing over the stick (or pen or chalk): The local people take over the process of analysis of their information, presentations and learning;

Seeking diversity: Actively looking for exceptions, dissenters and differences;

Self-critical: The facilitators continuously examine their behavior and try to do better, correcting dominant behavior.

Source: Chambers R. 1997. Whose Reality Counts? Putting the first last.

RAP & Participatory Approaches

• Located between RRA and PRA

> Study team can define degree of participation

> Study team can shift toward RRA or PRA

 wpe1D.jpg (19285 bytes)

Source of diagram: Freudenberger KS, 1999. RRA/PRA Manual for CRS Field Workers and Counterparts

RRA / RAP / PRA CONTINUUM

  RRA RAP PRA
Objective

Gather quality information that captures the complexity of local situations and values local knowledge

X

Build local capacity to define, analyze and solve problems

Who does it?

Generally a team of outsiders that builds a rapport and works closely with local community X Generally a group of local people; sometimes facilitated by outsiders

Output

Information that can be used by outsiders and information that is left for use by the community X Local capacity building, skills in planning, sometimes partnerships with outside agencies
Mechanism Discrete studies often lasting from 5 days to a month

X

Extended process generally lasting months or years
Emphasis Validity of information collected; capturing of the complexity of local situation X Local communities taking increasingly greater control over the process

Tools,

Techniques

Qualitative Research Methods

Participatory tools and techniques

(Diagrams, ranking exercises, etc.)

Source of table: Freudenberger KS, 1998. RRA/PRA Workshop Notes.

 

   Section III.

Interviewing in Qualitative Research

Things We Do in Qualitative Interviews

Use open-ended questions

Avoid leading questions

Probe issues in depth

Let the informant lead

Use Open-Ended Questions

Closed Questions: Questions for which the answer choices are either given to the respondent or understood by the respondent

Examples:

"Is your hair black, brown, or red?" [Choices provided]

"Are you interested in research?" [Choice implied: yes/no]

Closed questions limit the breadth of information that a respondent has to offer.

Open Questions: Questions that allow the respondent to answer without presented or implied choices

Examples:

"What color is your hair?"

"What are your interests?"

Open Question Words:

What? Where?

Who? When?

How? Why? *

* "Why?" Limit the use of "WHY" questions in this type of work because it implies that there is a right answer

Avoid Leading Questions

(From Herman & Bentley, 1993)

• Allow people to answer in their own terms voicing their own views, values and experiences.

• Leading questions are phrased to suggest a particular answer or to imply that one answer is expected or more correct:

bullet"What fears do you have when your baby’s diarrhea does not stop?"
bullet"What actions do you take to stop his/her diarrhea?"
bullet"How good was the treatment your baby got at the health center?"
bulletThese questions were phrased to elicit answers related to fears, actions and treatments, respectively.

• Non-leading questions on the same topics could be asked this way:

bullet"How do you feel when your baby’s diarrhea does not stop?"
bullet"What do you do when his/her diarrhea does not stop?"
bullet"How do you feel about the treatment your baby got at the health center?"

Asking Non Leading Questions

Leading Nonleading
Do you think vomiting during diarrhea is serious?  
Do you give less food when your baby had diarrhea?  
Do you know that children lose water when they have diarrhea?  

Probing

"The key to successful interviewing is learning how to probe effectively…

...that is, to stimulate an informant to produce more information…

...without injecting yourself so much into the interaction that you only get a reflection of yourself in the data."

                                                                                                               (Bernard, 1995)

Probing Techniques

"What?" or "What" questions

bulleta stimulus without putting yourself in it

Silent Probe

bulletjust remain quiet and wait for informant to continue
bulletoften happens as you are busy writing what the informant has just finished saying.

Echo Probe

bulletrepeat the last thing an informant said and ask them to continue
bullet"I see. The child has loose stools, becomes tired and will not eat. Then what happens?"

The Uh-huh Probe

bulletencourage participant to continue with a narrative by making affirmative noises:
bullet"Uh-huh," "yes, I see," "right, uh-huh".30

Letting the Informant Lead

"In unstructured interviewing, you keep the conversation focused on a topic, while giving the informant room to define the content of the discussion."

"The rule is: Get an informant on to a topic of interest and get out of the way. Let the informant provide information that he or she thinks is important."

                                                                                   (from Bernard, 1995)

Tips for Interviewing -1

• Do not begin interviewing right away

bulletFriendly greeting and explanations
bulletEstablish ‘cultural ignorance:’ interviewer as learner

• Listen and express interest in what the informant tells you

bulletMore of a friendly conversation
bulletNot a strict question & answer exchange
bulletBut remain neutral: don’t approve or disapprove

• Try to encourage informant to expand on their answers and give as many details as possible

bulletinformant’s tendency is to abbreviate answers
bulletUse "describe," "tell me about"
bulletDo not move on to a new topic until you feel you have explored the informant’s knowledge on the question at hand

• Let informant’s answers determine the direction the interview takes (keeping within topics of interest)

Tips for Interviewing -2

• Use informant’s own language to ask new questions

bulletDo this as you learn informant’s language
bulletThis encourages informants to speak to you in their own language

• Crude measure of success is the volume of response

bullet80% at least ‘their’ words
bulletmost problems are the fault of the interviewer

• Learn how to re-phrase/re-think questions

• Avoid using "why" questions as much as possible.

bulletimplies that there is a factual answer
bulletinformants will try to give you a ‘right’ answer
bulletask, "What was happening at the time?"

Use of Translators

Translators do the following:

bulletProvide literal translation
bullet" Do not edit, ‘clean-up’ or summarize statements
bulletKeep key terms in local language
bullet" Don’t try to translate if too difficult
bulletKeep your own dictionary of key local terms

Process:

bulletInterviewer introduces translator to informant
bulletInterviewer speaks directly to informant
bulletInterviewer keeps eye contact with informant
bulletInterviewer essentially ignores the translator
bulletInterviewer/translator complete raws notes after interview
bullet" write expanded notes together, if possible

 

Section IV.

RAP Methods

 

PARTICIPATORY MAPPING

(From Freudenberger, 1998)

• Choose area of interest (inhabited village, village farming areas, district)

• Invite persons whose perspective you wish to learn about regarding area of interest.

• Do mapping exercise in large open area:

bulletInvestigator identifies a couple of landmarks to orient the activity and draws figures on ground to represent these landmarks
bulletInvestigator "hands over the stick" to someone in the group and asks that person to identify on the map the most important sites in the area
bullet" use sticks, stones, seeds, leaves as markers
bulletDon’t ask about things on the checklist until all participants have identified sites important to them.
bulletInterview the map using a checklist to probe
bulletCopy the map into a field notebook as it is being drawn; transfer to flipchart paper later.
bulletRecord important quotes about sites on the map and record observations of the process

Example Checklist for Map Exercise

(from Herman & Bentley, 1993)

• Persons, places or things related to health in the area

• Which parts of the community or households have the most vulnerable persons and why is this so

• Which parts of the community or households have the most sickness and why is this so

• Which households have the most vulnerable or malnourished children and why is this so

• Where do individuals live who have specialized knowledge about childhood illnesses and how to treat them

WALKABOUT - 1

• Type of Observation

• Usually do not take notes while observing

bulletreduces reactivity
bulletMay be able to discreetly jot down details of what you observe between observation sites

• Usually have a focus (location, behaviors)

bulletUse a guide or checklist of topics

• What to record:

bulletwho, what, where, when, what, [why interpretation comes later]
bulletBehaviors/conversations related to topic
bulletWhat does not happen related to topic (that you might have expected)
bulletMaps/diagrams related to focus topics
bullet" e.g, drawing of activities at a water source

WALKABOUT - 2

• Familiarize yourself with the checklist before you set out on your walk

bulletuse it discreetly, as a reminder, if you need to refer to it during your walk

• Walk around the community in pairs or threes

bulletnot too many avoid attracting unnecessary attention
bulletmeander to absorb the community atmosphere, stopping to greet people

• Visit places in the community related to specific checklist topics (e.g., water sources, where food is stored, fields)

• Have spontaneous informal conversations on checklist topics where people normally gather

• Discreetly jot down details of what you observe (between sites)

• Make notes of things said during conversations with people you meet.

Example of Walkabout Checklist

1. What are the available water sources?

(a) well

(b) spring

(c) reservoir/dam

(d) rain water

(e) seasonal pond

(f) public stand post/tap/fountain

(g) hand-dug well

(h) other

2. Are the water sources protected? (indicate which ones)

(a) yes

(b) semi-protected

(c) no

3. How far are water sources from peoples homes?

Water source Distance

___________ (a) less than 100 meters

___________ (b) 100-500 meters

___________ (c) less than 1 km

___________ (d) 1-2 km

___________ (e) 3-5 km

___________ (f) 6-7 km

___________ (g) more than 8 km

4. What activities take place at or near the water source?

(a) washing water containers

(b) washing clothes

(c) bathing/washing self

(d) watering animals

(e) other

5. Who collects water?

(a) women

(b) children

(c) men

6. What utensils (and means) are used for fetching water?

7. How is water transported from the source to the home?

8. Is water treated at the source, and if so, how?

(a) by filtering with a piece of cloth

(b) by chlorination

(c) by other means

9. How is drinking water stored in the home?

10. How is drinking water handled in the home?

Reactivity in Observations

• Reactivity: people may change what they do or say when being observed

• What do we do with reactivity?

bulletalways record reactivity in notes
bulletanalyze/discuss reactivity in ‘Biases’ section of the Expanded Notes Summary

• Ways to reduce reactivity:

bulletrepeated observations
bulletextended visits (longer time)
bulletchoice of observer
bulletinteract with people prior to observing

Free Listing - 1

Purposes:

bulletIdentify a list of items included in a topic of interest
bullete.g. list of difficulties affecting the community
bulletIdentify the most known/prominent items in the culture
bullet   used to decide what to investigate more fully in the study
bulletIdentify the locally used words for these items

Preparations:

bulletTranslate and pre-test questions:
bulletprimary, probing and secondary question (optional)
bulletTrain for consistency in asking questions
bulletPrepare Free List recording form

Process:

bulletIdentify informants
bulletKnowledgeable about topic of interest
bulletMinimum of 10 informants
bulletStratify by significant sub-group
bulletAsk the primary question
bulletAsk "What are all the main difficulties that people living in this settlement face?" "Name all the difficulties you face?"
bulletAsk it with consistency
bulletDo not ask "If...?" "Are there... ?"

Free Listing - 2

Process (continued):

bulletRecord each item mentioned on the recording form in the "Item" column, one row per item.
bulletProbe after informant provides initial list of items
bulletAsk "What else?"

OR

bulletRepeat items mentioned & then Ask "What else?"
bulletRecord each additional item on the recording form
bulletNeed to agree on how much to probe; be consistent
bulletAsk secondary question (Optional)
bulletAsk secondary question for each item mentioned
bulletAsk a question to clarify the meaning of each item
bullete.g., "Describe what happens when X occurs?

OR

bulletAsk for additional information about each item
bullete.g., "What should a person do if X occurs?

Free Listing - 3

Analysis:

bulletMake a list of responses for the entire sample
bulletFor each item on the list, count the number of informants who mentioned the item
bulletWhen to collapse two or more items into one?
bulletSingular or plural forms of the same word
bulletKey informant clearly state two items are same
bulletGenerally, avoid the temptation to collapse
bulletForms of Tabulation:
bulletRank by frequency of mention (most common)
bulletRank by order of mention

OR

bulletRank by number of related items
bulletIdentify the most known/prominent items in the culture for topic of interest
bulletOrder items by frequency mentioned (%)
bulletSelect a relevant cutoff percentage
bulletLook at distribution: what makes sense?
bullete.g., 50% or more of informants mentioned the item

Free Listing Recording Form

Free listing Recording Form: Main dif ficulties faced by pe rsons living in the settlement
Interviewer:

Location:

Ethnicity:

Original home:

Date:

Informant’s age:

Time spent in settlement :

Marital status:

Question 1. "What are main difficulties that people living in this settlement face?" List of Names of Each Difficulty Mentioned (Write Local Terms) Question 2. "You mentioned ________ was a difficulty here. Please describe to me how this affects the lives of individuals faced with this difficulty?"
1.

2.

3.

4.

5.

6.

7.

8.

9.

10.

   

Free Listing Tabulation Form

  Term ( Item) # %
1      
2      
3      
4      
5      
6      
7      
8      
9      
10      
11      
12      
13      
14      
15      
16      
17      
18      
19