Module 2

Methods of Assessment
Topics to cover
• Unit 1: Behavioral assessment, Data collection methods

• Unit 2: Observation – Purpose, Types

• Unit 3: Survey- Questionnaire- Inventories

• Unit 4: Behavioral rating scale, Characteristics of rating scales,
Types of rating scale
• Unit 5: Interview and Case study- Structured, unstructured,
telephonic interviews
Behavioral assessment
Behavioral Assessment:

• The systematic study and evaluation of an individual’s behavior using

a wide variety of techniques, including direct observation, interviews,
and self-monitoring.

• Concerned with assessing and measuring various constituents of a

behavior that are indicative of why a certain behavior occurs and what
causes that behavior
Assumptions of behavioral assessment
• Focus on behavior

• Quantitative data

• Behavior- occur due to stimuli from the environment

• Assessment- multiple sources of information

• Focus on individual person than group

• Focus on developing adaptive behavior

 Data collection methods

Primary source Secondary source

Interview Observation Questionnaire Documents

Structured Participant Mailed • Census data

• Hospital records
Un- Non • School records
Face to face
structured Participant • Earlier research
• Govt. Publication
• Client histories
Methods of data collection:
Based on approach to information gathering:

• Primary data:

• First hand basis

• Derived from research/study

• Secondary data:

• Derived from primary data

Questionnaire:
• Contains a series of questions that the respondents themselves fill in
the answers.

• Attitude scale/opinionnaire- measure attitude/belief of the person

• Schedule-series of questions that the investigator asks and fills in

• Interview guide- basic points or topics to be covered by the

interviewer during interview
Questionnaire:
• Simplicity in language:
• Ambiguity

• Vague words

• Embarrassing questions

• Double negatives

• Leading questions- content and structure leads to a specific answer

• Presuming questions

• Hypothetical questions
Questionnaire: characteristics
• Investigator must state the significance, objectives and aim

• Questionnaires must be short- related to a specific topic

• Wordings should be simple and easy to understand

• Questions should be objective-not contain hints/suggestions

• Embarrassing question, presuming questions & hypothetical questions

must be avoided

• Questions and responses must be presented in an order

Questionnaire: functions
A questionnaire is a research instrument
consisting of a series of questions for the purpose of
gathering information from respondents.

• Description- describe the characteristics

• Measurement- measures variables attitude, trait etc

Questionnaire: types
Based on type of response:

Fixed response questionnaire/ close ended questionnaire:

• Consist of statements with fixed no. of choices

• Target sample has adequate knowledge about the topic

Open ended questions

• Lengthy answers by the respondent

 Open vs. close ended questionnaire

Fixed response questionnaire Open ended questionnaire

• Easily scored and coded • Provides detailed information
• Easy administration • Provides greater flexibility
• Less time • Time consuming
• Unable to provide relevant response items • Difficult to be objectively scored
• Respondent bias/ set • Biases
Questionnaire: types
Based on administration

Mail questionnaire

• Questionnaire mailed to the designated subject with a request to

answer the questions and return it through mail

Face to face administration

• Questionnaires are given and the subjects must complete them in the
presence of investigators
Questionnaire: types
Funnel type questionnaire:

• ordering questions in a questionnaire - general questions to specific

questions

• Start with open questions narrow down to close ended questions

 Mail vs. face to face questionnaire
Mail questionnaire Face to face questionnaire
• Less costly • Higher response rate
• Problem arising out of contacting the
• Provides greater flexibility
respondent is avoided
• Quick method of survey • Greater chance for clarification
• Reduces bias • Probing
• Non response • Respondents- too conscious
• Difficult & complex questions- less effective • Costly
• Inflexible • Time consuming
• Cannot observe mode of expression/reaction • Respondents are selected based on
accessibility and convenience
Interview:
• Face to face interaction between the interviewer and the respondent
which intends to elicit some desired information from the latter

• A directed conversation in which a researcher, therapist, clinician,

employer, or the like (the interviewer) intends to elicit specific
information from an individual (the interviewee) for purposes of
research, diagnosis, treatment, or employment.
Interview: Types
• Formal interview- already prepared questions are asked in a set order
by the interviewer and answers are recorded in a standardized form.

• It is a systematic procedure for collecting information regarding the

respondents

• Highly structured- sequence and scoring methods are predetermined

• Disadv: expensive and time consuming

• Validity is less compared to other modes (standardized tests)

Interview: Types
• Informal interview- no predetermined or preset order of questions-
interviewer can ask the questions using the key points.

• Can get a deeper understanding of the respondents behavior.

• Disadv: greater scope for personal influence and bias

• Requires greater skill

• Difficult to quanitfy
Interview: Functions
• Description- Provide insight- interaction helps understand how
respondents view the topic under discussion

• Exploration- Insight into the unexplored dimensions of the topic

Interview: Sources of error
• Attitude of the interviewer

• Incomprehensibility of the question

• Lack of warmth (rapport)

• Lack of motivation in respondents

• Duration of interview
 Interview
Advantages Disadvantages
• Interviewer’s variability-views and records
• Greater flexibility
similar responses differently
• Inter-interviewer variability – more no. of
• Collect information quickly
interviewers
• Validity and dependability of verbal
• Increases validity
responses
• Desired level of control • Time consuming
• Understand non verbal cues • Recording information
Observation
• Consist of collecting facts, which are in the direct knowledge of the
investigator

• Systematic observation is a basic method of science in which the

natural world, or various events or processes in it are observed and
measured in a very careful manner.

• Pauline Young- ‘Deliberate study through eyes’

Observation-Purpose
• Capture and study human behavior as it actually happens

• It provides graphic description of real life that can’t be acquired in

other ways

• Exploration- observes human behavior in real life setting –explore

those variables that our overlooked
Types of observation:
• Naturalistic: Researcher will observe events/ behavior where it
normally occurs.

• Controlled: The researcher decides time, place, participants for stud,

in what circumstances and uses a standardized procedure.

• Participant observation: In this method researcher joins in and

becomes part of the group they are studying to get a deeper insight
into their lives. E.g. Leon Festinger- study of religious cults.
Participant observation:
• Undisguised participant observation- Individual being observed
knows the observer who has intention to collect information about
them.

• Disguised participant observation: Researcher pretends to be a

member of the social group, and conceal their identity as
researchers.
Participant observation:
• Adv: Investigator records behavior in realistic and natural manner

• Disadv: time consuming

• Unstructured-lacks precision

• Biased
Non participant observation
• Observation in which the investigator observes the behavior of
other people in a natural setting but does not remain a participant
in the activities

• Adv: structured- more reliable results

• Disadv: Beh. Of the participants are not natural-know they are

being observed
Observation method
Advantages Limitations
Controlled observation- easy to Lack validity- participant knows they
replicate are watched.
Naturalistic observation- flow of Less reliable as other variables cannot
behavior in its own setting be controlled.
Participant observation- get deeper If the researcher becomes too
insights about various aspects of involved they may lose objectivity
behavior and become bias.
Time consuming, expensive
Case Study method
• In depth study, intensive and sharply focused exploration of an
event.

• The procedure-description of the behavior.

• Through interviews and observation.

Case Study method- Characteristics:
• Idiographic perspective- concerned with particular rather than the
general (individual)

• Contextual data- focuses on the various dimensions of the case

• Triangulation- multiple sources of data-improves credibility

• Temporal element- concerned with processes that takes place over

time.
Case study method
Advantages Limitations
• Provides detailed information. • Little basis for generalization of
results to the wider population.
• Provides insight for further • Researcher bias
research.
• Scientific experiments can be • Difficult to replicate
conducted
• Time consuming, expensive
Survey
• Investigation/examination/assessment

• Form of paper pencil feedback form or in depth interview

• For the purpose of collecting data

• Uses: Collect self report data; investigates characteristics/behavior;

collect info about experiences/opinion

• Technique:
• Interview method and questionnaire method
Inventory
• List of items- used to describe and study behavior

• Type of psychological test in which a person fills out a survey or

questionnaire with or without the help of an investigator.

• Test vs. Inventory:

• Inventories- no objectively correct answers/ responses are based on

subjective perception

• Tests- measure abilities / qualities- authoritative right and wrong answers

Behavior rating scale
• Technique through which observer categorizes the object, events or persons
on a continuum.

• tool for quantitatively measuring the intensity, frequency, or duration of

specific behaviors

• Assess both actual and remembered behavior

• Actual behavior- present and interact with each other, decision making on the
basis of surrounding.

• Remembered behavior- Decisions based on the previous experiences.

Behavior rating scale
• Components of a rating scale:

• Stimulus variable- traits / qualities to be rated

• Response option- numerical/ descriptive

• Precautions:

• Trait to be rated –clearly defined and explained

• Intervals / points to be clearly defined

• Objectively observable traits

Behavior rating scale
• Broad band rating scale- designed to measure multiple behavioral
and emotional attributes simultaneously

• Narrow band rating scale- designed to measure a specific behavior

or attribute

• items that sample from a small number of domains and are not
intended to be global measures of an individual's behavior.
Behavior rating scale
• Numerical Rating Scale:

• A type of rating scale that requires the respondent to provide his or

her feedback in terms of numerical values.

• Graphic rating scale:

• indicates the answer options on a scale of 1-3, 1-5

• Descriptive rating scale:

• the choice of descriptive statements.