KEMBAR78
Lecture 10 Table of Specifications | PDF | Knowledge | Cognition
0% found this document useful (0 votes)
78 views55 pages

Lecture 10 Table of Specifications

The document outlines the purpose and importance of a Table of Specifications (TOS) in assessment design, emphasizing its role in aligning instructional objectives with test content. It details the historical development of cognitive taxonomies, particularly Bloom's taxonomy and its revised version by Anderson and Krathwohl, which categorizes cognitive processes and knowledge dimensions. Additionally, the document provides steps for developing a TOS, including determining test coverage, objectives, and item distribution, while highlighting the significance of ensuring comprehensive assessment across various cognitive levels.

Uploaded by

Noli Oribello
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
78 views55 pages

Lecture 10 Table of Specifications

The document outlines the purpose and importance of a Table of Specifications (TOS) in assessment design, emphasizing its role in aligning instructional objectives with test content. It details the historical development of cognitive taxonomies, particularly Bloom's taxonomy and its revised version by Anderson and Krathwohl, which categorizes cognitive processes and knowledge dimensions. Additionally, the document provides steps for developing a TOS, including determining test coverage, objectives, and item distribution, while highlighting the significance of ensuring comprehensive assessment across various cognitive levels.

Uploaded by

Noli Oribello
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 55

Preparing Table

of Specifications
(TOS)
At the end of the learning session, YOU should be able to:

1 Explain the purpose of table of specifications


(TOS)

2 Prepare a sample table of specification (TOS)


for one quarter, covering the chosen
competencies for testing.
Appreciate the importance of TOS in
3
designing right assessment.
Preparing Table of Specifications (TOS)

In the late 1950s into the early


1970s, there were attempts to
dissect and classify the varied
domains of human learning
a. cognitive (knowing, or head),
b. affective (emotions, feelings,
or heart) and
c. psychomotor (doing, or
kinesthetic, tactile, haptic or
hand/body).

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

The resulting efforts yielded a series of taxonomies


for each area.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Taxonomies (classification) deal with the varied aspects


of human learning and were arranged hierarchically,
proceeding from the simplest functions to those that
are more complex.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Bloom et. al (1956) published


the taxonomy of educational
objectives: a cognitive
domain.
• Bloom et. al (1956) classified
forms and levels of learning
based on cognitive
processes that learners
involved in when they
learn.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

While all of the taxonomies have been defined and


used for many years, there came about at the
beginning of the 21st century in a new version of the
cognitive taxonomy.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

David R. Krathwohl

Anderson, a former student


of Bloom, updated and
revised the taxonomy
reflecting relevance to 21st
Lorin W. Anderson
century work for both
students and teachers
(Anderson& Krathwohl, 2001).

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Anderson changed the taxonomy in three broad


categories: terminology, structure and emphasis
(Forehands, 2005).
Anderson modified the
original terminology by
changing Bloom’s
categories from nouns to
verbs.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Anderson renamed the


knowledge category
into remember,
comprehension into
understanding and
synthesis into create
categories.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Anderson also
changed the order of
synthesis and placed it
at the top of the
triangle under the
name of Create
(Taylor & Francis, 2002).

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Thus, Anderson and


Krathwohl’s (2001) revised
Bloom’s taxonomy
became: Remember,
Understand,
Apply, Analyze, Evaluate
and Create

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Anderson and Krathwohl (2001) also made structural


changes to the original Bloom’s taxonomy. Anderson
considered two dimensions in the revised taxonomy
instead of one, a products dimension.
The two dimensions are:
1. knowledge (or the kind of knowledge to be
learned)
2. cognitive process (or the cognitive processes to
be used in acquiring knowledge).

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Cognitive Dimension
Knowledge
Dimension

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Taxonomies of the Cognitive Domain


Cognitive Illustrative
Definition Sample Objective
Process Verbs
Remember Recognizing Identify Name the 7th
List President of the
and recalling Philippines
facts Name
Underline
Recall
Retrieve
Locate

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Taxonomies of the Cognitive Domain


Cognitive Illustrative Sample
Definition
Process Verbs Objective
Understand Understanding Describe Explain the causes
Determine of malnutrition in
what the the country.
information Interpret
Translate
means
Paraphrase
explain

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Taxonomies of the Cognitive Domain


Cognitive Illustrative Sample
Definition
Process Verbs Objective
Apply Applying the Apply Solve the
Employ problems using
facts, rules, the different
concepts and Practice
measures of
Relate
ideas in central tendency
Use
another Implement
context Carry Out
Solve

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Taxonomies of the Cognitive Domain


Cognitive Illustrative Sample
Definition
Process Verbs Objective
Analyze Breaking down Analyze Classify the
Calculate chemical elements
information based on some
into parts Examine
categories/areas.
Test
Compare
Differentiate
Organize
Classify

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Taxonomies of the Cognitive Domain


Cognitive Illustrative Sample
Definition
Process Verbs Objective
Evaluate Judging the Assess Critique the latest
Measure film that you have
value of watched.
information or Estimate
Evaluate
data Use the critique
Critique guidelines and
Judge format discussed
in the class.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Taxonomies of the Cognitive Domain


Cognitive Illustrative Sample
Definition
Process Verbs Objective
Create Combining Compose Propose a
Produce program of action
parts to to help solve
make whole Develop
Metro Manila’s
Formulate traffic congestion
Devise
Prepare
Design
Construct
Propose
Re Organize
ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Knowledge Dimension
Knowledge
Description Sample Question
Dimension
Factual • It tells the facts or bits of What is the
information one needs to capital of the
know in a discipline Philippines?

• This type of knowledge


usually answer questions
that begin with “WHO,
WHERE, WHAT, AND
WHEN

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Knowledge Dimension
Knowledge Sample
Description
Dimension Question
Conceptual • It tells the concepts, What makes
generalizations, principles, the Philippines
and models that one the “Pearl of the
needs to know in a Orients Seas”?
discipline.

• Answer the questions that


begin with “WHAT”

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Knowledge Dimension
Knowledge Sample
Description
Dimension Question
Procedural • It tells the processes, How do we
steps, techniques, develop items
methodologies, or specific for an
skills needed in achievement
performing a specific task test?
that one needs to know
and be able to do in a
discipline.
• Answer the questions that
begin with “HOW”.
ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Knowledge Dimension
Knowledge Sample
Description
Dimension Question
Meta • It makes one understand the Why is
cognitive value of learning on one’s life.
• It requires reflective
engineering the
knowledge and strategies on most suitable
how to solve problems or course for you?
perform a cognitive task
through understanding of
oneself and context.
• Answer questions that begin
with “WHY”, or HOW

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Knowledge Dimension

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Cognitive and Knowledge Dimension

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Cognitive and Knowledge Dimension

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

3% of students who got low grades in exams are


caused by faulty test questions.
WORLDWATCH, The Philadelphia Trumpet (August 2005)

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

What are your common observation on test


questions?
• Hindi kasama sa lessons.
• Masyadong mahaba ang question at
mga pagpipilian.
• Hindi maayos ang layout ng test, putolputol
ang mga sentence.
• Nakakalito ang mga tanong. Minsan wala sa
pagpipiliaan ang sagot.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Possible Reasons for Faulty Test Questions:


• Questions are copied verbatim from the
book or other resources.
• Not consulting the course outline.
• Much consideration is given to reduce
printing cost.
• No Table of Specifications (TOS)
• TOS was made after making the test.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

General Steps in Test Construction

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

What is Table of Specifications?


A Table of Specifications or (TOS) is a
test map that guides the teacher in
constructing a test.

• TOS is a blueprint for the preparation


of an exam.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

What is Table of Specifications?


It is a table that maps out
1. the contents, or topics covered by the test,
2. test objectives,
3. the levels of cognitive behavior to be
measured;
4. the distribution of test items,
5. number placement and
6. weights of test items and
7. the test format.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

What is Table of Specifications?


• It helps ensure that the intended learning
outcomes, assessments and instructions are
aligned.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Importance of TOS
1. Ensures that the instructional objectives
and what the test captures match.
2. Ensures that the test developer will not
overlook details that are considered
essential to a good test
3. Makes developing a test easier and more
efficient

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Importance of TOS
4. Ensures that the test will sample all
important content areas and processes
5. TOS Is useful in planning and organizing
6. Offers an opportunity for teachers and
students to clarify achievement
expectations

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Components of Table of Specifications


1. A Table of Specifications consists of a three-
way chart or grid relating instructional
objectives to the instructional content.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Components of Table of Specifications


2. A Table of Specifications identifies not only the
content areas covered in class,
But it identifies the performance objectives at each
level of the cognitive domain of Bloom's Taxonomy.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Components of Table of Specifications


Teachers can be
assured that they are
measuring students'
learning across a wide
range of content and
readings as well as
cognitive processes
requiring higher
order thinking.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Components of Table of Specifications


3. A Table of Specifications is developed before
the test is written.
• In fact, it should be constructed before the
actual teaching begins.
4. The purpose of a Table of Specifications is to
identify the achievement domains being
measured and to ensure that a fair and
representative sample of questions appear on
the test.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Steps in Developing a Table of Specifications

1. Determine the coverage of the test.


• Only topics or contents that have
been discussed in class should be
included in the test.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Steps in Developing a Table of Specifications


2. Determine the objectives of the test.
• There are 3 types of objectives: cognitive,
affective and psychomotor.
• When planning for assessment, choose only
the objectives that can be best captured by
a written test.
• For a written test, you can consider cognitive
objectives that could be measured using
common formats for testing.
ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Steps in Developing a Table of Specifications

3. Specify the number of days/hours


spent for teaching a particular
topic

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Steps in Developing a Table of Specifications


4. Calculate the weight for each topic.
• The weight assigned per topic in the test is
based on the time spent to cover each
topic during instruction.

% for a topic = The total number of hours/days spent teaching the topic
x 100
Total Number Of Days/ Hours

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Steps in Developing a Table of Specifications


5. Determine the number of items for the
whole test.
• As a general rule, students are given 30-60
seconds for each item in test formats with
choices.
• For a one- hour class, this means that the test
should not exceed 60 items.
• However, you need also to give time for test paper
distribution and giving instructions, the number
of items should be less, maybe just 50 items.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Steps in Developing a Table of Specifications


Determine the number of the items for each
topic.
This can be done by multiplying the percentage
allocation for each topic by the total number of
items to be constructed.

50 items x 0.20 = 10 items

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Steps in Developing a Table of Specifications


6. Distribute the numbers to the objectives.
• The number of items
allocated for each
objective depends on
the degree of
importance attached
by the teacher to it.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Formats of TOS
1. One-way TOS.
• A one-way TOS maps out the content or topic
test objectives, number of hours spent, format
number and placement of items.

• A one-way TOS cannot ensure that all levels of


cognitive behaviors that should have been
developed by the course are covered in the test.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Formats of TOS
1. One-way TOS.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Formats of TOS
2. Two-Way TOS.
• A two-way TOS reflects not only the content,
time spent, and the number of items but also
the levels of cognitive behavior targeted
per test content.
• One advantage of this format is that it allows
one to see the levels of cognitive skills and
dimensions of knowledge that are
emphasized by the test.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Formats of TOS
2. Two-Way TOS.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Formats of TOS
3. Three-Way TOS.
This type of TOS reflects the features of one- way and
two-way TOS.
One advantage of this format is that it challenges the
test writer to classify objectives based on the theory
behind the assessment (knowledge dimension).
It also shows the variability of thinking skills targeted by
the test.
However, it takes a much longer to develop this type of
TOS.

ASSESSMENT IN LEARNING 1
Preparing Table of Specifications (TOS)

Formats of TOS
3. Three-Way TOS.

ASSESSMENT IN LEARNING 1

You might also like