Publié à l'aide de Google Docs Signaler un abus En savoir plus
Rubric Cheatsheet Mise à jour automatique effectuée toutes les 5 minutes
Rubric Cheatsheet
To write a great rubric, you should follow the step-by-step rubric composition process.
1. Read the user prompt.
2. Read the chatbot responses
3. Answer the “Criteria Development Questions”
4. Use the “Criteria Checklist” to write your criteria
5. Done!
Criteria Development Questions
● What did the user explicitly ask for?
● What does the response definitely need to be good but is not explicitly requested
by the user?
● What could make the response go above and beyond?
Criteria Checklist
Make sure that ALL of your criteria follow these guidelines.
● Identifies an element of a great response
● Targets a specific aspect
● Includes the exact answer (closed ended questions) or includes examples of
potential answers (open ended questions)
● Written as objective TRUE / FALSE statements
● Answer is accurate
Full Rules & Examples for Writing Criteria
Rule Description Examples
Rubric criteria should specify Good Criteria ✅: The response
Identifies elements of a great should state that 300 Mbps is
response. Put simply, your sufficient bandwidth to support 2
elements of a criteria should be TRUE zoom meetings simultaneously
great response when the response is great.
Bad Criteria ❌: The response
doesn't say if 300 Mbps is enough
Rubric criteria should target Good Criteria ✅: The response
one specific aspect of the should state that 300 Mbps is
Targets a great response per criteria. sufficient bandwidth to support 2
specific aspect Avoid combining multiple zoom meetings simultaneously
elements of a great response
into a single criteria Bad Criteria ❌: The response
should state that zoom meetings
typically require no more than 5
Mbps so 300 Mbps should be
sufficent bandwidth to support 2
zoom meetings simultaneously
Rubric criteria must state the Example Closed-ended Question
specific answer that the Criteria:
Includes the prompt should contain. The
answer way you do this depends on Good Criteria ✅: The response
whether the prompt asks a should state that 300 Mbps is
closed-ended question or sufficient bandwidth to support 2
an open-ended question. zoom meetings simultaneously
Closed-ended questions Bad Criteria ❌: The response
are questions where there is should determine if 300 Mbps is
an exact correct answer. enough bandwidth or not to support
Criteria for these questions 2 zoom meetings simultaneously
should contain the exact
answer that the response
should contain.
Example Open-ended Question
Open-ended questions are Criteria:
questions where there could
be multiple correct answers. Good Criteria ✅: The response
Criteria for these questions should consider that there may still
should contain a few be zoom performance issues if
possible examples of what a other activities are consuming high
response could contain. For bandwidth, including but not limited
these criteria avoid to: downloading large files, gaming,
specifying that the response multiple devices streaming video
needs to contain an exact
answer by using language Bad Criteria ❌: The response
like, "such as..." or "including should consider other things that
but not limited to..." could cause zoom performance
issues.
Rubric criteria should be an Good Criteria ✅: The response
objective statement that can should state that 300 Mbps is
Objective TRUE / be determined TRUE or sufficient bandwidth to support 2
FALSE FALSE based on the zoom meetings simultaneously
response. Avoid using
statements criteria that are subjective or Bad Criteria ❌: The response
open to interpretation, where should provide a reasonable
there may be disagreement explanation why 300 Mbps would
about whether a statement is be sufficient to support 2 zoom
true or false. meetings simultaneously
Good Criteria ✅: The response
The answers you include in should state that 300 Mbps is
Answer is your criteria must be truthful sufficient bandwidth to support 2
accurate and accurate. You are zoom meetings simultaneously
required to do whatever
research is needed to fact- Bad Criteria ❌: The response
check the answers to ensure should state that 300 Mbps would
accuracy. not be enough bandwidth to
support 2 zoom meetings
simultaneously
Common Rubric Errors
This section outlines common rubric mistakes. Understanding and avoiding these errors is crucial.
Contributors who frequently make rubric mistakes may be removed from the project.
Error Description Examples
Closed-ended questions Bad Criteria ❌: The response
with specific correct should name the first president of
❌ Missing answers MUST include the the United States
answers for correct answer as part of Bad Criteria ❌: The response
the criteria. You are should solve for x in the provided
closed ended responsible for conducting equation, x + 3 = 5
questions thorough research to ensure Bad Criteria ❌: The response
the answers are truthful and should sort the animals in
accurate. alphabetical order
Good Criteria ✅: The response
should state that the first president
of the United States was George
Washington-
Good Criteria ✅: The response
should should state that based on
the equation x + 3 = 5 the solution
is x = 2
Good Criteria ✅: The response
should sort the names in
alphabetical order: Adam, Charlie,
Susan, Tory
Criteria should be written as Bad Criteria ❌: The response
clear, objective true/false should list possible uses for a
❌ Missing statements, making it easy paperclip.
examples for to determine whether the Bad Criteria ❌: The response
response meets the criteria. should describe ways to reduce
open ended Avoid phrasing criteria in a stress.
questions way that requires subjective Bad Criteria ❌: The response
judgment or makes it difficult should suggest ideas for a birthday
to assess if the criteria are party theme.
true or not. Good Criteria ✅: The response
should list possible uses for a
paperclip, such as holding papers
together, unlocking a small lock, or
crafting simple jewelry.
Good Criteria ✅: The response
should describe ways to reduce
stress, such as practicing
mindfulness, engaging in physical
exercise, or listening to calming
music.
Good Criteria ✅: The response
should suggest ideas for a birthday
party theme, such as a tropical
luau, a superhero adventure, or a
retro 80s party.
Criteria should be objective Bad Criteria ❌: The response
true/false statements such should describe the qualities of a
❌ Subjective that it is easy based on the good leader.
criteria response to say whether it Bad Criteria ❌: The response
is true or false. Avoid writing should explain why climate change
criteria in a way that is important.
requires subjective Bad Criteria ❌: The response
judgment or is difficult to say should summarize the main idea of
if its true or no the article.
Good Criteria ✅: The response
should state that a good leader is
defined by qualities such as
communication, empathy, and
decision-making skills.
Good Criteria ✅: The response
should state that climate change is
important because it impacts global
ecosystems, weather patterns, and
human livelihoods.
Good Criteria ✅: The response
should summarize the main idea of
the article as being about the
effects of urbanization on
biodiversity.
Criteria should focus on one Bad Criteria ❌: The response must
specific aspect of a great answer what was the strength of
❌ Combined response to help the model both sides at the onset of both
criteria clearly understand what it battles by mentioning: that at the
did right and wrong. Avoid First Battle of El Alamein, the Allies
combining multiple elements numbered 150,000 troops, 179
of a great response into a tanks, 1,000 plus artillery pieces,
single criterion. and 1,500 plus planes. The Axis
forces numbered 96,000 troops
(56,000 Italian, 40,000 German), 70
tanks, and around 500 planes. At
the Battle of Anzio, the Allies
numbered 36,000 troops, 2,300
vehicles, and 2,700 planes. The
Axis forces numbered 20,000
German troops, 4,600 Italian troops,
and 337 planes.
Good Criteria ✅: The response
must state the number of Allied
troops (150,000), tanks (179),
artillery pieces (1,000+), and planes
(1,500+) at the onset of the First
Battle of El Alamein.
Good Criteria ✅: The response
must state the number of Axis
troops (96,000, including 56,000
Italian and 40,000 German), tanks
(70), and planes (around 500) at the
onset of the First Battle of El
Alamein.
Good Criteria ✅: The response
must state the number of Allied
troops (36,000), vehicles (2,300),
and planes (2,700) at the onset of
the Battle of Anzio.
Good Criteria ✅: The response
must state the number of Axis
troops (20,000 German, 4,600
Italian) and planes (337) at the
onset of the Battle of Anzio.
Example Prompt❓: What are some
Criteria should be based on good restaurants in san fransciso
❌ Personal the specific requirements of for a first date?
preferences & the prompt, essential
information needed for a
overly strong response, and extra Bad Criteria ❌: The response
prescriptive details that elevate an okay should recommend a list of exactly
response to a great one. 3 total restaurants, such as Foreign
criteria Avoid including criteria Cinema, Bix, and Lolinda
based solely on personal Bad Criteria ❌: The recommended
preferences. restaurants should serve Italian
food
Bad Criteria ❌: The response
should recommend restaurants that
are under $50 per person because
I'm on a budget
Good Criteria ✅: The response
should recommend more than 1
restaurant, such as Foreign
Cinema, Bix, and Lolinda
Good Criteria ✅: The
recommendations should be
suitable for a first date, taking into
account factors like a romantic
ambiance and an environment that
creates a positive first impression.
Good Criteria ✅: The restaurants
must be located in San Francisco
Do not include criteria that Example Prompt❓: What are some
specify a certain writing good restaurants in san fransciso
❌ Non-essential style or formatting for a first date?
style / formatting preference unless
specifically requested in the
preferences prompt. Bad Criteria ❌: The restaurant
recommendations should be
formatted as a bulleted list
Bad Criteria ❌: The response
should be extremely concise
Bad Criteria ❌: The response
should be written in a good format
that is easy to read and conveys
information effectively
