Professional Documents
Culture Documents
Session Topic:
A actually is A
Types of Validity
A correlates with B
Types of Validity
A predicts B
Valid Inferences
What assessments do
you already have that
purport to measure Review
this?
If necessary, consider
commercial
assessments or create Purchase Develop
a new assessment
Considerations
• Using what you have
– Is it carefully aligned to your purpose?
• Purchasing a new assessment
– Is it carefully matched to your purpose?
– Do you have the funds (for assessment, equipment, training)?
• Developing a new assessment
– Do you have the in-house content knowledge?
– Do you have the in-house assessment knowledge?
– Does your team have time for development?
– Does your team have the knowledge and time needed for
proper scoring?
Improving Validity & Reliability
• Ensure questions are based on taught curricula
• Ensure questions are based on standards
• Allow students to demonstrate knowledge/skills in
multiple ways
• Ensure a variety of item types (multiple-choice,
constructed response)
• Ask questions at varying Depth of Knowledge levels
• Ensure accurate test administration
• Include items that address the full range of standards
• Include multiple items that assess the same standard
• Review scorer reliability, when necessary
V&R : Student Learning Objectives
What makes high-quality evidence for SLOs:
The exam and composition will be part of the written final, administered
during the final exam period.
– I will score the compositions using the Foreign Language Department level 2
writing rubric, which includes vocabulary, tense, subject-verb agreement,
spelling, level of detail, etc.
– Approximately 20% of the compositions will also be double-scored by the
other French teacher.
I will administer and score most oral exams myself, though I will schedule
my Department Chair to sit in on and double-score the first 20%.
Questions?
Upcoming Webinars