Thursday, October 11, 2007

The Legal Defensibility of Assessments:
What You Need to Know

Defensibility is a key issue for organizations involved in medium and high-stakes testing (for example, awarding bodies, organizations/associations that grant certifications, etc.). The paper outlines and examines some of the key issues relating to assessment defensibility and outlines relevant standards and best practices. Moreover, the paper discusses the role Questionmark Perception can play in ensuring the defensibility of assessments programs.

The PDF can be found in the Questionmark Communities. Registration is free. Check your junk / spam mail for your community password.
http://www.questionmark.com/us/whitepapers/index.aspx


Table of Contents


EXECUTIVE SUMMARY
1. WHAT IS LEGAL DEFINSIBILITY?
2. GUIDELINES, STANDARDS, AND BEST PRACTICE RESOURCES
2.1. STANDARDS FOR EDUCATIONAL AND PSYCHOLOGICAL TESTING (1999)
2.2. CONFORMITY ASSESSMENT - GENERAL REQUIREMENTS FOR BODIES OPERATING CERTIFICATION OF PERSONS 17024 (2003)
2.3. GUIDELINES FOR COMPUTER-BASED TESTING (2000)
2.4. OTHER GUIDELINES AND RESOURCES
3. SOME AREAS OF LEGAL CHALLENGE
3.1. RELIABILITY
3.2. VALIDITY
3.2.1. Criterion-related validity
3.2.2. Content-related validity
3.2.3. Construct-related validity
3.3. FAIRNESS (AND BIAS)
3.4. CUT SCORES
3.5. OTHER ISSUES
4. QUESTIONMARK PRODUCTS AND LEGAL DEFENSIBILITY
4.1. AUTHORING
4.2. SCHEDULING
4.3. DELIVERY
4.4. REPORTING
4.4.1. Coaching Report
4.4.2. Item Analysis Report and Question Statistics Report
4.4.3. Assessment Overview Report
4.4.4. Survey Report
4.4.5. Score List Report
4.4.6. Transcript Report
4.4.7. Grade Book Report
4.4.8. Gap Report
4.4.9. Test Analysis Report
4.4.10. Export to ASCII and Export to Excel
4.4.11. Using Filtering in Questionmark Reports

No comments:

Check This Out!

More Links to Good Information