TVAP - Test Validation & Analysis Program
Test Validation & Analysis Software
The Test Validation & Analysis Program (TVAP) includes two Excel Workbooks that are designed to be used by personnel professionals to aid in developing and validating written tests that address professional standards, the Uniform Guidelines on Employee Selection Procedures (1978), and relevant court cases. The Workbooks include macros, surveys, and formulas that address the standards applied in Contreras v. City of Los Angeles (656 F.2d 1267. 9th Cir. 1981) and U.S. v. South Carolina (434 US 1026, 1978). The Test Validation & Analysis Program includes:
- 50-page Instruction Manual including directions, references, and appendices (including a Manual for writing better test items and for conducting effective Angoff Panels).
- Test Item Survey that can be completed by subject-matter experts to gather validation evidence for written tests (14 questions are included that are designed to address testing standards, the Uniform Guidelines, and concepts derived from test litigation).
- Test Item Survey Workbook (Excel workbook with over 10 programmed sheets) that can be used to input data from the Test Item Survey, tabulate the results, and screen test items for addressing specified test validation criteria.
- Test Analysis Workbook which is used for inputting item Angoff ratings, setting a "critical score," conducting rater reliability and rater panel reliability analyses (and "outlier" raters), importing test score data, conducting item analysis (including point-biserial, item difficulty, and differential item functioning analyses to analyze test item bias), and test-level analyses (including Cronbach's Alpha, Kuder Richardson or KR-21 reliability, mean, standard deviation, classical standard error of measurement, and conditional standard error of measurement), setting a modified Angoff cutoff score using the procedure followed in the U.S. v. South Carolina case, and analyzing the cutoffs for adverse impact using the Fisher Exact (with mid-P correction) statistic and practical significance tests.
For More Test Validation Software Information
Click to download the TVAP 7.0 software [ .zip version ] or the TVAP 7.0 software [ .exe version ]. (You only need one or the other. Some internet firewalls will not allow you to download a .exe file.) This software may be installed and run in a restricted format for evaluation purposes. The software may be optionally licensed after evaluating.
Annual License, Primary Seat (first license) $995 per year
Additional Seats -- Private Employers $500 per year
Additional Seats -- Public/Non-profit Employers $250 per year
Online Test Validation and Analysis - TVAP Online
TVAP Online is a free* progam designed to be used by personnel professionals to aid in validating written tests that address the Uniform Guidelines on Employee Selection Procedures (1978) and relevant court cases. With TVAP Online, you will be able to determine the validity and cutoff scores of each individual item on your employment assessments.
TVAP Online is an online program that provides basic test validation and analyses. For more advanced analyses including item analysis, DIF analysis, and adverse impact analyses, you'll want to use the TVAP software mentioned at the top of this page or request a quote for Biddle Consulting Group's test development and test validation consulting services. The results from TVAP Online may be imported into the TVAP software for more advanced test analyses.
*TVAP Online was developed by Biddle Consulting Group as a free service to the HR EEO Community. Qualified organizations may use the TVAP Online program without cost. HR EEO Consultants who want to use TVAP Online in their business to provide a service to clients qualify for special pricing.
For more information about TVAP Online and to register for an online test validation account, visit www.onlinetestvalidation.com.
Call (800) 999-0438 ext. 180 or e-mail firstname.lastname@example.org