Research Shows that CritiCall is a Strong Predictor of Emergency Dispatcher/Calltaker Job Success

A criterion validation study with the Florida Highway State Patrol shows a very strong relationship between scores on the CritiCall Pre-employment tests and job performance in an emergency 911 dispatch environment. [view the press release]

CritiCall Criterion Validity Study with FHP

Biddle Consulting Group recently conducted a study that demonstrated CritiCall test scores are a strong predictor of job performance as determined through supervisor ratings of more than sixty State Highway Patrol Dispatchers/Calltakers. This validation study was conducted in accordance with the requirements of the federal government’s Uniform Guidelines on Employee Selection Procedures for criterion-related studies (see www.uniformguidelines.com).

The uncorrected correlation coefficient (also known as a validity coefficient) between overall test scores and job performance ratings was 0.41, and the correlation coefficient statistically-adjusted for the unreliability of the criteria was 0.44. The United States Department of Labor (DOL) classifies these levels of correlation as being very beneficial (which is its highest rating description described by the DOL for this type of relationship).

Furthermore, the reliability of the combination of test modules from the CritiCall test used during the analysis was also an extremely strong 0.92 (out of a possible 1.00), which the United States Department of Labor indicates can be interpreted as being excellent (again, the highest rating-level described by the DOL).

Downloads:

A statistical-expectancy analysis determined that if the assumption is made that 60% of test takers would succeed on the job as dispatchers/calltakers if no testing was performed, using CritiCall overall test scores would increase the prediction of success from 37% for those test takers who scored the lowest on the test to 75% for those who scored highest on the CritiCall test. Based on these studies it was determined that overall scores from CritiCall Pre-Employment Testing Software are very likely to strongly predict job performance of job candidates.

About the CritiCall Dispatcher/Calltaker Software:

The CritiCall Pre-Employment Dispatcher Testing Software includes a series of work-sample tests designed to measure a dispatcher job applicant’s ability to successfully perform many of the work functions they would be required to perform on the job (measuring abilities required prior to their receiving any training or experience on the job) as an emergency dispatcher or emergency calltaker.

The CritiCall dispatcher skills tests include, but are not limited to, the following:

  • Multi-Tasking
  • Decision Making
  • Map Reading
  • Spelling
  • Reading Comprehension
  • Prioritization
  • Proofreading

For more information about the CritiCall Dispatcher Skills Testing Software, visit http://www.CritiCall911.com.

 

Product Feature: Prophecy Pre-Employment Nurse Testing

BCG is a long time provider of pre-employment testing software solutions. Our products include assessments for office skills (OPAC, Encounter), soft skills (Encounter), for use in the business classroom (OPAC), emergency dispatchers (CritiCall), call center call-takers (C4) and healthcare (Prophecy).

Prophecy, the most recent of those listed above, is a holistic pre-employment nursing assessment tool. It tests healthcare applicants in three areas: clinical, behavioral and situational. Biddle developed the situational arm and conducted a criterion-related validity study with results showing Prophecy to be an effective pre-employment nursing assessment tool.

The Clinical Assessments by Prophecy are specialty specific, and help to identify professionals with sufficient job knowledge to perform successfully by targeting the most important aspects of each clinical specialty.

The Behavioral Assessments by Prophecy measure four dimensions of the clinician’s behaviors; cognitive abilities, personality, attitude, and engagement. The results allow you to prevent personality conflicts and counter-productive behaviors before they start.

The Situational Assessments by Prophecy are a series of video vignettes, depicting situations the nurse is likely to encounter day one on the job. The clinician is asked to choose the most effective and least effective ways to handle the situations. This assessment focuses on the “soft skills” of the clinician including critical thinking, prioritization, handling conflict and change, and developing patient relationships.

Learn more about Prophecy and Biddle’s involvement:

http://situationaltesting.com/prophecy/

“Prophecy HealthCare’s leadership team really sets the company apart with their unique approach to addressing the hiring needs of the healthcare industry. The idea to create a holistic assessment – a testing solution that provides information on multiple job performance areas  –  may change the pre-hire testing arena. I enjoy being part of such an innovative and creative team!”

David McParland

Weld County – CritiCall 911

Dispatcher Applicant Testing

Weld County - CritiCall 911 Client“We currently use CritiCall for the initial screening in our hiring process and are extremely pleased with the results and the software in general. I love it! The biggest reason is because it’s very hands on (computer based) so it not only tests applicants’ ability but also gives us a view of their comfort level using computers on their own and with no direction. The score reports are great because I can show the applicant — directly from the printout — what their scores are as compared to what is passing. It’s hard for anyone to argue with the results when they are right there in black and white.”

Annie LaFleur
Supervisor
Weld County Regional Communications, CO