RESEARCH/PROGRAM EVALUATION MANAGER

Job Responsibilities

This position is responsible for determining the adequacy and appropriateness of highway safety projects submitted by state and local governmental agencies. This evaluation is a necessary and integral part of management of the department’s Highway Safety Program (HSP) and is in support of the Illinois Strategic Highway Safety Plan (SHSP).

Value of HSP:                                           $30 million annually
Special projects and reports evaluated:   6 - 8 annually
State agency projects evaluated:             5 - 6 annually
Local agency projects evaluated:             40 - 50 annually
Evaluations developed:                            15 - 20 annually

This position reports to the Evaluation Manager. There are no subordinates reporting to this position.

This position serves as an integral part of the Evaluation Section by providing knowledge and developing thorough evaluations of various traffic safety projects. The incumbent is responsible for evaluating various safety projects and programs throughout the state using descriptive and multivariate statistics. This position works extensively with Microsoft Office 365, particularly Microsoft Access. The incumbent’s primary role is to design and conduct individual project evaluations. This will lead to new program directions to increase the success and overall HSP and Illinois SHSP effectiveness. The types of safety measures employed cover a wide spectrum of activities and require the use of various statistical and mathematical techniques such as multiple regression, time series analysis, cohort analysis which evaluates overall project and program effectiveness. The incumbent is involved in all aspects of planning and evaluations from the initial review of project proposals to the final evaluation of project success. This position schedules individual project evaluations, conducts evaluations, designs, and performs pilot studies for more complex evaluations, and conducts lengthy or extensive evaluations of projects to monitor progress and gauge short and long-term consequences. The incumbent designs and organizes special surveys such as observational surveys of safety belt and child restraint use using probability sampling techniques. These techniques are used to gather data regarding drivers, passengers, and vehicles needed for the evaluation of specific projects. The conclusions and recommendations resulting from the project reviews and program evaluations contribute directly to major management decisions in the allocation of available safety funds. The incumbent undertakes literature searches and is responsible for the organization and maintenance of a collection of traffic safety studies.

Job Responsibilities (continued)

The principal challenges to this position are to solve the technical problems associated with the lack of reliable information, apply methods which accommodate the evaluation plan, formulate supported conclusions based on the data available and methods used, and ensure evaluation findings are clearly expressed and properly documented. The incumbent will face problems in dealing with various public, private agencies and elected or appointed local officials. These officials may view the evaluation as a technique to abolish projects and programs. Tact and diplomacy are often required to dispel these attitudes.

The incumbent is responsible for the accuracy and technical validity of all evaluation tasks and personally participates in each. The incumbent will utilize considerable technical writing and editing skills to accomplish the duties of this position. This position writes and edits all reports. Occasionally, the incumbent is assigned an evaluation to be accomplished solely by the incumbent. This position is also responsible for the completion of literature searches to support the process of evaluation. The incumbent is responsible for the organization and maintenance of a compendium of selected traffic safety publications and other reference materials.

The incumbent is constrained by the established policies of the department, Office of Highways Project Implementation, Bureau of Safety Programs and Engineering, and specific instructions of supervisors. The incumbent has the freedom to exercise wide latitude for independent thought and to initiate contacts in the academic and research community. S/he will recommend the use of consultant services to support evaluation projects when necessary and participate in the selection of such consultants.

The position requires the incumbent to develop and maintain working and professional contacts within the department and with federal and other state agencies. Externally, the incumbent has close contact with the academic and research institutions within the state. The incumbent also has contact with certain safety oriented and consulting organizations in the private sector. This position requires occasional travel which may include overnight stay. Successful completion of a background check is required.

The effectiveness of this position can be measured by the usability of previous studies, thoroughness of literature searches performed, accuracy and validity of project evaluations as well as their effect on overall program assessment and improvement of highway safety efforts at all levels.

Principal Accountabilities

1. Manages complex evaluation, survey projects and literature searches which support the process of evaluation.
2. Establishes clear and precise measurement criteria for project and program evaluation.
3. Develops innovative evaluation procedures and techniques which incorporate problem identifications, literature search, analysis, written reports, and presentation of findings to upper-level management.
4. Assures that projects proposals contain clearly stated objectives with criteria for evaluation identified in terms of specific output measures.
5. Prepares interim and final reports of evaluation to recommend continuation, cancellation, or expansion of specific traffic safety efforts.
6. Organizes and maintains a collection of traffic safety reports and studies.
7. Provides technical and statistical consulting services on highway safety related matters to organizational components of the department. These services will help to ensure development of proper evaluation methods and techniques.
8. Performs duties in compliance with departmental safety rules. Performs all duties in a manner conducive to the fair and equitable treatment of all employees.
9. Performs other duties as assigned.

Qualifications

Position Requirements

• Education/Experience:
  • Completion of a bachelor's degree majoring in math, statistics, computer science, or social science PLUS two years of experience with conducting quantitative research, and developing evaluations for programs and/or projects OR
  • Eight years of experience with conducting quantitative research, and developing evaluations for programs and/or projects
• Valid driver’s license.
• Occasional statewide travel which may include overnight stay.
• Successful completion of a background check.

Position Desirables

• Working knowledge of research methods, management techniques, and modern organizational concepts.
• Extensive knowledge of computer software packages such as SAS.
• Extensive knowledge of Microsoft Office 365, particularly Microsoft Access.
• Strong oral and written communication skills.
• Proven ability to make presentations to large groups.
• Ability to plan and execute program objectives.