Publication Detail
Final Evaluation Plan TransCal – IVHS Operational Test
|
UCD-ITS-RR-95-07 Research Report |
Suggested Citation:
Jovanis, Paul P. and Aram G. Stein (1995) Final Evaluation Plan TransCal – IVHS Operational Test. Institute of Transportation Studies, University of California, Davis, Research Report UCD-ITS-RR-95-07
This document, the Evaluation Plan for TransCal, is intended to be the final product of the evaluation definition phase. In addition, appendices contain the evaluation team's current evaluation test plans for IRTIS. While conceived as part of the evaluation design in the FHWA guidelines, the UC Davis team believed it important to convey as much detailed information as possible regarding IRTIS, the first TransCal subsystem to become operational. Therefore, early drafts of the evaluation test plans for IRTIS are included for review and comments.
The close interrelationship of the TransCal implementation schedule (the responsibility of TRW) and the evaluation schedule (the responsibility of UC Davis). As the system design and implementations evolve, first for IRTIS and subsequently for ENS and TFPP, more information will become available to the evaluation team that can be used for evaluation test plan developments. For example, as the user population for the PDA's and in-vehicle navigation units are identified, detailed test plans can evolve and be tailored to each sub-population, consistent with the overall plan. This is particularly important where user populations may seek IRTIS information in different contexts, e.g. commuters, recreational travelers, sales personnel, and truckers.
EVALUATION GOALS
The goals of the evaluation are to thoroughly evaluate the implementation of the TransCal system.
Based upon a review of existing TransCal documents, the IVHS evaluation guidelines, Caltrans requirement of a feasibility Study Report (FSR) for TransCal, and UC Davis' experience with other NHS evaluation plans, the following 5 evaluation goals are proposed for TransCal:
The close interrelationship of the TransCal implementation schedule (the responsibility of TRW) and the evaluation schedule (the responsibility of UC Davis). As the system design and implementations evolve, first for IRTIS and subsequently for ENS and TFPP, more information will become available to the evaluation team that can be used for evaluation test plan developments. For example, as the user population for the PDA's and in-vehicle navigation units are identified, detailed test plans can evolve and be tailored to each sub-population, consistent with the overall plan. This is particularly important where user populations may seek IRTIS information in different contexts, e.g. commuters, recreational travelers, sales personnel, and truckers.
EVALUATION GOALS
The goals of the evaluation are to thoroughly evaluate the implementation of the TransCal system.
Based upon a review of existing TransCal documents, the IVHS evaluation guidelines, Caltrans requirement of a feasibility Study Report (FSR) for TransCal, and UC Davis' experience with other NHS evaluation plans, the following 5 evaluation goals are proposed for TransCal:
- An assessment of user acceptance of the technology, specifically recognizing different potential user groups. It is of particular importance that we seek to identify any system attributes that may lead to a particular group of individuals to be non-users. Information providers and other private sector entities acceptance of, and willingness to participate in, the system are additional important evaluation measures.
- To thoroughly identify and assess system benefits and costs. Benefits will include time savings, energy and emission reductions, safety improvements and fmancial and other benefits accruing to public and private sectors. Costs will include capital and operating costs as well as congestion, emissions and other social costs.
- A demonstration of the technological feasibility of the system by constructing and testing it over the life of the project. Thoroughly evaluate the separate and integrated operation of hardware, software and management structure. For example, if a cellular call comes in concerning road closure in the Sierra, how long does it take to verify the condition and have it available through IRTIS?
- To study changes in the demand for travel and the travel patterns of individuals participating in the project, within the limitations of technologies demonstrated in TransCal. To assess impacts of the TransCal operational test on transportation, and to forecast impacts for full deployment.
- To assess the institutional arrangements developed during the operational test and to test and to describe the institutional arrangements necessary for the successful operation of TransCal on a sustained basis.