Appendix 1: Project Definition

• 1. Introduction
• 2. Aim
• 3. Project Organisation
  • 3.1 TIS Committee
  • 3.2 Review Team
• 4. Scope of the Review
  • 4.1 Elements of Review
  • 4.2 Process of Review
  • 4.3 Review Report
  • 4.4 Timeframe
• Appendix: Roles and Person Specifications of Review Team Members
  • (1) Project Manager
  • (2) Statistician
  • (3) Methodologist
  • (4) Review Support

Tourism Information System Committee
Tourism Research Council New Zealand
January 2002

1. Introduction

The Tourism Research Council New Zealand (TRCNZ) mandated the Tourism Information System Committee (TIS) to undertake a review of the six sets of tourism statistics under its ambit (IVA, IVS, CAM, DTS, TSA and forecasts). This review is initiated by the key sponsoring body for the datasets, Office of Tourism and Sport (OTSp), on behalf of the TRCNZ. This project definition outlines the aim, approach and scope of the review.

The review is to be independent and transparent to ensure its objectivity and credibility. It will be undertaken by a qualified project team consented after discussion with producers and independent peer reviewers. It is intended that the review will lead to improvement and greater public confidence in the tourism datasets endorsed by TRCNZ.

2. Aim

The aim is to review the six sets of core tourism statistics in order to assist the TRCNZ in its task of enhancing the overall quality and value of the core tourism datasets.

The review will examine a range of data issues and will pay special attention on technical fitness for use, conceptual consistency between surveys and relevance of statistics, and make recommendations for improvement.

3. Project Organisation

The review will have a two-tiered project management structure:

3.1 TIS Committee

Membership - comprises five members representing the datasets sponsor and key stakeholders. One member assumes the Chairperson responsibility.

• John Moriarty, Tourism Industry Association NZ (Chief Executive)
• Christine Fitzgerald, Tourism New Zealand (Manager, Marketing Research)
• Ian Ewing, Statistics NZ (Deputy Government Statistician)
• Brian Westwood, Hurunui District (Manager, Hurunui Tourism Board)
• Mike Noon, Ministry of Tourism (Acting General Manager)

Role - to act as a Steering Group providing direction and oversee the review, agree on project brief, establish the Review Team, ensure key issues are addressed, review is managed properly, resources and finance are available, assess recommendations and set priorities for implementation. The chairperson is to report review results to TRCNZ.

3.2 Review Team

Membership - The construct of the Review Team is yet to be agreed by the TIS Committee. It is envisaged that it may comprise four members: a project manager, survey statistician, methodologist and a researcher. This team will be competent in output and technical knowledge of the relevant data and surveys.

Role - to carry out the review of six sets of tourism statistics, prepare review report and recommendations, and convey final results to the chairperson of the TIS Committee. A reviewer does not have to cover all aspects of data review and may focus on a specialist area (e.g. methodology). Other aspects, e.g. user consultation, may be undertaken by the researcher. Person specifications and roles for individual review team members are described in the Appendix.

4. Scope of the Review

4.1 Elements of Review

The review should consider the various attributes of data quality:

• methodology (methods, questionnaires and sample design)
• data relevance (coverage and topics)
• utility (extent of use and value of data)
• accuracy (fitness for purpose)
• consistency in concepts and classifications between surveys
• timeliness
• accessibility and dissemination adequacy

Consultation is an important part of the review process. The reviewers should exercise due diligence and consult producers, key stakeholders and users of data by appropriate means (e.g. questionnaire, seminar, interview, correspondence or discussion).

The review team should determine the extent of review in each core dataset. Some data, such as TSA and forecasts, which have been subject to recent reviews of methodology may not require full technical review. This will depend on the merit of recent reviews. Priorities should be placed on issues of key concern that have been identified and seek solutions for recommendation.

The review will not generally cover the operational aspects of the producers such as method of processing, processing system efficiency and cost effectiveness.

4.2 Process of Review

The review will be conducted in an objective and transparent manner to provide constructive feedback that will benefit all parties involved. The review team will seek the co-operation of producers to enable them to discuss with appropriate staff and access relevant information for the purposes of the reviews. The project stages are:

Review Team to carry out review on all core datasets and prepare review reports.

• An expert to peer review the review reports.
• Producers of data to respond to review reports.
• Review Team to comment on producer responses.
• Project Manager of Review Team to report results and recommendations to the TIS Committee.

4.3 Review Report

The process will lead to a comprehensive review report to serve as a public document and the basis for TRCNZ advice on data purchase and improvement. It will describe the work completed and should include the review objective, scope, approach, current state of data and methodology, user requirements and quality issues in each core dataset, areas of deficiency, and a list of recommendations for improvement.

4.4 Timeframe

The review team is to be set up in December 2001 and the review tasks are to be undertaken in early 2002. The final review report is to be submitted by 31 May 2002 to the TIS Committee, which will report to TRCNZ's 8th meeting in June 2002.

However, two datasets, IVS and DTS, will need to be given priority because of the need to complete their review by the end of 1st quarter in 2002 in order to enable TRCNZ to advise on their purchase before the current IVS contract expires in mid 2002. Interim reports for the two datasets will be required to inform the TRCNZ.

Appendix: Roles and Person Specifications of Review Team Members

The review team may comprise four team members. Their roles and essential attributes required are outlined below.

(1) Project Manager

Role - To manage the Review Team, prepare action plan, delegate tasks, ensure key issues are addressed, ensure review on schedule, report monthly progress, report results and recommendation to TIS Committee.

Person Specification - A person with extensive technical knowledge and experience in statistical surveys, preferable with a good knowledge in tourism statistics, and has previous experience in major reviews and project management.

(2) Statistician

Role - To review the allocated statistical datasets according to the required elements of review. Identifies areas where improvement can be made and recommends sound practical solutions. Documents review work and prepares concise review report.

Person Specification - A person with extensive technical knowledge and experience in relevant statistical surveys, and is competent in evaluation work, preferably with proven experience in review of statistical system.

(3) Methodologist

Role - To review the methods used in producing statistics and forecasts, check for robustness within each of the core datasets and consistency with related datasets. Identifies areas where improvement can be made and recommends sound practical solutions. Documents review work and prepares concise review report.

Person Specification - A person with extensive knowledge and experience in statistical and forecasting methods, and is competent in evaluation work, preferably with proven experience in review of mathematical and statistical methodologies.

(4) Review Support

Role - To facilitate the activities of the Review Team. To consult broadly among the users and review the data needs of users in all the six core datasets, identify to what extent this need is met, what are the unmet needs and what concerns in the datasets. Documents review work and prepares review report and recommendations.

Person Specification - A person with research and investigative skills, a good knowledge of the six core datasets, and experience in review, investigation and user consultation work.