The GSIP Toolkit are currently under development and is not final.
Feedback may be submitted at the bottom of each page.
Data Collection
The process and methods for documenting, gathering, and compiling operational and safety data
Introduction
Data collection identifies the processes and methods utilized by an organization to document, compile, and gather operational and safety data. In high-risk domains, such as aviation, it is important for an organization to have the infrastructure and resources to collect complex sets of data from multiple internal and external sources. organizations should strive to collect data that is of the highest quality and integrity to inform analyses that yield actionable results. This section identifies opportunities for domains to:
- Evolve organizational processes to support the on-going collection of robust operational and safety data,
- Better understand how collected data can be applied to achieve domain and organizational performance objectives, and
- Improve data collection consistency to support high quality analyses and products.
To ensure a common use and understanding of key terms, below are a set of definitions that pertain to Data Collection:
Key Terms |
---|
Data - Safety Data is any safety-related facts, reports, collected materials providing knowledge about a safety subject. |
Information - Safety Information is a result of the Safety Data being processed, organized, presented to make it useful to the organization. |
Hazard - Hazard is any biological, chemical, mechanical, or physical agent that is reasonably likely to cause harm or damage to humans or equipment with sufficient exposure or dose. |
Risk - Risk is defined as the probability that exposure to a hazard will lead to a negative consequence |
Safety Data & Information Sources
A variety of internal and external data sources may be referenced by an Organization to collect operational and safety data. For the purposes of GSIP, these data sources have been grouped into three areas of application: Public Safety Information, Safety Program Information, and Reportable Occurrence. While each of these areas provides information that is unique and valuable, an Organization must consider when each data source is appropriate. This is typically driven by the question, or need, that an Organization must address (e.g. identify the probable cause of an accident vs. identify global probable cause trends). During the data collection process, it is important that as data is collected, it is captured in a manner that is usable by others within an Organization. For example, digital flight data obtained through FOQA may need to be conditioned before a specialist conducts their analysis.
Public Safety Information
Related ICAO Terms – Accident / Incident Data Report (sharing) (Annex 13, Chapter 6)
Public Safety Information describes the collection and analysis of publically available information to improve a domain’s SDCPS capabilities. Additionally, domains may apply this information to identify lessons learned from historical occurrences to improve future operations. Public safety information is available from many sources such as ICAO, IATA, Boeing, Airbus, and Civil Aviation Authorities.
Public safety information can be utilized by an organization to support:
- Identifying lessons learned from another Organization or domain (e.g. risk mitigations)
- Supporting the development of a benefits case for technology or procedure improvements (e.g. SESAR)
- Remaining apprised of emerging analytical methods, techniques, and application opportunities
The RSAG-PA was established in 2008 and supports the implementation of the ICAO GASP. This link provides access to the first exclusive safety report for the Pan American Region. It is based on safety data provided by ICAO, Boeing, and IATA.
This listing of airport hotspots identifies locations on an airport movement area with a history of potential risk of collision or runway incursion, and where heightened attention by pilots and drivers is necessary.
The ASRS database is the world's largest repository of voluntary, confidential safety information provided by aviation's frontline personnel, including pilots, controllers, mechanics, flight attendants, and dispatchers.
Flight Safety Foundation has published seven bulletins devoted to different aviation safety themes: Airport Operations, Aviation Mechanics Bulletin, Cabin Crew Safety, Helicopter Safety, and Human Factors & Aviation Medicine.
ICAO annually publishes the GASP to outline global aviation safety improvement opportunities and goals. This strategic plan establishes global performance targets and promote aviation stakeholder coordination.
The International Air Transport Association (IATA) Safety Report provides the industry with critical information derived from the analysis of aviation accidents to understand safety risks and propose mitigation strategies.
Flight Safety Foundation maintains an interactive web-based tool that permits users to review and tailor aircraft accident data, such as frequency and trends.
The FAA and EUROCONTROL conducted a comparative analysis of ATM performance using a set of harmonized KPIs. This assessment identified opportunities for each Agency to optimize operational performance.
DGCA has published an Aviation Handbook on civil aviation statistics which illustrate civil aviation data and a brief analysis on Passenger and Freight traffic, Aircraft, Air Safety and Human resources.
BEA provides the results of investigations including analysis, conclusions, the determination of the causes and/or contributing factors and, where appropriate, the issuing of safety recommendations.
ICAO annually publishes a safety report to document global policy and standardization initiatives, the status of monitored KPIs, current safety analyses, and the status changes to address safety needs.
IATA published an annual report detailing accident analysis trends. This information aims to provide insight into cross-cutting risks and potential mitigations.
Providing up-to-date, complete and reliable authoritative information on airliner accidents and safety issues
Each monthly edition of AeroSafety World contains an On-Record section that provides both a table of information regarding recent accidents and incidents, and an awareness of problems that might be avoided in the future.
FAA report detailing the cause of general aviation maintenance related accidents between 1988 and 1997. This report documents the frequency of occurrence, and focuses on top causal factors.
Statistical Summary of Commercial Jet Airplane Accidents – Worldwide Operations | 1959 – 2014 provides analyses of commercial jet airplane accidents, causes, and related information and statistics.
The Australian Transport Safety Bureau maintains an interactive database that contains completed and active accident and incident investigation data.
The Australian Transport Safety Bureau publishes a wide range of materials relating to transport safety. This link provides information on all ATSB non-investigation report publications.
Airbus annually publishes a brochure that highlights the evolution of aviation safety through worldwide accident rates, frequencies, and trends.
The National Transportation Safety Board (USA) maintains an interactive website that summarizes the NTSB aviation accident database. This information is updated daily and contains historical information from 1962 to present.
The Air Accident Investigation Bureau - Singapore maintains a database of on-going and completed safety investigations. This link provides access to the investigation reports.
The FAA maintains an interactive database that contains completed and active accident and incident investigation data.
The AIRBUS “Safety first’ magazine provides in-depth discussion of major safety issues effecting commercial jet aviation.
The National Transportation Safety Board (NTSB) maintains a webpage containing NTSB accident reports, information on transportation safety studies, strategic planning documents, and other valuable safety / outreach information
The Dutch Safety Board publishes information about all serious incidents and accidents with aircraft that have been reported in the first quarter of 2016.
The Accident Investigation Board Norway maintains a database of completed investigations, their reports, and related safety recommendations.
The FAA has developed a lessons learned library that captures the major outputs from aviation accidents and incidents. This library provides access to accidents by common themes, threat categories, or by aircraft lifecycle phase.
The US Department of Transportation provided a summary of 2014 aviation traffic data. This data can inform systemic performance changes over time.
Safety Assurance
Related ICAO Terms - Self-disclosure Reporting Systems (Annex 6, Part I, Chapter 3)
Safety Assurance describes the on-going monitoring and assessment of a domain’s operational safety performance to identify emerging safety needs before they escalate into a reportable occurrence. Safety assurance information from can be collected from both internal and external data sources.
Safety assurance information is well suited to support:
- Validation of operational performance targets (e.g. number of maintenance induced delays)
- Operational integration issues (e.g. reoccurring hard landings at a specific airport via FOQA data)
- Identification of emerging human-system performance needs (e.g. procedure issues identified via LOSA)
CANSO developed 21 recommended key performance indicators for measuring ATM operational performance. These KPIs span all phases of flight and allow ANSPs to monitor specific parts of their system, and identify opportunities for improvement.
The International Air Transport Association (IATA) Safety Report provides the industry with critical information derived from the analysis of aviation accidents to understand safety risks and propose mitigation strategies.
This Flight Data Monitoring (FDM) article describes the monitoring of operational safety levels for aircraft operators. FDM means the proactive and non-punitive use of digital flight data from routine operations to improve aviation safety.
Australia has developed guidance materials for the development of flight data analysis programs by operators, and for CASA in the assessment of those programs.
Flight Operational Quality Assurance (FOQA) is a voluntary safety program that is designed to make commercial aviation safer by allowing commercial airlines and pilots to share de-identified aggregate information with the FAA
CASA provides information on establishing a Flight Data Analysis Program (FDAP) as part of an operator’s safety management system (SMS).
The Service Integrity Risk Analysis Process (SI-RAP) taxonomy provides a taxonomy of factors impacting service integrity events. This report details the methodology for developing the SI-RAP taxonomy.
This link provides an example of third party flight data analysis services that can provide operators with valuable insight into emerging trends and issues before an accident or incident occurs.
IATA FDX provides an example of third party flight data exchange service that provides stakeholders with an understanding of domain-specific and systemic safety needs.
STEADES provides an example of third party services that allows users to submit and securely retrieve information to inform the development of performance targets.
This Accident Prevention Program document contains information on data collection and analysis. Information is provided in Portuguese.
Employee Voluntary Reporting
Related ICAO Terms - Voluntary Incident Reporting System (Annex 13, Chapter 8)
Employee Voluntary Reporting includes the collection and analysis of safety data voluntarily submitted by employees through an internal reporting system. Employee reports can provide unique insights into the safety issues and events encountered in daily operations that would otherwise go unreported. Reports can be collected through internal company reporting systems or accessed from publicly available external reporting systems.
The unique, first-hand perspective provided by employee voluntary reporting systems can help an organization:
- Identify close-calls and near miss events to prioritize near-term safety needs
- Develop and share lessons learned and best practices for managing specific types of hazards and oacross an organization
- Substantiate and explain other data sources (e.g. pairing of voluntary reports with FOQA data)
- Target opportunities to improve organizational safety culture (e.g. gauge program participation)
Employee Voluntary Reporting Systems
Reportable Occurrences
Related ICAO Terms - Accident, Serious Incident, Mandatory Incident Reporting Systems (Annex 13, Chapter 8)
Reportable Occurrences include information on an operational event or hazard that meets the criteria defined by the State requiring documentation and/or investigation. This information is obtained primarily through internal data sources by investigators, analysts, or by being a participating Organization / party to an investigative process.
Reportable occurrence data is typically collected in response to:
- Aircraft accident (e.g. controlled flight into terrain)
- Serious Incident (e.g. runway incursion)
- Significant Air proximity Event
ICAO annually publishes a safety report to document global policy and standardization initiatives, the status of monitored KPIs, current safety analyses, and the status changes to address safety needs.
Immediately reportable matters are documented in the Transportation Safety Investigation (TSI) Regulations 2003. This information enables investigators to preserve evidence, and identify the factors that led to an occurrence.
In Singapore, mandatory occurrence reporting is guided by several Air Navigation Orders and guidance materials. These allow CAAS to employ a forward-looking approach to the identification of safety needs.
The Australian Transport Safety Bureau maintains an interactive database that contains completed and active accident and incident investigation data.
The National Transportation Safety Board (USA) maintains an interactive website that summarizes the NTSB aviation accident database. This information is updated daily and contains historical information from 1962 to present.
States have access to the ADREP system, which is operated and maintained by ICAO. This interactive database collects occurrence data (accident / incident), and provides users with the ability to exchange safety information.
The Air Accident Investigation Bureau - Singapore maintains a database of on-going and completed safety investigations. This link provides access to the investigation reports.
Mandatory occurrence reporting requirements in the USA are detailed within 14 CFR Part 121 and 49 CFR Part 830. Sample mandatory occurrence reporting requirements are: 121.565, 121.575, 121.703, 830.5
The Accident Investigation Board Norway maintains a database of completed investigations, their reports, and related safety recommendations.
Data Collection Levels
Many factors such as organizational capabilities and the significance of the safety event may impact the level of intensity an organization applies to data collection. The level of intensity matrix provided below has been developed to assist organizations in the identification the appropriate level of intensity for managing and improving their operational safety. Additionally, the levels of intensity allow an organization to identify opportunities to enhance data collection quality and integrity to support thorough and accurate analyses and products.
ICAO Compliant | Advanced Measures | Industry Leading | Industry Driving |
---|---|---|---|
Data is collected to understand the most relevant events to an organization’s operations while practicing SMS principles on necessary risk mitigations. | Data is collected to understand the most relevant events and all the primary causes underlying those events. | Data is collected to understand the most relevant events and both primary causes and contributing causes. | Data is collected to understand the world’s investigative results and the pathways from initial breakdowns through the undesired states and all linkages between primary causes and contributing factors. |
Resources and Examples
A collection of resources related to aviation data collection and best practices are provided below. Click any example for more information.
The RSAG-PA was established in 2008 and supports the implementation of the ICAO GASP. This link provides access to the first exclusive safety report for the Pan American Region. It is based on safety data provided by ICAO, Boeing, and IATA.
This listing of airport hotspots identifies locations on an airport movement area with a history of potential risk of collision or runway incursion, and where heightened attention by pilots and drivers is necessary.
The ASRS database is the world's largest repository of voluntary, confidential safety information provided by aviation's frontline personnel, including pilots, controllers, mechanics, flight attendants, and dispatchers.
Flight Safety Foundation has published seven bulletins devoted to different aviation safety themes: Airport Operations, Aviation Mechanics Bulletin, Cabin Crew Safety, Helicopter Safety, and Human Factors & Aviation Medicine.
CANSO developed 21 recommended key performance indicators for measuring ATM operational performance. These KPIs span all phases of flight and allow ANSPs to monitor specific parts of their system, and identify opportunities for improvement.
ICAO annually publishes the GASP to outline global aviation safety improvement opportunities and goals. This strategic plan establishes global performance targets and promote aviation stakeholder coordination.
The International Air Transport Association (IATA) Safety Report provides the industry with critical information derived from the analysis of aviation accidents to understand safety risks and propose mitigation strategies.
Flight Safety Foundation maintains an interactive web-based tool that permits users to review and tailor aircraft accident data, such as frequency and trends.
The FAA and EUROCONTROL conducted a comparative analysis of ATM performance using a set of harmonized KPIs. This assessment identified opportunities for each Agency to optimize operational performance.
This Flight Data Monitoring (FDM) article describes the monitoring of operational safety levels for aircraft operators. FDM means the proactive and non-punitive use of digital flight data from routine operations to improve aviation safety.
DGCA has published an Aviation Handbook on civil aviation statistics which illustrate civil aviation data and a brief analysis on Passenger and Freight traffic, Aircraft, Air Safety and Human resources.
Australia has developed guidance materials for the development of flight data analysis programs by operators, and for CASA in the assessment of those programs.
BEA provides the results of investigations including analysis, conclusions, the determination of the causes and/or contributing factors and, where appropriate, the issuing of safety recommendations.
ICAO annually publishes a safety report to document global policy and standardization initiatives, the status of monitored KPIs, current safety analyses, and the status changes to address safety needs.
IATA published an annual report detailing accident analysis trends. This information aims to provide insight into cross-cutting risks and potential mitigations.
Providing up-to-date, complete and reliable authoritative information on airliner accidents and safety issues
Each monthly edition of AeroSafety World contains an On-Record section that provides both a table of information regarding recent accidents and incidents, and an awareness of problems that might be avoided in the future.
Immediately reportable matters are documented in the Transportation Safety Investigation (TSI) Regulations 2003. This information enables investigators to preserve evidence, and identify the factors that led to an occurrence.
FAA report detailing the cause of general aviation maintenance related accidents between 1988 and 1997. This report documents the frequency of occurrence, and focuses on top causal factors.
The FAA developed this maintenance Aviation Safety Action Plan (ASAP) guide ro provide a simple, practical source of information regarding the development and assessment of ASAP programs for the aviation maintenance community.
Flight Operational Quality Assurance (FOQA) is a voluntary safety program that is designed to make commercial aviation safer by allowing commercial airlines and pilots to share de-identified aggregate information with the FAA
The FAA has developed regulatory and guidance materials to encourage anonymous and consistent, non-punitive safety reporting by flight operations employees.
CASA provides information on establishing a Flight Data Analysis Program (FDAP) as part of an operator’s safety management system (SMS).
In Singapore, mandatory occurrence reporting is guided by several Air Navigation Orders and guidance materials. These allow CAAS to employ a forward-looking approach to the identification of safety needs.
Statistical Summary of Commercial Jet Airplane Accidents – Worldwide Operations | 1959 – 2014 provides analyses of commercial jet airplane accidents, causes, and related information and statistics.
The principles of aviation safety management laid down in the SSP serve as a basis for the development of safety management systems (SMS).
The Service Integrity Risk Analysis Process (SI-RAP) taxonomy provides a taxonomy of factors impacting service integrity events. This report details the methodology for developing the SI-RAP taxonomy.
The ATSB has developed materials to educate and increase participation in voluntary safety reporting programs. These resources including frequently asked questions, de-identified safety reports, and general program requirements.
The Australian Transport Safety Bureau maintains an interactive database that contains completed and active accident and incident investigation data.
The Australian Transport Safety Bureau publishes a wide range of materials relating to transport safety. This link provides information on all ATSB non-investigation report publications.
Feedback Requested
The Flight Safety Foundation requests your feedback will help us achieve one of the core objectives of GSIP – improve the sharing and harmonization of information. All aviation safety stakeholders are invited to submit toolkit feedback via either the link below or by adding a comment to this page. All feedback will be reviewed by the GSIP team to improve the overall quality of the product.