VOLUME 15 FAA Safety Team POLICIES AND PROCEDURES
Chapter 3 DATA COLLECTION, ANALYSIS, AND REPORTING
Section 3 Data Analysis
15-3-3-1 GENERAL. The Federal Aviation Administration (FAA) Safety
Team (FAASTeam) Program Managers (FPM) and/or the Regional FAASTeam Point of
Contact (RFPOC) analyze data collected from the National Transportation Safety
Board (NTSB) database and a variety of Federal Aviation Administration (FAA)
databases, as well as analyzing data collected from active investigations conducted
within the Flight Standards District Office (FSDO).
A. Purpose. This section provides guidelines and procedures for
the FPM to analyze data collected. The FPM will evaluate the data to identify
trends and modify/develop mitigation strategies. This is necessary to educate
airmen about causal and contributing factors associated with current accident/incidents,
pilot deviations (PD), near midair collisions (NMAC), maintenance failure to
follow procedures, recurring deviations from regulations or other standards,
etc. in their FSDO district.
B. Scope. This task is applicable to RFPOCs, and FPMs. This should
be an ongoing process to identify and target high risk areas of noncompliance
with regulations or other standards in order to mitigate aircraft accidents/incidents.
15-3-3-3 TASK PREREQUISITES AND SIGNIFICANT INTERFACES.
NOTE: This task requires knowledge of FAA accident investigation procedures
and system safety principles, qualification as an aviation safety inspector
(ASI), and appointment as an FPM.
A. Program Tracking and Reporting Subsystem (PTRS) Activity Code.
1) Operations: 1901.
2) Maintenance: 3901.
3) Avionics: 5901.
B. Significant Interfaces. This task requires coordination with
the following organizations or individuals:
· FAA Aviation Data System Branch (AFS-620);
· FAA Investigator-in-Charge (IIC);
· National FAASTeam Branch (AFS-850);
· Flight Standards District Office (FSDO) Management Team;
· National Transportation Safety Board (NTSB); and
C. Automation Tools. Microsoft Excel.
1) Regulatory Guidance. [Reserved]
2) Procedural Guidance (current editions):
· FAA Order
Program Tracking and Reporting Subsystem.
· PTRS Procedures Manual (PPM).
· FAA Form 8000-36, Program Tracking and Reporting System Data Sheet.
· FAA Form 8020-9, Aircraft Accident/Incident Preliminary Notice.
· FAA Form 8020-15, Investigation of Near Midair Collision Report.
· FAA Form 8020-18, Pilot Deviation Report.
· FAA Form 8020-23, Accident/Incident Report.
F. Job Aids. [Reserved]
A. Data Analysis. Data analysis is the process of organizing
facts, using available methods, tools or techniques to:
1) Determine if additional facts are needed.
2) Ascertain if data is valid to accurately identify underlying
3) Reach valid conclusions.
B. Safety Analysis. Safety analysis is based on factual accident
information originating from FAA Form 8020-23 as well as other aviation data
accessible from a number of databases available to the FPM. FPMs should be careful
to select and apply analytical methods and tools suitable to the analysis.
15-3-3-7 DATA ANALYSIS PROCESS FLOW.
Figure 15-3-3A. Data Analysis Process Flowchart
A. Open PTRS Record (see flowchart process step 15-3-3-9A).
B. Record Data for Analysis (see flowchart process step 15-3-3-9B).
The FPM must record data collected from their sources in an organized manner
to afford effective analysis. This is best accomplished by creating and using
a Microsoft Excel Spreadsheet. The FPMs should refer to the National FAASTeam
Excel Guide/FSDO Aviation Activity Report Work Instruction.
C. Create Graphs and Charts from the Data (see flowchart process
step 15-3-3-9C). Whether participating in a live investigation or accessing
available historical databases, the FPM can record collected data to create
charts in Microsoft Excel. Once created, the charts provide a visual tool that
identifies trend analysis and problem identification areas very clearly. The
National FAASTeam Excel Guide/FSDO Aviation Activity Report Work Instruction
provides instructions and examples of some of the more common charts used by
the FPM; however, the FPM can use the same processes to create any desired chart.
D. Identify Areas that Require Mitigation Strategies (see flowchart
process step 15-3-3-9D). Identify major problem areas and trends occurring
in your FSDO district using your data analysis results. The focus of FPM data
analysis will be looking for a high number of undesirable events or trends (e.g.,
excessive number of component failures, weather related events, loss of control
events, pilot air and surface deviations, repeated deviations from standards,
etc.). Accurate analysis of FSDO data will reveal areas that require the implementation
of mitigation strategies.
E. Establish Program Emphasis (see flowchart process step 15-3-3-9E).
Findings from data analysis should drive the FPM to establish emphasis areas
within local safety program activities and events. Area accident trends and
causal factors may vary significantly from national trends. This may require
the FPM to develop special events to educate airmen in the pertinent subject
areas. Use accident/incident or other data when planning tasks, budgeting, and
establishing priorities during the development of the work program.
1) Determine available or required resources to develop mitigation
strategies and establish program emphasis areas.
· FAA Safety Team (FAASTeam) Representatives (REP),
· FSDO ASIs,
· Type clubs,
· Flight schools, and
· Airport safety committees.
2) Add mitigation strategies and established program emphasis
areas to local work program. The FPM should use safety events, district newsletters,
instructor workshops, airport safety committee projects, and FAASTeam REPs’
activities to increase awareness in the aviation community of local area safety
concerns. The FPM should notify organizations within their FSDO of upcoming
programs and processes to mitigate recognized trends and problems. FPMs should
encourage organizations to develop appropriate mitigation programs on their
F. Close PTRS Record (see flowchart process step 15-3-3-9F).
15-3-3-11 TASK OUTCOMES. The completion of this task results in:
A. Trend Identification within the FPM’s FSDO District.
B. Promotional Material. Develop new safety promotional material.
C. Efficient Use of Resources.
D. Mitigation Strategy Development. Develop effective mitigation
strategies and program emphasis areas.
E. Recommendations. Submit any relevant recommendations to:
· Regional Flight Standards Division Manager (RFSDM) through the RFPOC; and
· FSDO Management Team.
15-3-3-13 FUTURE ACTIVITIES. The FPM will continually observe, track, record,
and analyze data from their FSDO district. Data analysis may substantiate and
justify district work program and/or strategy adjustment and focus, or as directed
by FSDO Management Team.
15-3-3-15 through 15-3-3-25 RESERVED.