2/10/16

 

8900.1 CHG 445

VOLUME 15  FAA Safety Team POLICIES AND PROCEDURES

Chapter 3  DATA COLLECTION, ANALYSIS, AND REPORTING

Indicates new/changed information.

Section 3  Data Analysis

15-3-3-1    GENERAL. The Federal Aviation Administration (FAA) Safety Team (FAASTeam) Program Managers (FPM) and/or the Regional FAASTeam Point of Contact (RFPOC) analyze data collected from the National Transportation Safety Board (NTSB) database and a variety of Federal Aviation Administration (FAA) databases, as well as analyzing data collected from active investigations conducted within the Flight Standards District Office (FSDO).

A.    Purpose. This section provides guidelines and procedures for the FPM to analyze data collected. The FPM will evaluate the data to identify trends and modify/develop mitigation strategies. This is necessary to educate airmen about causal and contributing factors associated with current accident/incidents, pilot deviations (PD), near midair collisions (NMAC), maintenance failure to follow procedures, recurring deviations from regulations or other standards, etc. in their FSDO district.

B.    Scope. This task is applicable to RFPOCs, and FPMs. This should be an ongoing process to identify and target high risk areas of noncompliance with regulations or other standards in order to mitigate aircraft accidents/incidents.

15-3-3-3    TASK PREREQUISITES AND SIGNIFICANT INTERFACES.

NOTE:  This task requires knowledge of FAA accident investigation procedures and system safety principles, qualification as an aviation safety inspector (ASI), and appointment as an FPM.

Indicates new/changed information.

A.    Program Tracking and Reporting Subsystem (PTRS) Activity Code.

1)    Operations: 1901.
2)    Maintenance: 3901.
3)    Avionics: 5901.

B.    Significant Interfaces. This task requires coordination with the following organizations or individuals:

    FAA Aviation Data System Branch (AFS-620);

    FAA Investigator-in-Charge (IIC);

    National FAASTeam Branch (AFS-850);

    FPMs;

    Flight Standards District Office (FSDO) Management Team;

    National Transportation Safety Board (NTSB); and

    RFPOC.

C.    Automation Tools. Microsoft Excel.

D.    References.

1)    Regulatory Guidance. [Reserved]
2)    Procedural Guidance (current editions):

    FAA Order 1380.51, Program Tracking and Reporting Subsystem.

    PTRS Procedures Manual (PPM).

E.    Forms:

    FAA Form 8000-36, Program Tracking and Reporting System Data Sheet.

    FAA Form 8020-9, Aircraft Accident/Incident Preliminary Notice.

    FAA Form 8020-15, Investigation of Near Midair Collision Report.

    FAA Form 8020-18, Pilot Deviation Report.

    FAA Form 8020-23, Accident/Incident Report.

F.    Job Aids. [Reserved]

15-3-3-5    BACKGROUND.

A.    Data Analysis. Data analysis is the process of organizing facts, using available methods, tools or techniques to:

1)    Determine if additional facts are needed.
2)    Ascertain if data is valid to accurately identify underlying safety deficiencies.
3)    Reach valid conclusions.

B.    Safety Analysis. Safety analysis is based on factual accident information originating from FAA Form 8020-23 as well as other aviation data accessible from a number of databases available to the FPM. FPMs should be careful to select and apply analytical methods and tools suitable to the analysis.

15-3-3-7    DATA ANALYSIS PROCESS FLOW.

Figure 15-3-3A.  Data Analysis Process Flowchart

Figure 15-3-3A. Data Analysis Process Flowchart

15-3-3-9    PROCEDURES.

A.    Open PTRS Record (see flowchart process step 15-3-3-9A).

B.    Record Data for Analysis (see flowchart process step 15-3-3-9B). The FPM must record data collected from their sources in an organized manner to afford effective analysis. This is best accomplished by creating and using a Microsoft Excel Spreadsheet. The FPMs should refer to the National FAASTeam Excel Guide/FSDO Aviation Activity Report Work Instruction.

C.    Create Graphs and Charts from the Data (see flowchart process step 15-3-3-9C). Whether participating in a live investigation or accessing available historical databases, the FPM can record collected data to create charts in Microsoft Excel. Once created, the charts provide a visual tool that identifies trend analysis and problem identification areas very clearly. The National FAASTeam Excel Guide/FSDO Aviation Activity Report Work Instruction provides instructions and examples of some of the more common charts used by the FPM; however, the FPM can use the same processes to create any desired chart.

D.    Identify Areas that Require Mitigation Strategies (see flowchart process step 15-3-3-9D). Identify major problem areas and trends occurring in your FSDO district using your data analysis results. The focus of FPM data analysis will be looking for a high number of undesirable events or trends (e.g., excessive number of component failures, weather related events, loss of control events, pilot air and surface deviations, repeated deviations from standards, etc.). Accurate analysis of FSDO data will reveal areas that require the implementation of mitigation strategies.

E.    Establish Program Emphasis (see flowchart process step 15-3-3-9E). Findings from data analysis should drive the FPM to establish emphasis areas within local safety program activities and events. Area accident trends and causal factors may vary significantly from national trends. This may require the FPM to develop special events to educate airmen in the pertinent subject areas. Use accident/incident or other data when planning tasks, budgeting, and establishing priorities during the development of the work program.

1)    Determine available or required resources to develop mitigation strategies and establish program emphasis areas.

    FAA Safety Team (FAASTeam) Representatives (REP),

    FSDO ASIs,

    Type clubs,

    Designees,

    Flight schools, and

    Airport safety committees.

2)    Add mitigation strategies and established program emphasis areas to local work program. The FPM should use safety events, district newsletters, instructor workshops, airport safety committee projects, and FAASTeam REPs’ activities to increase awareness in the aviation community of local area safety concerns. The FPM should notify organizations within their FSDO of upcoming programs and processes to mitigate recognized trends and problems. FPMs should encourage organizations to develop appropriate mitigation programs on their own.

F.    Close PTRS Record (see flowchart process step 15-3-3-9F).

15-3-3-11    TASK OUTCOMES. The completion of this task results in:

A.    Trend Identification within the FPM’s FSDO District.

B.    Promotional Material. Develop new safety promotional material.

C.    Efficient Use of Resources.

D.    Mitigation Strategy Development. Develop effective mitigation strategies and program emphasis areas.

E.    Recommendations. Submit any relevant recommendations to:

    AFS-850;

    Regional Flight Standards Division Manager (RFSDM) through the RFPOC; and

    FSDO Management Team.

15-3-3-13    FUTURE ACTIVITIES. The FPM will continually observe, track, record, and analyze data from their FSDO district. Data analysis may substantiate and justify district work program and/or strategy adjustment and focus, or as directed by FSDO Management Team.

15-3-3-15 through 15-3-3-25 RESERVED.