Unscoped DCT Report (Standard DCT)


MLF Label: 2.1 Training & Qualification
DCT Type: SP DCT
Specialty: Operations
Peer Group: A - Part 121 Air Operators
DCT Revision: 29.0 on 05/18/18 (Released)
Summary Information

Purpose (Certificate Holder Responsibility): The CH is responsible to manage the safety of the Training & Qualification processes within its operation.
Objective (FAA Responsibility): The FAA objective is to determine if the CH; (1) Met regulatory requirements, guidance, and safety performance objectives of its Training & Qualification processes, and; (2) Managed safety of the Training & Qualification processes by incorporating system safety principles which include safety attributes.


The Training & Qualification Subsystem includes the following Element(s)
  2.1 Training & Qualification
     2.1.1 (OP) Training of Flight Crewmembers
     2.1.2 (OP) Training of Check Airmen and Instructors
     2.1.3 (OP) Simulators / Training Devices
     2.1.4 (OP) Outsource Crewmember Training
     2.1.5 (OP) Appropriate Airmen / Crewmembers Checks and Qualifications
     2.1.6 (OP) Advanced Qualification Program (AQP)
     2.1.7 (OP) Flight Crewmember Flight / Duty / Rest Time


Questions Answers References
  2.1.1 (OP) Training of Flight Crewmembers
1   
Did your observations of Training of Flight Crewmembers procedures indicate the certificate holder met regulatory and guidance requirements?




NOTE: 

Safety Attribute: Procedures,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  18  3/27/2018 4:34:57 PM, 

QID:
 00012687, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Met regulatory and guidance requirements
  Isolated instance(s) when guidance requirements were not met
  Several instances when guidance requirements were not met
  Regulatory noncompliance
  Not Observable
AC-120-35, AC-120-51, AC-120-68, 8900.1 Vol 3 Ch 18 Sec 5, 8900.1 Vol 3 Ch 19 Sec 1, 8900.1 Vol 3 Ch 19 Sec 10, 8900.1 Vol 3 Ch 19 Sec 3, 8900.1 Vol 3 Ch 19 Sec 4, 8900.1 Vol 3 Ch 19 Sec 5, 8900.1 Vol 3 Ch 19 Sec 6, 8900.1 Vol 3 Ch 19 Sec 9, B046, C048, C081, A362, B030, B035, B040, B045, B051, B059, C061, C062, C063, C071, C072, C073, C076, C300, C384, A061, 8900.1 Vol 3 Ch 54 Sec 5, AC-120-109, 117.9(a), 117.9(b), 117.9(c), 8900.1 Vol 3 Ch 19 Sec 12, 121.419(c), 121.419(d), 121.423, 121.423(d), 121.423(f), 121 Appendix E, 121 Appendix F, 121 Appendix H, 121.137(b), 121.337, 61.156, 121.358, 121.418(b), 121.418(c), A319, 121.407(e), 121.415(h), 121.415(i), 121.419(e), 121.427(e), 121.394(a), 121.401(a), 121.401(c), 121.401(d), 121.403, 121.403(b), 121.404, 121.405, 121.407(a), 121.407(c), 121.409(a), 121.409(b), 121.409(c), 121.409(d), 121.412, 121.415(a), 121.415(b), 121.415(c), 121.415(d), 121.415(f), 121.415(g), 121.417, 121.417(b), 121.417(c), 121.417(d), 121.417(e), 121.418(a), 121.419(a), 121.419(b), 121.424(a), 121.424(b), 121.424(c), 121.424(d), 121.425(a), 121.425(b), 121.425(c), 121.426(b), 121.427(a), 121.427(b), 121.427(c), 121.427(d), 121.433(c), 121.433(d), 121.440, 121.441, 8900.1 Vol 3 Ch 19 Sec 14, AC-121-39, AC-120-111, AC-120-114, 121.683(a), 121.805, 121.805(a), 121.805(b), 8900.1 Vol 6 Ch 2 Sec 13, 14 CFR Part 121 Subpart N, 44703, 8000.88
2   
Did the certificate holder effectively mitigate unacceptable levels of risk(s) for the Training of Flight Crewmembers process?




NOTE: 

Safety Attribute: Controls,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:17 PM, 

QID:
 00012688, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Controls were effective
  Isolated instance(s) when controls were not effective
  Several instances when controls were not effective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.53, 5.55, 5.51
3   
Did the certificate holder's Training of Flight Crewmembers process ensure consistency of related processes between departments and employees (interfaces)?




NOTE: 

Safety Attribute: Interfaces,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  4  3/27/2018 4:34:32 PM, 

QID:
 00012689, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Interfaces were effective
  Isolated instance(s) when interfaces were ineffective
  Several instances when interfaces were ineffective
  Systemic or significant issues
  Not Observable
4   
Did the responsible person for Training of Flight Crewmembers process provide adequate resources (financial and human) to ensure the safety and performance in support of all process objectives?




NOTE: 

Safety Attribute: Management Responsibility,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:18 PM, 

QID:
 00012690, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.21, 5.23(a), 5.25(a), 5.25(b), 5.25(c)
5   
Did the person with authority over the certificate holder's Training of Flight Crewmembers process effectively plan, direct, control, or change procedures, and make key determinations, including safety risk acceptance decisions?




NOTE: 

Safety Attribute: Management Authority,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:19 PM, 

QID:
 00012691, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(b)
6   
Did the certificate holder monitor and measure the safety performance of the Training of Flight Crewmembers process to identify process deficiencies and take action to correct identified deficiencies?




NOTE: 

Safety Attribute: Process Measurement,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  4  3/30/2018 10:21:48 AM, 

QID:
 00012692, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Process measurements were effective
  Isolated instance(s) when process measurements were not used or ineffective
  Several instances when process measurements were not used or ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.71, 5.73, 5.75
7   
Were individuals knowledgeable on how their safety-related duties contributed to the safety performance of the Training of Flight Crew Members process?




NOTE: 

Safety Attribute: Safety Ownership,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:19 PM, 

QID:
 00012693, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Individuals were knowledgeable
  Isolated instances where knowledge was lacking
  Several instances where knowledge was lacking
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(a), 5.91, 5.93
  2.1.2 (OP) Training of Check Airmen and Instructors
8   
Did your observations of Training of Check Airmen and Instructors procedures indicate the certificate holder met regulatory and guidance requirements?




NOTE: 

Safety Attribute: Procedures,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING PERSONNEL = "CHECK AIRMEN AIRCRAFT") OR (TRAINING PERSONNEL = "CHECK AIRMEN SIMULATOR") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR AIRCRAFT") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR SIMULATOR")) ,  Rev.  10  3/27/2018 4:34:57 PM, 

QID:
 00012694, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Met regulatory and guidance requirements
  Isolated instance(s) when guidance requirements were not met
  Several instances when guidance requirements were not met
  Regulatory noncompliance
  Not Observable
AC-120-68, 8900.1 Vol 3 Ch 20 Sec 1, 8900.1 Vol 3 Ch 20 Sec 2, 8900.1 Vol 3 Ch 20 Sec 4, AC-120-109, 121 Appendix H, 121.413(h), 121.414(h), 121.401(a), 121.411(b), 121.411(c), 121.411(d), 121.411(e), 121.411(f), 121.412(b), 121.412(c), 121.412(f), 121.413, 121.413(a), 121.413(c), 121.413(d), 121.413(e), 121.414(a), 121.414(c), 121.414(d), 121.414(e), AC-120-111, 44703, 8000.88, 121.414(f)
9   
Did the certificate holder effectively mitigate unacceptable levels of risk(s) for the Training of Check Airmen and Instructors process?




NOTE: 

Safety Attribute: Controls,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING PERSONNEL = "CHECK AIRMEN AIRCRAFT") OR (TRAINING PERSONNEL = "CHECK AIRMEN SIMULATOR") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR AIRCRAFT") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR SIMULATOR")) ,  Rev.  4  3/27/2018 4:34:33 PM, 

QID:
 00012695, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Controls were effective
  Isolated instance(s) when controls were not effective
  Several instances when controls were not effective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.53, 5.55, 5.51
10   
Did the certificate holder's Training of Check Airmen and Instructors process ensure consistency of related processes between departments and employees (interfaces)?




NOTE: 

Safety Attribute: Interfaces,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING PERSONNEL = "CHECK AIRMEN AIRCRAFT") OR (TRAINING PERSONNEL = "CHECK AIRMEN SIMULATOR") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR AIRCRAFT") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR SIMULATOR")) ,  Rev.  4  3/27/2018 4:34:33 PM, 

QID:
 00012696, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Interfaces were effective
  Isolated instance(s) when interfaces were ineffective
  Several instances when interfaces were ineffective
  Systemic or significant issues
  Not Observable
11   
Did the responsible person for Training of Check Airmen and Instructors process provide adequate resources (financial and human) to ensure the safety and performance in support of all process objectives?




NOTE: 

Safety Attribute: Management Responsibility,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING PERSONNEL = "CHECK AIRMEN AIRCRAFT") OR (TRAINING PERSONNEL = "CHECK AIRMEN SIMULATOR") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR AIRCRAFT") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR SIMULATOR")) ,  Rev.  4  3/27/2018 4:34:33 PM, 

QID:
 00012697, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.21, 5.23(a), 5.25(a), 5.25(b), 5.25(c)
12   
Did the person with authority over the certificate holder's Training of Check Airmen and Instructors process effectively plan, direct, control, or change procedures, and make key determinations, including safety risk acceptance decisions?




NOTE: 

Safety Attribute: Management Authority,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING PERSONNEL = "CHECK AIRMEN AIRCRAFT") OR (TRAINING PERSONNEL = "CHECK AIRMEN SIMULATOR") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR AIRCRAFT") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR SIMULATOR")) ,  Rev.  4  3/27/2018 4:34:34 PM, 

QID:
 00012698, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(b)
13   
Did the certificate holder monitor and measure the safety performance of the Training of Check Airmen and Instructors process to identify process deficiencies and take action to correct identified deficiencies?




NOTE: 

Safety Attribute: Process Measurement,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING PERSONNEL = "CHECK AIRMEN AIRCRAFT") OR (TRAINING PERSONNEL = "CHECK AIRMEN SIMULATOR") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR AIRCRAFT") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR SIMULATOR")) ,  Rev.  5  3/30/2018 10:21:50 AM, 

QID:
 00012699, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Process measurements were effective
  Isolated instance(s) when process measurements were not used or ineffective
  Several instances when process measurements were not used or ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.71, 5.73, 5.75
14   
Were individuals knowledgeable on how their safety-related duties contributed to the safety performance of the Training of Check Airmen and Instructors process?




NOTE: 

Safety Attribute: Safety Ownership,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING PERSONNEL = "CHECK AIRMEN AIRCRAFT") OR (TRAINING PERSONNEL = "CHECK AIRMEN SIMULATOR") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR AIRCRAFT") OR (TRAINING PERSONNEL = "FLIGHT INSTRUCTOR SIMULATOR")) ,  Rev.  3  3/27/2018 4:34:22 PM, 

QID:
 00012700, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Individuals were knowledgeable
  Isolated instances where knowledge was lacking
  Several instances where knowledge was lacking
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(a), 5.91, 5.93
  2.1.3 (OP) Simulators / Training Devices
15   
Did your observations of Simulators/Training Devices procedures indicate the certificate holder met regulatory and guidance requirements?




NOTE: 

Safety Attribute: Procedures,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING EQUIPMENT = "FLIGHT SIMULATORS") OR (TRAINING EQUIPMENT = "FLIGHT TRAINING DEVICES")) ,  Rev.  6  3/27/2018 4:34:45 PM, 

QID:
 00012701, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Met regulatory and guidance requirements
  Isolated instance(s) when guidance requirements were not met
  Several instances when guidance requirements were not met
  Regulatory noncompliance
  Not Observable
8900.1 Vol 3 Ch 19 Sec 6, A034, 121.407(a), 121.921(a), 121.921(b), 60.20, 60.25
16   
Did the certificate holder effectively mitigate unacceptable levels of risk(s) for the Simulators/Training Devices process?




NOTE: 

Safety Attribute: Controls,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING EQUIPMENT = "FLIGHT SIMULATORS") OR (TRAINING EQUIPMENT = "FLIGHT TRAINING DEVICES")) ,  Rev.  4  3/27/2018 4:34:35 PM, 

QID:
 00012702, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Controls were effective
  Isolated instance(s) when controls were not effective
  Several instances when controls were not effective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.53, 5.55, 5.51
17   
Did the certificate holder's Simulators/Training Devices process ensure consistency of related processes between departments and employees (interfaces)?




NOTE: 

Safety Attribute: Interfaces,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING EQUIPMENT = "FLIGHT SIMULATORS") OR (TRAINING EQUIPMENT = "FLIGHT TRAINING DEVICES")) ,  Rev.  4  3/27/2018 4:34:35 PM, 

QID:
 00012703, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Interfaces were effective
  Isolated instance(s) when interfaces were ineffective
  Several instances when interfaces were ineffective
  Systemic or significant issues
  Not Observable
18   
Did the responsible person for Simulators/Training Devices process provide adequate resources (financial and human) to ensure the safety and performance in support of all process objectives?




NOTE: 

Safety Attribute: Management Responsibility,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING EQUIPMENT = "FLIGHT SIMULATORS") OR (TRAINING EQUIPMENT = "FLIGHT TRAINING DEVICES")) ,  Rev.  4  3/27/2018 4:34:35 PM, 

QID:
 00012704, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.21, 5.23(a), 5.25(a), 5.25(b), 5.25(c)
19   
Did the person with authority over the certificate holder's Simulators/Training Devices process effectively plan, direct, control, or change procedures, and make key determinations, including safety risk acceptance decisions?




NOTE: 

Safety Attribute: Management Authority,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING EQUIPMENT = "FLIGHT SIMULATORS") OR (TRAINING EQUIPMENT = "FLIGHT TRAINING DEVICES")) ,  Rev.  4  3/27/2018 4:34:35 PM, 

QID:
 00012705, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(b)
20   
Did the certificate holder monitor and measure the safety performance of the Simulators/Training Devices process to identify process deficiencies and take action to correct identified deficiencies?




NOTE: 

Safety Attribute: Process Measurement,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING EQUIPMENT = "FLIGHT SIMULATORS") OR (TRAINING EQUIPMENT = "FLIGHT TRAINING DEVICES")) ,  Rev.  5  3/30/2018 10:21:50 AM, 

QID:
 00012706, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Process measurements were effective
  Isolated instance(s) when process measurements were not used or ineffective
  Several instances when process measurements were not used or ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.71, 5.73, 5.75
21   
Were individuals knowledgeable on how their safety-related duties contributed to the safety performance of the Simulators/Training Devices process?




NOTE: 

Safety Attribute: Safety Ownership,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND ((TRAINING EQUIPMENT = "FLIGHT SIMULATORS") OR (TRAINING EQUIPMENT = "FLIGHT TRAINING DEVICES")) ,  Rev.  4  3/30/2018 10:21:48 AM, 

QID:
 00012707, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Simulators/Training Devices
  Isolated instances where knowledge was lacking
  Several instances where knowledge was lacking
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(a), 5.91, 5.93
  2.1.4 (OP) Outsource Crewmember Training
22   
Did your observations of Outsource Crewmember Training procedures indicate the certificate holder met regulatory and guidance requirements?




NOTE: 

Safety Attribute: Procedures,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A031") ,  Rev.  6  3/27/2018 4:34:44 PM, 

QID:
 00012708, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Met regulatory and guidance requirements
  Isolated instance(s) when guidance requirements were not met
  Several instances when guidance requirements were not met
  Regulatory noncompliance
  Not Observable
A031, 8900.1 Vol 3 Ch 54 Sec 5, 121.402(b), 121.411(d), 121.411(f), 121.412(d), 121.412(f), 121.413, 121.414(a)
23   
Did the certificate holder effectively mitigate unacceptable levels of risk(s) for the Outsource Crewmember Training process?




NOTE: 

Safety Attribute: Controls,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A031") ,  Rev.  4  3/27/2018 4:34:34 PM, 

QID:
 00012709, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Controls were effective
  Isolated instance(s) when controls were not effective
  Several instances when controls were not effective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.53, 5.55, 5.51
24   
Did the certificate holder's Outsource Crewmember Training process ensure consistency of related processes between departments and employees (interfaces)?




NOTE: 

Safety Attribute: Interfaces,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A031") ,  Rev.  4  3/27/2018 4:34:34 PM, 

QID:
 00012710, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Interfaces were effective
  Isolated instance(s) when interfaces were ineffective
  Several instances when interfaces were ineffective
  Systemic or significant issues
  Not Observable
25   
Did the responsible person for Outsource Crewmember Training process provide adequate resources (financial and human) to ensure the safety and performance in support of all process objectives?




NOTE: 

Safety Attribute: Management Responsibility,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A031") ,  Rev.  4  3/27/2018 4:34:34 PM, 

QID:
 00012711, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.21, 5.23(a), 5.25(a), 5.25(b), 5.25(c)
26   
Did the person with authority over the certificate holder's Outsource Crewmember Training process effectively plan, direct, control, or change procedures, and make key determinations, including safety risk acceptance decisions?




NOTE: 

Safety Attribute: Management Authority,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A031") ,  Rev.  4  3/27/2018 4:34:34 PM, 

QID:
 00012712, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(b)
27   
Did the certificate holder monitor and measure the safety performance of the Outsource Crewmember Training process to identify process deficiencies and take action to correct identified deficiencies?




NOTE: 

Safety Attribute: Process Measurement,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A031") ,  Rev.  5  3/30/2018 10:21:50 AM, 

QID:
 00012713, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Process measurements were effective
  Isolated instance(s) when process measurements were not used or ineffective
  Several instances when process measurements were not used or ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.71, 5.73, 5.75
28   
Were individuals knowledgeable on how their safety-related duties contributed to the safety performance of the Outsource Crewmember Training process?




NOTE: 

Safety Attribute: Safety Ownership,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A031") ,  Rev.  3  3/27/2018 4:34:23 PM, 

QID:
 00012714, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Individuals were knowledgeable
  Isolated instances where knowledge was lacking
  Several instances where knowledge was lacking
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(a), 5.91, 5.93
  2.1.5 (OP) Appropriate Airmen / Crewmembers Checks and Qualifications
29   
Did your observations of Appropriate Airmen/Crewmembers Checks and Qualifications procedures indicate the certificate holder met regulatory and guidance requirements?




NOTE: 

Safety Attribute: Procedures,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  13  5/18/2018 10:41:25 AM, 

QID:
 00012715, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Met regulatory and guidance requirements
  Isolated instance(s) when guidance requirements were not met
  Several instances when guidance requirements were not met
  Regulatory noncompliance
  Not Observable
8900.1 Vol 13 Ch 2 Sec 3, AC-120-35, AC-120-68, A031, A362, C050, 44729(a), 121.436(a), 121.436(b), 121.153(c), 121.383(a), 121.383(d), 121.383(e), 121.385(b), 121.385(d), 121.389(a), 121.402(b), 121.409, 121.409(d), 121.427(a), 121.432(a), 121.432(b), 121.433(c), 121.433(e), 121.434(b), 121.434(c), 121.434(d), 121.434(g), 121.439(a), 121.439(b), 121.439(c), 121.439(d), 121.440, 121.441, 121.441(a), 121.443(a), 121.443(b), 121.445(b), 121.445(c), 121.445(d), 121.453(a), 121.683(a), 121.683(b), 8000.88
30   
Did the certificate holder effectively mitigate unacceptable levels of risk(s) for the Appropriate Airmen/Crewmembers Checks and Qualifications process?




NOTE: 

Safety Attribute: Controls,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:24 PM, 

QID:
 00012716, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Controls were effective
  Isolated instance(s) when controls were not effective
  Several instances when controls were not effective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.53, 5.55, 5.51
31   
Did the certificate holder's Appropriate Airmen/Crewmembers Checks and Qualifications process ensure consistency of related processes between departments and employees (interfaces)?




NOTE: 

Safety Attribute: Interfaces,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:24 PM, 

QID:
 00012717, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Interfaces were effective
  Isolated instance(s) when interfaces were ineffective
  Several instances when interfaces were ineffective
  Systemic or significant issues
  Not Observable
32   
Did the responsible person for Appropriate Airmen/Crewmembers Checks and Qualifications process provide adequate resources (financial and human) to ensure the safety and performance in support of all process objectives?




NOTE: 

Safety Attribute: Management Responsibility,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:24 PM, 

QID:
 00012718, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.21, 5.23(a), 5.25(a), 5.25(b), 5.25(c)
33   
Did the person with authority over the certificate holder's Appropriate Airmen/Crewmembers Checks and Qualifications process effectively plan, direct, control, or change procedures, and make key determinations, including safety risk acceptance decisions?




NOTE: 

Safety Attribute: Management Authority,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:24 PM, 

QID:
 00012719, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(b)
34   
Did the certificate holder monitor and measure the safety performance of the Appropriate Airmen/Crewmembers Checks and Qualifications process to identify process deficiencies and take action to correct identified deficiencies?




NOTE: 

Safety Attribute: Process Measurement,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  4  3/30/2018 10:21:48 AM, 

QID:
 00012720, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Process measurements were effective
  Isolated instance(s) when process measurements were not used or ineffective
  Several instances when process measurements were not used or ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.71, 5.73, 5.75
35   
Were individuals knowledgeable on how their safety-related duties contributed to the safety performance of the Appropriate Airmen/Crewmember Checks and Qualifications process?




NOTE: 

Safety Attribute: Safety Ownership,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:24 PM, 

QID:
 00012721, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Individuals were knowledgeable
  Isolated instances where knowledge was lacking
  Several instances where knowledge was lacking
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(a), 5.91, 5.93
  2.1.6 (OP) Advanced Qualification Program (AQP)
36   
Did your observations of Advanced Qualification Program (AQP) procedures indicate the certificate holder met regulatory and guidance requirements?




NOTE: 

Safety Attribute: Procedures,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A034") ,  Rev.  7  3/27/2018 4:34:45 PM, 

QID:
 00012722, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Met regulatory and guidance requirements
  Isolated instance(s) when guidance requirements were not met
  Several instances when guidance requirements were not met
  Regulatory noncompliance
  Not Observable
AC-120-35, AC-120-54, AC-120-68, 8900.1 Vol 3 Ch 21 Sec 1, 8900.1 Vol 3 Ch 21 Sec 2, 8900.1 Vol 3 Ch 21 Sec 3, 8900.1 Vol 3 Ch 21 Sec 5, A034, 121.405(a), 121.407(a), 121.903, 121.903(c), 121.909, 121.909(b), 121.913(a), 121.915(a), 121.915(b), 121.917(a), 121.917(b), 121.917(c), 121.921, 121.923, 121.925, 44703, 60.20, 60.25, 8000.88
37   
Did the certificate holder effectively mitigate unacceptable levels of risk(s) for the Advanced Qualification Program (AQP) process?




NOTE: 

Safety Attribute: Controls,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A034") ,  Rev.  4  3/27/2018 4:34:34 PM, 

QID:
 00012723, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Controls were effective
  Isolated instance(s) when controls were not effective
  Several instances when controls were not effective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.53, 5.55, 5.51
38   
Did the certificate holder's Advanced Qualification Program (AQP) process ensure consistency of related processes between departments and employees (interfaces)?




NOTE: 

Safety Attribute: Interfaces,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A034") ,  Rev.  4  3/27/2018 4:34:34 PM, 

QID:
 00012724, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Interfaces were effective
  Isolated instance(s) when interfaces were ineffective
  Several instances when interfaces were ineffective
  Systemic or significant issues
  Not Observable
39   
Did the responsible person for Advanced Qualification Program (AQP) process provide adequate resources (financial and human) to ensure the safety and performance in support of all process objectives?




NOTE: 

Safety Attribute: Management Responsibility,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A034") ,  Rev.  5  3/27/2018 4:34:44 PM, 

QID:
 00012725, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.21, 5.23(a), 5.25(a), 5.25(b), 5.25(c)
40   
Did the person with authority over the certificate holder's Advanced Qualification Program (AQP) process effectively plan, direct, control, or change procedures, and make key determinations, including safety risk acceptance decisions?




NOTE: 

Safety Attribute: Management Authority,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A034") ,  Rev.  4  3/27/2018 4:34:34 PM, 

QID:
 00012726, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(b)
41   
Did the certificate holder monitor and measure the safety performance of the Advanced Qualification Program (AQP) process to identify process deficiencies and take action to correct identified deficiencies?




NOTE: 

Safety Attribute: Process Measurement,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A034") ,  Rev.  5  3/30/2018 10:21:50 AM, 

QID:
 00012727, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Process measurements were effective
  Isolated instance(s) when process measurements were not used or ineffective
  Several instances when process measurements were not used or ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.71, 5.73, 5.75
42   
Were individuals knowledgeable on how their safety-related duties contributed to the safety performance of the Advanced Qualification Program (AQP) process?




NOTE: 

Safety Attribute: Safety Ownership,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121") AND (OPSPEC = "A034") ,  Rev.  4  3/30/2018 10:21:48 AM, 

QID:
 00012728, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Individuals were knowledgeable
  Isolated instances where knowledge was lacking
  Several instances where knowledge was lacking
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(a), 5.91, 5.93
  2.1.7 (OP) Flight Crewmember Flight / Duty / Rest Time
43   
Did your observations of Flight Crewmember Flight/Duty/Rest Time procedures indicate the certificate holder met regulatory and guidance requirements?




NOTE: 

Safety Attribute: Procedures,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  7  5/18/2018 10:41:25 AM, 

QID:
 00012729, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Met regulatory and guidance requirements
  Isolated instance(s) when guidance requirements were not met
  Several instances when guidance requirements were not met
  Regulatory noncompliance
  Not Observable
A033, A317, 117.11(a), 117.11(b), 117.11(c), 117.13(a), 117.13(b), 117.15(a), 117.15(b), 117.15(c), 117.15(d), 117.15(e), 117.15(f), 117.17(a), 117.17(b), 117.17(c), 117.17(d), 117.19(a), 117.19(b), 117.21(c), 117.21(d), 117.21(e), 117.23(b), 117.23(c), 117.25(a), 117.25(b), 117.25(c), 117.25(d), 117.25(e), 117.25(f), 117.25(g), 117.27, 117.29(b), 117.29(d), 117.29(e), 117.29(f), 117.29(g), 117.5(a), 117.5(b), 117.5(c), 117.5(d), 117.7(a), 117.7(b), 117.9(a), 117.9(b), 117.9(c), A318, Appendix Table A to Part 117, Appendix Table B to Part 117, Appendix Table C to Part 117, A117, 121 Subpart Q, 121 Subpart R, 121 Supbart S, A319, 121.485(a), 121.523(b), AC-121-31
44   
Did the certificate holder effectively mitigate unacceptable levels of risk(s) for the Flight Crewmember Flight/Duty/Rest Time process?




NOTE: 

Safety Attribute: Controls,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:25 PM, 

QID:
 00012730, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Controls were effective
  Isolated instance(s) when controls were not effective
  Several instances when controls were not effective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.53, 5.55, 5.51
45   
Did the certificate holder's Flight Crewmember Flight/Duty/Rest Time process ensure consistency of related processes between departments and employees (interfaces)?




NOTE: 

Safety Attribute: Interfaces,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:28 PM, 

QID:
 00012731, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Interfaces were effective
  Isolated instance(s) when interfaces were ineffective
  Several instances when interfaces were ineffective
  Systemic or significant issues
  Not Observable
46   
Did the responsible person for Flight Crewmember Flight/Duty/Rest Time process provide adequate resources (financial and human) to ensure the safety and performance in support of all process objectives?




NOTE: 

Safety Attribute: Management Responsibility,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:28 PM, 

QID:
 00012732, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.21, 5.23(a), 5.25(a), 5.25(b), 5.25(c)
47   
Did the person with authority over the certificate holder's Flight Crewmember Flight/Duty/Rest Time process effectively plan, direct, control, or change procedures, and make key determinations, including safety risk acceptance decisions?




NOTE: 

Safety Attribute: Management Authority,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:25 PM, 

QID:
 00012733, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Management of the process was effective
  Isolated instance(s) where management of the process was ineffective
  Several instances where management of the process was ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(b)
48   
Did the certificate holder monitor and measure the safety performance of the Flight Crewmember Flight/Duty/Rest Time process to identify process deficiencies and take action to correct identified deficiencies?




NOTE: 

Safety Attribute: Process Measurement,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  4  3/30/2018 10:21:49 AM, 

QID:
 00012734, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Process measurements were effective
  Isolated instance(s) when process measurements were not used or ineffective
  Several instances when process measurements were not used or ineffective
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.71, 5.73, 5.75
49   
Were individuals knowledgeable on how their safety-related duties contributed to the safety performance of the Flight Crewmember Flight/Duty/Rest Time process?




NOTE: 

Safety Attribute: Safety Ownership,  Question Type: Process Observation,  

Scoping Attribute:
  (FAR PART = "121" ) ,  Rev.  3  3/27/2018 4:34:26 PM, 

QID:
 00012735, Response Details: SP DCTs (Both OP and AW),  Status: Released

  Individuals were knowledgeable
  Isolated instances where knowledge was lacking
  Several instances where knowledge was lacking
  Systemic, significant issues, or regulatory non-compliance
  Not Observable
5.23(a), 5.91, 5.93


Response Details List  SP DCTs (Both OP and AW) (Released, 1.0)
1 Unclear procedure(s)
2 Conflicting procedure(s)
3 Used workaround(s)
4 Skipped process step(s)
5 Personnel failed to follow process (procedures, guidance, etc)
6 Procedures/guidance not available
7 Procedures/guidance not current
8 Inconsistent procedure(s)
9 Undocumented procedure(s)
10 Minor typographical error(s) (i.e. record entries)
11 Information missing
12 Communication failure(s)
13 Personnel failed to perform task
14 Process failed to meet desired outcome
15 Process oversight failure
16 Equipment/tools not available
17 Equipment/tools not adequate
18 Equipment/tools not calibrated
19 Facilities not adequate
20 Other
Response Details List  N/O Response Detail (Released, 1.0)
1 Personnel (i.e. key certificate holder personnel not present/available)
2 Equipment (i.e. equipment not present/available/in serviceable condition)
3 Event did not occur (i.e. the drunk passenger did not show up for the flight...)
4 Time Constraints (i.e. resources/workload)
5 Weather (i.e. weather needed for observation not present or weather made observation impossible)
6 Other