System Supervi sory Control Computer Interface Display Control Sensors Direct Observation 16.422 Human Supervisory Control of Automated Systems Prof. R. John Hansman Prof. Missy Cummings System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Course Objectives y This is a graduate student class designed to examine the fundamental issues of human supervisory control, wherein humans interact with complex dynamic systems, mediated through various levels of automation. This course will explore how humans interact with automated systems of varying complexities, what decision processes can be encountered in complex man-machine systems, and how automated systems can be designed to support both human strengths and weaknesses. Several case studies will be presented from a variety of domains as illustrations. A secondary objective of this class is to provide an opportunity to improve both oral and written presentation skills. System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Evolution of Cockpit Displays System Supervi sory Control Computer Interface Display Control Sensors Direct Observation System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Types of Automation y Mechanical Automation (eg Factory > Industrial Revolution) y Mixed ; Information and Mechanical (eg Aircraft) ? Decision Aid ? Supervisory Control System Decision Aid Supervisory Control System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Verplank Notions System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Supervisory Control Architecture System Supervisory Control Computer Interface Display Control Sensors Direct Observation System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Supervisory Control Examples y Autopilot - Flight Management System y Autonomous Vehicle y Process Control Plant y Thermostat y Word Processing Program y Cruise Control y Automated Steering?? System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Sheridan Notions Spectrum of Automation System Supervi sory Control Computer Interface Display Control Sensors Direct Observation System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Models System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Tele-Systems Operator Human Interactive Computer /Interface Comm Comm Distance Task Interactive Computer /Autopilot Aircraft Bandwidth Loss of Direct Feedback Communications Latency Task Interactive Computer - Human Interactive Computer System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Tele-System Examples y Autonomous Vehicle ? Aircraft, AAV, RPV ? Rover - Mars, Bomb ? Underwater UUV, AUV y Web System y Virtual Presence y Tele-medicine y Other System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Decision Aid Architecture Display Decision Aiding Logic - Computer Sensors System System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Decision Aid Examples y Alerting Systems ? Gear Warning ? Idiot Light (eg Oil Pressure) ? TCAS y Automated Planning Systems ? Path Planners y Suggesters ? Spell Check y “What if” Tools ? Analysis Tools y Data Analysis ? Filters ? Interactive Data Analysis Tools System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Question y What is good design practice for development of human supervisory and decision aiding systems ? Distribution of Authority ? Architecture ? Intuitiveness of System ? Interface Issues ? Usability ? Performance robustness ? Safety ? Cost Benefit System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Spectrum of Automation Manual Fully Autonomous y Historically - Human required to compensate for limitations of system ? Skilled Operators ? Training y Human limits >>> System Limits y Distribution of Authority (Human vs Automation) System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Humans y Strengths ? Pattern Recognition ? Inference ? Data Assimilation ? Adaptation ? Intuition ? Judgment ? Intuition ? Morality y Limits ? Latency - Response time ? Bandwidth ? Data Input ? Visual ? Audio ? Tactical ? Cognitive Capacity ? Inconsistent Performance ? Boredom - Saturation ? Endurance ? Life Support ? Cost ? Training System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Automation y Strengths ? Can be fast ? Does not get bored ? Consistent ? Good for predictable cases y Limits ? Dumb ? Needs rules ? Adaptability ? Cost ? Input requirements ? Interface with system System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Why Automate ? y Enhance Human ? Extend, Relieve, Backup Replace y Performance ? Speed, Accuracy, Strength y Cost ? 2 person crew y Reliability/Repeatability y Hazards to Operators ? UCAV y Human Limitations ? G levels, Life Support y Market Perception y Distributed Geography ? Telepresece, Web y Safety ? True? System Supervi sory Control Computer Interface Display Control Sensors Direct Observation Does Automation Increase Safety? y Confounded with other Effects ? System Improvements y Changes Error Modes ? Automation Errors (eg A320) y Workload Distribution ? Cruise decreased, approach increased y System Failure ? Over-reliance/Dependence on Automation y Complexity Induced Issues System Supervi sory Control Computer Interface Display Control Sensors Direct Observation System Supervi sory Control Computer Interface Display Control Sensors Direct Observation VLS Vα Prot Vα Max Vα Floor 140 120 CL Airspeed scale α Angle of Attack (AOA) α Stall: Sudden loss of lift and or aircraft control Angle of attack reached with full aft stick (max aircraft performance) Angle of attack, where TOGA thrust is automatically applied by the A/THR Angle of attack from which stick input is converted into angle of attack demand (stick neutral α Prot) α VLS: Angle of attack reached at approach speed (VLS) α Max: α Prot: α Floor: High Angle of Attack Protection CL System Supervi sory Control Computer Interface Display Control Sensors Direct Observation A320 Thrust Control Thrust levers ? Moved manually (no servomotor) ? Transmit their position to the respective FADEC (Full Authority Digital Engine Control)