System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
16.422 Human Supervisory Control
of Automated Systems
Prof. R. John Hansman
Prof. Missy Cummings
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Course Objectives
y This is a graduate student class designed to examine the
fundamental issues of human supervisory control, wherein humans
interact with complex dynamic systems, mediated through various
levels of automation. This course will explore how humans interact
with automated systems of varying complexities, what decision
processes can be encountered in complex man-machine systems,
and how automated systems can be designed to support both human
strengths and weaknesses. Several case studies will be presented
from a variety of domains as illustrations. A secondary objective of
this class is to provide an opportunity to improve both oral and written
presentation skills.
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Evolution of Cockpit Displays
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Types of Automation
y Mechanical Automation (eg Factory > Industrial Revolution)
y Mixed ; Information and Mechanical (eg Aircraft)
? Decision Aid
? Supervisory Control
System
Decision Aid
Supervisory
Control
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Verplank Notions
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Supervisory Control
Architecture
System
Supervisory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Supervisory Control
Examples
y Autopilot - Flight Management System
y Autonomous Vehicle
y Process Control Plant
y Thermostat
y Word Processing Program
y Cruise Control
y Automated Steering??
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Sheridan Notions
Spectrum of Automation
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Models
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Tele-Systems
Operator
Human
Interactive
Computer
/Interface
Comm
Comm
Distance
Task
Interactive
Computer
/Autopilot
Aircraft
Bandwidth
Loss of Direct Feedback
Communications Latency
Task Interactive Computer - Human Interactive Computer
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Tele-System Examples
y Autonomous Vehicle
? Aircraft, AAV, RPV
? Rover - Mars, Bomb
? Underwater UUV, AUV
y Web System
y Virtual Presence
y Tele-medicine
y Other
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Decision Aid Architecture
Display
Decision Aiding
Logic -
Computer
Sensors System
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Decision Aid Examples
y Alerting Systems
? Gear Warning
? Idiot Light (eg Oil Pressure)
? TCAS
y Automated Planning Systems
? Path Planners
y Suggesters
? Spell Check
y “What if” Tools
? Analysis Tools
y Data Analysis
? Filters
? Interactive Data Analysis Tools
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Question
y What is good design practice for development of human
supervisory and decision aiding systems
? Distribution of Authority
? Architecture
? Intuitiveness of System
? Interface Issues
? Usability
? Performance robustness
? Safety
? Cost Benefit
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Spectrum of Automation
Manual Fully Autonomous
y Historically - Human required to compensate for limitations of
system
? Skilled Operators
? Training
y Human limits >>> System Limits
y Distribution of Authority (Human vs Automation)
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Humans
y Strengths
? Pattern Recognition
? Inference
? Data Assimilation
? Adaptation
? Intuition
? Judgment
? Intuition
? Morality
y Limits
? Latency - Response time
? Bandwidth
? Data Input
? Visual
? Audio
? Tactical
? Cognitive Capacity
? Inconsistent Performance
? Boredom - Saturation
? Endurance
? Life Support
? Cost
? Training
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Automation
y Strengths
? Can be fast
? Does not get bored
? Consistent
? Good for predictable cases
y Limits
? Dumb
? Needs rules
? Adaptability
? Cost
? Input requirements
? Interface with system
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Why Automate ?
y Enhance Human
? Extend, Relieve, Backup Replace
y Performance
? Speed, Accuracy, Strength
y Cost
? 2 person crew
y Reliability/Repeatability
y Hazards to Operators
? UCAV
y Human Limitations
? G levels, Life Support
y Market Perception
y Distributed Geography
? Telepresece, Web
y Safety
? True?
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
Does Automation Increase
Safety?
y Confounded with other Effects
? System Improvements
y Changes Error Modes
? Automation Errors (eg A320)
y Workload Distribution
? Cruise decreased, approach increased
y System Failure
? Over-reliance/Dependence on Automation
y Complexity Induced Issues
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
VLS
Vα Prot
Vα Max
Vα Floor
140
120
CL
Airspeed scale
α Angle of Attack (AOA)
α Stall: Sudden loss of lift and or aircraft control
Angle of attack reached with full aft stick
(max aircraft performance)
Angle of attack, where TOGA thrust is
automatically applied by the A/THR
Angle of attack from which stick input is converted
into angle of attack demand (stick neutral α Prot)
α VLS: Angle of attack reached at approach speed (VLS)
α Max:
α Prot:
α Floor:
High Angle of Attack
Protection
CL
System
Supervi sory
Control
Computer
Interface
Display
Control
Sensors
Direct Observation
A320 Thrust Control
Thrust levers
? Moved manually (no servomotor)
? Transmit their position to the
respective FADEC (Full Authority
Digital Engine Control)