a25c a6a8a26a4a6a8a3a4a27a8a20a19a28a30a29a32a31a8a33
a9a24a11a8a13a15a11a8a16 a17a19a18a2a20a8a11a8a22 a1a4a3a15a23 a3
System Hazard Analysis
Builds on PHA as a foundation (expands PHA)
Considers system as a whole and identifies how
system operation
interfaces and interactions between subsystems
interface and interactions between system and operators
component failures and normal (correct) behavior
could contribute to system hazards.
Refines high?level safety design constraints
Validates conformance of system design to design constraints
Traces safety design constraints to individual components.
(based on functional decomposition and allocation)
a25c a6a8a26a15a6a8a3a4a27a8a20a19a28a34a29a32a31a8a35
a0a2a1a4a3a4a5 a6a8a7a10a9a12a11a14a13a15a11a8a16 a17a19a18a21a20a8a11a8a22 a1a15a3a4a23 a3
Hazard Causal Analysis
Used to refine the high?level safety constraints into more
detailed constraints.
Requires some type of model (even if only in head of analyst)
Almost always involves some type of search through the
system design (model) for states or conditions that could lead
to system hazards.
Top?down
Bottom?up
Forward
Backward
a25c a6a8a26a4a6a8a3a15a27a14a20a19a28a30a29a32a31a8a38
a0a2a1a4a3a4a5 a6a8a7a36a9a24a11a8a13a4a11a8a16 a17a19a18a2a20a8a11a8a22 a1a4a3a4a23 a3
Forward vs. Backward Search
Initiating Final
Events States
D
C
B
A W
Z
Y
X
nonhazard
HAZARD
nonhazard
nonhazard
Forward Search
Initiating Final
Events States
B
A
C
D
W
Y
Z
X
nonhazard
HAZARD
nonhazard
nonhazard
Backward Search
a25c a6a8a26a4a6a8a3a15a27a14a20a19a28a30a29a32a31a8a37
a0a2a1a4a3a4a5 a6a8a7a36a9a24a11a8a13a4a11a8a16 a17a19a18a2a20a8a11a8a22 a1a4a3a4a23 a3
Top?Down Search
TOP EVENT
Basic or
primary events
Intermediate or
pseudo?events
Leveson ? 139
System Hazard Analysis
c
Fault Tree Analysis
Developed originally in 1961 for Minuteman.
Means of analyzing hazards, not identifying them.
Top?down search method.
Based on converging chains?of?events accident model.
Tree is simply a record of results; analysis done in head.
FT can be written as Boolean expression and simplified to show
specific combinations of identified basic events sufficient to cause
the undesired top event (hazard).
If want quantified analysis and individual probabilities for all basic
events are known, frequency of top event can be calculated.
Leveson ? 140
System Hazard Analysis
Fault Tree Example
c
valve 1
too high
Pressure
fails on
Position
Indicator
Valve 1
Light fails
on
Indicator
Open
too late
output
Computer
not open
does not open
Relief valve 2
does not open
Sensor
Failure
Operator does
not know to
open valve 2
Operator
inattentive
Valve
failure
failure
Computer does
Computer
does not issue
command to
open valve 1
or
and
and
or
or
Relief valve 1
Valve
Explosion
a25c a6a8a26a15a6a8a3a4a27a8a20a19a28a34a29a32a94a95a29
a0a2a1a4a3a4a5 a6a8a7a10a9a12a11a8a13a4a11a8a16 a17a19a18a21a20a8a11a8a22 a1a15a3a4a23 a3
Example Fault Tree for ATC Arrival Traffic
a93 a51 a51
a79a60a49a43a48 a53a30a40 a39a55a40a59a46a60a50a2a53a61a40a59a52a32a52 a54a47a68a44a49a43a48 a53a61a39a63a53a61a49 a50a47a85a63a48 a40a43a52 a49a47a50a4a54
a42a44a48 a46a47a48a32a42a56a45a47a42a92a62a55a54a43a79a60a49a59a53a61a49a47a50a57a48 a40a43a46a70a62a41a50a83a49a59a46a60a68a47a49a59a53a15a68a34a62
a64a67a65
a116 a51 a51 a51a116 a116
a48 a40a43a52 a49a34a50a2a48 a40a43a46a70a40 a42a44a48 a46a47a48a32a42a56a45a47a42 a48 a40a43a52 a49a34a50a2a48 a40a43a46a70a40 a68a43a48 a62a55a50a4a49a43a46a60a39a41a54a84a40a59a53a30a50a57a48 a42a70a54 a48 a40a59a52 a49a47a50a57a48 a40a43a46a70a40 a42a44a48a32a46a34a48a32a42a44a45a34a42a118a62a41a54a43a79a60a49a59a53a15a49a34a50a2a48 a40a43a46
a51a4a51
a48 a46a60a109a63a50a2a53a61a49a43a48 a52a78a62a55a54a59a79a60a49a43a53a61a49a34a50a2a48 a40a43a46a70a69a71a76a47a48 a52 a54 a62a41a54a43a79a60a49a59a53a15a49a34a50a2a48 a40a43a46a44a81a82a54a47a50a83a69a105a54a34a54a43a46a70a62a55a50a57a53a61a54a47a49a43a42a70a62 a81a60a54a34a50a83a69a105a54a34a54a43a46a70a49a43a53a91a53a91a48 a85a41a49a43a52a78a50a57a53a61a49 a48 a39a90a49a43a46a60a68
a51 a51 a51 a51a83a51 a51a4a51 a51
a48a40a59a46 a46a60a49a43a52a117a49a43a79a47a79a34a53a61a40a47a49a47a39a63a76a70a50a4a40 a40 a49a43a48 a53a61a39a63a53a61a49 a50a43a52 a49a43a46a60a68a59a48a32a46a82a72a84a40a59a46a70a68a43a48 a54a43a53a61a54a43a46a82a50 a68a47a54a59a79a60a49a43a53a61a50a57a45a47a53a61a54a44a50a57a53a61a49 a48 a39 a53a61a40a43a42a119a46a82a54a47a49a43a53a91a81a60a74
a51
a62a41a49a43a42a70a54a88a53a91a45a47a46a60a69a105a49a34a74 a53a91a45a34a46a60a69a105a49a47a74a55a62 a54a47a54a47a68a34a54a43a53a101a49a43a48a32a53a91a79a82a40a43a53a61a50a83a62a77a97
a64a67a65
a106 a51 a51a51 a51 a106 a93 a93 a51 a51
a69a105a40a44a49a43a48 a53a61a39a63a53a61a49 a50a47a40a59a46 a48 a46a60a49a43a52 a69a107a40a44a49a59a48a32a53a61a39a63a53a61a49 a50a59a52 a49a43a46a82a68a43a48 a46a60a72 a46a70a49a59a48a32a53a61a39a63a53a61a49 a50a34a85a63a48 a40a59a52 a49a34a50a83a54a34a62a108a50a57a76a60a54 a46a70a49a59a48a32a53a61a39a63a53a61a49 a50 a49a59a48a32a52 a62
a51a4a51
a49a43a79a47a79a34a53a61a40a47a49a47a39a77a76a104a50a4a40a88a79a60a49a59a53a61a49a43a52a32a52 a54a43a52 a39a55a40a59a46a60a62a55a54a34a39a63a45a60a50a57a48 a85a41a54a43a52 a74a90a40a59a46a70a68a43a48 a54a43a53a61a54a43a46a82a50 a46a60a40a43a46a82a109a110a50a57a53a61a49a43a46a60a62a41a72a43a53a61a54a47a62a55a62a63a48 a40a43a46a70a111a41a40a43a46a60a54 a50a4a40a115a42a87a49a43a89a78a54a44a50a57a45a47a53a91a46
a51
a53a91a45a47a46a60a69a105a49a47a74a41a62a67a46a60a40a47a50a34a62a63a79a60a49a47a50a57a48 a49a43a52 a52 a74 a53a91a45a47a46a82a69a107a49a34a74a55a62a67a48a32a46a44a48 a46a60a50a4a54a43a53a61a62a55a54a34a39a55a50a57a48a32a46a60a72a44a40a59a53 a69a71a76a47a48 a52 a54a44a49a43a48 a53a91a79a60a40a43a53a61a50a59a48 a62a90a39a55a40a59a46a60a68a43a45a82a39a55a50a2a48 a46a60a72 a53a15a40a59a42a120a81a82a49a47a62a55a54a44a50a4a40
a51
a62a55a50a4a49a47a72a47a72a34a54a43a53a61a54a47a68a43a97 a39a55a40a59a46a60a85a55a54a59a53a15a72a59a48a32a46a82a72a44a40a43a79a60a54a43a53a61a49a34a50a2a48 a40a43a46a82a62a108a85a77a48 a40a59a52 a49a47a50a4a54 a48a32a46a82a68a47a54a43a79a82a54a43a46a60a68a34a54a43a46a60a50a59a112a83a80a82a113a114a49a43a79a47a79a34a53a61a40a47a49a47a39a63a76a82a54a47a62 a48a32a46a60a49a59a52a78a49a43a79a34a79a47a53a61a40a47a49a47a39a77a76a47a97
a51a83a51
a52a42a44a48 a46a47a48 a42a44a45a47a42a92a68a43a48 a54a43a53a61a54a59a46a60a39a55a54a88a48 a46 a50a4a40a115a79a82a49a43a53a61a49a43a52 a54a59a52a55a53a91a45a47a46a60a69a105a49a34a74a55a62a63a97
a50a57a76a47a53a61a54a47a62a63a76a82a40a43a52 a68a44a39a63a53a61a40a47a62a55a62a77a48a32a46a60a72a44a50a57a48 a42a70a54a43a97
a6a8a26a15a6a8a3a4a27a8a20a19a28a34a29a32a94a8a96
a0a2a1a4a3a4a5 a6a8a7a10a9a12a11a8a13a4a11a8a16 a17a19a18a21a20a8a11a8a22 a1a15a3a4a23 a3
Example Fault Tree for ATC Arrival Traffic (2)
a58
a40a59a46a60a50a57a53a61a40a43a52a32a52 a54a43a53a10a48a32a46a82a62a55a50a57a53a91a45a60a39a55a50a57a48 a40a59a46a60a62a90a68a47a40a88a46a60a40a34a50a47a39a55a49a59a45a60a62a55a54
a51
a49a43a48a32a53a61a39a77a53a15a49 a50a34a50a83a40a88a42a70a49a59a89a78a54a88a46a60a54a34a39a55a54a47a62a55a62a41a49a43a53a61a74a90a62a63a79a60a54a34a54a47a68a44a39a63a76a60a49a59a46a60a72a47a54
a64a67a65
a58 a58 a58 a58 a58
a40a43a46a82a50a2a53a61a40a59a52a32a52 a54a43a53a101a68a47a40a47a54a34a62 a40a43a46a82a50a2a53a61a40a59a52a32a52 a54a43a53a10a48 a62a55a62a77a45a60a54a47a62 a40a43a46a82a50a2a53a61a40a43a52 a52 a54a43a53a102a48 a62a55a62a63a45a82a54a47a62 a40a59a46a60a50a57a53a61a40a43a52a32a52 a54a43a53a10a48 a62a41a62a63a45a60a54a34a62 a40a59a46a60a50a57a53a61a40a43a52a32a52 a54a43a53a10a48 a62a41a62a63a45a60a54a34a62
a46a82a40a47a50a43a48 a62a55a62a63a45a82a54a44a62a63a79a60a54a47a54a34a68 a49a59a79a47a79a47a53a61a40a43a79a34a53a91a48 a49a34a50a83a54a44a62a63a79a82a54a47a54a47a68 a49a43a79a34a79a47a53a61a40a43a79a34a53a103a48 a49a47a50a4a54a44a62a63a79a60a54a34a54a47a68 a62a63a79a60a54a47a54a34a68a44a49a47a68a47a85a77a48 a62a55a40a59a53a61a74 a62a63a79a60a54a47a54a34a68a44a49a47a68a47a85a77a48 a62a55a40a59a53a61a74
a49a34a68a47a85a63a48 a62a55a40a43a53a61a74 a49a34a68a47a85a63a48 a62a55a40a43a53a61a74a67a81a47a45a82a50a43a79a47a48 a52 a40a34a50 a49a47a68a34a85a63a48 a62a55a40a43a53a61a74a90a49a43a46a60a68a88a79a34a48a32a52 a40a47a50 a50a2a76a82a49a47a50a47a68a34a40a47a54a47a62a67a46a60a40a34a50 a50a83a40a34a40a88a52 a49a47a50a4a54a44a50a4a40a44a49a47a85a55a40a59a48 a68
a68a34a40a47a54a47a62a67a46a60a40a34a50a43a53a61a54a47a39a41a54a43a48 a85a41a54a88a48 a50a57a97 a53a61a54a47a39a41a54a43a48 a85a41a54a47a62a67a48 a50a59a81a47a45a60a50a34a68a47a40a47a54a34a62 a49a47a85a55a40a43a48 a68a44a62a55a54a59a79a60a49a43a53a61a49a47a50a57a48 a40a43a46 a62a55a54a43a79a60a49a59a53a61a49a47a50a57a48 a40a43a46
a51
a46a60a40a34a50 a40a43a52 a40a47a69a98a48a52 a50a2a97 a85a63a48 a40a59a52 a49a34a50a2a48 a40a43a46 a85a63a48 a40a59a52 a49a34a50a2a48 a40a43a46a47a97
a64a67a65
a75 a86 a58
a76a60a74a55a62a77a48 a39a41a49a43a52 a45a47a42a87a49a43a46 a40a59a46a60a50a57a53a61a40a43a52a32a52 a54a43a53a10a48 a62a41a62a63a45a60a54a34a62
a39a41a40a43a42a44a42a44a45a47a46a34a48 a39a41a49a47a50a2a48 a40a43a46 a39a55a40a43a42a44a42a56a45a47a46a47a48 a39a55a49a47a50a57a48 a40a43a46 a62a77a79a60a54a47a54a34a68a84a49a34a68a47a85a63a48 a62a55a40a43a53a61a74
a51 a51 a51
a49a43a48 a52a32a45a34a53a15a54 a49a43a48 a52a32a45a34a53a15a54 a50a83a40a44a69a71a53a61a40a43a46a82a72a84a49a59a48a32a53a61a39a63a53a61a49 a50
a64a66a65 a64a67a65
a65 a51
a49a59a48a32a52 a45a47a53a61a54
a65
a49a47a68a43a48 a40a44a40a43a46a70a69a71a53a61a40a43a46a60a72
a75 a99
a49a34a68a43a48 a40 a62a55a74a55a39a77a76a60a40a43a52 a40a47a72a43a48 a39a55a49a59a52a78a62a63a52 a48a32a79 a53a61a40a43a46a82a72a88a52 a49a59a81a60a54a43a52 a80a60a49a43a81a82a54a43a52a55a48 a46
a25c
a51
a53a15a54a34a73a43a45a60a54a59a46a60a39a55a74 a49a47a62a55a62a41a40a47a39a63a48 a49a47a50a4a54a47a68a44a69a71a48 a50a57a76 a42a44a48 a62a77a52 a54a47a49a34a68a43a48 a46a60a72
a51
a49a43a48 a53a61a39a63a53a61a49 a50a47a40a43a46 a79a47a52 a49a34a39a55a54a44a40a43a46
a79a47a52 a49a43a46a60a85a77a48 a54a47a69a100a68a43a48 a62a63a79a47a52 a49a47a74 a62a55a39a63a53a61a54a47a54a59a46
\System Hazard Analysis
FTA Evaluation
Leveson ? 143
c
operation of system.
Requires a detailed knowledge of design, construction, and
Dependencies (common?cause failure points) not easy to see.
Graphical format helps in understanding system and
relationship between events.
identifying potentially hazardous software behavior.
Can be useful in tracing hazards to software interface and
Cuts sets denote weak points of a complex design.
c
Leveson ? 144
\System Hazard Analysis
sometimes
FTA Evaluation (2)
A simplified representation of a complex process
too simplified.
Tends to concentrate on failures.
Quantitative evaluation may be misleading.
On U.S. space programs where FTA (and FMEA) were used
extensively, 35% of actual in?flight malfunctions were not
identified or were not identified as credible.
c
Leveson ? 145
Event Tree Analysis
Developed for and used primarily for nuclear power.
Underlying single chain of events model of accidents.
Forward search
Simply another form of decision tree.
Problems with dependent events.
Leveson ? 146
Event Tree Example
P1
P1 x P5
P1 x P4
P1 x P4 x P5
P1 x P3
P1 x P3 x P4
c
1?P5
P5
1?P5
P5
P4
1?P4
P4
1?P4
P3
1?P3
1?P2
P1
Fails
Fails
Fails
Fails
Fails
Succeeds
Succeeds
Succeeds
Succeeds
Succeeds
Available
Initiating event
Containment
integrity
productFission
removal
ECCSElectric powerPipe break
54321
Fails
P1 x P2
P2
c
Leveson ? 147,148
System Hazard Analysis
Event Trees vs. Fault Trees
Relief valve 1 Relief valve 2
Opens
Pressure decreases
Fails
Opens
Fails
too high
Pressure
Pressure decreases
Explosion
open valve 1
Computer does not
failure
Valve
OpenValve 1
does not issue
light fails
indicator
indicator
position
onfails on
command to
open valve 1
Computer
Computer
output
too late
Pressure
monitor
failure
Operator does not
know to open valve 2
inattentive
Operator
Valve
failure
does not open
Relief valve 2
Explosion
Relief valve 1
does not open
Pressure
too high
Leveson ? 149,150
System Hazard Analysis
c
ETA Evaluation
Events trees are better at handling ordering of events but
fault trees better at identifying and simplifying event scenarios.
Practical only when events can be ordered in time (chronology
of events is stable) and events are independent of each other.
Most useful when have a protection system.
Can become exceedingly complex and require simplication.
Separate tree required for each initiating event.
Difficult to represent interactions between events
Difficult to consider effects of multiple initiating events.
Defining functions across top of event tree and their order
is difficult.
Depends on being able to define set of initiating events that
will produce all important accident sequences.
Probably most useful in nuclear power plants where
all risk associated with one hazard (serious overheating of fuel)
designs are fairly standard
large reliance on protection systems and shutdown systems.
Cause?Consequence Analysis
Leveson ? 151
System Hazard Analysis
A combination of forward and top?down search.
Again based on converging chain?of?events.
Diagrams can become unwieldy.
Separate diagrams required for each initiating event.
Used primarily in Europe.
c
c
Leveson ? 152
System Hazard Analysis
Cause?Consequence
Diagram
critical event
open
does not
Computer
Pressure too high
opens?
Valve
Operator
open
Valve
reaction
Yes No
Relief valve 1
Pressure
Explosion
reduced
does not
NoYes
Relief valve 2
failure
opens?
failure
Uncontrolled
c
System Hazard Analysis
Leveson ? 153
HAZOP: Hazard and Operability Analysis
Unlike most techniques, HAZOP can identify hazards.
Based on model of accidents that assumes they are caused
by deviations from design or operating intentions.
Purpose is to identify all possible deviations from the design’s
expected operation and all hazards associated with these
deviations.
Software Deviation Analysis (Jon Reese)
c
Leveson ? 154
System Hazard Analysis
HAZOP Guidewords
NONE
NO, NOT,
Guideword
The intended result is not achieved, but nothing else happens
Meaning
(such as no forward flow when there should be)
MORE
or higher viscosity).
(such as higher pressure, higher temperature, higher flow,
More of any relevant physical property than there should be
LESS Less of a relevant physical property than there should be.
AS WELL AS
water, acids, corrosive products).
(such as extra vapors or solids or impurities, including air,
components are present in the system than there should be
An activity occurs in addition to what was intended, or more
PART OF
one of two components in a mixture).
Only some of the design intentions are achieved (such as only
REVERSE
backflow instead of forward flow).
The logical opposite of what was intended occurs (such as
OTHER THAN
material).
completely different happens (such as the flow of the wrong
No part of the intended result is achieved, and something
c
Leveson ? 155
Example Entry in a HAZOP report
System Hazard Analysis
Guide Word
NONE
Deviation
No flow
Possible Causes
1. Pump failure
2. Pump suction
3. Pump isolation
filter blocked
valve closed.
Possible Consequences
1. Overheating in heat
exchanger.
2. Loss of feed to reactor.
c
Leveson ? 156
System Hazard Analysis
Interface Analyses
Various types used to evaluate physical, functional, or flow
relationships.
Generally use structured walkthroughs.
Like HAZOP, effectiveness depends on procedures used
and thoroughness of application.
.
c
Leveson ? 157
System Hazard Analysis
FMEA or FMECA
Failure Modes and Effects (Criticality) Analysis
Developed to predict equipment reliability.
Forward search based on underlying single chain?of?events
and failure models (like event trees).
Initiating events are failures of individual components.
c
Leveson ? 158
System Hazard Analysis
FMECA Example (1)
B
A
Component
probability
Failure
Failure mode
by mode
% failures
Effects
Critical Noncritical
B
A
?3
?3
1x10
1x10
Short
Other
Short
Other
Open
Open
5
5
5
90
5
90
5x10
5x10
?5
5x10
?5
5x10
?5
?5
X
X
Leveson ? 159
System Hazard Analysis
c
FMECA Example (2)
Subsystem __________________________ Prepared by____________________________ Date _____________
FAILURE MODES AND EFFECTS CRITICALITY ANALYSIS
ITEM
MODES
FAILURE
CAUSE OF FAILURE POSSIBLE EFFECTS PROB. LEVEL
POSSIBLE ACTION TO REDUCE
FAILURE RATE OR EFFECTS
Motor Case Rupture a. Poor workmanship
b. Defective materials
c. Damage during
transportation
d. Damage during handling
e. Overpressurization
Destruction of missile 0.0006 Critical Close control of manufacturing
processes to ensure that
workmanship meets prescribed
standards. Rigid quality control
of basic materials to eliminate
defectives. Inspection and
pressure testing of completed
cases. Provision of suitable
packaging to protect motor during
transportation.
c a126a95a141a91a126a21a124a103a142a123a135a60a143a145a144a8a146a21a147a140
a121a123a122a91a124a103a125 a126a19a127a87a128a130a129a21a131a91a129a19a132 a133a77a134a136a135a137a129a19a138 a122a103a124a130a139 a124
ABORT: CRIT. FUNC.:
CRIT. HDW:
REVISION:
PREPARED BY: APPROVED BY: APPROVED BY (NASA):
ITEM:
FUNCTION:
FAILURE MODE:
CAUSE(S):
EFFECT(S) ON (A) SUBSYSTEM
DISPOSITION AND RATIONALE:
REDUNDANCY SCREEN:
SHUTTLE CRITICAL ITEMS LIST ? ORBITER
SUBSYSTEM: FMEA NO:
EFFECTIVITY:
VEHICLE
ASSEMBLY:
P/N RI:
P/N VENDOR:
PHASE:
QUANTITY
(D) CREW/VEHICLE (C) MISSION (B) INTERFACES