: V? y
?
f y
?
1 r BD%h
2 ? Vg
r￥i?|
{
3 yL.
4 ?)2
f y
?
í
B ?×1￥
?
"d
V?￥
?
"d
?
H
ù
)￥
^
￥
VB
H
ù?/
H
ù￥
?B?à
qM
/
H
ù
o | %?'
H
ù
Mà
q
X?C| ?DV ?í1
íar?
f y (Markov Chain)
——
HWa
(1 ? ?￥
MV?
1 r BD%h
YVμ
L=?￥ è0o

f y￥'à
Q?é
|￥r B
"
HW￥wM
1?
3M
 B
31g |? ?￥r B
T9,[?
è Bá ?
￡á￥
-
è 1, |￥r B ?s1r B%h
?

!+
?
M
-
￥ |?
Mr Ba
ü
M ?r B
￥à
q
1 0.8,7?
Mha
ü
M1r B
￥à
q1 0.7
?
 |g
Hr B,ù 10
Ma
e ˉ)?r B
￥à
q

D
M
=
M%h?
Mr B?

n
n
X
n
,2
,1
",1,0,2,1
),()(
==
==
ni
iXPna
ni

à
q
",1,0,2,1,),(
1
=====
+
njiiXjXPp
nnij
Mà
q
X
n+1
o | %? X
n
p
ij
,D X
n-1
,…í1
8.0
11
=p 2.01
1112
=?= pp
7.0
21
=p
3.01
2122
=?= pp
12
0.8 0.2 0.3
0.7
2121111
)()()1( pnapnana +=+

M 
μíar?
2221212
)()()1( pnapnana +=+
+=+
+=+
2221212
2121111
)()()1(
)()()1(
pnapnana
pnapnana
ó? a(0),??
a(n),n=1,2…

D
M
12
0.8 0.2 0.3
0.7
n 0
a
2
(n) 0
a
1
(n) 1
1
0.8
0.2
2
0.78
0.22
3 …
0.778 …
0.222 …
?
7/9
2/9
!g
Hr B
!g
H%h
a
2
(n) 1
a
1
(n) 0
0.7 0.77 0.777 …
0.3 0.33 0.333 …
7/9
2/9
n→∞
H
à
q t?×?′×?′D
S
í1
r BD%h
è 2,r B%h
]
 X
n
=1~ r B,X
n
=2~ %h
μ§1? 3?
,X
n
=3
1
2
3
0.10.02
1
0.8 0.250.18
0.65
p
11
=0.8,p
12
=0.18,p
13
=0.02
p
21
=0.65,p
22
=0.25,p
23
=0.1
p
31
=0,p
32
=0,p
33
=1
3332321313
3232221212
3132121111
)()()()1(
)()()()1(
)()()()1(
pnapnapnana
pnapnapnana
pnapnapnana
++=+
++=+
++=+

D
M
!g
H)?r B
?? a(n),n=1,2…
n 0 1 2 3 …
a
2
(n) 0 0.18 0.189 0.1835 …
a
3
(n) 0 0.02 0.054 0.0880 …
a
1
(n) 1 0.8 0.757 0.7285 …
0
0
1
∞
50 …
0.1293 …
0.0326 …
0.8381 …
?

S
?K??1?
3 
B? a
1
(k)= a
2
(k)=0,a
3
(k)=1,5? n>k,a
1
(n)=0
a
2
(n)=0,a
3
(n)=1,'V
3?M? 

b
f y￥'Z?
),1,0(,2,1""== nkX
n

1)(
1
=
∑
=
na
k
i
i
"",1,0,,,2,1
),()(
==
==
nki
iXPna
ni

à
q
kipp
k
j
ijij
,,2,1,1,0
1
"==≥
∑
=
)(
1
iXjXPp
nnij
===
+
Mà
q

dμ?1
Mà
q ?
1
~}{
kkij
pP
×
=
Pnana )()1( =+
kipnana
k
j
jiji
,,2,1,)()1(
1
"==+
∑
=
'Z?

à
q_
~
))(,),(),(()(
21
nananana
k
"=
n
Pana )0()( =
f y￥
?×1 ??
1,?5 y ~ V ?B
?üμKQM
[?à
q?r
6? ?B

? è 1b
Pnana )()1( =+
0,>
N
PN?5 y
w ~ ×
à
q
)()(,∞→→ nwnaw?5 y
wwPw =
@
)9/2,9/7(=w
221
121
3.02.0
7.08.0
www
www
=+
=+
=
3.07.0
2.08.0
.1 P è
1
21
=+ww
21
7.02.0 ww =
1
1
=
∑
=
k
i
i
ww
@
f y￥
?×1 ??
2,
l y ~ i
l

B??rü? ?
7￥
i,p
ii
=1, OV ?Bd
l
?üμ
KQM
[?à
q?r
l

? è 2b
=
×
QR
I
P
rr
0
μ r?
l
￥
l y
￥Mà
q?S?
T
Rμd
,í
í
T
e )1,,1,1("=
Meyyyy
rk
==
),,(
21
"
∑
∞
=
=?=
0
1
)(
s
s
QQIM
y
i
~ V? i ?d
l
?$
?

l

l -￥
ü (MQ
b
2 ? Vg
r￥i?|
{
?Dù5
? Vg
r
l
?￥ oi
?v[
a'á
BE
?? ü9
ü (
?￥? V3 p1 1O
i?|
{ 
?
_° oi
?? oi
1
,
H?è 3O/?g
r ?5?èb
9??|
{/
> ?g
r￥ V
?μv
[#
?￥
ü (g
r

^
b
ù5s
$ Z￥? ?Mo? ?3 p
í
?Vo
s? 
?
?3 p (′1
? 1O ???N9
3 pà
q
i?|
{
^?
oi
1
,
Hè 3O →?
￥ oi
 V
^ 0,1,2,3?￥ oi
 V
^ 1,2,3b
¨
f y
í
?]3 p?á￥? oi
￥Mb
?
V??
?g
r
?]
> ?g
r
3 p
?V oi￥à
q?]b
V?×
f ?
HW sé[a9
> ?g
r
￥à
q
?￥
ü (g
r
b
?L
!
? V
?3 p
?Vo
s? (′1
? 1O
i?|
{ ??
oi
1
,
Hè 3O?
?
 ?5?èb
[
?￥ oi
T1
M

M μ
íar?b
×
f ?/9
?i?|
{
> ?g
r￥à
q
?￥
ü (g
r
b
?y ?
D
n
~? n?3 p
 (′1 1￥o
s?
)2,1,0(!/)(
1
"===
kkekDP
n
D
n
0 1 2 3 >3
P 0.368 0.368 0.184 0.061 0.019
S
n
~? n? oi
 (
M
 )


M
p
≥
<?
=
+
nn
nnnn
n
SD
SDDS
S
,3
,
1
368.0)0()11(
111
======
+ nnn
DPSSPp
0)12(
112
====
+ nn
SSPp
632.0)1()13(
113
=≥====
+ nnn
DPSSPp
}3,2,1{∈
n
S
=
448.0368.0184.0
264.0368.0368.0
632.00368.0
=
333231
232221
131211
ppp
ppp
ppp
P

M?
448.0)3()0()33(
133
=≥+=====
+ nnnn
DPDPSSPp
……
?y ?
3,2,1),()( === iiSPna
ni

à
q
Pnana )()1( =+
f y￥'Z?
=
448.0368.0184.0
264.0368.0368.0
632.00368.0
P
X?
S
 V???
n? oi
 S
n
=i ￥à
q
?5 y0,>
N
PN?5 y 0
2
>P
×
à
qs? w
@ wP=w
)452.0,263.0,285.0(),,(
321
== wwww
n→∞,
à
q
)452.0,263.0,285.0()( =na
? p3
1,9??|
{/
> ?g
r￥ V
?
? n?
> ?g
r￥à
q
)(
nn
SDP >
n sv
H
in
wiSP == )(
)()(
3
1
iSPiSiDP
n
i
nn
==>=
∑
=
D 0 1 2 3 >3
P 0.368 0.368 0.184 0.061 0.019
321
)3()2()1( wDPwDPwDP >+>+>=
)452.0,263.0,285.0(=w
105.0452.0019.0263.0080.0285.0264.0 =×+×+×=
Vé
ù A
> ?g
r￥ V
?v? 10%b
? p3
2,9??|
{/
?￥
ü (g
r

]),([
3
11
∑∑
==
===
i
nn
i
j
n
iSjDPjR
? n?
ü
(
r

),( iSiDiP
nn
=>+
3 p??Vi
,g
r3 p 3 p?Vi
,g
ri

)(])()([
3
11
iSPiSiDiPiSjDPj
n
i
nnnn
i
j
==>+===
∑∑
==
n sv
H
in
wiSP == )(
857.0452.0977.0263.0896.0285.0632.0 =×+×+×=
Vé
ù A
?￥
ü (g
r
1 0.857(O )
± I1
I
1??
′
{l?
?
ü (3 p
 1(O )?
ù??s
?
ü (3 p
? 1 (O ) ?ío
?
HK?2TμvMb
! D
n
?V (′1 λ
￥o
s?
)2,1,0(,!/)("=λ==
λ?
kkekDP
k
n
λ+λ?λλ
λ+?λ
=
λ?λ?λ?
λ?λ?λ?
λ?λ?
eee
eee
ee
P
)2/(12/
)1(1
10
22

M?
? n? (n sv )
> ?g
r￥à
q
)(
nn
SDPP >=
λ 0.8 0.9 1.0 1.1 1.2
P 0.073 0.089 0.105 0.122 0.139
?
ü (3 p9é
h
 10%
H
> ?g
r
￥à
q|9é
h
? 12%b
3 yL.
?
3t￥??V??
=?M?￥y %?b
ysa
]y d

]y r
?b
???V??
?y %?
?y V[
^
d,r ?￥ ?B?b?? 3?y ?? dd ~ a? D,
dr ~ ? H,rr ~
? Rb
y ??1a??,??V??a
] y
??1
?,??V??

]b
3tN2
Ha}
1
?à
q1??3a
￥
òB?y??
￥
?yb3
￥y ??
%?a}y ??￥à
q
? ?
a
]
y
L.
? ?a
]yL.
3?y ?? dd~a? D,dr~? H,rr~
? R
3
y ?? %?a}ò?y ??￥à
q
3
y ??F
a}ò?
y ??
￥à
q
DD RR
DH
DR HH
HR
D
R
H
1
0
0
0
0
1
1 / 2
1 / 2
0
0
1
0
1 / 4
1 / 2
1 / 4
0
1 / 2
1 / 2
P(D?DH)=P(dd?dd,dr)=P(d?dd)P(d?dr) =1×1/2=1/2
P(R?HH)=P(rr?dr,dr)=P(r?dr)P(r?dr)
=1/2×1/2=1/4
N2
)
y ??￥M f ?
! ?8?|?aI?￥1 èM?y ?
?￥s?M]
:T D:H:R
L
!
B|??8[ D:H:R￥à
qDBI??8?
￥
a}
1??
ì￥òB?y
!
SB}y ??1 è D:H:R =a:2b:c

a+2b+c=1),,p=a+b,q=b+c,5 ?8?a
]y

]y1 è d:r=p:q (p+q=1)b
y


X
n
=1,2,3 ~ ? n}￥B?8
? D,H,R

à
q a
i
(n) ~ ? n}￥B?8
?
i(=1,2,3)￥à
qb
N2

Mà
q
y1 è d:r=p:q
))()((
1
3y ??a}y ?? iXjXPp
nnij
===
+
pddXddXPp
nn
====
+
)1)(1(
111

31a}1
qddXdrXPp
nn
====
+
)1)(2(
112

31a}1
0)1)(3(
113
====
+

31a}1 ddXrrXPp
nn
2/2/1)2)(1(
121
ppdrXddXPp
nn
=?====
+

31a}1
2/12/12/1
)2
)(2(
122
=?+?=
=
==
+
qp
drX
drXPp
n
n

31
a}1
=
qp
qp
qp
P
0
2/2/12/
0
Mà
q ?
""
),2,()1()2(
),2,()0()1(
22
22
qpqpPaa
qpqpPaa
==
==
12
,
=++
+=+=
cba
cbqbap
f y
?
",1,0,)()1( ==+ nPnana
),2,()0( cbaa =
=
qp
qp
qp
P
0
2/2/12/
0
N2
),2,()0(
22
qpqpwPwa == ?i×
s?
×
s? D:H:R=1/4:1/2:1/4
1 ???Yè p=q=1/2
y ??1 D H,a
]V? ——
s ?
y ??1 R,

]V? —— ?b
3
do? S±t￥?
s ?, ? =3:1p
(D+H):R=3:1
B3
￥v
a}?,|I

￥N2
)
B"
a}￥y ??￥MV?b
í T
N2
f y
?

?l1
￥￥y ??F
X
n
=1,2,3,4,5,6~
￥yF1 DD,RR,DH,DR,HH,HR

Mà
q
1)''
''(
111
==
==
+
DDX
DDXPp
n
n
4/12/12/1
)''
''(
131
=?=
=
==
+
DHX
DDXPp
n
n
=
2/14/1004/10
4/14/18/14/116/116/1
010000
04/102/104/1
000010
000001
P
T
Mey
==
6
5
4,
3
2
5,
3
2
6,
6
5
4
=?=
3/83/46/13/2
3/43/83/13/4
3/43/83/43/4
3/23/46/13/8
)(
1
QIM
=
2/14/1004/10
4/14/18/14/116/116/1
010000
04/102/104/1
000010
000001
P
I0
R
Q

1(DD),2(RR)
^
l

f y
^
l y ——?

S ?ü ??}í T
N2| ?M1a?
?,
9
V ?Bd
l
?
ü (üV+}
$
l

lb
B? (a?
? )￥
t
é? ??
í TN2/v? 5~6
}ü3×?ê?,
í TN2
4 ?)2
"d?￥?)2
a?a×?2￥il
í
?)2￥MV???? ?￥2
??1r?
? ?X2?? |￥|
{b
? ?)2M￥y
í
"d
=??)W￥M4
6?)
"d
=?￥?
@? ?| (|¨a? ?? ).
¨
f y
?
í
???Mù5 —
—M1 è
j1à
q
'
?
?) i=1,2,… k
?ù?a?
=a?
q
M9 |
t
tntN
k
i
i∑
=
=
1
)()(
s? n(t)=(n
1
(t),n
2
(t),… n
k
(t))
n
i
(t) ~ t
M
??) i ￥ |
 t =0,1,…
)(
)(
)(
tN
tn
ta
i
i
=1 ès? a(t)=(a
1
(t),a
2
(t),… a
k
(t))
1)(,0)(
1
=≥
∑
=
tata
k
i
ii
a(t)~?)2
M ? Q={p
ij
}
k×k
,p
ij
^
MV i à j ￥1 è
'
?
|￥1 è
MV|1 è iwwwww
ik
~),,,(
21
"=
M|9 |
twtntnwtW
k
i
T
ii
~)()()(
1
∑
=
==
￥1 è
M? ?? ?1 è irrrrr
ik
~),,,(
21
"=
￥ |
M? ?
M? ?9 |
 ittRrttR
i
~)(~)(
kiwp
rrwp
k
j
iij
k
i
iiiij
",1,1
1,0,,
1
1
==+
=≥
∑
∑
=
=
'
?
)(,
)(,
}{
)(
)(
tRr
tWw
pQ
tN
tn
ij
? ?
|
M
9 |
s?
=
)()()()1( tWtRtNtN?+=+9 |
)()()1(
1
tRrtnptnj
k
i
jiijj
∑
=
+=+ |
?)
)(tnw
jj
rtRQtntn )()()1( +=+
×
1
1
1
1
=+
=
∑
∑
=
=
k
j
iij
k
i
i
wp
r
)()1()( tNtNtM?+=9 |
9

)()()()()( tMwtntMtWtR
T
+=+=
rtMrwQtntn
T
)())(()1( ++=+
~ '
?
)(),0(),(,,,tnntMrwQ V??X?
'
?
rtMrwQtntn
T
)())(()1( ++=+
rtMPtntn )()()1( +=+rwQP
T
+=

 ?
￥?1 1P
1,1},{
11
==+=
∑∑
==
k
i
i
k
j
iijij
rwppQ
0)()1()( =?+= tNtNtM ?9 |
?M
))(()()1( rwQtaPtata
T
+==+?)2
BáD
f y'Z? Pnana )()1( =+
P~Mà
q ?
?)2 a(t) ~
à
q
¨? ?1 èé?×? e?
rwQP
T
+=
Ptata )()1( =+
1},{
1
=+=
∑
=
k
j
iijij
wppQ
ù5ó? Q,
't?)2 V
[¨
a￥? ?1 è ??M
.),(
)(
1
1×?2?

P ?i
k
T
aaa
rwQaar
"=
+=
∑
=
=≥
k
i
ii
rrr
1
1,0?
@
T
aw
aQa
r
=
∑
=
=
k
i
i
r
1
1 V￡
)( rwQaa
T
+=
0≥?≥ raQa a1×?2
1×?2aaQa?≥
=
8.000
3.06.00
04.05.0
Q
¨? ?1 èé?×? e?
+≥
+≥
≥
≥
323
212
11
8.03.0
6.04.0
5.0
aaa
aaa
aa
aQa
p×?2 a=(a
1
,a
2
,a
3
)(a
1
+a
2
+a
3
=1)
(0.5,0.5,0)
a
2
=a
1
a
3
=1.5a
2
(0,0.4,0.6)
5.1:1:1::
:5.1
321
2312
=
==
aaa
aaaa ??D
a
*
×?× B
B
(0,0,1)
(0,1,0)
(1,0,0)
A
V?× A
è vD?
= (ù?a?
=a?
q )
?) i=1,2,3X?
MM1 è
)428.0,286.0,286.0(
*
=a
≥
≥
23
12
5.1 aa
aa
¨? ?1 èé?×? e? 1×?2aaQa?≥
ù?×?× B￥2
rMawa
T
)(=
)0,1,0(
1
""=
=
∑
=
i
i
k
i
i
e
err:
∑
=
=
=
k
j
iji
ikiii
miM
mmmmiM
1
21
),,,(
μ?í
í￥?:
?￥?:"
i
k
i
k
i
iii
mrMerrM
∑∑
==
==
11
ù p a≥ aQ￥
6B??
T
)( rwQaa
T
+=
T
aw
aQa
r
=
1
)(
= QIM
? p
rMawa
T
)(=
1
1
)(
=
∑
=
k
i
ii
T
raw μ
∑
∑
=
=
=
k
i
ii
k
i
ii
r
mr
a
1
1
μ
¨? ?1 èé?×? e?
ù?×?× B￥2
∑
∑
=
=
=
k
i
ii
k
i
ii
r
mr
a
1
1
μ
∑
=
=
k
i
ii
sba
1
∑
=
=
k
j
jj
ii
i
r
r
b
1
μ
μ
i
i
i
m
s
μ
=
.1,0
1
^×?2
H O
￥L?F1"
￥
V1[?
abb
sba
k
i
ii
ii
∑
=
=≥
00 ≥?≥
ii
br
∑
=
=
k
i
i
b
1
1 V￡
×?×
^ k? bW?[ s
i
1??￥j
8
¨? ?1 èé?×? e?
=
8.000
3.06.00
04.05.0
Q
è
=?=
500
75.35.20
322
)(
1
QIM
iii
j
iji
iiii
msmi
mmmmiM
μμ /,
),,(
3
1
321
==
=
∑
=
?
?￥?
5,25.6,7
321
=== μμμ
)428.0,286.0,286.0(
1
=s
)1,0,0(),6.0,4.0,0(
32
== ss
1,0
,
332211
=≥
++=
∑ ii
bb
sbsbsba
(0,1,0)
(1,0,0)
(0,0,1)
0.286
0.286
S
1
S
2
S
3
B
×?× B
^[ s
i
1??￥ ???
¨? ?1 èé? ?
??
ù5ó? Q
S2 a(0), pB"
￥? ?
1 è r,
PD yr?¤í ?X2 Ba ∈
*
??E? Q a(0), pr
P a(1)D
¤í a
*
,
| a(1)T1?￥ a(0),??/ ?b
￥ ?×?) iaaaaD
i
k
i
iii
~,)(),(
1
2)2()1()2()1(
λλ
∑
=
=
W￥  ??l
?2 ),(),,(
)2()2(
1
)2()1()1(
1
)1(
kk
aaaaaa""==
1,0
),)(0()1(..
)),1((min
1
*
=≥
+=
∑
=
k
i
ii
T
r
rr
rwQaats
aaD
?
¨? ?1 èé? ?
??
=
8.000
3.06.00
04.05.0
Q
è
)428.0,286.0,286.0(
),1,0,0()0(
*
=
=
a
a
!
(0,1,0)
(1,0,0)
(0,0,1)
a(0)
0.286
0.286
a
*
1,0
),)(0()1(..
)),1((min
1
*
=≥
+=
∑
=
k
i
ii
T
r
rr
rwQaats
aaD
)8.0,1.0,1.0()1(
)0,5.0,5.0(
=
=
a
r
a(1)
1=
i
λ
! ?×
pr
P a(1)D
¤í a
*
¨? ?1 èé? ?
??
)428.0,286.0,286.0(
),1,0,0()0(
*
=
=
a
a
!
r(t),a(t) ￥9
2T
7423 5 6
0.639
0.361
0
0.165
0.165
0.670
0.747
0.253
0
0.207
0.207
0.586
0.827
0.173
0
0.235
0.235
0.531
0.883
0.117
0
0.253
0.253
0.495
0.922
0.078
0
0.264
0.264
0.472
0.949
0.051
0
0.272
0.272
0.457
a(7)X¤í a
*
43 r(t)￥+?
1
0.5
0.5
0
0.1
0.1
0.8
r(t)
a(t)
t
Discussions