1 arma model let ε t be white noise process, z t be a stationary series. white noise : 純雜訊 ε...

20
1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純純純 ε t ~ NID( 0, σ 2 ) ARMA model 純純純 Box-Jankin model 1970 純純純 純純純純純純純純純純純純純純純純 純純純 ,, Stationary series 純純純 純純純純純純純純純

Post on 21-Dec-2015

222 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

1

ARMA model

Let εt be white noise process, Zt be a stationary series.

white noise : 純雜訊 εt ~ NID( 0, σ2)

ARMA model 又稱為 Box-Jankin model , 1970 年代推出,用來配適時間序列中的不規則震盪,適用於 Stationary series ,可解釋序列中的自相關現象。

Page 2: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

2

AR(p), Autoregressive model with order p is defined as

tptptt ZZZ ...11

...11 qtqtttZ

MA(p), Movingaverage model with order q is defined as

ARMA(p,q), Autoregressive and movingaverage with order (p,q) is defined as

...... 1111 qtqttptptt ZZZ

註: δ 是一 constant , 並不一定是 μ

Page 3: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

3

註:1 、 AR(p) model 可以下列式表示 (assume δ=0) :

(B) or Z ,)...1( tt1 tq

qt BBZ

ity)(stationar 0)(

(B) or Z (B)Zor )...1( 1tt1

滿足平穩性之根需在單位圓外,始

B

ZBB ttttp

p

)()(

t Zor, )()( BB

tt BZB

2 、 MA(q) model 可以下列式表示:

3 、 ARMA(p,q) model 可以下列式表示:

)(B

)(B

是 B 的 p 次多項式,

是 B 的 q 次多項式,

lity)(invertibi 0)( 滿足可逆性之根需在單位圓外,始 B

Page 4: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

4

MA(q) model

),0(~ )(... 2t11 NBZ tqtqttt

qkk

q

qq

q

qq

for ,0)...1(

.............)...1(

...

221

221

12111

Zt 之變異數及自相關係數:222

12 )...1( qZ

Movingaverage with order q:

由此得到參數估計量

註: For MA(q) model , μ=δ

Page 5: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

5

Zt 偏自相關係數 (partial autocorrelation):

.............

21

212

122

111

For MA model , ACF cuts off after lag q, PACF dies down.

Page 6: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

6

MA(1) model

2for ,0)1(

:ACF

k

21

11

k

0 112

11

1|| ,)1( 1111 tttt BZ

}1/{}1{

:)1(2

12

11 kk

kk

PACF

由此得到估計量

theta 0.9 0.7 0.5 0.3 0.1 -0.1 -0.3 -0.5 -0.7 -0.9

Rho_1 -0.50 -0.47 -0.40 -0.28 -0.10 0.10 0.28 0.40 0.47 0.50

phi_11

-0.50 -0.47 -0.40 -0.28 -0.10 0.10 0.28 0.40 0.47 0.50

phi_22

0.33 0.28 0.19 0.08 0.01 0.01 0.08 0.19 0.28 0.33

phi_33

-0.24 -0.19 -0.09 -0.02 0.00 0.00 0.02 0.09 0.19 0.24

phi_44

0.19 0.13 0.05 0.01 0.00 0.00 0.01 0.05 0.13 0.19

Page 7: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

7

Page 8: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

8

, 2211 ttttZ MA(2) model

3for ,0)1(

)1(

:

k

22

21

22

22

21

2111

k

ACF

由此得到參數估計

Page 9: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

9

Page 10: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

10

AR(p) model

, ....., kkppkk 21for , ...11

Autoregressive with order p

tt

tptptt

B

ZZZ

)( Z Z(B) ,0

,...1

tt

11

此模式滿足平穩性的條件:係數使得方程式 的根在單位圓外

2221

2 )...1( qZ

Variance for AR(p) model

Autocorrelation for AR(p) model

0)( B

Page 11: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

11

Partial Autocorrelation for AR(p) model

...

..........

, ...

, ...

112211

2132112

1231211

ppppp

pp

pp

稱為 Yule-Walker 等

式 , 由此得到估計量

1for ,0 .......

,

22

212

1

22

111

p kkk

For AR model , ACF dies down, PACF cuts off after lag p.

Page 12: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

12

1||

B)Z-(1or , :)1(

1

t111

tttt ZZAR

Stationarity 之條件

ACF 呈指數下降,或波動下降; PACF 在 k=2 處切斷

2for 0 , :

, :

111

1k11

kPACF

ACF

kk

k

11̂ 估計量:

註: AR(1) 過程又稱為馬可夫過程 (Markov process)

........ ,0 ,8.0

,)8.0( ,8.0

2211

1

k

k

例: Zt = 6 - 0.8 Zt-1 + εt

Page 13: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

13

Page 14: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

14

之根在單位圓外 (B)

B-B-1 (B) , :)2( 2212211

tttt ZZZAR

Stationarity 之條件

Yule-Walker 等式 :2112

1211

2

21

2

1

1

22

1

1

3for ,0 , , 222111 k φkk

例: Zt = Zt-1 - 0.6Zt-2 + εt

...... ,35.0 ,025.0

0 ,66.0 ,625.0

32

22111

kk

Page 15: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

15

Page 16: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

16

Page 17: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

17

ARMA(p,q) model

,...... 1111 ptptqtqttt ZZZ

若 q<= p ,則 ACF 遞減 (damped exponentially or sine-wave) 若 q > p ,前面 q-p+1 個 p 和其它的 p 呈二段式遞減

Page 18: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

18

1|| 1,|| ,

:)1,1(

111111 tttt ZZ

ARMA

2k ,

,

11

2-1

))(1(1

1

112

1

1111

kk

ACF 與 PACF 皆漸漸消失型 (damped exponentially or sine-wave)

1

Page 19: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

19

Page 20: 1 ARMA model Let ε t be white noise process, Z t be a stationary series. white noise : 純雜訊 ε t ~ NID( 0, σ 2 ) ARMA model 又稱為 Box-Jankin model , 1970 年代推出,

20

Table Behavior of the acf and pacf for ARMA model

Model acf Pacf

MA(q) 時差 q 之後切斷 指數或正弦函數式漸漸消失

AR(p) 指數或正弦函數式漸漸消失 時差 p 之後切斷

ARMA(p,q) 指數或正弦函數式漸漸消失 指數或正弦函數式漸漸消失