XGBoost

JSAI Cup 2017

2015 4

n :

n STAIR Captions: ACL2017 short paper

n STAIR Actions ( ):

• NEDO

n

• NLP CV

JSAI Cup

n

n

JSAI Cup

n

n

n

XGBoost

n 58

n

4

n :

n

10

n :

n 2012/01/01 – 2013/6/30500km

n

n

5

301: 7

: 5

n (5 ): 2 -4 , 5 -10 , 11 -17 , 18 -22 , 23 -1

: 55 5 = 275

n 5 (55 )one-hot

: 2

n ID.

: 2

n

6

: 2

n

: 3

n

: 4

n (CG)3

: 1

n

1

(

n XGBoost (Gradient Tree Boosting) v0.60 https://github.com/dmlc/xgboost

: 3

n XGBoost 1: 3 XGBoost

n XGBoost 2: XGBoost 1 4(5 4=20 )

n :

XGBoost1

XGBoost2

+0.3

0.3

0.4

t+1

t

J S A

n

XGBoost

n XGBoost (log loss) = 0.1985

n XGBoost + (log loss) = 0.1922

n 1-fold 15-fold XGBoost

: 10000n

J S

1.

n

2.

n

3.

n

4.

n

• Log loss

•

Log loss ( )

benchmark ( ) 1.38629

0.21121

+ 0.20698 (+2.00%)

+ 0.20113 (+2.82%)

+ 0.20089 (+0.12%)

+ , 0.19972 (+0.58%)

+ 0.19949 (+0.11%)

+ 0.19958 (-0.04%)

+ 0.19841 (+0.59%)

1: XGBoost Log loss ( )

• 6/20

• 20

2: XGBoost 1 Top-20

0.00 0.01 0.02 0.03 0.04 0.05 0.06 0.07 0.08 0.09 0.10

(uchibou, )( )( )

(keiyou, )(uchibou, )

(keihintohoku, )(keiyou, )

(keihintohoku, )( )( )

(keihintohoku, )(keiyou, )

( )( )

(uchibou, )( )( )

(tyuou, )(keihintohoku, )

( )

1.

n

2.

n ( )

3.

n

4.

n 1 2 Top-20 0

B C

n XGBoost 3

n

9

n

n XGBoost