flame: probabilistic model combining aspect based opinion mining and collaborative filtering

18
WDSM WU&ESTER 2015 1 Thursday, May 14, 15

Upload: yuta-kashino

Post on 06-Aug-2015

253 views

Category:

Software


0 download

TRANSCRIPT

Page 1: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

WDSMWU&ESTER 2015

1

Thursday, May 14, 15

Page 2: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

WHO

•バクフー株式会社 柏野 雄太

Thursday, May 14, 15

Page 3: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

読んだ論文

• FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

• Yao Wu / Matin Ester

• collaborative filtering -> opinion mining

• large geo DB -> spatial data mining

• Review Mining using LDA like method

Thursday, May 14, 15

Page 4: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

動機

Thursday, May 14, 15

Page 5: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

動機

• webの世界にはレビューが溢れているが,沢山ありすぎて全部読めない

•同じ対象でも意見は各人多様のプリファレンスを持つので容易に扱えない

•それでもレビューは意思決定に役に立つはずだ

Thursday, May 14, 15

Page 6: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

先行研究• Collaborative Filtering + LDA (science articles)

• Wang & Blei 2011

↵ ✓ z w �

r�v

�u u

N K

J

I

v

rij ⇠ N (uTi vj , c

�ij1)

✓j ⇠ Dirichlet(↵) wjn ⇠ Mult(�zjn)

rij 2 {0, 1}

r : overall rating

v : latent item distribution

u : latent user preference

Thursday, May 14, 15

Page 7: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

先行研究• Aspect-based Opinion Mining (hotel review)

• Wang et al. 2010

µ

�2 �

s wr

DK

r : overall rating

s : aspect rating

Thursday, May 14, 15

Page 8: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

ASPECT?

• location, sleep quality, room, service, value, cleanliness

Thursday, May 14, 15

Page 9: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

提案モデル

Thursday, May 14, 15

Page 10: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

提案モデル�i,a �u

'd,a

✓d

rd

⌘0 ⌘u ⌘i

st

at

wn

�a

�a,rW

T

D

A

A

IU

UI

R

A

p(wn|at, st,↵) ⇠ Multi(↵at,st)

↵a,s[j] =exp(�a[j] + �a,s[j])PVl=1 exp(�a[l] + �a,s[l])

rd ⇠ N (X

a

✓d[a]E[rd, a],�2r)

E[rd, a] = �Tu�i,a

Thursday, May 14, 15

Page 11: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

提案モデル�i,a �u

'd,a

✓d

rd

⌘0 ⌘u ⌘i

st

at

wn

�a

�a,rW

T

D

A

A

IU

UI

R

A

p(wn|at, st,↵) ⇠ Multi(↵at,st)

↵a,s[j] =exp(�a[j] + �a,s[j])PVl=1 exp(�a[l] + �a,s[l])

rd ⇠ N (X

a

✓d[a]E[rd, a],�2r)

E[rd, a] = �Tu�i,a

潜在ユーザ選好

語-アスペクトの相関

語,アスペクト,評価の相関

文ごとのアスペクト

文ごとの評価

アスペクトごとの評価分布

評価分布

評価の出やすさの潜在変数

アスペクト分布

Thursday, May 14, 15

Page 12: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

生成プロセス

Thursday, May 14, 15

Page 13: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

LIKELIFOOD• MAP

•変分ベイズ

{{⌘}, {�},�, �}

{↵, s}

Thursday, May 14, 15

Page 14: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

実験と結果 データ

• TripAdvisor / Yelp

Thursday, May 14, 15

Page 15: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

実験と結果 PERPLEXITY

• FLAMEがアウトパフォーム

TripAdvisor Yelp

LDA-A

LDA-AR

D-LDA

FLAME

1012.80 767.24

918.07 728.00

771.05 621.24

733.12 590.46

Thursday, May 14, 15

Page 16: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

実験と結果 PREDICTION

• TripAdvisorアスペクト評価予測

PMF LRR+PMF FLAME

RMSE 0.970 1.000 0.980

N/A 0.110 0.195

0.304 0.177 0.333

0.210 0.238 0.196

⇢A

⇢I

L0/1

Pearson correlation inside reviews ⇢A =

1

D

AX

d=1

⇢(sd, s⇤d)

Pearson correlation pers.ed ranking ⇢I =

1

UA

UX

u=1

AX

d=1

⇢(sIu,a , s⇤Iu,a

)

Thursday, May 14, 15

Page 17: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

実験と結果 質的評価�a �a,r

Thursday, May 14, 15

Page 18: FLAME: Probabilistic Model Combining Aspect Based Opinion Mining and Collaborative Filtering

将来の応用 アスペクト分布•ユーザごとのレビュー推薦

•推薦の理由付け

Thursday, May 14, 15