批踢踢的立場語言分析與偵測

Yvonne Chuang

Outline

• Background

• Research Question

• Stance and Persuasion

• Methodology

• Result and Discussion

• Q&A

Background of this study

• “Social media have become a fact of life for civil society worldwide, involving many actors– regular citizens, activists, nongovernmental organizations, telecommunications firms, software providers, governments.” (Shirky, 2015)

• “Public debate functions as a forum for both expressing and forming opinions.” (Walker et al., 2012)

• Development of technology and social media have enable citizens more control over the information they get and the opinions being shared and being formed.

Research Goals

• Establish lexical resources for arguing and subjective language

• Utilizing these resources in classifying opinionated texts online

Stance and Persuasion

Stance

• Stance, subjectivity, and evaluation may refer to the same concept

• (Englebretson, 2007)

• “the lexical and grammatical expression of attitudes, feelings, judgments, or commitment concerning the propositional content of a message”

• (Biber and Finegan, 1989)

• “personal feelings, attitudes, value judgments, or assessments”

• (Biber et al., 1999)

Evaluation

• “evaluation is the broad cover term for the expression of the speaker or writer’s attitude or stance towards, viewpoint on, or feelings about the entities or propositions that he or she is talking about. That attitude may relate to certainty or obligation or desirability or any of a number of other sets of values.”

• (Thompson and Hunston, 2000)

Persuasion

• Conscious behavior that involves two parties (Tidwell, 1994)

• A successful intentional effort at influencing another’s mental state through communication in a circumstance in which the persuade has some measure of freedom (O’Keefe, 1990)

• A symbolic activity whose purpose is to effect the internalization or voluntary acceptance of new cognitive states or patterns of overt behavior through the exchange of messages (Smith, 1982)

Argument

• Two opposing parties, each asserting themselves to be right and often pointing out the wrongness of the opposing view (Cobb and Kulklinski, 1997; Kuhn, 1991)

• Involves managing competing claims (Antaki, 1994; Coulter, 1990; Goodwin, 1983)

• Justifying an opinion or refuting an opinion Although in practice could be a monologue, but should be interpreted dialogically (Eemeren and Grootendorst, 1980)

• Stance: “an overall position held by a person toward an object, idea, or proposition”

• (Somasundaran and Wiebe, 2009)

• Arguing: “where a person is arguing for or against something or expressing a belief about what is true, should be true or should be done is his or her view of the world”

• (Wilson and Wiebe, 2005; Wilson, 2007; Somasundaran et al., 2008)

Methodology

• Extracting PTT comments

• Manual annotation on subjective elements

• Adding the new lexicon as features to train the classifier, and use relative frequency of the words in the dataset as features

• Classifying the texts using an SVM classifier

PTT Corpus

Data Collection

Board Time span Number of comments

Number of words

Number of tokens

Gossiping 6 months Push: 3786034Boo: 1222735

Push: 28341656Boo: 9000728

Push: 1153842Boo: 493926

WomenTalk 12 months Push: 998327Boo: 53376

Push: 10006638Boo:508778

Push: 462780Boo:66186

Boy_Girl 12 months Push: 167473Boo:36381

Push: 1655771Boo: 354672

Push:121794Boo:47904

Types of articles

• Feelings/ experience- sharing articles[ 心情 ] 我做了椰子雪花糕 (WomenTalk)

• Discussion oriented articles[ 問題 ] 食物掉在桌上，會拿起來吃嗎？ (WomenTalk)[ 問卦 ] 老師薪水真的很高嗎？ (Gossiping)

• Advice-seeking articles[ 討論 ] 分手後聽甚麼歌最療傷？ (Boy_Girl)[ 求助 ] 對女生來說甚麼才算幽默？ (Boy_Girl)

• Advice-giving articlesRe:[ 求助 ] 很想一起出國但女友不行 (Boy_Girl)

Types of reply (Reynolds and Wang, 2014)

• Questions

• Reply

• Clarification

• Interpretation

• Conflict

• Assertion

• Judgement

• Support

• Other

Annotation Scheme

• Private state is a general term that covers mental and emotional states, which cannot be directly observed or verified (Quirk et al., 1985)

• In natural language, opinions, emotions and other private states are expressed using subjective language (Banfield, 1982; Wiebe, 1994)

Annotation Scheme

• Multi-perspective Question Answering Annotation Scheme, MPQA(Wiebe et al., 2005; Wilson, 2008)

• Direct subjective frames

• Expressive subjective element frames

• Objective speech event frames

• Agent frames

Tagging set

• Arguing (including explicit subjective cues):

• 1. answering [ 有你真好， PS. 我愛你，真愛每一天 ] [ 找一個小空地 瘋狂繞圈 直線七秒早點去考場練 ]

• 2. confirming [ 同意這篇還有推文 ] [ 我也會 吵架男友會拎雞排來和好 ~]

• 3. recommending/suggesting [ 說錢花完了或是行李箱裝不下來拒絕他吧！ ]

Tagging set

• 4. sympathizing/encouraging[ 原 PO 辛苦了加油 ]

• 5. counter-arguing[ 你怎麼知道是先劈腿在故意製造糾紛還是有糾紛才劈腿？ ][ 我持相反意見 N3 以上去念 能學到的有限 ]

• 6. clarifying[ 你爸爸這樣是錢奴，不是企業家… ][ 重點會被放在態度是因為原 PO 一開始 PO 文是想戰房東態度差 ]

Tagging set

• Subjective (Expressive subjective element):

• 1. Positive evaluation[ 想認識樓上 ][ 一樓神回 我也有想過 ]

• 2. Negative evaluation [ 火星人請快回火星比較好 ~][H&M 破布等級 ]

Lexical Resources (Feature Set)

• Tagged chunks and words from the dataset

• C-LIWC positive emotion words and negative emotion words (Huang et al., 2012)

• MPQA arguing cues (Somasundaran et al., 2007)

• MPQA subjectivity lexicon (Wilson et al., 2005)

• Relative frequency of the occurring words ( > 0.7 )

Result

Accuracy

WomenTalk 0.55 0.75 0.55 0.63

Boy_Girl 0.57 0.73 0.57 0.64

Gossiping 0.69 0.69 0.69 0.69Accuracy

WomenTalk 0.75 0.75 0.75 0.75

Boy_Girl 0.70 0.70 0.70 0.70

Gossiping 0.67 0.67 0.67 0.67

1. Diversity of Topics2. Differences in Language Use

3. Coverage of the Annotated Data

Accurate Examples

• 戰力 等於 零 回去 練練 再來 吧 可憐人• 幹 只有 我 覺得 有 男友 還 常常 跟 男生 出去 很 怪 嗎 ？ • 現在 還 會唱 爆走 兄弟 的 歌 XDD

• 跪求 可愛 的 點 在 哪裡 • 我也是 我 是 晚上 洗頭 出門 前洗 劉海 我 是 先用 滋潤 洗髮精

BOO

BOO

PUSH

BOO

PUSH

Evaluation targetsComment Origina

l tagClassified result

覺得 你 已經 很 放下 身段 討好 她 了 她 怎麼 那麼 難搞

Push Boo

劈腿 也 劈 的 太 明顯 了 ， 把 妳 當 阿呆 喔

Push Boo

Context dependentComment Origina

l tagClassified result

很 不 喜歡 那 種 婚前 就 在 說 離婚 後 怎樣 怎樣 的 人

Push Boo

沒 水準 Push Boo

天啊 Boo Push

SarcasmComment Origina

l tagClassified result

加油 ^ _ ^ Boo Push

當了 鄉民 這麼多 年 ， 我 終於 搶到 頭噓 了 好 感動 qwq

Boo Push

河蟹 好吃 boo push Boo Push

大師 ， 什麼 時候 要 出來 選舉 阿 ？ Boo Push

Intentionally VagueComment Origina

l tagClassified result

圍巾 醜 原 PO ＿ 二 結案 Boo Push

甘吟釀 的 欠噓 ~ ~ ~ Boo Push

好 的 小 一 儿 Push Boo

讓給 剩蚊 好 嗎 別 讓 他 不 開心 Boo Push

Others

Comment Original tag

Classified result

推 投幣式 女友 XD Boo Push

Conclusion

Thank You!!!!