第二讲 自然语言处理和信息抽取 - ianlpr-web.ia.ac.cn/cip/english/~junzhao... ·...

Download 第二讲 自然语言处理和信息抽取 - IAnlpr-web.ia.ac.cn/cip/english/~junzhao... · 主要内容 第一课09:00-10:00信息抽取 第二课10:20-11:30观点挖掘和倾向性分析

If you can't read please download the document

Upload: others

Post on 26-Sep-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

  • 21

  • 09:00- 10:00

    10:20- 11:30

    14:00- 15:00

    15:20- 16:20

    16:30- 17:00

  • (1/2)

    www.google.com.hk

  • (2/2)

  • (Grishman, 1997)

    Making information more machine-readable (Wu, 2010)

  • 2011 4 11 17 16 7.0

    36.9 140.7 30

    10 30

    7.0

    36.9 140.7

    10km

    30

    30

  • (1/2)

    70

    80

    JASPER

  • (2/2)MUC Message Understanding Conferences, 1987-1997

    DARPA

    ACE Automatic Content Extraction, 1999-2008

    NIST

    2009 ACE TAC Text Analysis Conference

    TAC-KBP(Knowledge Base Population) (2009- )

  • Web

    1987-1993 MUC1-MUC5

    ( )

    1995-1997 MUC6-MUC7

    ( )

    1999 ACE-Pilot----

    ACE-1

    2002 ACE2

    2003-2007 ACE2003-

    ACE2007

    2009-2011 TAC1-TAC3 Web

  • 2011 4 11 17 16

    7.0

    36.9 140.7

    30

    10

    30

    2011 4 11 17 16

    7.0

    36.9 140

    .7 30

    10

    30

  • MEMM HMM CRF

  • MUC SigHAN CoNLL IEER ACE

    MUC-6 MUC-7

    MUC-6 MUC-7 MET

    SigHAN 2003 BAKEOFF 2006

    2008 BAKEOFF-3 BAKEOFF-4

    2003 2004 863

  • Language Technology Group Summary

    MUC-7

    95% 92%

    2006

  • MET-2

    (66% 92%) (89% 91%)

    (89% 88%) 2006

  • BAKEOFF-3

    P R F ORG-

    F

    LOC-F PER-F GPE-F

    MSRC Closed 0.8894 0.8420 0.8651 0.8310 0.8545 0.9009 ~

    Open 0.9220 0.9018 0.9118 0.8590 0.9034 0.9604 ~

    LDC Closed 0.8026 0.7265 0.7627 0.6585 0.3046 0.7884 0.8204

    Open 0.7616 0.6621 0.7084 0.5209 0.2857 0.7422 0.7930

    CITY

    U

    Closed 0.9143 0.8676 0.8903 0.8046 0.9211 0.9087 ~

    Open 0.8692 0.7498 0.8051 0.6801 0.8604 0.8098 ~

    MSRC 1.3M/63K / 100K/13K /

    LDC 632K 61K

    CITYU 1.6M/76K / 220K/23K /

    (Levow, 2006 )

  • 863

    ORG LOC PER

    P R F P R F P R F

    SXU .646

    4

    .5741 .6081 .8702 .7843 .8251 .8138 .8847 .8478

    CITYU .398

    6

    .2532 .3097 .6839 .7004 .6921 .3986 .2532 .3097

    /

    SXU NONE 400K

    CITYU NONE 400K

  • BAKEOFF-3 MSRC BAKEOFF-3 CITYUBAKEOFF-3 LDC

    863

    BAKEOFF-3 MSRC CITYUBAKEOFF-3 LDC

    863

    BAKEOFF-3 MSRC BAKEOFF-3CITYU

  • V8088 6

  • < >

    <

    Input

    Output

  • Step1

    Step2

    ()

    ()

  • : Query Log (Pasca CIKM 2007)

  • : Web Page (Wang

    ICDM 2007) (1/2)

    Motivation

  • : Web Page (Wang ICDM 2007) (2/2)

    Fetcher

    100

    Extractor

    Ranker

    Random Walk

  • :

    (Pennacchiotti EMNLP 2009)

    6

    1

    Wikipedia

  • Wang 2007 12

  • Michael Jordan

    MJ1: Michael Jordan is a researcher in machine learning.

    MJ2: Learning in Graphical Models: Michael Jordan

    MJ3: M. Jordan wins NBA MVP.

    MJ4 : Michael Jordan plays basketball in Chicago Bulls.

  • MJ1: Michael Jordan is a researcher in machine learning.

    MJ2: Research in Graphical Models: Michael Jordan

    MJ3: M. Jordan wins NBA MVP.

    MJ4 : Michael Jordan plays basketball in Chicago Bulls

    MJ4 : Michael Jordan plays basketball in Chicago Bulls

  • (Bagga et al., 1998)

    (Pederson et al., 2005)

    (Bekkerman et al., 2005)

    (Han and Zhao, 2009)

    (Han and Zhao, 2010)

  • :

    (Bagga et al., 1998)

    MJ1: Mi chael Jor dan i s a r esear cher i n machi nel ear ni ng.

    MJ1: Mi chael Jor dan pl ays basket bal l i n Chi cago Bul l s

    MJ1 r esear cher machi ne l ear ni ng

    MJ4 pl ays basket bal l Chi cago Bul l s

  • :

    (Pederson et al., 2005)

    SVD

  • :

    (Bekkerman et al., 2005)

    MJ BasketBall

    MJ Machine Learning

  • : Wikipedia(Han CIKM 2009) (1/3)

    Wikipedia

    GlobalizationBank

    CapitalismDependency

    theory

    Illegal

    immigrationTrade

    MasterCard

    Overnight

    rate

    World

    BankMergers &

    Aquisitions

    Assets

    inflation

    Mixed

    economy

    Debit card

    Financial

    market

    Automated teller

    machine

    Human

    migration

    European

    Union

    Corporation

    Accenture

    Division of

    labour

    Imperialism

    Colonization

  • : Wikipedia (Han CIKM 2009) (2/3)

    MJ1: Michael Jordan is a Researcher in machine learning.

    MJ2: Research in Graphical Models: Michael Jordan

    MJ1

    MJ2

    Researcher(0.42) Machine learning(0.54)

    Graphic model(0.51)Research(0.47)

    MJ1 Researcher Machine learning

    MJ2 Research Graphic model

  • (Han CIKM 2009) (3/3)

    WePS

    10.7%

  • :

    (Han ACL 2010) (1/3)Wikipedia

    Wikipedia

    WordNet

    Web

  • :

    (Han ACL 2010) (2/3)

  • :

    (Han ACL 2010) (3/3)

    WePS

  • (1/2)

    WePS Web People Search EvaluationWePS1 SEMEVAL2007

    WePS2 WWW workshop

    Web

  • (2/2)

    WePS 1 WePS 2

  • Michael Jordan is a former NBA player, active businessman and majority owner of the Charlotte Bobcats.

    Michael Jordan (basketball player)Michael Jordan (mycologistMichael Jordan (footballer)

    Michael B. JordanMichael H. Jordan

    Michael- Hakim JordanMichael Jordan (Irish polotician )

  • Wikipedia

  • Wikipedia

    Wikipedia

    Michal Jordan is a former NBA player

    Wikipedia

    Wikipedia

  • (Zhang IJCAI 2011)

    KBP2009

    3904 827

    ABC American Broadcasting Company AIArtificial Intelligence

  • BOW (Honnibal TAC 2009, Bikel TAC 2009)

    Bunescu et al., 2006

    Han et al., 2011

    Cucerzan, 2007

    Kulkarni et al., 2009

    Han et al., 2011

  • (Honnibal

    TAC 2009, Bikel TAC 2009)

  • (Bunescu EACL 2006)

    SVM

    Wikipedia

    Williams has also composed

    numerous classical concerti, and he

    served as the principal conductor of

    the Boston Pops Orchestra from

    1980 to 1993

    John Williams (composer)

    John Williams (wrestler)

    John Williams (VC)

    music

  • Han ACL 2011

    e P(e) e

    s e P(s|e)

    c e P(c|e)

  • During his standout career at ,

    also acts in the movie Space Jam .Jordan

    Bulls

  • Pairwise

    Cucerzan, 2007

    Kulkarni KDD 2009

  • Han SIGIR 2011

    Pairwise

    Referent Graph

    VSM

  • (1/2)

    TAC-KBP (2009-Now) Entity LinkingWikipedia

  • (2/2)

    2009

    2009

    2010

    2009 VS. 2010

  • Alexander Schutz

    Example1: CEO

    CEO( , )

    Example2: CMU

    Located-in(CMU, )

    Michael Jordan 1997/98 MVP

    Award(Michael Jordan, 1997/98 , MVP)

  • MUC, ACE, KBP

  • ACE