bigdata2012nlp okanohara

40
規模・速・精な 然語処をえる技術 岡野原 株式会社Preferred Infrastructure [email protected] 2012/12/6@情報処学会連続セミナー: ビッグデータ時代の然語処

Upload: preferred-infrastructure-preferred-networks

Post on 24-May-2015

25.422 views

Category:

Documents


1 download

DESCRIPTION

2012/11/19 情報処理学会連続セミナー「ビッグデータとスマートな社会」の第5回:ビッグデータに立ち向かう機械学習での講演資料です。

TRANSCRIPT

2. Preferred Infrastructurel PFIl l 20063l 26l 113-0033 2-40-1l l /, , l 2 3. Preferred Infrastructurel 2623/l //l ////l ICPC = 7l 5l TopCoderl l Hadoop, l , Haskel, , UI/UX3 4. l l l l l Bazil l Jubatus4 5. 6. (1/3) l l twitter60% l 61% 39%201050%http://semiocast.com/publications/2011_11_24_Arabic_highest_growth_on_Twitter 7. 2/3l l c.f. LINEl l l l l 8. 3/3)l NLPl l l Google50l 9. (1/4)l Google, MS//l 45%202040l 10. (2/4)l SNS l Twitter : 100 tweets / , 5.17 useractive 1.4*1 l Facebook : 1200 message /, >10 user *2 l LINE : 300 message / , 7500 user*3l l Peer reviewed Journal 135 article / *4 l 410%, 152 l conference proceedings *1 http://weekly.ascii.jp/elem/000/000/084/84331/*2 http://qconlondon.com/dl/qcon-london-2011/slides/KannanMuthukkaruppan_HBaseFacebook.pdf*3 http://www.slideshare.net/sunsuk7tp/hbase-at-line*4 http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2909426/ 10 11. (3/4)l l l SNS, l l l l SNSl , 11 12. (4/4)l l Google N-gram, Wikipedia, twitterl *1 l English Wikipedia l Wikipedia l wikipedia l 312.9 - l *1 A Cross-Lingual Dictionary for English Wikipedia Concepts, V. I. Spitkovsky, A. X. Chang, LREC 2012http://www-nlp.stanford.edu/pubs/crosswikis-data.tar.bz2/12 13. 13 14. l l l Googlel l Social News Curator pull push twitter Social News Curator 15. Prismaticl l l 15 16. 16 17. ttweet17 18. tweet18 19. apple 19 20. l Crowsnest l l Facebook l EdgeRank EdgeRank = * * l 20 21. l l l l l l l l l l 21 22. NLP22 23. l NLPl l l l ECl l l 23 24. l l c.f. IBM Watsonl l Google Flu http://www.google.org/utrends/about/how.html 24 25. l :l l octopart l 25 26. Octpart 26 27. ECl Amazonl ECGooglel ECl ECAmazonZOZOTOWN l NLPl l l l l 28. l l l l IPSl l l 29. l l push l l l , l l l linkedin 30. l l l l l 100 BI l FastMSAutonomy (HPEndecaOraclel l 31. l l tweet/l l l ( 32. Bazil 32 33. Bazil: l ASPl l ExcelBazil Excel NLP 34. Bazill l R&DR&D etc etc 35. Bazil Farm (1) Tweet:20Tweet10-19l 10-19ameblol 10-1910-19()35 36. Bazil Farm (2) Tweet:20Tweet20-29l 20-29l 20-29 20-29() 37. Bazil Farm (3) Tweet:Tweetl l 38. Bazil Farm(4): 38 39. l l , l l l l l Bazil : l ASPl Jubatus: l 39 40. Copyright 2006-2012 Preferred Infrastructure All Right Reserved.