using cloud natural language api as a preprocessor

12
Using Cloud Natural Language API as a Preprocessor NL APIを前処理に使ってみよう〜 GCPUG Machine Learning Day Nov. 1, 2017 Hayato Yoshikawa

Upload: hayato-yoshikawa

Post on 21-Jan-2018

358 views

Category:

Technology


2 download

TRANSCRIPT

Using Cloud Natural Language API as a Preprocessor〜NL APIを前処理に使ってみよう〜

GCPUG Machine Learning DayNov. 1, 2017Hayato Yoshikawa

Hi there!

● Hayato Yoshikawa @hayatoy @hayatoy82

● Publication!今月末に「Google Cloud Platformでは

じめる機械学習・深層学習」という本が

出ます!

Demo

Let’s play a sentiment analysis game!

Rules

● Split into Team A and B

● Submit POSITIVE sentences

● Team A must submit sentences of GCP

● Team B must submit sentences of

AWS

● No matter English or Japanese

Examples“Cloud Functionsはサーバーレスで簡単! ”

“S3で静的ウェブサイトがすぐ作れる! ”

Main Screen& Presenter

Team A(GCP)

Team B(AWS) Entrance →

Billiards ↓

Had fun?https://github.com/hayatoy/nl-bubble

Thanks for your contribution…TO MAKE DATASET! :D

みなさんの投稿は学習データとして使わせてもらいました ^p^

Web App

Architecture of the Demo

Front-end Web AppApp Engine

FirebaseRealtime DB

Cloud NaturalLanguage API

Front-end Web AppApp Engine

Insert rowsvia REST API

Get sentiment analysis result

BigQuery

CloudDatalab

Insert rowsvia REST API

Cloud NaturalLanguage API

Classifying the Category of Sentence

GAEはインスタンスの立ち上がりがとても速い!

Which category is this sentence?

GCP? or AWS?

Vectorizing Sentences

GAEはインスタンスの立ち上がりがとても速い!

GAE instance spin up time is very fast!

Easy as pie.. Just split by space.

No space! Complex kana suffixes!

Syntax Analysis with Cloud NL API

✓ Easy to extract words✓ No dictionary needed✓ No special knowledge needed

Demo

Check my gist:https://gist.github.com/hayatoy

Thank you!