20160813 102-59-kim youngwook
TRANSCRIPT
Python으로IoT(Internet of Things), Cognitive, Machine Learning 3종 셋트 활용하기
김영욱 EvangelistMicrosoft / DX / 부장[email protected]
War of IT
https://github.com/KoreaEva/Python.git
Microsoft LOVE ♥
Microsoft ♥ Open Source
PTVS(Python Tools for Visual Studio)
NTVS(Node.js Tools for Visual Studio)RTVS(R Tools for Visual Studio)
PHP Tools for Visual StudioVisual C++ for Linux
Microsoft is Open Source
Microsoft ♥ Python
Sensors on
Linux (Rasberian)
SQL Database Machine Learning
Power BIStream AnalyticsIoT Hubs
Blob / Table
Cognitive Services
Microsoft Cognitive Services
IoT Service
Machine Learning
Visual Studio Code
http://visualstudio.com
Cognitive Servicehttp://www.Microsoft.com/cognitive
Microsoft Cognitive Services Give your apps a human side
VisionFrom faces to feelings, allow your apps to understand images and video
SpeechHear and speak to your users by filtering noise, identifying speakers, and understanding intent
LanguageProcess text and learn how to recognize what users want
KnowledgeTap into rich knowledge amassed from the web, academia, or your own data
SearchAccess billions of web pages, images, videos, and news with the power of Bing APIs
Cognitive Services
Apps Powered by MS Cognitive Services
ProjectMurphy.netCaptionBot.ai
I think it’s a person sitting in front of a computer and he seems ☺. I am 99% sure that’s Bill Gates
Celebslike.me
Roll your own with REST APIs Simple to add: just a few lines of code required
Make the same API code call on iOS, Android, and Windows Integrate into the language and platform of your choice
Built by experts in their field from Microsoft Research, Bing, and Azure Machine Learning Quality documentation, sample code, and community support
Easy Flexible Tested
GET A KEY
BUILD
Why Microsoft Cognitive Services ?
Cognitive Services
Emotion Speaker Recognition
Speech
Custom RecognitionComputer Vision
Face
Video
microsoft.com/cognitive
SearchSpeech Language KnowledgeVision
Linguistic Analysis
Language Understanding
Bing Spell Check
Entity Linking
Knowledge Exploration
Academic Knowledge
Bing Image Search
Bing Video Search
Bing Web Search
WebLM
Text Analytics Recommendations
Bing Autosuggest
Bing News SearchTranslator
Cognitive Services
Emotion Speaker Recognition
Speech
Custom RecognitionComputer Vision
Face
Video
SearchSpeech Language KnowledgeVision
Linguistic Analysis
Language Understanding
Bing Spell Check
Entity Linking
Knowledge Exploration
Academic Knowledge
Bing Image Search
Bing Video Search
Bing Web Search
WebLM
Text Analytics Recommendations
Bing Autosuggest
Bing News SearchTranslator
microsoft.com/cognitive
{Subscription Key}
JSON• http://www.json.org/json-ko.html
Vision APIComputer VisionEmotionFace
Demo
LanguageBing Spell checkLanguage UnderstandingLinguistic AnalysisText Analytics WebLM
Demo
BingBing Web SearchBing Image SearchBing Video SearchBing News SearchBing Autosuggest
Bing beyond search in bing.comSmarter, more
engaging experiences
Trusted by industry-leading experiences
Introducing Bing Search API v5
Web Search
Image Search
Video Search
News Search
Autosuggest
Spell Check
Search API v5
REST
Enhanced Search and Filtering Capabilities
Ongoing Improvements and Support
Web- Scale
High Performance
Secure (HTTPs)
Web Search APIWeb Search API
*screenshots show actual search results on bing.com
https://bingapis.azure-api.net/v5/search?q=nasa
Get relevant web and answer results and metadata with one API call
{ “_type”: “SearchResponse”, “queryContent”: {…}, “webPages”: {…}, “news”: {…}, “images”: {…}, “videos”: {…}, “relatedSearches”: {…}, “rankingResponse”: {…} }
{ “answerType”:”WebPages”, “resultIndex”:0,… }, { “answerType”:”News”, “resultIndex”:1,… }
Ranking Response
Search Response
Web Results
Deep Links
(1st Algo)
News Results
Image Results
Video Results
Related Searches
Vertical Search APIshttps://bingapis.azure-api.net/v5/images/search?q=shuttle+launch
• Enhanced metadata and filters (size, license, style, freshness, color) • Image insights (entity recognition, visually similar)
Image Search API
source: nasa.gov
https://bingapis.azure-api.net/v5/videos/search?q=viral+videos
• Enhanced metadata and filters (price, resolution, length, freshness)
• Motion thumbnails (video preview)
https://bingapis.azure-api.net/v5/news/search?q=cuba
• News by category/market, and trending news • Rich article metadata (featured entities)
source: youtube.com
Video Search API
*screenshots show actual search results in bing.com
Get more results, features and metadata tailored to each search vertical
News Search API
source: cnn.com
Demo
• Sign up and get started today for free at
www.microsoft.com/cognitive
Developer Call to Action
Internet of Thingshttp://www.microsoft.com/iot
Sensors on
Linux (Rasberian)
SQL Database Machine Learning
Power BIStream AnalyticsIoT Hubs
Blob / Table
Cognitive Services
Microsoft Cognitive Services
IoT Service
Machine Learning
• 지원되는 프로토콜은 HTTP1.1, MQTT, AMQP 1.0 (16년 4월 OPC 공식지원 발표)• LWM2M, CoAP 등의 지원은 계획 중이나 시기 미정
IoT Hub
Stream Analysis
Sensors on
Linux (Rasberian)
SQL Database Machine Learning
Power BIStream AnalyticsIoT Hubs
Blob / Table
Cognitive Services
Microsoft Cognitive Services
IoT Service
Machine Learning
Machine Learninghttp://www.microsoft.com/iot
Microsoft & Machine Learning15 years of realizing innovation
SQL Server enables
data mining
Computers work on
users behalf, filtering junk
Microsoft Kinect can
watch users gestures
Microsoft launches
Azure Machine Learning
Microsoft search engine
built with machine learning
Bing Maps ships with ML
traffic-prediction service
Successful, real-time, speech-to-
speech translation
John Platt, Distinguished scientist at Microsoft Research
1999 201220082004 201420102005
Machine learning is pervasive throughout Microsoft products.“ ”
One solution for Machine Learning - from data to results
Azure Portal
Azure Ops Team
ML Studio
Data Scientist
HDInsight
Azure Storage
Desktop Data
Azure Portal & ML API service
Azure Ops Team
PowerBI/Dashboards
Mobile AppsWeb Apps
ML API service Developer
Machine Learning
Data I/O
Taking Data & preparing for AnalysisDimensionality reduction. E.g. Kinect measures 1000 points, 6 are relevantFitting Model selection; calibration; assessment
R – free scripts/graphics, many packages based on Vector Data.
Metrics to allow us to describe the data. E.g. Mean, Correlation…
Tools used for Text Input. E.g. ‘What is the theme of this essay?’