microsoft cognitive services: build smarter and more...
TRANSCRIPT
Microsoft
Cognitive
Services
讓您的 Apps 了解圖片與影片的內容
讓您的 Apps 過濾雜訊可以辨識說話者是誰? 並了解用戶的意圖
文字語意分析，讓 Apps 了解用戶文字的意涵
彙整來自互聯網，學術研究與您自己所累積的知識與資料
Access billions of web pages, images, videos, and news with the power of Bing APIs
microsoft.com/cognitive
情緒辨識
Bing 語音辨識
電腦視覺
人臉辨識
microsoft.com/cognitive
理解人類語言 LUIS
Bing 網頁搜尋
https://www.microsoft.com/cognitive-services/en-us/bing-web-search-api
微軟核心服務 全球重要合作夥伴
REST
強化搜尋與過濾能力
持續投資與增進能力
全球等級 高效能支援 HTTPs
*screenshots show actual search results on bing.com
https://bingapis.azure-api.net/v5/search?q=nasa
{
“_type”: “SearchResponse”,
“queryContent”: {…},
“webPages”: {…},
“news”: {…},
“images”: {…},
“videos”: {…},
“relatedSearches”: {…},
“rankingResponse”: {…}
}
{
“answerType”:”WebPages”,
“resultIndex”:0,…
},
{
“answerType”:”News”,
“resultIndex”:1,…
}
Ranking Response
Search Response
Web
Results
Deep
Links(1st Algo)
News
Results
Image
Results
Video
Results
Related
Searches
https://bingapis.azure-api.net/v5/images/search?q=shuttle+launch
• 支援多種過濾條件(尺寸, 版權, 色彩, 過濾成人內容…等)• Image insights (相似圖片，相關搜尋… 等)
source: nasa.gov
https://bingapis.azure-api.net/v5/videos/search?q=viral+videos
• 支援多種過濾條件 (影片解析度,長度… 等)• 影片預覽圖片
https://bingapis.azure-api.net/v5/news/search?q=cuba
• 新聞分類• 豐富之metadata (美國區域)
source: youtube.com
*screenshots show actual search results in bing.com
source: cnn.com
GET https://bingapis.azure-api.net/v5/search?q=nasa HTTP/1.1
OCP-Apim-Subscription-Key: <API KEY>
Start coding
microsoft.com/cognitive
https://www.microsoft.com/cognitive-services/en-us/bing-web-search-api
https://www.microsoft.com/cognitive-services/en-us/computer-vision-api
Computer Vision API - V1 持續強化功能
圖片內容:
圖片分類 v0: [{ “name”: “animal”, “score”: 0.9765625 }]
V1: [{ "name": "grass", "confidence": 0.9999992847442627 },
{ "name": "outdoor", "confidence": 0.9999072551727295 },
{ "name": "cow", "confidence": 0.99954754114151 },
{ "name": "field", "confidence": 0.9976195693016052 },
{ "name": "brown", "confidence": 0.988935649394989 },
{ "name": "animal", "confidence": 0.97904372215271 },
{ "name": "standing", "confidence": 0.9632768630981445 },
{ "name": "mammal", "confidence": 0.9366017580032349, "hint": "animal" },
{ "name": "wire", "confidence": 0.8946959376335144 },
{ "name": "green", "confidence": 0.8844101428985596 },
{ "name": "pasture", "confidence": 0.8332059383392334 },
{ "name": "bovine", "confidence": 0.5618471503257751, "hint": "animal" },
{ "name": "grassy", "confidence": 0.48627158999443054 },
{ "name": "lush", "confidence": 0.1874018907546997 },
{ "name": "staring", "confidence": 0.165890634059906 }]
圖片英文描述0.975 "a brown cow standing on top of a lush green field“
0.974 “a cow standing on top of a lush green field”
0.965 “a large brown cow standing on top of a lush green field”
Start coding
microsoft.com/cognitive
{“entities”: [
{“entity”: “flight_delays”,“type”: “Topic”
}],“intents”: [
{“intent”: “FindNews”,“score”: 0.99853384
},{
“intent”: “None”,“score”: 0.07289317
},{
“intent”: “ReadNews”,“score”: 0.0167122427
},{
“intent”: “ShareNews”,“score”: 1.0919299E-06
}]
}
“News about flight delays”
LUIS 語言理解模型https://www.luis.ai/
提供互動式模型訓練工具漸少標示關鍵實體成本
可以整合 Cognitive Services Speech API 與 Bot Framework
呼叫內容自動保存，可日後持續訓練與學習
支援五種語言 (英文,中文, 義大利文, 法文, 西班牙文)
語言理解模型
模型訓練工具支援中文
Bot Framework 是微軟公司所提供簡化製作文字對話機器人的框架，目前支援Skype, Slack, Office 365 mail 未來將支援其他受歡迎之服務
Bot Framework 內建支援 C# 與 node.js，所有 API 皆為 REST API 能與任何支援HTTP 通訊協定之程式語言界接
整合 Microsoft Cognitive Services 之 LUIS, Speech APIs 將能使機器人更具智慧
Your conversation logic
文字處理邏輯
Web service
Microsoft Cognitive Services
LUIS
您所撰寫之對話機器人
Bot
https://dev.botframework.com/
Start coding
microsoft.com/cognitive
https://www.microsoft.com/cognitive-services/en-us/speech-api
en-US
en-GB
de-DE
es-ES
fr-FR
it-IT
zh-TW
Intelligent Services Made Easy
語音時間長短 < 15 秒 < 2 分鐘
轉換成果 n-best 可供選擇 句子停頓處提供最佳選擇
********* Final N-BEST Results *********
[0] Confidence=Normal Text="450 six St San Francisco."
[1] Confidence=Normal Text="For 50 six St San Francisco."
[2] Confidence=Normal Text="456th St San Francisco."
[3] Confidence=Normal Text="450 six St in San Francisco."
[4] Confidence=Normal Text="456 St San Francisco."
語音辨識模型 Voice Recognition Modes
Short Form Long Form
450 6th St. San Francisco
支援 REST API與特定平台函式庫
real-time streaming
Start coding
microsoft.com/cognitive
www.microsoft.com/cognitive
azure.com
https://social.msdn.microsoft.com/forums/azure/en-us/home?forum=mlapi