Microsoft
Cognitive
Services
讓您的 Apps 了解圖片與影片的內容
讓您的 Apps 過濾雜訊可以辨識說話者是誰? 並了解用戶的意圖
文字語意分析,讓 Apps 了解用戶文字的意涵
彙整來自互聯網,學術研究與您自己所累積的知識與資料
Access billions of web pages, images, videos, and news with the power of Bing APIs
microsoft.com/cognitive
情緒辨識
Bing 語音辨識
電腦視覺
人臉辨識
microsoft.com/cognitive
理解人類語言 LUIS
Bing 網頁搜尋
https://www.microsoft.com/cognitive-services/en-us/bing-web-search-api
微軟核心服務 全球重要合作夥伴
REST
強化搜尋與過濾能力
持續投資與增進能力
全球等級 高效能支援 HTTPs
*screenshots show actual search results on bing.com
https://bingapis.azure-api.net/v5/search?q=nasa
{
“_type”: “SearchResponse”,
“queryContent”: {…},
“webPages”: {…},
“news”: {…},
“images”: {…},
“videos”: {…},
“relatedSearches”: {…},
“rankingResponse”: {…}
}
{
“answerType”:”WebPages”,
“resultIndex”:0,…
},
{
“answerType”:”News”,
“resultIndex”:1,…
}
Ranking Response
Search Response
Web
Results
Deep
Links(1st Algo)
News
Results
Image
Results
Video
Results
Related
Searches
https://bingapis.azure-api.net/v5/images/search?q=shuttle+launch
• 支援多種過濾條件(尺寸, 版權, 色彩, 過濾成人內容…等)• Image insights (相似圖片,相關搜尋… 等)
source: nasa.gov
https://bingapis.azure-api.net/v5/videos/search?q=viral+videos
• 支援多種過濾條件 (影片解析度,長度… 等)• 影片預覽圖片
https://bingapis.azure-api.net/v5/news/search?q=cuba
• 新聞分類• 豐富之metadata (美國區域)
source: youtube.com
*screenshots show actual search results in bing.com
source: cnn.com
GET https://bingapis.azure-api.net/v5/search?q=nasa HTTP/1.1
OCP-Apim-Subscription-Key: <API KEY>
Start coding
microsoft.com/cognitive
https://www.microsoft.com/cognitive-services/en-us/bing-web-search-api
https://www.microsoft.com/cognitive-services/en-us/computer-vision-api
Computer Vision API - V1 持續強化功能
圖片內容:
圖片分類 v0: [{ “name”: “animal”, “score”: 0.9765625 }]
V1: [{ "name": "grass", "confidence": 0.9999992847442627 },
{ "name": "outdoor", "confidence": 0.9999072551727295 },
{ "name": "cow", "confidence": 0.99954754114151 },
{ "name": "field", "confidence": 0.9976195693016052 },
{ "name": "brown", "confidence": 0.988935649394989 },
{ "name": "animal", "confidence": 0.97904372215271 },
{ "name": "standing", "confidence": 0.9632768630981445 },
{ "name": "mammal", "confidence": 0.9366017580032349, "hint": "animal" },
{ "name": "wire", "confidence": 0.8946959376335144 },
{ "name": "green", "confidence": 0.8844101428985596 },
{ "name": "pasture", "confidence": 0.8332059383392334 },
{ "name": "bovine", "confidence": 0.5618471503257751, "hint": "animal" },
{ "name": "grassy", "confidence": 0.48627158999443054 },
{ "name": "lush", "confidence": 0.1874018907546997 },
{ "name": "staring", "confidence": 0.165890634059906 }]
圖片英文描述0.975 "a brown cow standing on top of a lush green field“
0.974 “a cow standing on top of a lush green field”
0.965 “a large brown cow standing on top of a lush green field”
Start coding
microsoft.com/cognitive
https://www.luis.ai/
{“entities”: [
{“entity”: “flight_delays”,“type”: “Topic”
}],“intents”: [
{“intent”: “FindNews”,“score”: 0.99853384
},{
“intent”: “None”,“score”: 0.07289317
},{
“intent”: “ReadNews”,“score”: 0.0167122427
},{
“intent”: “ShareNews”,“score”: 1.0919299E-06
}]
}
“News about flight delays”
LUIS 語言理解模型https://www.luis.ai/
提供互動式模型訓練工具漸少標示關鍵實體成本
可以整合 Cognitive Services Speech API 與 Bot Framework
呼叫內容自動保存,可日後持續訓練與學習
支援五種語言 (英文,中文, 義大利文, 法文, 西班牙文)
語言理解模型
模型訓練工具支援中文
Bot Framework 是微軟公司所提供簡化製作文字對話機器人的框架,目前支援Skype, Slack, Office 365 mail 未來將支援其他受歡迎之服務
Bot Framework 內建支援 C# 與 node.js,所有 API 皆為 REST API 能與任何支援HTTP 通訊協定之程式語言界接
整合 Microsoft Cognitive Services 之 LUIS, Speech APIs 將能使機器人更具智慧
Your conversation logic
文字處理邏輯
Web service
Microsoft Cognitive Services
LUIS
您所撰寫之對話機器人
Bot
https://dev.botframework.com/
Start coding
microsoft.com/cognitive
https://www.microsoft.com/cognitive-services/en-us/speech-api
en-US
en-GB
de-DE
es-ES
fr-FR
it-IT
zh-TW
Intelligent Services Made Easy
語音時間長短 < 15 秒 < 2 分鐘
轉換成果 n-best 可供選擇 句子停頓處提供最佳選擇
********* Final N-BEST Results *********
[0] Confidence=Normal Text="450 six St San Francisco."
[1] Confidence=Normal Text="For 50 six St San Francisco."
[2] Confidence=Normal Text="456th St San Francisco."
[3] Confidence=Normal Text="450 six St in San Francisco."
[4] Confidence=Normal Text="456 St San Francisco."
語音辨識模型 Voice Recognition Modes
Short Form Long Form
450 6th St. San Francisco
支援 REST API與特定平台函式庫
real-time streaming
Start coding
microsoft.com/cognitive
www.microsoft.com/cognitive
azure.com
https://social.msdn.microsoft.com/forums/azure/en-us/home?forum=mlapi