典型应用场景
杨旭
2017年 1月
Microsoft Confidential - Signed NDA Required
Stream analytics
Document DB
Redis Cache
OLTP DB
SQL DW
OLAP DB
Blob Premium Storage
Blob page
Blob storage
Blob file
Blob Cold
Microsoft Confidential - Signed NDA Required
替换带库
• 1080P
• 24*7 on
• 6 cameras per branch office
• 40 branches office in a city
……
• 1.8G/Hour
• 43G/Day
• 15T/Year
• 95T/Branch
• 3.8PB/City!
HP MSL Tape Library
• 10T 10W RMB
• 3800W /Year!
• +Manual Management
• +space of storage
• +Unreliable storage
Azure Blob-cold LRS
• 0.11/GB*Month
• 1.3/GB*Year
• 500W /Year!
• +network traffic expense
• +4M Express Route
Microsoft Confidential - Signed NDA Required
4
Microsoft Confidential - Signed NDA Required
Microsoft Confidential - Signed NDA Required
6
Microsoft Confidential - Signed NDA Required
Deve
lop Developer IDE
Team CollaborationB
uild
+ T
est Build/CI
Test
Dep
loy Release/CD
Mo
nito
r +
Learn Monitor
On-Premises | Hybrid | Cloud
Microsoft Tooling
Microsoft Confidential - Signed NDA Required
Microsoft Confidential - Signed NDA Required
Deve
lop Developer IDE
Team CollaborationB
uild
+ T
est Build/CI
Test
Dep
loy
Mo
nito
r +
Learn Monitor
OSS Tooling
Configuration
Release
On-Premises | Hybrid | Cloud
Microsoft Confidential - Signed NDA Required
*Operated by 21Vianet
Microsoft’s network is one of the largest in the world
Microsoft Power BI
Power BI dashboard
Blob Storagebatch
streamed
HDI, Machine Learning
HDI(Hadoop service on Azure)
Azure DW(数据仓库)
Azure Data Factory(ETL Service on Azure): Move Data, Orchestrate, Schedule & Monitor
Data in Motion
Data at Rest
Diagnostic Events Event Hub(实时数据采集)
ASA(数据流分析)
AML(机器学习)
Power BI Dashboards(前端分析/展现)
Data Sources Ingest Prepare(normalize, clean, etc.)
Analyze(build dim model, ML, etc.)
Publish(for consumption, for BI/visualization) Consu
me
Consume
Vehicle Catalogue
Solution architecture diagram
ASA(数据流分析)
Business ConnectivityData Processing, Analytics and ManagementDevice Connectivity and Management
Low power devices
Existing IoTdevices
IoT Client
Solution UX
Provisioning API
Device Registry
Stream Processors
Analytics &
Machine Learning
Business
Integration
Connectors
and
Gateway(s)
Device State Store
Gateway
Storage
Cloud
Gateway
App Backend
IoT Client
Personal mobile devices
IP capable devices
IoT Client
Business systems
Data Path
Optional solution component
Azure IoT solution component
Azure IoT Reference Architecture
Azure 物联网
Microsoft Confidential - Signed NDA Required
转化数据为智能行为
Action
People
Automated Systems
Apps
Web
Mobile
Bots
Intelligence
Dashboards &
Visualizations
Cortana
Bot Framework
Cognitive Services
Power BI
Information
Management
Event Hubs
Data Catalog
Data Factory
Machine Learning
and Analytics
HDInsight (Hadoop and
Spark)
Stream Analytics
Intelligence
Data Lake Analytics
Machine Learning
Big Data Stores
SQL Data Warehouse
Data Lake Store
Data Sources
Apps
Sensors and devices
Data
www.botframework.com
Bot 框架是一个 Microsoft-operated 服务也是一个 SDK.
Bot 框架是微软提供编写bot机器人的众多技术之一
其他技术: LUIS(语义理解), Speech APIs(语音识别技术), Azure, more
Bot 对话逻辑
后端逻辑代码
Web Service(web服务)
LUIS(语义理解服务)
Open source SDKs make it possible
to bring your bot to life in minutes
Connect your bot to any or all of the
top conversational experiences to
reach >1B users
Make your bot discoverable via Bing,
Cortana and other Microsoft
surfaces
Microsoft Bot 框架的组成部分
一套帮助开发者轻松添加智能服务的API,SDK,app,
例如向应用中增加视觉或者语言功能
认知服务–为您的应用添加智能服务
微软认知服务: 理解世界的智能API
视觉 语言 搜索知识语音
理解您应用中的数据
图像分析基于所输入图像的视觉内容分析出图像的视觉特征
光学字符识别在图像中检测并识别文本
生成缩略图生成高品质和高存储效率的缩略图
计算机视觉 API
图片分析图片类型:
Clip Art Type 0 Non-clipart
Line Drawing Type 0 Non-Line Drawing
Black & White Image False
图片内容:
Adult Content False
Adult Score 0.18533889949321747
Faces [{ “age”: 27, “gender”: “Male”, “faceRectangle”: {“left”: 472, “top”: 258, “width”: 199, “height”: 199}}]
Tags [ { "name": "water", "confidence": 0.9996442794799805 },
{ "name": "sport", "confidence": 0.9504992365837097 },
{ "name": "swimming", "confidence": 0.9062818288803101, "hint": "sport" },
{ "name": "pool", "confidence": 0.8787588477134705 },
{ "name": "water sport", "confidence": 0.631849467754364, "hint": "sport" } ]
图片色值:
Dominant Color Background White
Dominant Color Foreground Grey
Dominant Colors White
Accent Color
光学字符识别LIFE IS LIKERIDING A BICYCLETO KEEP YOUR BALANCEYOU MUST KEEP MOVING
JSON:{"language": "en","orientation": "Up","regions": [{"boundingBox": "41,77,918,440","lines": [{"boundingBox": "41,77,723,89","words": [{"boundingBox": "41,102,225,64","text": "LIFE"},{"boundingBox": "356,89,94,62","text": "IS"},{"boundingBox": "539,77,225,64","text": "LIKE"}
. . .
已支持功能:• 扫描图片• 含有文本的图片• 纹理致密的位置信息
有待增强功能• 机动车牌照• 手写文本• 超大文本识别
智能缩略图
Smart Cropping Off开启智能缩略功能
人脸检测检测图片中的人脸并识别属性
人脸验证核对两张人脸是否属于同一个人
相似人脸搜索从多张人脸中找出与所查人脸相似的人脸
人脸识别 API
人脸分组根据识别的人脸进行分组
人脸辨识查询某张人脸,与提供的数据中的何人相匹配
人脸识别 API
检测"faceRectangle": {"width": 193, "height": 193, "left": 326, "top": 204}
…
属性特征"attributes": { "age": 42, "gender": "male",
"headPose": { "roll": "8.2", "yaw": "-37.8", "pitch": "0.0" }}
辨识Jasper Williams
分组
识别情感基于面部表情来检测感情
情感识别 API
情感识别 API
人脸检测"faceRectangle": {"width": 193, "height": 193, "left": 326, "top": 204}
…
情感指数“scores": { "anger": 5.182241e-8,
"contempt": 0.0000242813,
"disgust": 5.621025e-7,
"fear": 0.00115027453,
"happiness": 1.06114619e-8,
"neutral": 0.003540177,
"sadness": 9.30888746e-7,
"surprise": 0.9952837}
语音API
语音识别 (语音转文本)将语音转换为文本
语音输出(文本转语音)将文本合成语音
说话者ID & Diarisation即将上线
语音识别
音频时长 < 15秒 < 2分钟
最终结果 n-best模式 Best模式并在语音结束时输出
部分结果 支持 支持
语音识别短模式 长模式
通过POST请求将文本合成为语音
最长支持15秒
支持17种语言
语音输出
<speak version="1.0" xmlns="http://www.w3.org/2001/10/synthesis" xmlns:mstts="http://www.w3.org/2001/mstts" xml:lang="en-US"><voice name="Microsoft Server Speech Text to Speech Voice (en-US, ZiraRUS)">
Synthesize audio from text, to speak to your users.
</voice></speak>
声纹验证检测两个声音是否来自于同一个人
声纹辨识辨识出谁正在说话
声纹识别 API
微软最先进的拼写检查算法,以云平台为基础检测及识别多种拼写错误
拼写检查 API
在上下文语境中识别常用名称错误能更正上下文中的同形同音异义词及其他难以识别的错误
与时俱进支持不断涌现的新生品牌名称及其他创造性表达式
拼写检查 API
检查单个词语或者整个句子“Our engineers developed this four you!”
Corrected Text: “four” “for”
标识错误并提供修改建议"spellingErrors": [
{ "offset": 5, "token": "gona", "type": "UnknownToken", "suggestions": [
{ "token": "gonna" } ] }
语言理解智能服务
理解用户所说的话使用来自Bing和Cortana的预构的模型或者自己创建的模型
用交互的特征来减少贴标签的工作
使用可视化来测量和提升性能
与语音识别服务的无缝集成
几个样例就足以搭建自己的应用,并自主学习
语言理解智能服务
{“entities”: [
{“entity”: “flight_delays”,“type”: “Topic”
}],“intents”: [
{“intent”: “FindNews”,“score”: 0.99853384
},{
“intent”: “None”,“score”: 0.07289317
},{
“intent”: “ReadNews”,“score”: 0.0167122427
},{
“intent”: “ShareNews”,“score”: 1.0919299E-06
}]
}
语言理解智能服务
Bot Extend Cortana Conversational Interface
Your Business Logic
Your Web service
Dialog Skills
MS Cognitive Services
LUIS Translator …Bing APIs
Azure帮助客户构建并扩展一流的云应用
客户物理机房环境在Azure上的内网延伸部署• 测试和开发:按需启用• 数据备份、存档、恢复• 灾备:以极低成本实现快速高效灾备
大数据和商业智能• 网站监测平台• 用户画像、数字化精准
营销• 实时大数据分析支持销
售预测、库存管理
企业级应用
• Microsoft Workloads• SAP Workloads• Oracle Workloads
企业面向to C互联网业务
• Web应用:官方网站、微信平台接入、移动应用
• 电子商务• 媒体分享、E-Learning
Active Directory
SharePoint SQL Server
MicrosoftAzure
Microsoft Confidential - Signed NDA Required
容灾备份开发测试分支机构(特别是海外)网站电商培训以及其他办公应用大数据IOTBOT智能
离互联网近的原来就是微软应用的大规模访问(2C或大量员工)有明显峰值的快速创新的借助暗黑科技创新的