cortana analytics overview · 替换带库 microsoft confidential - signed nda required • 1080p...

典型应用场景

杨旭

2017年 1月

Microsoft Confidential - Signed NDA Required

Stream analytics

Document DB

Redis Cache

OLTP DB

SQL DW

OLAP DB

Blob Premium Storage

Blob page

Blob storage

Blob file

Blob Cold


替换带库

• 1080P

• 24*7 on

• 6 cameras per branch office

• 40 branches office in a city

……

• 1.8G/Hour

• 43G/Day

• 15T/Year

• 95T/Branch

• 3.8PB/City！

HP MSL Tape Library

• 10T 10W RMB

• 3800W /Year!

• +Manual Management

• +space of storage

• +Unreliable storage

Azure Blob-cold LRS

• 0.11/GB*Month

• 1.3/GB*Year

• 500W /Year!

• +network traffic expense

• +4M Express Route


4


6


Deve

lop Developer IDE

Team CollaborationB

uild

+ T

est Build/CI

Test

Dep

loy Release/CD

Mo

nito

r +

Learn Monitor

On-Premises | Hybrid | Cloud

Microsoft Tooling


Deve

lop Developer IDE

Team CollaborationB

uild

+ T

est Build/CI

Test

Dep

loy

Mo

nito

r +

Learn Monitor

OSS Tooling

Configuration

Release

On-Premises | Hybrid | Cloud

*Operated by 21Vianet

Microsoft’s network is one of the largest in the world

Microsoft Power BI

Power BI dashboard

Blob Storagebatch

streamed

HDI, Machine Learning

HDI(Hadoop service on Azure)

Azure DW(数据仓库)

Azure Data Factory(ETL Service on Azure): Move Data, Orchestrate, Schedule & Monitor

Data in Motion

Data at Rest

Diagnostic Events Event Hub(实时数据采集）

ASA（数据流分析)

AML（机器学习）

Power BI Dashboards（前端分析/展现)

Data Sources Ingest Prepare(normalize, clean, etc.)

Analyze(build dim model, ML, etc.)

Publish(for consumption, for BI/visualization) Consu

me

Consume

Vehicle Catalogue

Solution architecture diagram

ASA（数据流分析)

Business ConnectivityData Processing, Analytics and ManagementDevice Connectivity and Management

Low power devices

Existing IoTdevices

IoT Client

Solution UX

Provisioning API

Device Registry

Stream Processors

Analytics &

Machine Learning

Business

Integration

Connectors

and

Gateway(s)

Device State Store

Gateway

Storage

Cloud

Gateway

App Backend

IoT Client

Personal mobile devices

IP capable devices

IoT Client

Business systems

Data Path

Optional solution component

Azure IoT solution component

Azure IoT Reference Architecture

Azure 物联网

转化数据为智能行为

Action

People

Automated Systems

Apps

Web

Mobile

Bots

Intelligence

Dashboards &

Visualizations

Cortana

Bot Framework

Cognitive Services

Power BI

Information

Management

Event Hubs

Data Catalog

Data Factory

Machine Learning

and Analytics

HDInsight (Hadoop and

Spark)

Stream Analytics

Intelligence

Data Lake Analytics

Machine Learning

Big Data Stores

SQL Data Warehouse

Data Lake Store

Data Sources

Apps

Sensors and devices

Data

www.botframework.com

Bot 框架是一个 Microsoft-operated 服务也是一个 SDK.

Bot 框架是微软提供编写bot机器人的众多技术之一

其他技术: LUIS(语义理解), Speech APIs(语音识别技术), Azure, more

Bot 对话逻辑

后端逻辑代码

Web Service(web服务）

LUIS（语义理解服务）

Open source SDKs make it possible

to bring your bot to life in minutes

Connect your bot to any or all of the

top conversational experiences to

reach >1B users

Make your bot discoverable via Bing,

Cortana and other Microsoft

surfaces

Microsoft Bot 框架的组成部分

一套帮助开发者轻松添加智能服务的API，SDK，app，

例如向应用中增加视觉或者语言功能

认知服务–为您的应用添加智能服务

微软认知服务: 理解世界的智能API

视觉语言搜索知识语音

理解您应用中的数据

图像分析基于所输入图像的视觉内容分析出图像的视觉特征

光学字符识别在图像中检测并识别文本

生成缩略图生成高品质和高存储效率的缩略图

计算机视觉 API

图片分析图片类型:

Clip Art Type 0 Non-clipart

Line Drawing Type 0 Non-Line Drawing

Black & White Image False

图片内容:

Adult Content False

Adult Score 0.18533889949321747

Faces [{ “age”: 27, “gender”: “Male”, “faceRectangle”: {“left”: 472, “top”: 258, “width”: 199, “height”: 199}}]

Tags [ { "name": "water", "confidence": 0.9996442794799805 },

{ "name": "sport", "confidence": 0.9504992365837097 },

{ "name": "swimming", "confidence": 0.9062818288803101, "hint": "sport" },

{ "name": "pool", "confidence": 0.8787588477134705 },

{ "name": "water sport", "confidence": 0.631849467754364, "hint": "sport" } ]

图片色值:

Dominant Color Background White

Dominant Color Foreground Grey

Dominant Colors White

Accent Color

光学字符识别LIFE IS LIKERIDING A BICYCLETO KEEP YOUR BALANCEYOU MUST KEEP MOVING

JSON:{"language": "en","orientation": "Up","regions": [{"boundingBox": "41,77,918,440","lines": [{"boundingBox": "41,77,723,89","words": [{"boundingBox": "41,102,225,64","text": "LIFE"},{"boundingBox": "356,89,94,62","text": "IS"},{"boundingBox": "539,77,225,64","text": "LIKE"}

. . .

已支持功能:• 扫描图片• 含有文本的图片• 纹理致密的位置信息

有待增强功能• 机动车牌照• 手写文本• 超大文本识别

智能缩略图

Smart Cropping Off开启智能缩略功能

人脸检测检测图片中的人脸并识别属性

人脸验证核对两张人脸是否属于同一个人

相似人脸搜索从多张人脸中找出与所查人脸相似的人脸

人脸识别 API

人脸分组根据识别的人脸进行分组

人脸辨识查询某张人脸，与提供的数据中的何人相匹配

人脸识别 API

检测"faceRectangle": {"width": 193, "height": 193, "left": 326, "top": 204}

…

属性特征"attributes": { "age": 42, "gender": "male",

"headPose": { "roll": "8.2", "yaw": "-37.8", "pitch": "0.0" }}

辨识Jasper Williams

分组

识别情感基于面部表情来检测感情

情感识别 API

情感识别 API

人脸检测"faceRectangle": {"width": 193, "height": 193, "left": 326, "top": 204}

…

情感指数“scores": { "anger": 5.182241e-8,

"contempt": 0.0000242813,

"disgust": 5.621025e-7,

"fear": 0.00115027453,

"happiness": 1.06114619e-8,

"neutral": 0.003540177,

"sadness": 9.30888746e-7,

"surprise": 0.9952837}

语音API

语音识别 (语音转文本)将语音转换为文本

语音输出(文本转语音)将文本合成语音

说话者ID & Diarisation即将上线

语音识别

音频时长 < 15秒 < 2分钟

最终结果 n-best模式 Best模式并在语音结束时输出

部分结果支持支持

语音识别短模式长模式

通过POST请求将文本合成为语音

最长支持15秒

支持17种语言

语音输出

<speak version="1.0" xmlns="http://www.w3.org/2001/10/synthesis" xmlns:mstts="http://www.w3.org/2001/mstts" xml:lang="en-US"><voice name="Microsoft Server Speech Text to Speech Voice (en-US, ZiraRUS)">

Synthesize audio from text, to speak to your users.

</voice></speak>

声纹验证检测两个声音是否来自于同一个人

声纹辨识辨识出谁正在说话

声纹识别 API

微软最先进的拼写检查算法，以云平台为基础检测及识别多种拼写错误

拼写检查 API

在上下文语境中识别常用名称错误能更正上下文中的同形同音异义词及其他难以识别的错误

与时俱进支持不断涌现的新生品牌名称及其他创造性表达式

拼写检查 API

检查单个词语或者整个句子“Our engineers developed this four you!”

Corrected Text: “four” “for”

标识错误并提供修改建议"spellingErrors": [

{ "offset": 5, "token": "gona", "type": "UnknownToken", "suggestions": [

{ "token": "gonna" } ] }

语言理解智能服务

理解用户所说的话使用来自Bing和Cortana的预构的模型或者自己创建的模型

用交互的特征来减少贴标签的工作

使用可视化来测量和提升性能

与语音识别服务的无缝集成

几个样例就足以搭建自己的应用，并自主学习


{“entities”: [

{“entity”: “flight_delays”,“type”: “Topic”

}],“intents”: [

{“intent”: “FindNews”,“score”: 0.99853384

},{

“intent”: “None”,“score”: 0.07289317

},{

“intent”: “ReadNews”,“score”: 0.0167122427

},{

“intent”: “ShareNews”,“score”: 1.0919299E-06

}]

}


Bot Extend Cortana Conversational Interface

Your Business Logic

Your Web service

Dialog Skills

MS Cognitive Services

LUIS Translator …Bing APIs

Azure帮助客户构建并扩展一流的云应用

客户物理机房环境在Azure上的内网延伸部署• 测试和开发:按需启用• 数据备份、存档、恢复• 灾备：以极低成本实现快速高效灾备

大数据和商业智能• 网站监测平台• 用户画像、数字化精准

营销• 实时大数据分析支持销

售预测、库存管理

企业级应用

• Microsoft Workloads• SAP Workloads• Oracle Workloads

企业面向to C互联网业务

• Web应用：官方网站、微信平台接入、移动应用

• 电子商务• 媒体分享、E-Learning

Active Directory

SharePoint SQL Server

MicrosoftAzure

容灾备份开发测试分支机构（特别是海外）网站电商培训以及其他办公应用大数据IOTBOT智能

离互联网近的原来就是微软应用的大规模访问（2C或大量员工）有明显峰值的快速创新的借助暗黑科技创新的

cortana analytics overview · 替换带库 microsoft confidential - signed nda required • 1080p...

Documents