oracle confidential – internal/restricted/highly restricted...
TRANSCRIPT
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
产教融合,实践为王
Oracle Confidential – Internal/Restricted/Highly Restricted 2Oracle Confidential – Internal/Restricted/Highly Restricted 2
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 3
当前
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 3
企业
历史
必备技术,但不够充分
公共数据
供应商提供
客户生成
新数据越来越多存储在数据湖中
全数据
现代商业成功要求组织能高效地使用所有数据
Oracle Confidential – Internal/Restricted/Highly Restricted 3
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 4
大数据生态
组织
实验
操作化
处理 治理存储管理
机器学习
图
空间
公共
流数据
企业数据
数据服务
业务分析
企业应用
准备 分析数据供应商
数据消费者
数据基础设施
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 4Oracle Confidential – Internal/Restricted/Highly Restricted 4
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016, Oracle and/or its affiliates. All rights reserved. |
高校大数据专业要培养行业专才而不是一个科研项目
5Oracle Confidential – Internal/Restricted/Highly Restricted 5
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 6Oracle Confidential – Internal/Restricted/Highly Restricted 6
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Oracle Confidential – Internal/Restricted/Highly Restricted7Oracle Confidential – Internal/Restricted/Highly Restricted 7
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Oracle大数据市场发展状况
Oracle Confidential – Internal/Restricted/Highly Restricted 8
Public Stories我们经过授权可以将这些成功的案例与大家分享,有些涉及私密的信息会进行一些屏蔽(比如空中客车的厂商Logo等)
Oracle Confidential – Internal/Restricted/Highly Restricted 9
Copyright © 2017, Oracle and/or its affiliates. All rights reserved.
使用Oracle大数据解决方案提升用户体验
10Copyright © 2017, Oracle and/or its affiliates. All rights reserved. Oracle Confidential – Internal/Restricted/Highly Restricted10
Copyright © 2017, Oracle and/or its affiliates. All rights reserved.
使用大数据分析大幅增加销量
CUSTOMER PERSPECTIVEThe implementation of this Big Data solution will help CaixaBank remain at the forefront of innovation in the financial sector.Juan-Maria Nin, CEO
11Oracle Confidential – Internal/Restricted/Highly Restricted11
Copyright © 2017, Oracle and/or its affiliates. All rights reserved.
加速产品测试周期,A320机型快速投放市场
Copyright © 2017, Oracle and/or its affiliates. All rights reserved. 12Oracle Confidential – Internal/Restricted/Highly Restricted12
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
大数据价值体现
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 13Oracle Confidential – Internal/Restricted/Highly Restricted 13
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 14
根植于产业融合
大数据价值体现
Oracle Confidential – Internal/Restricted/Highly Restricted 14
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 15
大数据流
数据资本
业务调整 业务运营
Oracle Confidential – Internal/Restricted/Highly Restricted 15
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 16
大数据架构
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
大数据管理
大数据分析 大数据应用程序
大数据聚合
数据资本
连接和治理所需数据
简化对所有数据的访问
快速的发现和预测
数据驱动的行动
Oracle Confidential – Internal/Restricted/Highly Restricted 16
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
大数据专业建设误区解读
• 大数据是传统数据仓库技术、数据挖掘和商业智能的扩展和延伸,各有优势
• 全数据收集、分析、决策形成新的产业模型和社会分工
• 关于大数据的四大误区:• 大数据学习是技术驱动• 任何大数据人才培养都从基础架构
学起,要培养完整的大数据人才• 数据科学 OR 数据工程• 为互联网公司培养 OR 为所有相关
企业培养
Oracle Confidential – Internal/Restricted/Highly Restricted 17
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 18
• ETL、爬虫技术
• 物联网技术
• 传输
• 实时数据流
应用数据
社交媒体
传感器
数据供应商
聚合
Oracle Confidential – Internal/Restricted/Highly Restricted 18
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
• 分析的前提是整合为统一格式
• 绝大多数大数据聚合多为传统关系型数据库
• 技术成熟• 难度较小
• 关系型数据库人才需求增长
Oracle Confidential – Internal/Restricted/Highly Restricted 19
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 20
• 关系型, Hadoop, NoSQL
• 分布式系统
• 无缝, 安全, 授权的访问
• 快速, 可靠
管理
安全
性能
访问
管理
Oracle Confidential – Internal/Restricted/Highly Restricted 20
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
• 深度学习
• 数据挖掘
• 业务分析师和数据科学家
可视化叙述
数据服务
应用程序
辅助决策
分析分析
管理
聚合
挖掘 分析
发现预测
Oracle Confidential – Internal/Restricted/Highly Restricted 21Oracle Confidential – Internal/Restricted/Highly Restricted 21
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 22
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 23
* Bundled with other Cloud Services
应用程序 分析管理聚合
Big Data PreparationGoldenGateIoT Stream Explorer*
Big DataBig Data SQLNoSQL DatabaseOracle Database
Data VisualizationBusiness IntelligenceSpatial and Graph*Advanced Analytics*R on Hadoop*
Big Data DiscoveryR on Hadoop*Stream Explorer*
Oracle Confidential – Internal/Restricted/Highly Restricted 23
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
大数据运维工程师 数据科学家 业务分析师大数据开发
工程师
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 24Oracle Confidential – Internal/Restricted/Highly RestrictedOracle Confidential – Internal/Restricted/Highly Restricted
24
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
能力画像
• 熟练掌握Linux
• 深入理解分布式系统Hadoop、Spark
• 硬件维护技能:网络、存储、搭建大数据服务技能
• 硬件配置经验:根据业务需求和上层应用参考配置参数
• 低风险操作最佳实践
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 25
快速部署大数据产品
确保安全的管理所有的数据
多平台协同操作
现场、云端、移动端
Oracle Confidential – Internal/Restricted/Highly Restricted 25
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
能力画像
• 熟练掌握Linux操作系统
• 分布式多线程应用程序开发能力
• Java泛型、Scala、Python、R、SQL
• 理解Hadoop或spark等分布式系统
理解多数据类型,能够进行数据准备
理解数据分析师需求,并且能够开发相应应用
预测和提供硬件需求参数,为硬件工程师提供参考
26Oracle Confidential – Internal/Restricted/Highly RestrictedOracle Confidential – Internal/Restricted/Highly Restricted
26
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
深入理解业务模型
赋予大量用户的自服务能力
使用数据实验室完成实验
能力画像
• 熟练使用分析工具
• 熟练掌握至少一种脚本语言 Python、SQL…
• 获得新的可视化和洞察模型
• 具备和LOB用户沟通和共享分析结果的能力
27Oracle Confidential – Internal/Restricted/Highly RestrictedOracle Confidential – Internal/Restricted/Highly Restricted
27
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 28
具有基于MapReduce/Spark
开发大数据应用的能力
理解行业需求,能够将之转化为数学模型
专注于数据分析而非数据维护
能力画像
• 具有一定使用数据挖掘算法进行数据分析的能力
• 了解大数据系统的基本搭建和调优方法
• 了解大数据的发展趋势和应用领域
Oracle Confidential – Internal/Restricted/Highly Restricted 28
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 29
Copyright © 2016, Oracle and/or its affiliates. All rights reserved.
大数据专业建设首要问题:务实的培养目标
30
培养 全才是大多数高校制定培养计划的误区,行业内务实的大数据人才是专才
Oracle Confidential – Internal/Restricted/Highly Restricted 30
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |Oracle Confidential – Internal/Restricted/Highly Restricted 31
IT技术:具备完善的大数据构建和维护技能,从而搭建大数据计算平台
数学、统计学知识:具备数学科学的思想、熟练掌握统计学方法、建立数学模型的初步能力
行业知识:金融、电子商务、健康医疗等专业知识,明白可以获取哪些数据,需要解决什么问题
大数据专业建设的核心问题:内容设计-交叉学科中的专业设计
Big Data
数学与应用数学统计学
计算机科学与技术软件工程信息工程
金融学工商管理电子商务医学统计学…
Oracle Confidential – Internal/Restricted/Highly Restricted 31
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
大数据专业建设要避免的问题:避免孤岛建设-综合建设
设备利用率
教材适配理论课教案
课题 案例嵌入项目案例
兼顾其他院系基础课和专业课
软件正版化
作业
专业理论课
操作指南
论文
• 轻架构设计,重产品功能• 轻软件资源,重硬件设备• 轻师资培养,重内容获取
信息中心/教务处 学生 课程内容 老师 实验室
32Oracle Confidential – Internal/Restricted/Highly Restricted 32
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 33
建设目标
完整 包括实验课、理论课和教师科研等使用场景,交付所需的全部内容
根据高校的申报专业或者专业课的课时和难度需求进行定制
所有知识点基于项目需求反向拆解得来
所有交付内容数字化,可用于MOOC或校内的教学平台
案例由Oracle与企业完成的商业案例为背景,保证真实性
项目驱动
定制化
数字化
行业最佳实践
Oracle Confidential – Internal/Restricted/Highly Restricted 33
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 34
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
大数据专业建设目标:非虚而全,是实且专
Oracle Confidential – Internal/Restricted/Highly Restricted 35
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. |
关注本专业在大数据生态中
最有价值的部分
(Don’t assemble information, take advantage of it)Oracle Confidential – Internal/Restricted/Highly Restricted 36
Copyright © 2015, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 37Oracle Confidential – Internal/Restricted/Highly Restricted 37