adriano amaral - novas tendências
TRANSCRIPT
![Page 1: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/1.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Big, Fast e Opendata Transformando dados em ouro
1
MSEE, Adriano Amaral [email protected] Big Data & Data Science
1
![Page 2: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/2.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
“Na era da Internet, nós não podemos confrontar os desafios do futuro, fazendo as coisas que fazíamos a 20 anos atrás”
Executivo do CaixaBank quando da implementação do “data pool” e
experiência do usuário laboratório
2
Inspiração
![Page 3: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/3.jpg)
3
Não vim para explicar… mas sim pra confundir!
![Page 4: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/4.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 4
Os alquimistas estão chegando….
![Page 5: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/5.jpg)
O Alquimista…
![Page 6: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/6.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 6
Cidadãos Demanda de novos serviços
Governos e Empresas Adaptação para atender as necessidades
Slide, Arturo Muente-Kunigami
@n0wh3r3m4n
![Page 7: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/7.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 7
http://www.clickestudante.com/resultado-dos-protestos-pelo-brasil.html
![Page 8: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/8.jpg)
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
As 3 Leis da Economia dos Dados
1. Dados advém da atividade;
2. Dados tendem a gerar mais dados;
3. Dados em plataformas, não isoladamente;
![Page 9: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/9.jpg)
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. Oracle Confidential – Internal
Caminho dos dados!
0
20
40
60
80
100
120
140
2011 2012 2013 2014 2015 2016 2017
Milh
ares
Dados no SGBD 20%+
Dados fora do SGBD crescendo a taxas 40%+
IDC: Structured Versus Unstructured Data: The Balance of Power Continues to Shift. #247106. Table 1. Page 9
![Page 10: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/10.jpg)
Fato: Hadoop mais usado para dados estruturados
10
E mais uma coisinha… pesquisas da TDWI e Gartner
indicam que Data Warehouses maduros, hoje, já
acomodam diversos dados não-estruturados ou semi-
estruturados!
Maior parte das aplicações em Hadoop são utilizando fontes de repositórios estruturados;
Muitos dados ditos como “não estruturados” em uso no Hadoop, na verdade são estruturados (ex.: web log analytics e analise de sentimento são tipicamente impusionados por JSON ou XML)
![Page 11: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/11.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Opendata Revolution Apenas começando!
11
http://www.economist.com/news/international/21678833-open-data-revolution-has-not-lived-up-expectations-it-only-getting?fsrc=scn/tw_ec/out_of_the_box
![Page 12: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/12.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Proximo www. Revolução 20 anos!
12
![Page 13: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/13.jpg)
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 13
dataLab 1.Design
2.Construção
3.Libere
4.Revise
Fonte: Adaptado Modelo Ágil
Dados
Cidadão/Cliente
![Page 14: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/14.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 14
Inovação Aberta
![Page 15: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/15.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 15
![Page 16: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/16.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Dados em Valor Como extrair valor dos dados?
16
![Page 17: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/17.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 17
![Page 18: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/18.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 18
![Page 19: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/19.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 19
![Page 20: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/20.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Mais Valor… Visão G20
20
![Page 21: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/21.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Luta contra a corrupção… Muito além disso!
21
![Page 22: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/22.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Dados da Camara Proposição de retorno
22
![Page 23: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/23.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Dados da Educação Avaliação, acompanhamento das escolas públicas!
23
![Page 24: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/24.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Mexico ICMO Fraudes na Educação
24
![Page 25: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/25.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Prescrições Economia e desvios
25
http://www.economist.com/news/britain/21567980-how-scrutiny-freely-available-data-might-save-nhs-money-
beggar-thy-neighbour
![Page 26: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/26.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Triagem médica usando dados da saúde…
26
![Page 27: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/27.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Complicações cirúrgicas e monitoramento da qualidade dos serviços hospitalares, a partir dos Dados
27
Monitoramento de Estabelecimentos de Saúde
![Page 28: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/28.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Governança Caso Nigéria!
28
![Page 29: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/29.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Atacado Mercado de energia renovável!
29
https://piclo.uk
![Page 30: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/30.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Agua Dados em Agua
30
![Page 31: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/31.jpg)
![Page 32: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/32.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Bigdata: Definição…
32
“Big Data é qualquer dado que é caro demais para gerenciar e extrair valor”
Michael Franklin
Thomas M. Siebel Professor of Computer Science
Director of the Algorithms, Machines and People Lab
University of Berkeley
![Page 33: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/33.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Dinâmico e Integral
Estático e Sistêmico
![Page 34: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/34.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted
Simplificado e Sêmantico
Modelagem e Complexidade
Orientado aos Dados
First Nat Bank of Philadelphia
Wachovia
Wells Fargo
Crocker National First Union
Norwest
Is owned by
Now known as
Now known as
Now known as Now known as
Core States
Now known as
![Page 35: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/35.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | 35
MapReduce
No-SQL
Linked Data
Machine Learning
Real-time ingestion
} Maquina de Dados Processamento Grafo
![Page 36: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/36.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 36
Cadeia de Valor dos Dados
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
INTELIGÊNCIA
NECESSIDADE
Informação Dados
Decisões Insights Resultados
![Page 37: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/37.jpg)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 37
Compartilhando uma visão…
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Dados
Open Data
Big Data
![Page 38: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/38.jpg)
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Company Confidential
Impacto de Eventos
Reservatório Dados
Fabrica de Dados
Repositório de Informações
Análise e Insights
Lab. Descoberta
Informação Ativa
Descobertas Continuas
Fluxo de Dados
Investigação
Descoberta
Saídas Descobertas
Eventos & Dados
38
Dados Conhecidos
Novos Dados
Motor Decisão
Investigação
Gestão
Governança e Controle dos Casos
Segurança dos Dados e Casos
Opendata
Inovação Rapida
![Page 39: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/39.jpg)
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal
Descoberta dos Dados, não modelagem Virando a mesa, e criando inovação!
Aquisição
Aquisição dos dados baseados em parâmetros
investigativos pré-definidos e dinâmicos
Busca
Identificação dos dados mais
relevantes no contexto
investigativo e fácil acesso aos
mesmos
Entendimento
Enquadramento dos dados baseado em sua significância e
valor das informações contidas,
entendimento dos relacionamentos
Ajustes
Ferramentas para higienização e
enriquecimento dos dados de maneira ágil e
dinamica
Análise
Constatações e validações de
hipóteses investigativas e formulação de
novas hipóteses, primeiros resultados
Colaboração
Publicar os casos de investigação a
revisão de outros agentes e analistas,
feedback de procuradores e jurisprudências
Descoberta
Desvelar elementos
ocultos e novos no processo investigativo fomentando
novas fontes e insights
39
Tempo
![Page 40: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/40.jpg)
Copyright © 2014, Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal 40
Big data vivo …. O Hadoop Visual e Fácil
Explore
Transforme Descubra
Encontre
![Page 41: Adriano Amaral - Novas Tendências](https://reader034.vdocuments.pub/reader034/viewer/2022051707/58eec17e1a28ab371a8b465f/html5/thumbnails/41.jpg)