cognitive computing

@pieroleo

Cognitive ComputingHow Artificial Intelligence and Machine Learning is

transforming Data into Wisdom

Pietro LeoExecutive Architect - IBM Italy CTO for Big Data Analytics & WatsonIBM Academy of Technology LeadershipHead of IBM Italy Center of Advanced Studies

@pieroleo

@pieroleo

WISDOM

KNOWLEDGEDATA

INFORMATION

@pieroleo

DATA

INFORMATION

KNOWLEDGE

WISDOM "Olli"

Self-Drive VehicleCo-creative community3D-printedCloud IoTArtificial Intelligence30 Transportation Sensors + New onesConversationRecommenderVideo RecognitionPersonalization…

5

You shared your position with me and can guess your mobility need. I can take you where you need to be

Just enjoy your new experience. Stay safe as in your home

I know what is needed for you, even before you order it

Please, come with me and stay by me.I know your content I can take care of all your digital life

Artificial Intelligence patents have more than tripled in 10 years

Venture Scanner are tracking 1481 ArtificialIntelligence companies with a combinedfundingamount of $8.8 Billion

78% of Executives say business will manage people along side machines

10

How is that possible?

11

Image source: http://personalexcellence.co/blog/ideal-‐beauty/

City

Lifestyle

ZIPcode

Costal vs Inland Marital status

Generation

Location

Family Size

Gender

Income Level

Competitors

Age

Loyalty & CardActivity

Revenue Size

Life Stages

Eductation

Legal status

Sector

Industry

12


City

Lifestyle

ZIPcode


Generation

Location

Family Size

Gender

Income Level

Competitors

Age


Revenue Size

Life Stages

Eductation

Legal status

Sector

Industry

SubscriptionsDate on Site

Wish List

Size of Network

Check-ins

App usage duration

Number of Apps on Device

Deposits/Withdrawals

Device UsagePurchase History

FollowingFollowers

Likes

Number of Hashtags used

History of Hashtags

Search Strings entered

Sequence of visits

Time/Day log in

Time spent on site

Time spent on page

Frequency of Search

Videos Viewed

Photos liked

13


City

Lifestyle

ZIPcode


Generation

Location

Family Size

Gender

Income Level

Competitors

Age


Revenue Size

Life Stages

Eductation

Legal status

Sector

Industry

SubscriptionsDate on Site

Wish List

Size of Network

Check-ins

App usage duration

Number of Apps on Device

Deposits/Withdrawals

Device UsagePurchase History

FollowingFollowers

Likes

Number of Hashtags used

History of Hashtags

Search Strings entered

Sequence of visits

Time/Day log in

Time spent on site

Time spent on page

Frequency of Search

Videos Viewed

Photos liked

Sentiment

Tone

Euphemisms

Hedonism

Extroversion

Face Recognition

Openess

Colloquialism

Reasoning Strategies

Language Modeling

DialogIntent

Latent Semantic Analysis

Phonemes

Ontology Analysis

Linguistics Image Tags

Question Analysis

Self-transcendent

Affective Status

@pieroleo

Source: http://www.bloomberg.com/video/meet-the-world-s-most-connected-man-Vs~LzkbkR7yhjza~7nji1g.html

Meet theWorld's Most Connected Man

@pieroleo

Rapid growth of exogenous data is transforming healthcare

6 Terabytes

60%Exogenous Factors

1100 TerabytesVolume, Variety, Velocity, Veracity:Educational records, Employment Status, Social Security Accounts, Mental Health Records, Caseworker Files, Fitbits, Home Monitoring Systems, and more…

0.4 TerabytesElectronic Medical / Health Records, Physician Management Systems, Claims Systems and more…

30%Genomics Factors

10%Clinical Factors

IBM Watson Health // SOURCE: ©2015 J.M. McGinnis et al., “The Case for More Active Policy Attention to Health Promotion,” Health Affairs 21, no. 2 (2002):78–93

Data Generated per Life

@pieroleo

Leveraging Exogenous Data for Chronic Care (Type 2 Diabetes;; Primary & Secondary Prevention)

60%Exogenous Factors

30%Genomics Factors

10%Clinical Factors

SOURCE: ©2015 J.M. McGinnis et al., “The Case for More Active Policy Attention to Health Promotion,” Health Affairs 21, no. 2 (2002):78–93

Glucose Monitoring

Calorie Intake

Stress LevelsPhysical Activity

Other vital signs Social Interaction

Affinity (retail)

Sleep Pattern

17

What is happening?

18

Automating the

World

Understanding the

World

Main Technology Shift

H-FactorProgram Train

Knowledge Workers Learning Workers

19

BIG DATA

DATA

WISDOM

Knowledge

Information

Technology is no more supporting every kind of

private and public organizations, it is becoming

part of them.

Machine IntelligenceIs becoming the key

ingredient.

AnalyticsCloud Computing

Data Science

Mobile

Social

Digitalization

Technology

Business

Robotics

Artificial Intelligence

Business & Tech NexusThings

@pieroleo

Cognitive Computingscales our wisdom to expand what’s possible.

New Information Technology challenge is now about the

possibility to expand our WISDOM options

Watson

@pieroleo

21

Analytic Systems use statistical techniques for detecting patterns or detect trends within data, yield an understanding of historical or current state from which to draw conclusions

Text Mining is a class of functions for parsing and identifying significant words in language (NLP) as well as understand the semantic of a textual content

Cognitive Systems leverage machine learning to predict meaning in features of human language (spoken, written, visual) and related forms of human reasoning

Multi-Media Mining is a a class of function for analyzing visual content such as images or videos

Speech Mining is a class of functions for analyzing audio signals including speech to such as ability Cognitive Solutions

leverage a combination of cognitive system reasoningstrategies and other analytic and classical computing techniques to solve for a complex problem -> Amplify Human WISDOM in a specific domain

XXX Mining is class of large specialized functions for analyzing “digital representation” in a specific domain à e.g., Bioinformatics, Financial Analytics, etc.

Capitalize on Digital Data

Machine Learning is a class of statistical techniques that use training data to recognize the correlation between a set of feature patterns and outcomes.

It includes also Deep Learning that is a rapidly maturing space, based on neural network techniques, that are taught to find their own features

Emerging Patterns for Artificial Intelligence adoption in Business World

WISDOM

@pieroleo

2011 2015

2016 - AlphaGO=4 Lee Se-Dol=1

1997 - IBM=2.5 Kasparov=2.5

1997

AlphaGO uses self-trained net to evaluate positions and moves on 30M historical games

DeepBlue uses a hard-coded objective function written by a human coupled with High Performance Computing

2016

10

10170

1040

Applying or having wisdom in real world is not only an AI game

COMPUTING & MATH WISDOM

IBM Watson – Jeopardy!

SEMANTICS

@pieroleo

IBM Cognitive Computing by numbers in IBM

45Countries

100+Applicationsalready in market

6.000Researchers& Specialists in IBM

8LanguagesLearned by Watson

200Universitiesoffering Watson courses

500+PartnersPowered by Watson

28APIalready available

20Industries

80.000Developers building with Watson

Watson Health

Watson InternetOf Things

Watson FinantialServices

3 Industrial Business Units

@pieroleo

24

IBM Platforms are hosting all layers needed to design, develop, build and SCALE cognitive systems or apps on cloud

Watson Core

Watson Health

Cloud

Ecosystems to quick industrialize and scale cognitive systems are emerging

Watson for FinancialServices

Watson Internet of Things

IBM Vertical Cognitive Business Units are emerging blending, in industry specific platforms, cognitive layer & specific data

Cognitive Systems & Products built by Customers, Partners and IBM


Ecosystem Cognitive Applications

Cognitive Products

Cognitive Solutions & Conversation Applications

4.

Watson Services - API3. 2.Hybrid Cognitive

Frameworks

1.

@pieroleo

25


Watson Core

Watson Health

Cloud








Cognitive Products


4.


Frameworks

1.

@pieroleo

26

IBM Conversation Applications

Watson Marketing• Watson Real-time Personalization• Watson Customer Experience Analytics

• Watson Ads

Watson Commerce• Watson Commerce Insights• Watson Content Hub• Watson Order Optimizer• Watson Personal Shopper

Watson Supply Chain• Watson Supply Chain Insights

Watson Work• Watson Workplace• Watson Work Services (3 APIs)

Watson Education• Watson Element for Educators• Watson Enlight for Educators• Watson Teacher Advisor

Watson Talent• Watson Talent Insight• Watson Career Coach• Watson Recruitment• Watson Talent Development• Watson Virtual Agent for HR

Watson for Financial Services• Watson Regulatory Compliance• Watson Client Insight for Wealth Management

• Watson Customer Insight for Banking

• Watson Customer Insight for Insurance

Watson Health• Watson Health Cloud• Watson Drug Discovery• Watson Genomics• Watson Oncology

1.

….and more

@pieroleo

27

IBM Conversation Applications

Watson Marketing• Watson Real-time Personalization• Watson Customer Experience Analytics

• Watson Ads

Watson Commerce• Watson Commerce Insights• Watson Content Hub• Watson Order Optimizer• Watson Personal Shopper

Watson Supply Chain• Watson Supply Chain Insights

Watson Work• Watson Workplace• Watson Work Services (3 APIs)Watson Marketing

Watson Education• Watson Element for Educators• Watson Enlight for Educators• Watson Teacher Advisor

Watson Talent• Watson Talent Insight• Watson Career Coach• Watson Recruitment• Watson Talent Development• Watson Virtual Agent for HR

Watson for Financial Services• Watson Regulatory Compliance• Watson Client Insight for Wealth Management

• Watson Customer Insight for Banking

• Watson Customer Insight for Insurance

Watson Health• Watson Health Cloud• Watson Drug Discovery• Watson Genomics• Watson Oncology

1.

@pieroleo

1-800 Flowers

Live at: https://www.1800flowers.com/gwyn-1800flowers?flws_rd=1 Live at: https://www.thenorthface.com/xps

GWYN (Gifts When You Need), a Watson-powered personal concierge designed to help customers find the perfect gift

The North Face

A personal Shop Assistant that can drive you to select the most appropriate Jacket

@pieroleo

170,000 personal weather stations worldwide

2.2 B locations forecasted every 15 minutes.

15 B Weather averages 15B forecast queries daily.

20 terabytes, every day.

Bring Advanced Weather Insights to Business

Source: https://www.wunderground.com/

@pieroleo

Weather is the secret to understanding how consumers feel

30

@pieroleo

And that earned us a spot in the daily routines and ritualsof consumers.

31

@pieroleo

Making real connections with consumers through weather and analytics.

32

@pieroleo

When do people want soup?

Soup warms L.A. up when it’s 55°

33

New Yorkers enjoy soup when temps drop from 50° to 30°

LOS ANGELES NEW YORK CITY

@pieroleo

34https://watsonads.com/#

Watson Ads

@pieroleo

35


Watson Core

Watson Health

Cloud








Cognitive Products


4.


Frameworks

1.

@pieroleo

VisualRecognition

Speech toText

Personality

Insights

LanguageTranslatio

n

Cognitive Services are a set of building blocks that can be mixed to build cognitive applications.They run on a Platform.

IBM Cognitive Services –BlueMix - Platform

Text tospeech

2.

@pieroleo

Anaphoric Co-referencingColloquialism ProcessingContent Management -- VersioningConvolutional Neural NetworksCurationDeep LearningDialog FramingEllipsesEmbedded Table ProcessingEnsembles and FusionEntity ResolutionFactoid Answering

Feature Engineering

Feature NormalizationFocus and Spurious Phrase ResolutionHTML Page AnalysisImage ManagementInformation RetrievalKnowledge (Property) GraphsKnowledge AnsweringKnowledge Extraction AnnotatorsKnowledge Validation and ExtrapolationLanguage ModelingLatent Semantic Analysis

Learn To RankLinguistic AnalysisLogical Reasoning AnalysisLogistical RegressionMachine LearningMulti-Dimensional ClusteringMultilingual trainingn-Gram Analysis (word combinations and distance)Ontology AnalysisPareto AnalysisPassage AnsweringPDF ConversionPhoneme Aggregation

Question AnalysisQuestion-answering Reasoning StrategiesRecursive Neural NetworksRules ProcessingScalable SearchSimilarity AnalyticsStatistical Language ParsingSupport Vector MachinesSyllable AnalysisTable AnsweringVisual AnalysisVisual RenderingVoice Synthesis

These APIs are underpinned by 50 technologies:

2011

2015Source: http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/services-catalog.html

3.

@pieroleo

IBM Cognitive Services1. Watson APIs are

continuously. 2. They are

complemented with tens of other APIs in other domains, all running on ONE platform.

3. They can mashed up to build an infinite number of cognitive assistants.

2011

2015Pipeline

@pieroleo

39


Watson Core

Watson Health

Cloud








Cognitive Products


4.


Frameworks

1.

@pieroleo

New programming environments on clouds are providing a fast and easy access to IBM Watson APIs and more …

40

@pieroleo

41


Watson Core

Watson Health

Cloud








Cognitive Products


4.


Frameworks

1.

@pieroleo

Cognitive Products

4

3.

Watson AnalyticsWatson Trend

Watson Machine Learning…

Chef WatsonWatson Design

Watson Beat…..…..

CognitiveFro All

Cerativity

43

CLOSING

@pieroleo

Source: https://www.whitehouse.gov/sites/default/files/whitehouse_files/microsites/ostp/NSTC/preparing_for_the_future_of_ai.pdf

1 Private and public institutions are encouraged to examine whether and how they can responsibly leverage AI and machine learning in ways that will benefit society.

2 Federal agencies should prioritize open training data and open data standards in AI.

3 The Federal Government should explore ways to improve the capacity of key agencies to apply AI to their missions.

@pieroleo

@pieroleo

www.linkedin.com/in/pieroleo

Pietro LeoExecutive Architect IBM Italy CTO for Big Data Analytics & WatsonIBM Academy of Technology LeadershipHead of IBM Italy Center of Advanced Studies

Grazie!