大數據時代的行動支付風險控制

Copyright© 2016 Cheng-Hsun Lin All Rights Reserved Chris Lin

X X (

20160730


(ETL & Data Analysis )

3


(Data Mining & Machine Learning)

...

4


(A.I. & Deep Learning)

.....

5


VS

6


SQL R PythonDMML

HDFSHadoop Spark

7


SQL NoSQL

8


1. - 2. - 3. - 4. - 5. -

X X


13


2016/7/30

( )

( )

( )

( )

15


...

16

X X


X X

Koban Coin

Koban Coin 2015 2 29

API (APIM)

.......

Koban Coin 2015 2 28

17


Koban Coin

18


/

App

Koban Coin

kobantimes.com

/ Koban Coin -2017 2 29 5:54

# #

19


P6

/

?20


-

21


-

22


- (Gateway Provider)

23


- /

24


1

26


2

28


3

30


31


P6

/

p=2

: 2016/7/30

32


300KM / hr

<

33


Case1

Case2

34


P6

/

Streaming / LBS Log

ML /

36


22:00-08:00

18:00-22:00

9:00-18:00

6:00-11:00


(LBS) v.s.

LBS

38


3690336902


36903

LBS

36902


( )

( )

M12345678 36902 30


- Mapper

Input Data

Data

Time UNIX

IMEI EWallet_UID

1 2

3


- Mapper

IMEI EWallet_UID

24

EWallet_UID TimeFlag KeyLocation TimeStamp Value

3

Time UNIX

Map output


- Reducer

21

3

TimeStamp

Map input

Key Value

Key Reducer

Key Reducer


- Reducer

54

3

off Time (17:59:59)

Output


47


Step1 ( Extract-Transform-Load, ETL )

48


Step1 ( Extract-Transform-Load, ETL )

49


Step2 (Hierarchical Clustering)

50


Step2 (Hierarchical Clustering)

51


Step3 (Hierarchical Agglomerative Clustering)

52


Step3 (Hierarchical Agglomerative Clustering)

53


Step4

54


Step4

55


Step5-1 1( )

56


Step5-2 2( )

57


Step5-3 3( )

58


11

1 1

111

3

3

2

22

2

1 3


LBS

(Intelligent Transportation System , ITS) API

……

60


Yuen Sze Lok,2015, ,http://photoblog.hk/


Map-Reduce

62


- (2014)

65

https://youtu.be/UEBLoDxq0yM

https://youtu.be/UEBLoDxq0yM


(2016) -

https://www.youtube.com/watch?v=QCmXHGa5dlQ

66

https://www.youtube.com/watch?v=QCmXHGa5dlQ


[3] ,2015,”Hadoop ”,DATAGURU

[2]Cloudera,2016,”Developer Training for Apache Spark”

[4] ,2016,”Python ”,DATAGURU

[1]Cloudera,2016,”Cloudera Administrator Training for Apache Hadoop”

[5] ,2016,” ”,DATAGURU

大數據時代的行動支付風險控制

Technology