信号検出理論の解説 (signal detection theory, a primer)

111
SDT primer You have a sensor (1D continuous value). You have to decide which is a signal and which is a noise, based on the sensor value. When you classify the data as signal, you are aware of the signal.

Upload: masatoshi-yoshida

Post on 07-Jul-2015

4.983 views

Category:

Education


1 download

DESCRIPTION

駒場集中講義用資料。1/10 第2回講義分です。英語です。古いバージョンは消さずにこちらに誘導。

TRANSCRIPT

Page 1: 信号検出理論の解説 (Signal detection theory, a primer)

SDT primer

You have a sensor (1D continuous value).You have to decide which is a signal and which

is a noise, based on the sensor value.When you classify the data as signal,

you are aware of the signal.

Page 2: 信号検出理論の解説 (Signal detection theory, a primer)

SDT primer

You have a sensor (1D continuous value).You have to decide which is a signal and which

is a noise, based on the sensor value.When you classify the data as signal,

you are aware of the signal.

1) You collect samples.2) You set the criteria for optimal discrimination.3) You classify new data by comparing the

sensor value and the criteria.

Page 3: 信号検出理論の解説 (Signal detection theory, a primer)

1) You collect samples.

Page 4: 信号検出理論の解説 (Signal detection theory, a primer)

1) You collect samples.2) You set the criteria for optimal discrimination.

Page 5: 信号検出理論の解説 (Signal detection theory, a primer)
Page 6: 信号検出理論の解説 (Signal detection theory, a primer)
Page 7: 信号検出理論の解説 (Signal detection theory, a primer)
Page 8: 信号検出理論の解説 (Signal detection theory, a primer)
Page 9: 信号検出理論の解説 (Signal detection theory, a primer)
Page 10: 信号検出理論の解説 (Signal detection theory, a primer)
Page 11: 信号検出理論の解説 (Signal detection theory, a primer)
Page 12: 信号検出理論の解説 (Signal detection theory, a primer)
Page 13: 信号検出理論の解説 (Signal detection theory, a primer)
Page 14: 信号検出理論の解説 (Signal detection theory, a primer)
Page 15: 信号検出理論の解説 (Signal detection theory, a primer)
Page 16: 信号検出理論の解説 (Signal detection theory, a primer)
Page 17: 信号検出理論の解説 (Signal detection theory, a primer)
Page 18: 信号検出理論の解説 (Signal detection theory, a primer)
Page 19: 信号検出理論の解説 (Signal detection theory, a primer)
Page 20: 信号検出理論の解説 (Signal detection theory, a primer)
Page 21: 信号検出理論の解説 (Signal detection theory, a primer)
Page 22: 信号検出理論の解説 (Signal detection theory, a primer)
Page 23: 信号検出理論の解説 (Signal detection theory, a primer)
Page 24: 信号検出理論の解説 (Signal detection theory, a primer)

1) You collect samples (training data).2) You set the criteria for optimal discrimination.3) You classify new data by comparing the sensor value and

the criteria.

Page 25: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 26: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 27: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 28: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 29: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 30: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 31: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 32: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 33: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 34: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 35: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 36: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 37: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 38: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 39: 信号検出理論の解説 (Signal detection theory, a primer)

SDT primer

1) You collect samples (training data).2) You set the criteria for optimal discrimination.3) You classify test data by comparing the sensor value and

the criteria.

When you classify the data as signal,you are aware of the signal.

Let’s do it again, with different data set.

Page 40: 信号検出理論の解説 (Signal detection theory, a primer)

1) You collect samples (training data).

Page 41: 信号検出理論の解説 (Signal detection theory, a primer)

1) You collect samples (training data).2) You set the criteria for optimal discrimination.

Page 42: 信号検出理論の解説 (Signal detection theory, a primer)
Page 43: 信号検出理論の解説 (Signal detection theory, a primer)
Page 44: 信号検出理論の解説 (Signal detection theory, a primer)
Page 45: 信号検出理論の解説 (Signal detection theory, a primer)
Page 46: 信号検出理論の解説 (Signal detection theory, a primer)
Page 47: 信号検出理論の解説 (Signal detection theory, a primer)
Page 48: 信号検出理論の解説 (Signal detection theory, a primer)
Page 49: 信号検出理論の解説 (Signal detection theory, a primer)
Page 50: 信号検出理論の解説 (Signal detection theory, a primer)
Page 51: 信号検出理論の解説 (Signal detection theory, a primer)
Page 52: 信号検出理論の解説 (Signal detection theory, a primer)
Page 53: 信号検出理論の解説 (Signal detection theory, a primer)
Page 54: 信号検出理論の解説 (Signal detection theory, a primer)
Page 55: 信号検出理論の解説 (Signal detection theory, a primer)

1) You collect samples.2) You set the criteria for optimal discrimination.3) You classify new data by comparing the sensor value and

the criteria.

Page 56: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 57: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 58: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 59: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 60: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 61: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 62: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 63: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 64: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 65: 信号検出理論の解説 (Signal detection theory, a primer)

3) You classify new data by comparing the sensor value and the criteria.

Criteria

Page 66: 信号検出理論の解説 (Signal detection theory, a primer)

Unknown processes

Recognition model (=> model-free)

Data (signal or noise)

classifywith criteria (c=2)awareness as decision

generate

Page 67: 信号検出理論の解説 (Signal detection theory, a primer)

Processes with unknown parametersNoise: N(0,1); Signal: N(d’,1)

Generative model (=> model-based)

Data (signal or noise)

Estimate parameter(d’ = 4) andclassify with criteria

generate

Page 68: 信号検出理論の解説 (Signal detection theory, a primer)

SDT primer

Processes with unknown parametersNoise: N(0,1); Signal: N(d’,1)

Page 69: 信号検出理論の解説 (Signal detection theory, a primer)

SDT primer

The sensitivity of the sensor is characterized as d’.

d’ is independent of criteria (c).(The correct ratio depends on c.)

Processes with unknown parametersNoise: N(0,1); Signal: N(d’,1)

Page 70: 信号検出理論の解説 (Signal detection theory, a primer)

SDT primer

The sensitivity of the sensor is characterized as d’.

d’ is independent of criteria (c).(The correct ratio depends on c.)

OK, but we have no such sensor.How to estimate d’ in psychophysics?

Processes with unknown parametersNoise: N(0,1); Signal: N(d’,1)

Page 71: 信号検出理論の解説 (Signal detection theory, a primer)

By changing criteria

Page 72: 信号検出理論の解説 (Signal detection theory, a primer)

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).3) You obtain data set 1 (with hit, miss, FA, CR).4) Repeat 1)-3) with different criteria.5) You reconstruct the distribution of samples.6) You estimate d’.

By changing criteria

Page 73: 信号検出理論の解説 (Signal detection theory, a primer)

1) You set a criterion and classify samples.

Page 74: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 75: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 76: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 77: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 78: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 79: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 80: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 81: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 82: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 83: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 84: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 85: 信号検出理論の解説 (Signal detection theory, a primer)

signal noise

yes hit ● FA ○no miss ○ CR ●

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).

Page 86: 信号検出理論の解説 (Signal detection theory, a primer)

1) You set a criterion and classify samples.2) You get the feedback (correct or incorrect).3) You obtain data set 1 (with hit, miss, FA, CR).

Page 87: 信号検出理論の解説 (Signal detection theory, a primer)

4) Repeat 1)-3) with different criteria.

Page 88: 信号検出理論の解説 (Signal detection theory, a primer)

4) Repeat 1)-3) with different criteria.

Page 89: 信号検出理論の解説 (Signal detection theory, a primer)

4) Repeat 1)-3) with different criteria.

Page 90: 信号検出理論の解説 (Signal detection theory, a primer)

4) Repeat 1)-3) with different criteria.

Page 91: 信号検出理論の解説 (Signal detection theory, a primer)

4) Repeat 1)-3) with different criteria.

Page 92: 信号検出理論の解説 (Signal detection theory, a primer)

4) Repeat 1)-3) with different criteria.

Page 93: 信号検出理論の解説 (Signal detection theory, a primer)

4) Repeat 1)-3) with different criteria.

Page 94: 信号検出理論の解説 (Signal detection theory, a primer)

4) Repeat 1)-3) with different criteria.

Page 95: 信号検出理論の解説 (Signal detection theory, a primer)

5) You reconstruct the distribution of samples.6) You estimate d’.

Page 96: 信号検出理論の解説 (Signal detection theory, a primer)

5) You reconstruct the distribution of samples.6) You estimate d’.

Page 97: 信号検出理論の解説 (Signal detection theory, a primer)

5) You reconstruct the distribution of samples.6) You estimate d’.

Page 98: 信号検出理論の解説 (Signal detection theory, a primer)

5) You reconstruct the distribution of samples.6) You estimate d’.

Page 99: 信号検出理論の解説 (Signal detection theory, a primer)

5) You reconstruct the distribution of samples.6) You estimate d’.

Page 100: 信号検出理論の解説 (Signal detection theory, a primer)

5) You reconstruct the distribution of samples.6) You estimate d’.

Page 101: 信号検出理論の解説 (Signal detection theory, a primer)

5) You reconstruct the distribution of samples.6) You estimate d’.

Page 102: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?

Page 103: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

Page 104: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

Page 105: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

YesNo

Page 106: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

Very sureUncertain SureVery sure UncertainSure

Page 107: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

2) By changing value or probability (animal study)

Very sureUncertain SureVery sure UncertainSure

Page 108: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

2) By changing value or probability (animal study)

Very sureUncertain SureVery sure UncertainSure

Page 109: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

2) By changing value or probability (animal study)

Very sureUncertain SureVery sure UncertainSure

Page 110: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

2) By changing value or probability (animal study)

Very sureUncertain SureVery sure UncertainSure

Page 111: 信号検出理論の解説 (Signal detection theory, a primer)

How do you change the criteria?1) Confidence rating (Human study)

2) By changing value or probability (animal study)

Very sureUncertain SureVery sure UncertainSure