saliency-based color accessibility - gipsa- · pdf filesaliency-based color accessibility...
TRANSCRIPT
Saliency-based Color AccessibilityOpening the Umwelt
Satohiro [email protected]
Reference:
Tajima, S. & Komine, K., IEEE Trans. Imag. Proc., 24(3):1115–1126, (2015)
Background
tajima - consciousness / embedding
Satohiro Tajima (“Sato”)
2007-09 U Tokyo (Masato Okada, Ikuya Murakami, …) Bayes models of vision
2009-13 NHK (Japan Broadcasting Corporation) Image processing, natural stats etc.
2013 PhD (Engineering), U Tokyo
2013-14 RIKEN Dynamical systems
2014- U Geneva (Alex Pouget) + Decision-making, consciousness
Background
tajima - consciousness / embedding
Satohiro Tajima (“Sato”)
2007-09 U Tokyo (Masato Okada, Ikuya Murakami, …)
2009-13 NHK (Japan Broadcasting Corporation)
2013 PhD (Engineering), U Tokyo
2013-14 RIKEN
2014- U Geneva (Alex Pouget)
11.3.2011: Earthquake 9.0MTsunami
Fukushima power plant accident
What you see ≠ What others see.
Saliency-based color accessibility
Original image
Fukushimanuclear plant
Deuteranopia (*simulation)
Fukushimanuclear plant
SML
SL
An actual evacuation map for the nuclear plant accident
1-1.3% 0.02% 1.3% 0.02%
1-1.2% 0.01% 5.0% 0.35%
0.001% 0.03% 0.01% 0.01%
Protanope ∙ ● ●
Deuteranope ● ∙ ●
Tritanope ● ● ∙
Male Female Male Female
DichromacyAnomaloustrichromacy
Color deficiency ~280 million (8% of male)
Common ● ● ●
Color vison polymorphism
SML
(Viénot et al., Nature, 1995)
Conventional simulation method
Saliency-based color accessibility
Common Protanope
Tritanope Deuteranope
Conventional simulation method
Saliency-based color accessibility
• No objective criteria for image quality
• Simulated color distance Perceptual difference?
(Brettel et al., JOSA A, 1997)
ProblemsCommon
Tritanope
(Viénot et al., Nature, 1995)
More fundamental problem
Saliency-based color accessibility
• No objective criteria for image quality
• Simulated color distance Perceptual difference?
• Can we compare subjective perceptions between
individuals having different sensory properties?
Problems
SML SL
More fundamental problem
Saliency-based color accessibility
• No objective criteria for image quality
• Simulated color distance Perceptual difference?
• Can we compare subjective perceptions between
individuals having different sensory properties?
Problems
SML
Umwelt(self-centered world)
J. J. B. von Uexküll
More fundamental problem
Saliency-based color accessibility
• No objective criteria for image quality
• Simulated color distance Perceptual difference?
• Can we compare subjective perceptions between
individuals having different sensory properties?
Problems
SML SL
Umwelt(self-centered world)
Saliency-based color accessibility
“Saliency-based accessibility”
• Objective criteria
• Distance in a perceptual space
• Attentional cue as a common subspace of perception
We propose:
A (partial but practical) solution…
Concept
Salience: cue for bottom-up visual attention
Saliency-based color accessibility
(Itti & Koch, Nat. Rev. Neurosci., 2001)
MethodCommon vision
Uncommon vision
(e.g., deuteranopia)
MethodDeuteranopeControl
Difference:Lost information
Model outputs
Saliency-based color accessibility
Cf. Dichromatic vision can have advantages in the wild.
Animal Behaviour 83:479-486 (2012)
Animal Behaviour, 73:205-214 (2007)
Experiment
Saliency-based color accessibility
2) Original vs. Saliency-based recoloring
• Participants: 5 color-deficient, 18 control observers
• Task: 2AFC judgement of subjective salience
1) Original vs. Dichromat simulation
Time
“how easily the visual information is extracted from images”
W/ and w/o spatial context:
Saliency-based color accessibility
Concept of experiment
Original image
Saliency-based recoloring (SBR)
Dichromat simulation (DS)
Saliency-based color accessibility
Results
Saliency-based color accessibility
Results
Saliency-based color accessibility
Results
W/ context W/O context
Saliency-based color accessibility
Results
W/ context W/O context
Applications to TV program production
Saliency-based color accessibility
Improved
Original
Summary
Saliency-based color accessibility
New method to analyze
color accessibility was
proposed,
experimentally evaluated (roughly), and
applied to TV program productions.
“Saliency-based accessibility”
What you see ≠ What others see
What you attend = What others attendBut you can make:
SML SL