1 importance of type-ii error and falsifiability hiroyuki matsuda univ. of tokyo, iwc/sc japan...
Post on 19-Dec-2015
214 views
TRANSCRIPT
1
Importance of Type-II Error and Falsifiability
• Hiroyuki MATSUDA
• Univ. of Tokyo,• IWC/SC Japan Delegate
• WWF Japan Committee Member
This Powerpoint file will be uploaded onhttp://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt2
Precautionary principlePrecautionary principle Rio Declaration 1992, Rio Declaration 1992, Principle Principle
1515 • “In order to protect the environment, the
precautionary approach shall be widely applied by States according to their capabilities. Where there are threats of serious or irreversible damage, lack of full scientific certainty shall not be used as a reason for postponing cost-effective measures to prevent environmental degradation.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt3
Convention on Biological Diversity Convention on Biological Diversity JUNE 1992JUNE 1992
• “Noting also that where there is a threat of significant reduction or loss of biological diversity, lack of full scientific certainty should not be used as a reason for postponing measures to avoid or minimize such a threat,
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt4
UN Framework Convention on Climate
Change“Where there are threats of serious or ir-reversible damage, lack of full scientific certainty should not be used as a reason for postponing such measures, taking into account that policies and measures to deal with climate change should be cost-effective so as to ensure global benefits at the lowest possible cost.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt5
No academic rule for what we should say has been established.
Scientists …
• Before the Earth Summit in 1992,– should give no comments to public
without full scientific evidence;
– keep their result irrespective of public opinion
Aftermust give some
make their opinion a public consensus or win votes
Galileo’s InquisitionGalileo’s Inquisition
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt11
IUCN Redlist Criteria (2001)IUCN Redlist Criteria (2001)Criterion CR EN VU
A: Population declinerate is
>80%/10yrs or 3generations
>50%/10yrs or 3generations
>30%/10yrs or 3generations
A2: (under managed) >90%/10yrs or 3 gen. >70%/10yrs or 3 gen. >50%/10yrs or 3 gen.
B1: Area of occupancyis
<10km2 <500km2 <2000km2
B2: Extent ofoccurrence is
<100km2 <5000km2 <20000km2
C1: Population isdeclining and is
<250 (25%/ 3yrsor 1 gen.)
<2500 (20%/ 5yrsor 2 gen.)
<10000 (10%/10yrs or 3 gen.)
D1: Population size is <50 <250 <1000
D2: AOO is -- -- <10% of related sp.
E: Extinction risk is >50% in 10yrs or3 gen.(cap 100yrs)
>20% in 20yrs or5 gen. (cap 100 yrs)
>10% in 100 yrs
[1] http://iucn.org/themes/ssc/siteindx.htm
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt12
Risk analysis is based on a threshold of type-II error.
• Type-II: The probability that a species goes extinct when it is not listed as endangered.
• Type-I: The probability that a species persists when it is listed as endangered (very small).
• Or, If the extinction risk of a species is >10% within next 100 years, it is listed as endangered.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt14
G. Mace et al. 1992: Species 19:16.
• (The validity of criterion A:) “it can result in the listing of some species with very large, apparently secure populations”. (Type-I error)
• “However, linking [the rates of de-cline] to population size would exclude the listing of many populations with limited census data.” (Type-II error)
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt15
Mrosovsky N (1997) Nature 389:436
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt16
Allow criterion E to over-rule Allow criterion E to over-rule other criteria !?other criteria !?
• If we do not evaluate extinction risk, we agree with listing a species by criteria other than Criterion E.
• We disagree with listing it by criteria A-D if estimated extinction risk is apparently low.
• No consensus was made in IUCN Marine Workshop. www.iucn.org/themes/ssc/redlists/marine/marine3.htm
• About 2/3 of IUCN Criteria Workshop participants disagreed with this option.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
Risk is usually evaluated under pessimistic assumptions.
• IUCN/SSC (p.25) “Assessors should resist an evidentiary attitude and adopt a precautionary but realistic attitude to uncertainty when applying the criteria, for example, by using plausible lower bounds, rather than best estimates, in determining population size...” Therefore, extinction risk based on pessimistic estimates is biased (-fit to avoid type II errors)
• We could take risk based on best estimates, and measure type I errors (the weight of evidence).
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
Japanese plant Red Data Book
• Questionnaires: The number of plants and decline rate in each of 4437 map grids in each of ca.2100 threatened? plant species.
• Calculate total population size, rate of population decline, extinction risk of each species.
• >1500 species are listed in RDB.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
Frequency distribution of gridsThe case of primura sieboldii
extinctionextinction 1313
Np=f1N1+ f2N2+ f3N3+ f4N5=31977
>1000>1000 <0.01<0.01 <0.1<0.1 <0.5<0.5 <1<1 >1>1 ?? totaltotal>1000>1000 22 11 11 44 88>100>100 22 22 11 33 22 55 1515
>10>10 55 1616 1919 66 22 1212 6060>1>1 11 33 33 22 11 22 1212?? 11 2222 2323
totaltotal 88 2323 2424 1212 66 4545 118118
Decline rate within past 10 years
Pop
ulat
ion
size
2323
Pessimistic assumption = ignoring unknown gridsUnbiased assumption = proportional divide
+2.8
+ 1.7+ 3.2
+12.8+ 2.5
38210
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
We define the weight of evidence in plant RDB
• Extinction risk: based on pessimistic assumptions (ignoring unknown grids)
• Weight of evidence: based on unbiased assumptions (proportional divide)
• For 8 CR taxa, 32 EN taxa and 14 VU taxa among 1325 taxa, the weight of evidence within the years in question did not satisfy the extinction risk criteria.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
The weight of evidence decreases with increasing number of size unknown grids
L %UK Np Np* R Rank p T p T*ranking
p100*listing
Cynanchuminamoenum 2 81% 35 69 60% CR 54% 32% 100%Lycopodiumalpinum 6 73% 361 668 50% EN 27% 11% 100%Primulatosaensis 15 90% 901 1,149 22% EN 21% 16% 100%Sedumpolytrichoides 19 39% 5,979 6,524 9% VU 11% 9% 9%Carexsacrosancta 6 63% 1613 4775 86% VU 26% 4% 4%
EN?
VU?
VU?
NT?
NT?
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
How to handle the weight of evidence…
• We do not need down-listing even in case of disagreement between scenarios with pessimistic and unbiased estimates (PP)
• We should show the weight of evidence for future review process (accountability)
• Like weather focast (risk of shower)
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt6
Fallacy of applying PP to Maximum Sustainable Yield
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt8
Threat of biodiversity is serious if the population is below MVP
• Minimum viable population (MVP) is defined as threat of demographic stochasticity (e.g., all mothers make sons = 50) and genetic degradation (=500).
• The “50/500” law does not guarantee a zero-risk.• If population size > 10,000, the mean time to extin
ction is usually far too long (I ignore > 1 million yrs).
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt9
Should any few risk be avoided? (IWC 2001 report, p.93)
• Exploitation of whales with environmental variability was still “equivalent to an unsustainable ‘mining’” (still positive risk)
• Under the RMP, “the time scales were far too long (1045 years)” (>>the age of cosmos)
• “the long time-scale was necessary to examine the mechanisms of the interaction between environmental variability and exploitation.” ????
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
RMP cares just 10% errors
0
1
2
0 0.2 0.4 0.6 0.8 1
Relative Stock Size P t/P 0
Unusedresourcemanaged
resource
Protectedresource
Production
Catch quota
Fishing rate
MSY
limit stock level
MSY at 60%,0 catch at 54%
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
Fisheries Management Rule I US and Japan
0
1
2
3
0 1 2
Bt/Bmsy
Fis
hing
co
effi
cie
nt, F
1-a
Flimit(Fmsy)
Ftarget
Overfishing
MNo lower stock limit
Fishing is possible until stock collapse
Uncertainty exists not only in whaling, but all fisheries.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt10
Fallacy of applying PP to MSY
• If we adopt biased (precautionary) estimates, expected yield is again negatively biased.
• MSY should be based on unbiased, most likely estimates (Error in quota is reversible = adaptive management)
• MVP should be based on biased estimates, or PP. (Lost of biodiversity is irreversible)
• MSY is usually >>MVP, but is <MVP in some local population.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
Precautionary Approach?
• dN / dt = r [1 – (N / K)q] N – fN,• Maximize yield at fMSY = rq / (1 + q).
• If estimates of r, K, q and f includes uncertainty, MSY is not achieved, nor extinction risk is not eliminated.
• f < fMSY (Precautionary approach) is risk factor not to achieve MSY.
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
fMSY is neither sufficient nor necessary to stock conservation
High uncertainty in rLow uncertainty in r
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt17
Conclusion:Conclusion:What is needed for PPWhat is needed for PP
• Usually avoid Type II errors (risk-averse)
• Say a falsifiable prediction (responsibility of present assessment to the future)
• Show the weight of Evidence from unbiased estimates
• Non-regret policy (Acceptance of high risk from “good” manners)
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
Species Replacement of Pelagic FishesC
atch
in J
apan
(10
00 m
t) AnchovyHorse mackerelsPacific sauryChub mackerelSardine
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
Cyclic Advantage Hypothesis
The next dominant to sardine is anchovy –Yes! As I predicted
The second next is chub mackerelMany people agree
now
Matsuda et al. (1992) Res. Pop. Ecol. 34:309-319
http://cod.ori.u-tokyo.ac.jp/~matsuda/2002/021024.ppt
Future of Pelagic Fish Populations in the north-western Pacific:
• If overfishing of chub mackerel continues,– Chub mackerel will not recover forever;
• If cyclic replacement hypothesis is true,– Sardine will not recover forever;
• Do not catch immature mackerel too much– The overfishing is an experiment for my
hypothesis. (Adaptive mismanagement)