Table 1 A Checklist for ERA ReviewProblem Formulation ____ States purpose of the assessment ____ Defines role of assessment in the project ____ Cites and follows appropriate federal and
Trang 1Ecological Risk Assessment Review
Clifford S Duke and Jan W Briede
CONTENTS
I Introduction 257
II Reviewing an Ecological Risk Assessment 258
A Problem Formulation 258
B Exposure Analysis 260
C Effects Analysis 261
D Risk Characterization and Uncertainty Analysis 261
III Conclusion 262
References 263
I INTRODUCTION
ERAs evaluate the likelihood that adverse ecological effects may occur or are occurring as a result of exposure to one or more stressors caused by human activities
contractor produced ERA deliverables is necessary to ensure that the science is consistent with current standards, calculations are verifiable, and all product and performance standards have been met This chapter offers tools for critically review-ing contractor produced deliverables durreview-ing the production of interim drafts or following production of a draft final report No matter when critical review occurs, its purpose is to ensure production of scientifically credible products
Contracting organization project managers are responsible for ensuring that contractors fully and appropriately respond to all critical reviewer comments Responsiveness summaries can help verify that the contractor makes all necessary changes in text, tables, figures, and appendices, and that those changes appear in
Trang 2258 A PRACTICAL GUIDE TO ENVIRONMENTAL RISK ASSESSMENT REPORTS
approved interim deliverables and final reports Contractors should review all com-ments, make all responses available to the contracting organization in writing, and incorporate designated responses in the report as appropriate
Regulated entities have a great interest in conducting the critical review before submitting a risk assessment to regulatory agencies ERAs that follow current guid-ance and practices and that are critically reviewed are likely to have higher credibility and fare better in regulatory agency reviews This in turn can reduce costs, shorten the time agencies need to reach risk management decisions, and increase the effec-tiveness of the risk assessment in negotiating such issues as discharge limits and site remediation goals
Thorough reviews are essential to high quality reports Poor reports can result
in permit delays or denials and lost opportunities to modify remediation goals or discharge limits Reports that ignore or downplay ecological risks can contribute to public opposition to projects, increasing the likelihood of regulatory delays and costly lawsuits Ignoring potential impacts on threatened and endangered species or wetlands can lead to criminal prosecution
ERA reviewers should have a thorough grounding in ecology, toxicology, and chemistry, as well as a working knowledge of environmental laws and regulations Contracting organizations that lack personnel with such expertise are advised to hire appropriately trained individuals or contract out the reviewing task to another con-sultant The latter strategy can be the preferred one, saving substantial overhead, unless there is a continuing need for ERA staff
II REVIEWING AN ECOLOGICAL RISK ASSESSMENT
The major phases of an ERA have been formalized by EPA (1992) as problem
U.S EPA, 1993a, 1994, 1995) can help reviewers ensure that an ERA uses an up-to-date structural approach and terminology familiar to regulators At a minimum, the final product should be formally peer reviewed before submittal to a regulator However, as the most recent draft EPA guidance advocates, each phase of the risk assessment should be discussed with the risk manager and reviewers as it proceeds (U.S EPA, 1995) This decreases the likelihood that issues of importance to the manager and/or regulators will be overlooked and ensures that the assessment design focuses on the decision to be made The steps for reviewing an ERA outlined below are based on the EPA framework (U.S EPA, 1992, 1995)
A Problem Formulation
Problem formulation includes preliminary characterization of exposure and effects; examination of scientific data and data needs, policy and regulatory issues, and site-specific factors; and determination of the level of detail and information needed The emphasis on data needs and policy issues is critical, because the purpose of the assessment is to assist efficient and timely decision making Research in environmental LA4111/ch09 Page 258 Wednesday, December 27, 2000 2:58 PM
Trang 3Table 1 A Checklist for ERA Review
Problem Formulation
States purpose of the assessment Defines role of assessment in the project Cites and follows appropriate federal and state agency guidance Identifies ecosystem at risk and sensitive environments (e.g., wetlands) and organisms, especially threatened and endangered species
Identifies and justifies assessment endpoints Identifies and justifies measures of effect Describes relationship of measures of effect to the assessment endpoints Describes how stressors of concern may exert their effects
Identifies all likely complete pathways Justifies the omission or selection of pathways for analysis
Exposure Analysis
Describes stressor characteristics in appropriate detail Describes the basis for selecting stressors for evaluation Describes temporal and spatial distributions of the stressors relative to the measures
of effect Provides references for any variables cited Matches tools to the problem
Explains selection of biomarkers and models
Effects Analysis
Summarizes relevant field data concerning stressor effects Describes the kinds of effects stressors have on measures of effect Describes the shape and extent of the stressor-response relationship, if known
Risk Characterization and Uncertainty Analysis
Identifies key sources of uncertainty Describes sensitivity of the conclusions to changes in the values of key parameters Identifies key assumptions and sources of uncertainty
States the source and method of calculation benchmark toxicity values used for estimating hazard quotients
Provides dates for values obtained from databases that are periodically updated Addresses the weight of evidence supporting the conclusions of the analysis Discusses sufficiency and quality of the data
Discusses supplementary information from the literature and other sources Provides evidence that the stressor is causing or can cause the effects of concern Describes additional analyses or field sampling that would strengthen the analysis or answer questions
Identifies parameter distributions, ranges, and other inputs to any quantitative uncertainty analysis should be identified
Justifies the choices of inputs
General Issues
Describes all variables for equations used in the exposure analysis Units on the right side of equations balance those on the left (dimensional analysis) Describes and justifies basis of extrapolation for parameters requiring extrapolation Provides sufficient information to reproduce key calculations
States assumptions, potential shortcomings of data, and areas of uncertainty throughout the report
Trang 4260 A PRACTICAL GUIDE TO ENVIRONMENTAL RISK ASSESSMENT REPORTS
science is requisite to ERA, but is not ordinarily part of its purpose Exceptions may include cases when no data are available, extrapolation from literature sources is impossible, or sensitive ecosystems or species are investigated Two key products
of the problem formulation phase are a conceptual model and the selection of assessment endpoints and measures of effect The latter are also called measurement
In this section of an ERA, the reviewer should check that the purpose of the assessment and its overall role in the project are clearly defined Appropriate federal and state agency guidance must be cited and followed Guidance in ERA is evolving rapidly, and ERA formats that are acceptable at one point in time may not be later For example, EPA has recently circulated a draft ERA guidance analogous to those currently used for HHRA (U.S EPA, 1995) Regulated entities should ensure that their contractors are constantly aware of such efforts This section should identify the ecosystem at risk and sensitive environments (e.g., wetlands) and organisms, especially threatened and endangered species This step is critical to designing the conceptual model and choosing appropriate assessment endpoints and measures of effect Assessment endpoints must be identified and justified Inappropriate choices may lead the ERA preparer to focus on the wrong issues and provide either insuf-ficient or unnecessary detail Measures of effect should be identified and justified, and their relationships to the assessment endpoints described The analyses in ERAs are based on effects measures, which must have a clear relationship to the assessment endpoints that are the ultimate concern of the document Finally, the conceptual model must clearly describe how stressors of concern may exert their effects, identify all likely complete pathways, and justify the omission or selection of pathways for analysis
The steps that follow problem formulation depend on the conceptual model Errors or inappropriate detail (too little or too much) in the conceptual model will result in an ERA of low quality that may be unduly expensive
B Exposure Analysis
Exposure characterization may include field measurements of the distribution of a stressor in organisms and environmental media; analysis of biomarkers, which can provide biological evidence of contaminant exposure (McCarthy and Shugart 1990); and computer modeling to estimate exposures in the future or at locations not sampled The reviewer should check the following items
Stressor characteristics must be described in appropriate detail Examples include stressor type (e.g., chemical, physical), exposure intensity, duration, frequency, tim-ing, and scale (U.S EPA, 1992) The conceptual model, as well as knowledge of the site’s characteristics, should help the reviewer to evaluate this factor Weaknesses
in the stressor description may result in either insufficient or unnecessary detail, a less defensible risk characterization, and/or unnecessary expense in the ERA The basis for selecting stressors for evaluation should be described either in the ERA itself or in a cited companion document Not all stressors will necessarily receive detailed attention For example, if only a few chemicals, out of hundreds,
at a site dominate the risk, the others may not need to be addressed in detail However, LA4111/ch09 Page 260 Wednesday, December 27, 2000 2:58 PM
Trang 5it is important to state explicitly the reasons for eliminating any potential stressors from consideration
Temporal and spatial distributions of the stressors are described in the exposure analysis relative to the measures of effect The risk characterization depends upon comparing these distributions with a dose-response relationship If this information
is unclear or not provided, the risk characterization cannot be adequately reviewed References should be provided for any variables cited, e.g., body weights, feeding rates, etc The reviewer may wish to do spot checks of values taken from references for quality control purposes Errors in variables will cause proportional errors in the risk characterization
Tools, such as biomarkers and computer models, should match the problem For example, analysis of metallothioneins, which can indicate heavy metal exposure, would have little relevance at a site where heavy metals are known to not be of concern Fate and transport models designed for use in arid environments may lead
to erroneous conclusions when applied to a location with high rainfall In general, the selection of biomarkers and models should be clearly explained
C Effects Analysis
Effects analysis uses literature information and/or laboratory tests to examine both the kinds of effects caused by the stressor and the relationship between exposure and effect This section of an ERA summarizes relevant field data concerning stressor effects If such data are not available, this should be explicitly stated Chemical stressors often have different effects or different magnitudes of effects in the field than in the laboratory, because complex factors in the field alter the availability of chemicals to organisms For example, metal ions may bind to soils, organic chemicals may degrade, or organisms may be able to avoid the exposure Conclusions based
on field data may therefore differ from conclusions based on laboratory data The reviewer should be confident that any site-specific studies have been noted and that important related studies have not been overlooked
The kinds of effects that stressors have on the measures of effect should be described, as well as the shape and extent of the stressor-response relationship, if they are known The risk characterization depends upon comparing these distribu-tions with the exposure assessment If this information is unclear or not provided, the risk characterization cannot be adequately reviewed Errors in the choice of a dose-response relationship may result in underestimates or overestimates of the risk
D Risk Characterization and Uncertainty Analysis
The third phase of ERA, risk characterization, uses the data and conceptual tools provided by the first two phases to estimate the likelihood and degree of adverse effects of the stressor(s) on the organism or other ecological components of concern For screening level assessments, a typical measurement endpoint is the HQ, the ratio
of the estimated exposure to the no adverse effect level (or some other toxicity-based benchmark value.) A quotient greater than 1.0 indicates potential adverse effects More detailed characterizations may combine modeling with site-specific data,
Trang 6tox-262 A PRACTICAL GUIDE TO ENVIRONMENTAL RISK ASSESSMENT REPORTS
icity tests, biomarkers, and other information in a “weight-of-evidence” approach This approach is the preferred one, because it incorporates field and laboratory data, avoiding potential limitations of the quotient method used alone, such as over conservatism or overlooked exposure pathways The advantages include greater credibility for the analysis, increased confidence that potential risks have been adequately characterized, and potential cost savings on site remediation in cases where field data show that effects predicted by the quotient method are not occurring Uncertainty analyses, which typically follow the risk characterization, vary in detail, depending on the needs and constraints of the project, and may be qualitative
or quantitative Whatever the level of detail, the analysis should at least identify the key sources of uncertainty and the sensitivity of the conclusions to changes in the values of key parameters The basics of uncertainty analysis are outlined elsewhere
in this book
In these sections of an ERA, the reviewer should check to make sure that the source and method of calculation of any benchmark toxicity values used for esti-mating HQs are clearly stated For a given intake estimate, the HQ is inversely proportional to the benchmark chosen Defensible benchmark values are therefore critical in an ERA using the quotient method Although there is no formal guidance
on how to choose “correct” benchmarks, a number of sources of values are available, including current journals, books (e.g., Opresko et al., 1994), and databases such as EPA’s IRIS The dates should be provided for values obtained from databases that are periodically updated, for example, IRIS
The risk characterization must address the weight of evidence supporting the conclusions of the analysis It should include a discussion of the sufficiency and quality of the data, supplementary information from the literature and other sources, and evidence that the stressor is causing or can cause the effects of concern (U.S EPA, 1992) Overlooked site-specific or relevant literature data may result in overly optimistic or conservative conclusions, with consequent impacts on the credibility
of the analysis
Where appropriate, the ERA should describe additional analyses or field sam-pling that would strengthen the analysis or answer questions that it raises This will help the contracting organization respond proactively to any regulatory concerns based on the analysis
Key assumptions and sources of uncertainty should be identified, and the sensi-tivity of the conclusions to changes in the values of key parameters should be discussed The parameter distributions, ranges, and other inputs to any quantitative uncertainty analysis should be identified and the choices of inputs, (e.g., distribution type), justified Inappropriate or unclear choices of parameters may affect the cred-ibility of the uncertainty analysis, and consequently the entire ERA Clear explana-tions and justificaexplana-tions, backed up by appropriate literature citaexplana-tions, can help avoid such problems
III CONCLUSION
In addition to the section-specific requirements discussed above, the following requirements apply to all sections of an ERA First, equations should be checked to LA4111/ch09 Page 262 Wednesday, December 27, 2000 2:58 PM
Trang 7ensure all required information is provided Specifically, variables should be described for every equation used in the exposure analysis Otherwise, an adequate review cannot be conducted The units on the right side of any equation must balance those on the left (dimensional analysis) If they do not, there are errors in either the equation or the variable descriptions, with potentially catastrophic effects on the ERA The text or appendices should supply sufficient information to reproduce key calculations For complex analyses, data may need to be obtained on computer diskettes from the risk assessor, but should be readily available Second, the basis for any parameters requiring extrapolation must be described and justified (e.g., extrapolation from values measured in one species and applied to another) Although there is no comprehensive guidance on how to do this, it is important for quality assurance purposes and for the credibility of the ERA that the derivations be clear EPA (1993b) has provided guidance for deriving a number of variables used in wildlife exposure analysis Finally, assumptions, potential shortcomings of the data, and areas of uncertainty should be clearly stated throughout the ERA In this light, there is nothing wrong with intuition when reviewing an ERA or related documents The reviewer, whether an expert in the field or not, should use intuition as a guide
in determining if the appropriate steps have been taken and if they make sense Clear writing often reflects careful analysis; obfuscation nearly always accompanies the opposite
REFERENCES
Pub-lishers, Boca Raton, FL, 1990
Revision, Oak Ridge National Laboratory, Oak Ridge, TN, 1994.
Assessment Forum, Washington, 1992
Assessment Perspective, Risk Assessment Forum, Washington, 1993a.
Office of Research and Development, Washington, 1993b
Assessment Perspective, Vol II, Risk Assessment Forum, Washington, 1994
Assess-ment, Review Draft, Risk Assessment Forum, Washington, 1995.