Journal Information
Vol. 18. Issue 4.
Pages 235-237 (October - December 2020)
Share
Share
Download PDF
More article options
Visits
2795
Vol. 18. Issue 4.
Pages 235-237 (October - December 2020)
Policy Forums
Open Access
Negative results provide valuable evidence for conservation
Visits
2795
Kevin A. Wood
Wildfowl & Wetlands Trust, Slimbridge, Gloucestershire GL2 7BT, United Kingdom
Highlights

  • Conservation practice and policy draw on information from a range of disciplines.

  • A publication bias limits the dissemination of negative findings.

  • This bias restricts and distorts the evidence used to inform conservation.

  • Both positive and negative findings can provide valuable evidence for conservation.

  • Addressing such bias requires the efforts of scientists, practitioners, policy-makers, editors and reviewers.

This item has received

Under a Creative Commons license
Article information
Abstract
Full Text
Bibliography
Download PDF
Statistics
Figures (1)
Abstract

A pervasive publication bias, whereby studies that report positive results are prioritised over those that report negative findings, has been shown to exist in the disciplines that conservation practice and policy draw information from. The bias reflects the preferential submission of positive results by scientists and the preferential publication of positive results by journals. In this Reflective Practice essay, I consider the implications of this publication bias for the end-users of conservation evidence, and consider potential solutions. The documented publication bias limits and distorts the evidence available to inform conservation. Other disciplines have begun to take steps to redress publication biases, providing examples for conservation to learn from. Reducing the bias in the literature will help to increase the use of peer-reviewed scientific evidence in conservation by making the evidence more relevant to the needs of practitioners and policy-makers.

Keywords:
Environmental action and policy
Evidence-based conservation
File drawer problem
Publication bias
Research practices
Science-policy interface
Full Text
Introduction

Conservation research aims to provide the evidence needed to inform action and policy, for example to understand how wildlife responds to anthropogenic environmental change or the effectiveness of conservation interventions (Soulé, 1985; Kareiva and Marvier, 2012). Studies that report conservation evidence can present positive findings (i.e. evidence that an intervention is effective), negative or null findings (i.e. no evidence that an intervention is effective), or mixed findings (i.e. some evidence that an intervention is effective, for example under specific circumstances) (Salafsky et al., 2019). The publication of such studies in the scientific literature increases the information available for conservation practice and policy, and increasing the applied use of peer-reviewed scientific evidence remains a long-standing aim of the conservation community (Sutherland et al., 2004; Adams and Sandbrook, 2013). To inform practice and policy effectively, however, the conservation literature should represent an unbiased collection of scientific knowledge.

Publication bias

A pervasive publication bias, whereby studies that report positive findings are prioritised over those that report negative or mixed findings, exists in the disciplines that conservation draws evidence from, including biology, ecology, behaviour, geosciences, and social sciences (Jennions and Møller, 2002; Fanelli, 2012; Martínez-Abraín, 2013; Franco et al., 2014; van Emmerik et al., 2018; Tincani and Travers, 2019). This well-documented bias is associated with the behaviours of both researchers and journals. Researchers face increasingly intense competition for funding and prestige, both of which are considered more likely to result from publishing positive results, and hence the publication of negative findings is likely to be a lower priority (Csada et al., 1996). Journals similarly compete for prestige, often judged through proxies such as impact factors (despite the widely-acknowledged limitations of such metrics), and so prioritise the publication of those findings deemed to be the most novel and exciting, and hence the most likely to be well-cited in future work (Leimu and Koricheva, 2005). The bias against the submission and publication of negative findings has been termed the ‘file drawer problem’, whereby scientists gradually accumulate negative results over the course of their careers which are not published and so are not added to the scientific literature (Csada et al., 1996; Franco et al., 2014).

Negative results in conservation

While earlier articles have identified and described this publication bias, to date there has been little consideration of the implications for the end-users of conservation evidence. Here, I argue that negative findings can provide practitioners and policy-makers with valuable evidence for conservation, and that the current bias of the literature towards positive findings hinders conservation efforts. Therefore, while I am not advocating for the publication of studies that provide negative findings due to poor design, insufficient sampling, or inadequate statistical power, the publication of high quality studies featuring negative results broadens the evidence-base available for conservation practitioners and policy-makers to draw upon. Recent advances in the assessment of conservation evidence, such as the framework proposed by Salafsky et al. (2019), will allow such high quality negative findings to be identified more easily.

For a conservation organisation such as the Wildfowl & Wetlands Trust, negative results that can inform our work might include findings of no effect of a perturbation on a species or ecosystem, no change in the conservation status of a population, or no effect of a conservation intervention on the target species or ecosystem. The value of negative findings in conservation can also be considered in terms of a Bayesian learning approach, such as that suggested by Salafsky et al. (2019). As such, negative findings can maintain an evidence base in a prior state, for example if a new land management approach is found to offer no improved conservation outcomes relative to the previous management approach. Alternatively, negative findings can moves the evidence base away from a prior state to an updated posterior state, for example if no support is found for a particular conservation intervention (Salafsky et al., 2019).

A less-biased conservation literature would help us to better prioritise conservation actions on critical threats, and direct us away from those actions shown to have little or no effect, so that limited resources are allocated effectively (Wilson et al., 2009). Where studies that report negative findings are not published, opportunities are lost to strengthen the work through peer-review and post-publication discussion, and hence increase the quality of the information available to the end-users of conservation evidence. Preferentially publishing positive results also biases the evidence-base available to inform actions and decision-making. For example, the publication bias against negative findings means that positive findings are overrepresented in meta-analyses, which will then inevitably overestimate the effectiveness of conservation interventions or the impacts of certain threats on biodiversity (Stewart, 2010). More frequent publication of negative results would also prevent the duplication of effort as scientists are less likely to repeat earlier work, and practitioners are less likely to repeat interventions that have been shown to be ineffective.

Numerous examples of valuable negative findings can be found in the research undertaken by the Wildfowl & Wetlands Trust and its collaborators: (i) evidence that high levels of lead poisoning continued among waterbirds despite regulations on the use of lead shot in recreational shooting (Newth et al., 2013); (ii) survival rates of Common Pochard Aythya ferina have not changed over time despite their declining population size (Folliot et al., 2020); (iii) the strength of autumn tailwinds in the Baltic Sea had no effect of the demographic rates of migratory swans (Nuijten et al., 2020); (iv) supplementary food resources would not alleviate the decline of the northwest European Bewick's Swan Cygnus columbianus bewickii population (Wood et al., 2019). This final example is illustrative, as without this information, conservation organisations may have undertaken actions to attempt to increase food availability for swans in the landscape, for example by working with farmers and land managers. As the negative findings were published, conservationists were instead able to pursue alternative explanations for the decline in swan numbers (Nuijten et al., 2020).

Moving towards solutions

Other disciplines have begun to take steps to redress publication biases, providing examples for conservation to draw on. Fundamentally, a shift in publication culture is required to better reflect the needs of those using conservation evidence. Institutions and funders of conservation scientists should better recognise the value of negative findings to conservation, to reduce any real or perceived pressure to prioritise positive findings. The pre-registration of studies may also help, as both authors and journals must evaluate the merits of a study before knowing the results (Nosek et al., 2018; Chalmers et al., 2013). Conservation practitioners could also do more to highlight the benefits of publishing negative or null findings for conservation action and decision-making. Journal editors and their reviewers should not penalise good studies for negative findings. In 2015 the editors of eight health economics journals issued an editorial statement calling on reviewers not to reject studies on the basis of negative findings, which has resulted in an increased proportion of papers published in those journals reporting negative findings (Blanco-Perez and Brodeur, 2019). Some medical journals have published commentary articles to highlight the usefulness of negative results (Chalmers et al., 2013; Taragin, 2019).

Disseminating negative findings could also benefit from other publication routes beyond traditional journals, for example the Conservation Evidence database which collates examples of conservation interventions regardless of whether the findings were positive or negative (Sutherland et al., 2019). The growth in the use of pre-print servers such as bioRxiv, EcoEvoRxiv, or PeerJ will also help to share negative findings (Abdill and Blekhman, 2019), although the lack of peer-review associated with pre-prints may reduce the perceived evidence value.

Future work

Research scientists can play a crucial role in quantifying the impacts of publication bias and testing proposed solutions. Whilst publication bias has been shown to exist across a wide range of scientific disciplines (Jennions and Møller, 2002; Fanelli, 2012; Martínez-Abraín, 2013; Franco et al., 2014; van Emmerik et al., 2018; Tincani and Travers, 2019), it is not known whether some areas of conservation are more affected than others. It is also unknown whether all areas of conservation decision-making are equally susceptible to the problems caused by a biased, incomplete evidence base in which negative findings are under-represented. Addressing these unknowns could help to prioritise areas where solutions to the publication bias are required most urgently. The previous section of this essay identified potential solutions to the issue of publication bias, and no doubt others will be suggested as the issue increases in prominence. Some potential solutions have begun to be enacted, and yet the impacts of many of these solutions on the rates of acceptance of manuscripts that report negative findings, remain largely untested (but see Blanco-Perez and Brodeur, 2019). Where attempts are made to reduce publication bias in the disciplines that conservation draws evidence from, the effectiveness of these should therefore be tested.

Conclusions

My aim in this Reflective Practice essay was to inspire and inform greater consideration of the impacts of publication bias on conservation practice and policy, whilst recognising that it is beyond the scope of a short essay to solve such a complex, multi-faceted issue. It is clear that a publication bias towards positive findings pervades the many research disciplines that conservation draws evidence from. Any such solutions to the current publication bias will require the concerted and collective efforts of conservation scientists, practitioners, policy-makers, editors, and reviewers. Reducing the bias in the current conservation literature to better reflect the needs of practitioners and policy-makers will help the long-standing aim of increasing the use of peer-reviewed scientific evidence in conservation (Sutherland et al., 2004; Adams and Sandbrook, 2013).

Conflict of interest

The authors declare no conflict of interest.

Acknowledgements

I am grateful to Jean Paul Metzger, Ze Alexandre, Lucy Wood, and three anonymous reviewers, for their valuable and constructive feedback, which improved this essay.

References
[Abdill and Blekhman, 2019]
R.J. Abdill, R. Blekhman.
Meta-Research: tracking the popularity and outcomes of all bioRxiv preprints.
ELife, 8 (2019), pp. e45133
[Adams and Sandbrook, 2013]
W.M. Adams, C. Sandbrook.
Conservation, evidence and policy.
Oryx, 47 (2013), pp. 329-335
[Blanco-Perez and Brodeur, 2019]
C. Blanco-Perez, A. Brodeur.
Publication Bias and Editorial Statement on Negative Findings.
(2019),
[Chalmers et al., 2013]
I. Chalmers, P. Glasziou, F. Godlee.
All trials must be registered and the results published.
BMJ, 346 (2013), pp. f105
[Csada et al., 1996]
R.D. Csada, P.C. James, R.H. Espie.
The “file drawer problem” of non-significant results: does it apply to biological research?.
Oikos, 76 (1996), pp. 591-593
[Fanelli, 2012]
D. Fanelli.
Negative results are disappearing from most disciplines and countries.
Scientometrics, 90 (2012), pp. 891-904
[Folliot et al., 2020]
B. Folliot, G. Souchay, J. Champagnon, M. Guillemain, M. Durham, R. Hearn, J. Hofer, J. Laesser, C. Sorin, A. Caizergues.
When survival matters: is decreasing survival underlying the decline of common pochard in western Europe?.
Wildlife Biol., 2020 (2020),
[Franco et al., 2014]
A. Franco, N. Malhotra, G. Simonovits.
Publication bias in the social sciences: unlocking the file drawer.
Science, 345 (2014), pp. 1502-1505
[Jennions and Møller, 2002]
M.D. Jennions, A.P. Møller.
Publication bias in ecology and evolution: an empirical assessment using the ‘trim and fill’ method.
Biol. Rev., 77 (2002), pp. 211-222
[Kareiva and Marvier, 2012]
P. Kareiva, M. Marvier.
What is conservation science?.
BioScience, 62 (2012), pp. 962-969
[Leimu and Koricheva, 2005]
R. Leimu, J. Koricheva.
What determines the citation frequency of ecological papers?.
Trends Ecol. Evol., 20 (2005), pp. 28-32
[Martínez-Abraín, 2013]
A. Martínez-Abraín.
Why do ecologists aim to get positive results? Once again, negative results are necessary for better knowledge accumulation.
Anim. Biodiv. Conserv., 36 (2013), pp. 33-36
[Newth et al., 2013]
J.L. Newth, R.L. Cromie, M.J. Brown, R.J. Delahay, A.A. Meharg, C. Deacon, G.J. Norton, M.F. O’Brien, D.J. Pain.
Poisoning from lead gunshot: still a threat to wild waterbirds in Britain.
Eur. J. Wildl. Res., 59 (2013), pp. 195-204
[Nosek et al., 2018]
B.A. Nosek, C.R. Ebersole, A.C. DeHaven, D.T. Mellor.
The preregistration revolution.
Proc. Natl. Acad. Sci. USA, 115 (2018), pp. 2600-2606
[Nuijten et al., 2020]
R.J.M. Nuijten, S.J.G. Vriend, K.A. Wood, T. Haitjema, E.C. Rees, E. Jongejans, B.A. Nolet.
Apparent breeding success drives long-term population dynamics of a migratory swan.
J. Avian Biol., (2020),
[Salafsky et al., 2019]
N. Salafsky, J. Boshoven, Z. Burivalova, N.S. Dubois, A. Gomez, A. Johnson, A. Lee, R. Margoluis, J. Morrison, M. Muir, S.C. Pratt, A.S. Pullin, D. Salzer, A. Stewart, W.J. Sutherland, C.F.R. Wordley.
Defining and using evidence in conservation practice.
Conserv. Sci. Pract., 1 (2019), pp. e27
[Soulé, 1985]
M.E. Soulé.
What is conservation biology?.
BioScience, 35 (1985), pp. 727-734
[Stewart, 2010]
G. Stewart.
Meta-analysis in applied ecology.
Biol. Lett., 6 (2010), pp. 78-81
[Sutherland et al., 2004]
W.J. Sutherland, A.S. Pullin, P.M. Dolman, T.M. Knight.
The need for evidence-based conservation.
Trends Ecol. Evol., 19 (2004), pp. 305-308
[Sutherland et al., 2019]
W.J. Sutherland, N.G. Taylor, D. MacFarlane, T. Amano, A.P. Christie, L.V. Dicks, A.J. Lemasson, N.A. Littlewood, P.A. Martin, N. Ockendon, S.O. Petrovan, R.J. Robsertson, R. Rocha, G.E. Shackleford, R.K. Smith, E.H.M. Tyler, C.F.R. Wordley.
Building a tool to overcome barriers in research-implementation spaces: the conservation evidence database.
Biol. Conserv., 238 (2019), pp. 108199
[Taragin, 2019]
M.I. Taragin.
Learning from negative findings.
Isr. J. Health Policy Res., 8 (2019), pp. 38
[Tincani and Travers, 2019]
M. Tincani, J. Travers.
Replication research, publication bias, and applied behavior analysis.
Perspect. Behav. Sci., 42 (2019), pp. 59-75
[van Emmerik et al., 2018]
T. van Emmerik, A. Popp, A. Solcerova, H. Müller, R. Hut.
Reporting negative results to stimulate experimental hydrology: discussion of “The role of experimental work in hydrological sciences – insights from a community survey”.
Hydrolog. Sci. J., 63 (2018), pp. 1269-1272
[Wilson et al., 2009]
K.A. Wilson, J. Carwardine, H.P. Possingham.
Setting conservation priorities.
Ann. NY Acad. Sci., 1162 (2009), pp. 237-264
[Wood et al., 2019]
K.A. Wood, J.L. Newth, K. Brides, M. Burdekin, A.L. Harrison, S. Heaven, C. Kitchin, L. Marshall, C. Mitchell, J. Ponting, D.K. Scott, J. Smith, W. Tijsen, G.M. Hilton, E.C. Rees.
Are long-term trends in Bewick's Swan (Cygnus columbianus bewickii) numbers driven by changes in winter food resources?.
Bird Conserv. Int., 29 (2019), pp. 479-496
Copyright © 2020. Associação Brasileira de Ciência Ecológica e Conservação
Perspectives in Ecology and Conservation
Article options
Tools