Research Studies
Study Tracker
Fluoridation advocacy in referenda where media coverage is balanced yet biased.Abstract
BACKGROUND: Despite supporting scientific evidence, community water fluoridation (CWF) often fails in public referenda. To understand why, the authors quantitatively analyzed text from news media coverage of CWF referenda.
METHODS: The authors analyzed text from 234 articles covering 11 CWF referenda conducted in 3 US cities from 1956 through 2013. The authors used cluster analysis to identify each article’s core rhetoric and classified it according to sentiment and tone. The authors used multilevel count regression models to measure the use of positive and negative words regarding CWF.
RESULTS: Media coverage more closely resembled core rhetoric used by fluoridation opponents than the rhetoric used by fluoridation proponents. Despite the scientific evidence, the media reports were balanced in tone and sentiment for and against CWF. However, in articles emphasizing children, greater negative sentiment was associated with CWF rejection.
CONCLUSIONS: Media coverage depicted an artificial balance of evidence and tone in favor of and against CWF. The focus on children was associated with more negative tone in cities where voters rejected CWF.
PRACTICAL IMPLICATIONS: When speaking to the media, advocates for CWF should emphasize benefits for children and use positive terms about dental health rather than negative terms about dental disease.
DISCUSSION
There were three principal findings from the text analysis. First, news coverage of CWF reflects some evidence of a media balance bias. Second, greater reference to children is associated with an increase in non-neutral terms. Third, the extent of negative tone is more strongly associated with CWF defeat as an article’s number of references to children increases.
Our results suggest that the tone in articles is approximately balanced, with a slight favor towards pro-CWF terms than anti-CWF. However, the media balances positive with negative, and pro-CWF with anti-CWF, when children are written about. These results are consistent with complaints by scientists that journalists force a false balance of arguments, and hence generate controversy.16,17 Coverage of CWF largely appears to conform with media desires to appear balanced to the general audience and sell the news.
Among referendum items, CWF is infamous for its level of polarization despite being an established public health good. Opposition to marginal increases in public water fluoridation arose upon the inception of CWF, with accusations against fluoride focused on the theme of forced medication,12 dangerous side effects18 and contamination of natural resources.4,12,18 Due to public contention, water fluoridation is the most competitive type of referendum and receives the lowest level of support in the event of passage.19 Among the initial reasons given to CWF’s poor performance is that CWF opponents “[N]eed only to create doubt about fluoridation; they do not need to convince the electorate of all their points” (page 60, italics in original).7 The concept of doubt derailing changes to the status quo has since received wider support in research on issue framing and agenda setting; those who seek to change status quo policy need to refute the opposition and present a positive message to make clear that their alternative is superior.20,21 When anti-fluoride activists raise concerns of fluoride-induced cancer, coupled with the frame of easy opt-in to fluoride via tablets, CWF referendums can easily fail.12,18,22
In this study, the media gave similar coverage to anti-fluoride arguments and scientific evidence, especially in relation to children. Although we do not know how voters interpreted these conflicting views, the balanced yet biased coverage did not aid pro-fluoride activists.
Where CWF won might offer some insight in CWF messaging. Although mention of children drove the contentious balanced coverage, the rate at which negative and anti-CWF terms were mentioned was significantly less. When people read the news, they read less generally negative and anti-CWF coverage associated with children. Given that people often tend to forget the context of news and associate the tone of coverage with the appeal of the issue in question,2,14,23 it makes sense that more negative coverage in general might impair passage of CWF. Further, the targeted use of anti-CWF terms in relation to children may very well have associated fluoride with harm to children. Case studies conducted of fluoridation in 1985 found that positive messaging and direct outreach greatly aided in the passage of CWF.24
Given the importance of doubt in derailing CWF referendums, it is necessary to consider the messaging that voters receive from the media. If doubt is all that is needed to prevent pro-fluoridation votes, then even a few hints of anti-fluoride information may be enough to bring down CWF. Fluoride campaigns in California in the 1950s only succeeded in the event of overwhelming support for fluoride without any serious opposition.18 More recently in Portland, Oregon in 2013, even purportedly balanced coverage did not prevent a lopsided defeat for CWF.12 Established models of referendum voting demonstrate that voters vote for a change in the status quo only when they are certain that the change will result in a better outcome.20 Given that the average person does not scientifically understand fluoridation or the credibility of information sources,4,25 mixed messages that introduce even some uncertainty should be enough to lead to a rejection at the polls.
There is no easy way forward to overcome reluctance to accept CWF. One step is to start employing an easy to understand and positive message with direct outreach to voters.24 Handing out accessible information at dental offices and door-to-door would bypass the media filter and resolve confusion. While this will require resources and effort, the status quo does not appear to be working.
Strategies for Advocacy
Advocates for community water fluoridation should be conscious of the media’s tendency for “balance bias” in which equal weight is assigned to opposing views, regardless of the strength of evidence supporting those views. One way for dentists to avert the bias is by communicating directly with their patients in dental offices and the public at large at community gatherings. When messages are conveyed via the media, it is advisable to prepare accessible and non-specialized information for journalists in advance of elections. Reviews of scientist-press relations recommend establishing an early rapport with journalists in order to ensure that reporters do not falsely balance scientific and pseudo-scientific studies.16,17 A journalist covering an election with a clear understanding of the differing scientific merit of each side will be able to conduct more investigative studies as opposed to reporting on argumentum ad passions logical fallacious arguments against CWF. One specific strategy, suggested by findings from this study, is to recognize and counteract anti-CWF language as it relates to children, such as purported harmful effects of CWF for children’s health. For example, fluorides’ benefits for children can be depicted using positive terms (improving dental health) instead of negative ones (reducing tooth decay).
Acknowledgments
Research reported in this publication was supported by the National Institute of Dental & Craniofacial Research of the National Institutes of Health under Award Number UH2DE025494. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.
The underlying data, code, and other materials necessary to reproduce results presented in the article will be preserved and made publicly available online via the UNC Dataverse (https://dataverse.unc.edu/) hosted by the Odum Institute Data Archive at the University of North Carolina at Chapel Hill.
APPENDIX
Establishing the Document Term Matrices
We conducted the analysis via the document term matrices that we derived from the articles used in this study. All articles were copied and pasted to text documents for archive and replication purposes. We read in the articles as a corpus, where we applied standard transformations. These included removing URLs, punctuation, whitespace, and transforming all words to lower case. From there we analyzed the data and removed uninformative words and replaced synonyms with a common word. These included all synonyms of fluoride, science and children. Words that referenced locations were also removed.
For the creation of the dendrograms, we read in the top ten most frequently occurring words from the term document matrix and scaled the distance between the words based on Euclidean distance. We then normalized the distances onto a zero to one scale by dividing the distances by the maximum distance between the words. Once the distances were normalized, we plotted the results based on the average distance.
The tone and sentiment text analysis required the creation of unique cleaning profiles with the respective dictionaries attached. Other cleaning commands were the same as described above. Following the creation of document term matrices, we summed the data by column (article), and then merged the tone and sentiment counts to a single data frame by their article IDs.
Determining Count Model Fit
We determined the best model for tone and sentiment based on first, whether the model converged, and second, the presence of over dispersion in the data. Poisson regression assumes that the count mean and variance are equivalent.1 When this is not true, the results produced will generally be biased. Negative binomial models account for variances greater than the mean and scale the standard errors relative to the level of over dispersion. However, negative binomial models take up more degrees of freedom and can lead to inefficiency. Given that we account for three different random effects, city, election date, and media type, there is the risk of non-convergence as the model becomes impossible to compute.2 Unlike single level models, multilevel models with random effects can reduce the bias that would otherwise afflict Poisson regression models, with observation level effects eliminating all potential bias.3 We therefore seek the best unbiased model that is also computationally possible.
Figure 1 demonstrates the mean relative to the variance for all four models, fitting the data to Poisson and negative binomial lines. As can be seen in the figures, the Poisson models do a sufficient job at explaining the data up until the high mean values. It is at the higher means that the negative binomial lines adjust easier to the higher variances and account for potential bias. It would therefore be ideal to use negative binomial models. However, besides the positive count data, the models do not converge when negative binomial models are used. This is due to the random effects providing too few degrees of freedom. While unfortunate, given that the higher mean values are few in number, the Poisson multilevel models as used for models 2 – 4 offer the best, albeit, imperfect means to run our analyses.
Figure 1

Count Model Dispersion Plots
Plot (a) is model 1 of the positive word count, plot (b) is model 2 of the negative word count, plot (c) is model 3 of the pro-CWF word count, and plot (d) is model 4 of the anti-CWF word count. All plots demonstrate the best fit lines of the multilevel Poisson models compared to the negative binomial models. For all models, the Poisson model explains most of the data up until the high mean values. Higher means are better explained by negative binomial models. However, in the data the random effects largely explained by the high mean values, and the lack of degrees of freedom lead to a failure of multilevel negative binomial models to converge. Therefore, the Poisson multilevel models explaining the data sufficiently
Appendix Table 1
Characteristics of referendums and source of articles
Portland, Oregon | Wichita, Kansas | San Antonio, Texas | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|
Referendum year | 1956 | 1962 | 1978 | 1980 | 2013 | 1964 | 1978 | 2012 | 1966 | 1985 | 2000 |
Referendum decision | Against | Against | For | Against | Against | Against | Against | Against | Against | Against | For |
% voting in favor of fluoridation | 42% | 45% | 51% | 46% | 39% | 37% | 46% | 40% | 32% | 48% | 53% |
Number of votes cast | 181,140 | 144,300 | 139,373 | 115,408 | 164,301 | 50,997 | 84,139 | 129,199 | 38,855 | 81,373 | 292,811 |
Population size | 373,628 | 372,676 | 382,619 | 366,383 | 733,764 | 254,698 | 276,554 | 356,724 | 587,718 | 785,880 | 1,385,695 |
News media type | |||||||||||
![]() |
14 | 13 | 14 | 10 | 12 | 19 | 5 | 23 | 5 | 19 | 26 |
![]() |
1 | 2 | 2 | 2 | 12 | 7 | 4 | 2 | 12 | 6 | 18 |
![]() |
0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 4 | 0 | 0 |
Total | 15 | 15 | 16 | 12 | 24 | 27 | 10 | 25 | 21 | 25 | 44U |
Bibliography
Footnotes
Disclosure. None of the authors reported any disclosures.
Funding
Funders who supported this work.
NIDCR NIH HHS (1)
Publisher’s Disclaimer: This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final citable form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
References
1. Centers for Disease Control and Prevention (CDC) Ten great public health achievements–United States, 1900–1999. Morb Mortal Wkly Rep. 1999;48(12):241–243. [Abstract] [Google Scholar]
2. Hochschild JL, Einstein KL. Do facts matter? Information and misinformation in American politics. Polit Sci Q. 2015;130(4):585–624. [Google Scholar]
3. Metz AS. An analysis of some determinants of attitude toward fluoridation. Soc Forces. 1966;44(4):477–484. [Google Scholar]
4. Martin B. The sociology of the fluoridation controversy: A reexamination. Sociol Q. 1989;30(1):59–76. [Google Scholar]
5. Bennett WL. Toward a theory of press-state relations in the United States. J Commun. 1990;40(2):103–127. [Google Scholar]
6. American Dental Association. [Accessed Apr. 11, 2017];ADA news on fluoridation. Available at: http://www.ada.org/en/public-programs/advocating-for-the-public/fluoride-and-fluoridation/ada-fluoridation-recent-news.
7. Fluoride Action Network. Fluoride articles. [Accessed April 11, 2017];Mercola. Available at: http://fluoride.mercola.com/
8. American Dental Association. Fluoridation facts. Chicago, IL: American Dental Association; Jul, 2005. [Accessed July 20, 2016]. Available at: http://www.ada.org/~/media/ADA/Member%20Center/FIles/fluoridation_facts.pdf. [Google Scholar]
9. Connett P. 50 reasons to oppose fluoridation. Birmingham, NY: Fluoride Action Network; Sep, 2012. [Accessed July 20, 2016]. Available at: http://fluoridealert.org/articles/50-reasons/ [Google Scholar]
10. Mouchet M, Guilhaumon F, Villéger S, Mason NWH, Tomasini J-A, Mouillot D. Towards a consensus for calculating dendrogram-based functional diversity indices. Oikos. 2008;117(5):794–800. [Google Scholar]
11. Hu M, Liu B. Mining opinion features in customer reviews. Paper presented at: 19th National Conference on Artificial Intelligence; July 27, 2004; San Jose, CA. [Google Scholar]
12. Bianchi A, Bergren MD, Lewis PR. Portland water fluoridation: A newspaper analysis. Public Health Nurs. 2017;34(2):152–165. [Abstract] [Google Scholar]
13. Howard A. Fluoride in the media: A review of newspaper articles from 1999 to 2009. DentUpdate. 2011;38(2):86–92. [Abstract] [Google Scholar]
14. Hetherington MJ. Why trust matters: Declining political trust and the demise of American liberalism. Princeton, NJ: Princeton University Press; 2007. [Google Scholar]
15. Hlavac M. stargazer: Well-formatted regression and summary statistics tables. [Accessed July 20, 2016];R package version 5.2. 2015. Available at: http://cran.r-project.org/package=stargazer.
16. Dean C. Am I making myself clear? A scientist’s guide to talking to the public. Cambridge, MA: Harvard University Press; 2009. [Google Scholar]
17. Baron N. Escape from the ivory tower: A guide to making your science matter. 2. Washington, DC: Island Press; 2010. [Google Scholar]
18. Mueller JE. The politics of fluoridation in seven California cities. West Polit Q. 1966;(1):54–67. [Abstract] [Google Scholar]
19. Hahn H. Voting in Canadian communities: A taxonomy of referendum issues. Can J Polit Sci. 1968;1(4):462–469. [Google Scholar]
20. Riker WH, Calvert RL, Mueller JE, Wilson RK. The strategy of rhetoric: Campaigning for the American Constitution. New Haven, CT: Yale University Press; 1996. p. 283. [Google Scholar]
21. Hänggli R, Kriesi H. Political framing strategies and their impact on media framing in a Swiss direct-democratic campaign. Polit Commun. 2010;27(2):141–157. [Google Scholar]
22. Scism TE. Fluoridation in local politics: Study of the failure of a proposed ordinance in one American city. Am J Public Health. 1972;62(10):1340–1345. [Abstract] [Google Scholar]
23. Berinsky AJ. Rumors and health care reform: Experiments in political misinformation. Br J Polit Sci. 2015;47(02):241–262. [Google Scholar]
24. Margolis FJ, Cohen SN. Successful and unsuccessful experiences in combating the antifluoridationists. Pediatrics. 1985;76(1):113–118. [Abstract] [Google Scholar]
25. Gans HJ. A study of CBS Evening News, NBC Nightly News, Newsweek, and Time. 2. Evanston, IL: Northwestern University Press; 2004. Deciding what’s news. [Google Scholar]
FULL-TEXT STUDY ONLINE AT https://europepmc.org/article/MED/29454461#free-full-text