Amid continuing false claims regarding the historical incidence of autism by mainstream media plugged authors Steve Silberman, John Donvan and Caren Zucker AoA re-publishes a series of articles by John Stone, UK Editor, chronicling data abuse and fabricated adult autism numbers, which also impacted heavily on opinion in the United States. These articles document the official drive to paper over the catastrophe engulfing so many of our children. The first in the series dates from October 2009 (updated 2015) deconstructing the then recently published National Statistics survey of "Autism Spectrum Disorders in adults living in households throughout England”. Interesting to note that its publication in 2009 coincided with the US National Institutes of Mental Health unveiling a figure of 1 in 100 fur US children. Six years later the figure has been admitted as 1 in 45. But for Silberman, Donvan and Zucker they are out there dancing around pretending the Emperor has clothes.
1 in 100: How the UK Government Arrived at the Adult Autism Figures
By John Stone
UPDATE April 10, 2015 (corrected). Revisiting this article five and half years on there are a small number of additional points. For clarity the original survey of 2007 from which this data was derived was looking for instances of Asperger Syndrome only. No mention was made of "higher-functioning autism" until the Eurekalert Press Release in 2008 but by 2009 both the terms "Asperger" and "high-functioning autism" had disappeared to be replaced by "autism spectrum disorders" but it was the same data set re-labelled to give a false idea of what was being surveyed. It can also be pointed out that not only were the diagnostic tests non-standard, and diluted the criteria for diagnosis but also that the assessments were not carried out by people qualified to make a diagnosis of autism. In the end it is impossible to say that there were any real cases of Asperger Syndrome let alone autism in this survey. Finally, the survey, originally published as National Statistics, was re-published as peer review study which came to be cited by Thomas Insel, Director of the National Institutes of Mental Health, and Chair of the Interagency Autism Coordinating committee (here , here and at IACC meetings) as if it was a credible source.
[Original article] Sometimes events across the pond seem connected. Just a few days ago the UK National Health Service’s Information Centre announced its new survey, which purportedly showed adult incidence of Autistic Spectrum Disorders running at the rate of 1 in 100 – according to them exactly the same rate as for schoolchildren, thus clearing MMR vaccine (or any other vaccine exposure for that matter) from being implicated in autism. Never mind that the rate was projected from a base of just 19 unconfirmed cases, or that the survey included young adults born between 1986 and 1991 who may have had MMR, or that the study had only high functioning and Asperger cases in it, or that the autism rate amongst schoolchildren in the UK runs at more like 1 in 64 - what an excellent opportunity for the US National Institute of Mental Health to concede that the autism rate for US children was also now 1 in 100, up from 1 in 150. There is now an official statistic they can cite that a rate of 1 in 100 for autism in both children and adults is perfectly normal, and nothing whatever to worry about.
To set the very curious British adult autism survey in context it is enlightening to return to the Eurekalert media announcement of May 2008 ‘University of Leicester to lead adult autism audit’ (HERE) . We read:
“Professor Terry Brugha, Professor of Psychiatry in the Department of Health Sciences is spearheading the study in conjunction with a team of research experts including the the National Centre for Social Research (NatCen), Research Autism and Professor Simon Baron-Cohen of the Autism Research Centre. It will report in 2009.”
Interesting, first of all, to note that though it does not anticipate the result of the survey it does go on to cite a 1 in 100 autism rate figure for children in the UK:
“The number of children with autism is as high as 1 in 100 (according to studies by Prof Howard Meltzer of the University of Leicester and Prof. Baird's 2006 study). The new prevalence study now underway will give the first ever accurate picture of how many adults have the condition. “
This statement was highly misleading. Meltzer, who is a signatory to the new paper, seems to have been responsible for the 1 in 100 figure for children in UK National Statistics but this was not true of the Baird study which gave a rate of 1 in 86, while Baron-Cohen - who was not in the end a signatory - had already headed a study which when it was finally published furnished a childhood figure of 1 in 64 (HERE).
But perhaps the most astonishing statement from the 2008 press release in retrospect is this:
‘The prevalence study will make use of new data collected in 2007 by NatCen and Professor Brugha’s team to record the number of adults with Asperger's syndrome and high functioning autism. There will also be an additional part to the study on the number of people with autism who have more complex needs and learning disabilities. The aim of the combined research will provide good epidemiological information in terms of prevalence and the characteristics and problems of this group.’
The new report, therefore, is based not on the full range of ASDs but solely on the data collected for the “Asperger syndrome and high functioning autism” by Prof Brugha in 2007; the “additional part” on “more complex needs and learning disabilities” has not been included at all, if it was ever conducted. On the other hand the report has been incorrectly published under a title which suggests that it is in fact a survey of all Autistic Spectrum Disorders “Autistic Spectrum Disorders in adults living in household throughout England” (HERE) , and this was how it was announced to the media.
Other key questions arise:
One is: why, if this report includes only people with Asperger’s Syndrome and high functioning autism - and only represents a proportion of ASDs - is the figure so high?
The diagnostic methodology has already been heavily criticised by Dr Carol Stott (HERE)
Stott complained about the use of non-standard tests both in the initial phase 1 population screening – the specially created AQ-20 (Autism Quotient) - and in phase 2 the use of ADOS (Autism Diagnostic Observation Schedule), which is not well-established for adults, and which was not scored in a standard way. It also seems the more standard SCID (Structural Clinical Interview for DSM-IV Disorders) was carried out in phase 2 but the results not published. However, the single oddest feature is having screened 7,400 people in phase 1 and having retained 630 with the most likely psychiatric profiles for intensive screening in phase 2, they then hypothesised that apart from the 19 cases actually identified in phase 2 they had missed a further 53 in phase 1. This is puzzling: it would be rational to calculate you had missed some – particularly given drop-outs – but to calculate that you had missed nearly three-quarters puts the whole process in doubt, not least because the original purpose was that of charting unknown territory.
A second is: how can statistics compiled for only the segment of ASDs comprising Asperger Syndrome and high functioning autism be included in UK National Statistics as representative figures for all ASDs (at least those living in households)?
This seems to be an over-riding objection even before you consider methodology. An inscription at the head of the publication states:
“This new set of statistics has not been formally assessed for compliance with the Code of Practice for Official Statistics. However, the Statistics Authority has agreed that, in view of the fact that the statistics are the product of secondary analysis of existing National Statistics, they can be designated as National Statistics. The producer body has confirmed that the new statistics are produced to the same standards as the existing ones.”
So, the Statistics Authority waived the necessity for compliance with its standards on the basis of assurances from the authors, or the institutions supporting them. On the other hand the fact that the statistics may derive in some way from National Statistics could not in itself ensure integrity.
--While the report did not refer to MMR or the vaccine/autism issue it was used by the NHS Information Centre to bolster MMR (Guardian, BBC ) it was not mentioned that study included young adults born in the years 1986 to 1991 who would have had MMR.
--Inclusion in the study was based on the willingness and ability of selected members of the public to answer questions on the telephone in the first phase and cooperation with a complex psychiatric assessment in the second phase. The results are self-selecting and unrepresentative.
--The 19 cases were unrepresentative of the population at large, including no one from an ethnic minority, and a low ratio of females to males (the usual ratio of males to females with ASD being about 4 to 1, but here 9 to 1).
--In an exercise in faux statistical precision, the study authors assign a “95% confidence interval” to their 1% estimate, but it is hard to see how you can repeat what has not been achieved in the first place.
Irrespective of cause it is tragic to see the great issue of autism prevalence betrayed in this way. What is actually shown here is that if the figure for adults provided by the survey was genuine it would still only be a relatively small fraction of cases in total: i.e. missing out low functioning ASDs, people living in institutions, all ethnic minority cases, perhaps half of females etc., but still coming up with the magic 1 in 100 – and the true rate of adult ASDs would be well in excess of 1 in 50, with all the most difficult cases left out and apparently still invisible. If we have learnt anything about adult autism cases it is that they are rather hard to find, so the 1 in 100 figure for what is apparently a small fraction is absurdly high and very poorly accounted. This study does not increase our knowledge: it just makes matters very much worse.
Little over three months ago Simon Baron-Cohen responded enigmatically to Anne Dachel of Age of Autism: “I agree we need a good prevalence study of ADULTS with autism spectrum conditions, and I haven't seen a study like this!” Baron-Cohen obviously knew about this study which conspicuously does not now have his name on it as a co-author, despite this having been publicly announced in May 2008. It does, however, still have the imprimatur of Baron-Cohen’s Autism Research Centre. This whole episode has been immensely damaging and must corrode further the autism community’s trust in public institutions - eloquent testimony to what the British government really thinks about MMR and autism.
Carol Stott’s comments on the methodology as quoted in a press release by Autism File :
Whatever claims are made to the contrary this report tells us very little about the number of adults with ASDs – inEnglandor anywhere else. The main problems with the study are with (a) case-definition, (b) ascertainment (c) diagnostic instruments (d) case identification and (e) statistical power.
There is no clearly stated case-definition anywhere in the report. The cases reported are defined loosely in terms of an initial score on a shortened unstandardised non-peer reviewed version of ascreening tool together with a semi-structured clinical interview – the Autism Diagnostic Observation Schedule (ADOS) – that was not designed to act as astand-alone diagnostic instrument.
The sample selected is not representative of the ASD population. All participants were verbally fluent, living in ordinary households, and able to complete a self-report questionnaire.
The choice of measurement tools is inadequately justified and badly referenced. No details are provided, nor are any sources referenced, on the psychometric properties of the initial screening instrument (AQ-20). The standardized scoring criteria for the ADOS were not followed (using a total cut-off of 10 for Communication + Social Reciprocity, rather than three cut-offs (respectively) of 3, 6 and 10 for Communication, Social Reciprocity and the two combined). Additionally the authors over state the validity of the ADOS as a tool for use in adult populations. Module Four (used in the study) was standardized on a sample of only 70 adults aged between 16 and 44. Ages in the study sample range from 16 – 75.
The technical appendix, which is intended to provide information about the derivation of the AQ-20 is statistically naïve, unclear and potentially inaccurate. It is not clear for example, what is meant by the phrase on pg 16 of Appendix C "….once the final set of predictors had been selected, a regression equation was available for predicting the prevalence of ADOS." Neither is it clear whether General Linear Modelling, Linear Regression or both were used to derive final items.
Finally, inferences are made about the lack of a significant association between age-groups and ASD prevalence without reference to statistical power. In a study of this size, with only 19 identified (unweighted) cases, the likelihood is that the study was underpowered to detect such differences.
A valid and reliable study of the population frequency of a disorder requires clear and robust case definition, validated instruments, standardized procedures and adequate statistical power. An initial evaluation of this report suggests it fails on all counts. A further much more detailed critique is currently being prepared and will be featured in The Autism File Magazine: Scientific Review early in the New Year.
John Stone is UK Editor for Age of Autism.