Brainduck’s Weblog
Psychology geek tries to explain a few things.

DORE breakthrough published in, ummm ‘Leamington Courier’

DORE have chosen to distribute their news of a ‘Major Autism Breakthrough’ via the doubtless-estimable Leamington Courier.

Now, I’m all for the public understanding of science, and particularly advances in educational psychology, or I wouldn’t be writing this blog.

However, publishing science by press-release to local papers first is Not On, particularly when said science could influence desparate people to hand over a lot of money to you in the hope of a ‘cure’.

It’s not OK to say ‘The Dore Clinic has achieved massive successes while working with 1,000 patients suffering from the symptoms of high-functioning autism’, when the article goes on to say ‘In addition 56 people who had been formally diagnosed as suffering from autism have now completed the programme’.

So, how many people with an actual diagnosis of Autistic Spectrum Disorder (ASD), given by someone qualified to do so, were actually helped? There’s a lot of difference between the reliability of research on 1000 people, and on 56. If your child is diagnosed with an ASD, then the results of the 56 are a lot more relevant than 1000 people who may or may not have had some ASD traits, which are not uncommon within the general population and particularly amongst people with PDDs.

How were these people helped? We don’t actually know. The paper doesn’t seem to have been published in a journal, or made available on a DORE website, as far as I can tell (I’d love a copy when it does show up). What does ‘expressed emotion’ mean in practice, and how do you measure it improving?

‘Of this number 100 per cent showed improvement across a battery of cognitive, literacy and motor tests’ looks good but doesn’t mean much. If everyone scored higher on standing on wobble-boards & throwing beanbags post-DORE, that would count as an (unsurprising) improvement – but it would not necessarily help people much in their everyday lives. We also don’t have any demographic data – if most of the group are young, you would expect them to get better at things over the 18 months – 2 years DORE usually seems to take.

We have no information on drop-out rates. This is important, because people who don’t see an improvement will be more likely to drop out. If half of people who perform below average (so 50% of the sample) drop out, overall scores will improve – even if any ‘improvement’ or ‘getting worse’ was completely down to normal variation. It depends on how they’ve done the stats, but if you assume that the most severely affected to start of with will be more likely to drop out (& it’s not hard to see that someone with particularly problematic ASD symptoms might be less able to keep up regular daily exercises), and their scores are included in the initial but not the final groups, this makes matters even worse. This is why publishing your data & stats is important. (BTW, does anyone know drop-out rates for DORE? Unofficially I’ve heard 50%, but I’d appreciate info).
Again, this study does not seem to have a control group – so again you can’t tell what was just normal progression with time, what is non-specific effects which could be obtained by telling the family to pat their head & rub their tummy for 15 minutes twice a day as opposed to anything to do with DORE or the cerebellum specifically. ‘Doing something’, giving a child lots of attention, raised expectations, etc, will all have very real effects on a person & their family. We also don’t know what else they’ve done. I was interested to find that it’s not uncommon for DORE to suggest 1:1 more conventional tuition alongside the programme – so looking at studies of people in the ‘real world’ doing DORE then the question isn’t so much ‘How does DORE compare to doing nothing’ as ‘How does DORE & extra 1:1 help compare to doing nothing?’.

The point of peer-review is that experts in the field can look at a paper and correct mistakes before it goes out for public consumption. The point of publishing your full methodology & results is so that people can read them for themselves and see what you did, decide if you did it right, and maybe do it again to see if the same thing happens. Publishing unreviewed press releases with hyped claims is irresponsible. Not telling people exactly what you have done, what you found, and how you measured it, doesn’t allow them to weigh up the research for themselves.

Incidentally, some of the language used in the newspaper article is – rather outdated & patronising to say the least. I’m hoping that’s due to staff on a local paper not being used to covering disability-related stories, but ‘high-functioning autistic cases’ don’t exist – people with ASD do. They’ve also managed to mention ‘suffering’ seven times in a short article. I would strongly suggest a look at the NAS on ‘What (not) to say about autism’.

National Autistic Society’s rather noncommittal response to DORE .

I’ve heard of ‘publish or perish’, but this is getting daft. If the research was as good as it says, Nature Neuroscience at the very least would be falling over themselves to get their hands on it. It would be huge & deeply exciting news. The front pages of broadsheet papers would doubtless be devoting many inches. So why do DORE feel they need to publish this first in an obscure local newspaper, if the research is that good or the findings that exciting?

Advertisements

15 Responses to “DORE breakthrough published in, ummm ‘Leamington Courier’”

  1. One of the company directors lives in Leamington, I suspect this is a bit of free advertising as a favour to a friend.

    It always surprises me how this gets into the daily mail so often and the Times as well in fact. Each time ‘a breakthrough’! Again, its just advertising.

  2. It’s very near what seems to be their ‘research’ HQ at Kenilworth.
    I suspect it’s mostly just press-release on ‘local organisation done good’ as filler.
    It does not say much for what DORE think of their own research if they want to give the ‘Leamington Chronicle’ an international scoop on it!
    BTW Tom – how did you find me, & do I know you from somewhere else? Feel free to bung me an email, but I like to fit together who I’m talking to.

  3. Oh nicely done Brainduck.
    I read the article before the post and you picked out the things that stood out to me too; poor science and lack of peer review, choosing to make such an ‘important’ announcement in a local paper and the irritating disablist language.
    The low standards of science in much autism research really bugs me. I’d like to mention the lack of ethics too, but after reading about the fella mentioned in your earlier post (Obi), I’ve gone off the word for a while.

  4. […] course, Dore shouldn’t make us guess like this. As BrainDuck puts it publishing science by press-release to local papers first is Not On, particularly when said […]

  5. […] on January 28, 2008 Dore, the dubious dyslexia people, have recently come under criticism from brainduck and holfordwatch for publishing their research claiming to successfully treat Autism Spectrum […]

  6. […] Autism Spectrums And DORE Speculations Jump to Comments So, I’m still waiting on a reply from DORE Australia, after reading a great blogger on the topic of DORE. You see, I have an unanswered question. […]

  7. […] of note, brainduck has an excellent examination of some of the problems of Dore’s research here and here while Ben Goldacre has covered it here.  Dore research has been so flawed that their […]

  8. […] rather implausible ‘treatment’ for dyslexia and dyspraxia, now also being marketed for autistic spectrum disorders – on this blog in the past. We found that Dore’s research was extremely poor but they are […]

  9. […] of blogs noted the limited evidence for Dore’s efficacy – among others, see Bad Science, Brainduck, Gimpy, Left Brain/Right Brain, Podblack, and right here on HolfordWatch – while Gimpy raised the […]

  10. […] noted on this blog and elsewhere, Dore has been marketed as a treatment for ASDs (not to mention dyslexia, dyspraxia and ADHD) based […]

  11. […] which were either unpublished or press-released through such august journals as the Leamington Courier. The research which Wynford Dore said he’d be concentrating on funding, after Dore went broke […]

  12. Pretty nice post. I just stumbled upon your weblog
    and wished to say that I have truly enjoyed browsing your blog posts.

    In any case I will be subscribing to your rss feed
    and I hope you write again very soon!

  13. surfaced surfacer surfaces surfbird surfboat surfeits surffish surfiest.
    This is supposed to take 6 weeks to help, if it ever does.
    droop    drops    dropt    dross    drouk    drove    drown    drubs.

  14. What’s up to every body, it’s my first go to see of this website;
    this blog includes remarkable and actually excellent stuff in favor of
    visitors.

  15. May I simply just say what a relief to uncover somebody
    that actually understands what they’re talking about on the net.
    You definitely realize how to bring an issue to light and make it important.
    More and more people need to read this and understand this side of your story.
    It’s surprising you aren’t more popular because you certainly have the gift.


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: