This piece has just gone up at the Guardian's Cif. I took part in a discussion about the same research last night on BBC Radio 3's Night Waves too...

People who are "spiritual but not religious" are more likely to suffer poor mental health, according to a study published in the British Journal of Psychiatry. Michael King of University College London and his colleagues examined 7,400 interviews with folk in Britain, of whom 35% had a religious understanding of life, 19% a spiritual one and 46% neither a religious nor spiritual outlook. The analysis led to one clear conclusion. "People who have a spiritual understanding of life in the absence of a religious framework are vulnerable to mental disorder [dependence on drugs, abnormal eating attitudes, anxiety, phobias and neuroses]." The work supports evidence from other studies too.

All the usual weaknesses associated with asking individuals about religion are at play here, as the authors acknowledge. Nonetheless, the study prompts a number of speculations.

The spiritual itch is a deep one in the human psyche, for those who feel it. To scratch without the support of others might lead to an inner obsession that spirals out of control. It is possible, too, that personal crises drive people to seek spiritual solace that of itself does not address the underlying psychological distress. Then again, the resources of a healthy spiritual tradition, not pursued in isolation, should provide or point to the means of addressing psychological problems. The ground is then gradually cleared for genuine spiritual growth.

This raises another question, though. Do religious organisations in the UK today take enough notice of the insights of psychology and, conversely, do schools of therapy treat spirituality seriously? As the Cambridge psychologist and priest Fraser Watts explored in a recent talk, American therapists, for example, seem to be far happier talking about their clients' spiritual concerns than their British counterparts.

This must highlight broader cultural differences. In the US, religion tends to carry associations of freedom. I remember an American priest once saying to me, when I expressed amazement at the prevalence of religiosity in the US, that Americans came from Europe fleeing religious persecution. The two words "religion" and "freedom" naturally go together in the American psyche.

In Britain, though, it appears that many individuals view religion as an impingement upon their spiritual searching. Christianity, say, is felt to constrain life – perhaps because of the negative attitudes it projects about gay people and women; or because it presents belief as more important than growth; or because it looks more interested in sin than enlightenment. If that is so, the new research is a striking indictment of the failure of British churches to meet spiritual needs: individuals are not just not coming to church, some are becoming mentally ill as a result of religious failure.

Other results from the research are striking too, though similarly not determinative. People with no religious or spiritual understanding were significantly younger and more often white British, but were less likely to have qualifications beyond secondary school, perhaps challenging research purporting to show that atheists are more intelligent.

Another finding of this work was that those who were neither religious nor spiritual had just as good mental health as those the religious. This contradicts a notion widely held in positive psychology that religion is good for happiness (though that positive correlation typically derives from North American evidence.)

Finally, the research challenges the stance of those who are spiritual but not religious. It might be called the individualism delusion, the conviction that I can "do God" on my own. And yet, as the psychotherapist Donald Winnicott argued, human beings need to work through traditions to resource their personal creativity. Only in the lives of others can we make something rich of our own life. To be spiritual but not religious might be said to be like embarking on an extreme sport while refusing the support of safety procedures and the wisdom of experts who have made the jump before. Spirituality is like love: more risky than you can countenance when you're falling for it.