Behavioural Science Blog

In one of the last posts I summarized three articles that all came to the conclusion that there was no big difference between novice and expert therapists. I came to the conclusion that the tasks used were presenting ready-to-judge material, which was in no way ecological valid. I hypothesised that the true merit of expertise would rather lay in the skill of information gathering and a vast network of knowledge including contra-indications and possible developmental pathways that need to be taken into account. The article by Kuyken, Fothergill, Musa and Chadwick (2005) The reliability and quality of cognitive case information further elaborates on the process that take place in therapy and focuses mainly on the stage of information gathering. The authors had participants of different experience levels make case formulations using the J. Beck Case Conceptualization Diagram (CCD). 115 mental health practitioners were given extensive information about a hypothetical case (Anna), which included an account of the presenting problem, a psychosocial history, observation of the client during the assessment, standardized psychological assessments and a multi-axial diagnosis. Quality of the case formulation was rated with the Cognitive Case Formulation Scale and was defined as a ‘parsimonious, coherent and meaningful account of a client’s presenting problems in cognitive therapy terms. Interrater reliability for the judges who rated the CCD was good, although the rating of dysfunctional assumptions (in subcategories) only reached a kappa of 0,63. The case formulations of the participants were rated against a benchmark formulation provided by J. Beck and ranged from very poor to good. Only 44,2% of the formulations were found to be at least “good enough”. Such benchmarking by an allegedly expert must be interpreted with caution, because the agreement with the systematic approach of the CCD is measured and not validity of the case formulation. Chi-square analysis revealed that the quality of the formulations did differ between the three groups (novice, experienced and expert). Participants who had a professional qualification or a BABCP accreditation provided case formulations of a better quality than the other participants. So for the time being I keep on believing that the true expertise is found in the systematic and comprehensive information gathering and not in the interpretation of (hypothetical) data. I would like to see an experiment in which novices and experts talk to a (real) client and gather information. The information that is produced by that session could then be presented to other novices and experts. Those would have to make several predictions about the patient that could be verified in a longitudinal study. I hypothesis that variance on the second task will mainly be explained by the expertise level of the first therapist with almost no interaction with the expertise level of the second therapist.