Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

ObjectiveComplex Figure Copy Tasks are one of the most commonly employed neuropsychological tests. However, manual scoring of this test is time-consuming, requires training, and can then still be inconsistent between different examiners. We aimed to develop and evaluate a novel, automated method for scoring a tablet-based Figure Copy Task. MethodA cohort of 261 healthy adults and 203 stroke survivors completed the computerised Oxford Cognitive Screen – Plus Figure Copy Task. Responses were independently scored by two trained human raters and by a novel automated scoring program. ResultsOverall, the Automated Scoring Program was able to reliably extract and identify the separate figure elements (average sensitivity and specificity of 92.10% and 90.20% respectively) and assigned total scores which agreed well with manual scores (ICC = .83). Receiver Operating Curve analysis demonstrated that, compared to overall impairment categorisations based on manual scores, the Automated Scoring Program had an overall sensitivity and specificity of 80% and 93.40% respectively (AUC = 86.70%). Automated total scores also reliably distinguished between different clinical impairment groups with acute stroke survivors scoring significantly worse than longer term survivors, which in turn scored worse than neurologically healthy adults. ConclusionsThese results demonstrate that the novel automated scoring algorithm was able to reliably extract and accurately score Figure Copy Task data, even in cases where drawings were highly distorted due to comorbid fine-motor deficits. This represents a significant advancement as this novel technology can be employed to produce immediate, unbiased, and reproducible scores for Figure Copy Task responses in clinical and research environments.

Original publication

DOI

10.31234/osf.io/sfzjc

Type

Journal article

Publication Date

18/11/2020