Wilf, M., Korakin, A., Bahat, Y., Koren, O., Galor, N., Dagan, O., et al. (2024). Using virtual reality-based neurocognitive testing and eye tracking to study naturalistic cognitive-motor performance. Neuropsychologia, 194, 108744.
Abstract: Natural human behavior arises from continuous interactions between the cognitive and motor domains. However, assessments of cognitive abilities are typically conducted using pen and paper tests, i.e., in isolation from “real life” cognitive-motor behavior and in artificial contexts. In the current study, we aimed to assess cognitive-motor task performance in a more naturalistic setting while recording multiple motor and eye tracking signals. Specifically, we aimed to (i) delineate the contribution of cognitive and motor components to overall task performance and (ii) probe for a link between cognitive-motor performance and pupil size. To that end, we used a virtual reality (VR) adaptation of a well-established neurocognitive test for executive functions, the 'Color Trails Test' (CTT). The VR-CTT involves performing 3D reaching movements to follow a trail of numbered targets. To tease apart the cognitive and motor components of task performance, we included two additional conditions: a condition where participants only used their eyes to perform the CTT task (using an eye tracking device), incurring reduced motor demands, and a condition where participants manually tracked visually-cued targets without numbers on them, incurring reduced cognitive demands. Our results from a group of 30 older adults (>65) showed that reducing cognitive demands shortened completion times more extensively than reducing motor demands. Conditions with higher cognitive demands had longer target search time, as well as decreased movement execution velocity and head-hand coordination. We found larger pupil sizes in the more cognitively demanding conditions, and an inverse correlation between pupil size and completion times across individuals in all task conditions. Lastly, we found a possible link between VR-CTT performance measures and clinical signatures of participants (fallers versus non-fallers). In summary, performance and pupil parameters were mainly dependent on task cognitive load, while maintaining systematic interindividual differences. We suggest that this paradigm opens the possibility for more detailed profiling of individual cognitive-motor performance capabilities in older adults and other at-risk populations.
|
Zopf, R., Friedman, J., & Williams, M. A. (2015). The plausibility of visual information for hand ownership modulates multisensory synchrony perception. Experimental Brain Research, 233(8), 2311–2321.
Abstract: We are frequently changing the position of our bodies and body parts within complex environments. How does the brain keep track of one’s own body? Current models of body ownership state that visual body ownership cues such as viewed object form and orientation are combined with multisensory information to correctly identify one’s own body, estimate its current location and evoke an experience of body ownership. Within this framework, it may be possible that the brain relies on a separate perceptual analysis of body ownership cues (e.g. form, orientation, multisensory synchrony). Alternatively, these cues may interact in earlier stages of perceptual processing—visually derived body form and orientation cues may, for example, directly modulate temporal synchrony perception. The aim of the present study was to distinguish between these two alternatives. We employed a virtual hand set-up and psychophysical methods. In a two-interval force-choice task, participants were asked to detect temporal delays between executed index finger movements and observed movements. We found that body-specifying cues interact in perceptual processing. Specifically, we show that plausible visual information (both form and orientation) for one’s own body led to significantly better detection performance for small multisensory asynchronies compared to implausible visual information. We suggest that this perceptual modulation when visual information plausible for one’s own body is present is a consequence of body-specific sensory predictions.
|
Steinhart, S., Weiss, P. L., & Friedman, J. (2021). Proximal and distal movement patterns during a graphomotor task in typically developing children and children with handwriting problems. J Neuroeng Rehabil, 18(1), 178.
Abstract: BACKGROUND: Therapists specializing in handwriting difficulties in children often address motor problems including both proximal and distal movements in the upper extremity. Kinematic measures can be used to investigate various aspects of handwriting. This study examined differences in movement patterns in proximal and distal joints of the upper extremity during graphomotor tasks between typically developing children with and without handwriting problems. Additionally, it explored relationships between movement patterns, speed, and legibility of writing. METHODS: Forty-one children, aged 7-11 years, were assessed with the Aleph Aleph Ktav Yad Hebrew Handwriting assessment and the Beery Test of Visual Motor Integration and, based on their scores, were divided into a research group (with handwriting difficulties) and a control group (without handwriting difficulties). Upper extremity joint movement patterns were analyzed with a motion capture system. Differences in the quality of shapes traced and copied on a graphics tablet positioned horizontally and vertically were compared. Between-group differences and relationships with speed and legibility were analyzed. RESULTS: In both groups, there was greater movement in the distal compared to the proximal joints, greater movement when performing the task in a horizontal compared to a vertical plane, and greater movement when tracing than copying. Joint movements in the arm executed scaled-down versions of the shapes being drawn. While the amount of joint displacement was similar between groups, children in the research group showed greater dissimilarity between the drawn shape and the shape produced by the proximal joints. Finally, the drawing measure on the tablet was a significant predictor of legibility, speed of writing, visual motor integration and motor coordination, whereas the dissimilarity measure of joint movement was a significant predictor of speed of writing and motor coordination. CONCLUSIONS: This study provides support for the role of the distal upper extremity joints in the writing process and some guidance to assist clinicians in devising treatment strategies for movement-related handwriting problems. While we observed differences in proximal joint movements between the children with and without handwriting difficulties, the extent to which they are responsible for the differences in drawing quality remains to be determined. Further studies should use a similar methodology to examine additional tasks such as drawing shapes of varying sizes.
|
Liebermann, D. G., Krasovsky, T., & Berman, S. (2008). Planning maximally smooth hand movements constrained to nonplanar workspaces. J Mot Behav, 40(6), 516–531.
Abstract: The article characterizes hand paths and speed profiles for movements performed in a nonplanar, 2-dimensional workspace (a hemisphere of constant curvature). The authors assessed endpoint kinematics (i.e., paths and speeds) under the minimum-jerk model assumptions and calculated minimal amplitude paths (geodesics) and the corresponding speed profiles. The authors also calculated hand speeds using the 2/3 power law. They then compared modeled results with the empirical observations. In all, 10 participants moved their hands forward and backward from a common starting position toward 3 targets located within a hemispheric workspace of small or large curvature. Comparisons of modeled observed differences using 2-way RM-ANOVAs showed that movement direction had no clear influence on hand kinetics (p < .05). Workspace curvature affected the hand paths, which seldom followed geodesic lines. Constraining the paths to different curvatures did not affect the hand speed profiles. Minimum-jerk speed profiles closely matched the observations and were superior to those predicted by 2/3 power law (p < .001). The authors conclude that speed and path cannot be unambiguously linked under the minimum-jerk assumption when individuals move the hand in a nonplanar 2-dimensional workspace. In such a case, the hands do not follow geodesic paths, but they preserve the speed profile, regardless of the geometric features of the workspace.
|
Park, J., Pazin, N., Friedman, J., Zatsiorsky, V. M., & Latash, M. L. (2014). Mechanical properties of the human hand digits: Age-related differences. Clinical Biomechanics, 29(2), 129–137.
Abstract: Background
Mechanical properties of human digits may have significant implications for the hand function. We quantified several mechanical characteristics of individual digits in young and older adults.
Methods
Digit tip friction was measured at several normal force values using a method of induced relative motion between the digit tip and the object surface. A modified quick-release paradigm was used to estimate digit apparent stiffness, damping, and inertial parameters. The subjects grasped a vertical handle instrumented with force/moment sensors using a prismatic grasp with four digits; the handle was fixed to the table. Unexpectedly, one of the sensors yielded leading to a quick displacement of the corresponding digit. A second-order, linear model was used to fit the force/displacement data.
Findings
Friction of the digit pads was significantly lower in older adults. The apparent stiffness coefficient values were higher while the damping coefficients were lower in older adults leading to lower damping ratio. The damping ratio was above unity for most data in young adults and below unity for older adults. Quick release of a digit led to force changes in other digits of the hand, likely due to inertial hand properties. These phenomena of “mechanical enslaving” were smaller in older adults although no significant difference was found in the inertial parameter in the two groups.
Interpretations
The decreased friction and damping ratio present challenges for the control of everyday prehensile tasks. They may lead to excessive digit forces and low stability of the grasped object.
|
