|
|
Thorpe, A., Friedman, J., Evans, S., Nesbitt, K., & Eidels, A. (2022). Mouse Movement Trajectories as an Indicator of Cognitive Workload. International Journal of Human-Computer Interaction, 38(15), 1464–1479.
Abstract: Assessing the cognitive impact of user interfaces is a shared focus of human-computer interaction researchers and cognitive scientists. Methods of cognitive assessment based on data derived from the system itself, rather than external apparatus, have the potential to be applied in a range of scenarios. The current study applied methods of analyzing kinematics to mouse movements in a computer-based task, alongside the detection response task, a standard workload measure. Sixty-five participants completed a task in which stationary stimuli were tar;geted using a mouse, with a within-subjects factor of task workload based on the number of targets to be hovered over with the mouse (one/two), and a between-subjects factor based on whether both targets (exhaustive) or just one target (minimum-time) needed to be hovered over to complete a trial when two targets were presented. Mouse movement onset times were slower and mouse movement trajectories exhibited more submovements when two targets were presented, than when one target was presented. Responses to the detection response task were also slower in this condition, indicating higher cognitive workload. However, these differences were only found for participants in the exhaustive condition, suggesting those in the minimum-time condition were not affected by the presence of the second target. Mouse movement trajectory results agreed with other measures of workload and task performance. Our findings suggest this analysis can be applied to workload assessments in real-world scenarios.
|
|
|
|
Zacks, O., & Friedman, J. (2020). Analogies can speed up the motor learning process. Sci Rep, 10(1), 6932.
Abstract: Analogies have been shown to improve motor learning in various tasks and settings. In this study we tested whether applying analogies can shorten the motor learning process and induce insight and skill improvement in tasks that usually demand many hours of practice. Kinematic measures were used to quantify participant's skill and learning dynamics. For this purpose, we used a drawing task, in which subjects drew lines to connect dots, and a mirror game, in which subjects tracked a moving stimulus. After establishing a baseline, subjects were given an analogy, explicit instructions or no further instruction. We compared their improvement in skill (quantified by coarticulation or smoothness), accuracy and movement duration. Subjects in the analogy and explicit groups improved their coarticulation in the target task, while significant differences were found in the mirror game only at a slow movement frequency between analogy and controls.We conclude that a verbal analogy can be a useful tool for rapidly changing motor kinematics and movement strategy in some circumstances, although in the tasks selected it did not produce better performance in most measurements than explicit guidance. Furthermore, we observed that different movement facets may improve independently from others, and may be selectively affected by verbal instructions. These results suggest an important role for the type of instruction in motor learning.
|
|
|
|
Dempsey-Jones, H., Wesselink, D. B., Friedman, J., & Makin, T. R. (2019). Organized Toe Maps in Extreme Foot Users. Cell Reports, 28(11), 2748–2756.e4.
Abstract: Although the fine-grained features of topographic maps in the somatosensory cortex can be shaped by everyday experience, it is unknown whether behavior can support the expression of somatotopic maps where they do not typically occur. Unlike the fingers, represented in all primates, individuated toe maps have only been found in non-human primates. Using 1-mm resolution fMRI, we identify organized toe maps in two individuals born without either upper limb who use their feet to substitute missing hand function and even support their profession as foot artists. We demonstrate that the ordering and structure of the artists’ toe representation mimics typical hand representation. We further reveal “hand-like” features of activity patterns, not only in the foot area but also similarly in the missing hand area. We suggest humans may have an innate capacity for forming additional topographic maps that can be expressed with appropriate experience.
|
|
|
|
Zopf, R., Truong, S., Finkbeiner, M., Friedman, J., & Williams, M. A. (2011). Viewing and feeling touch modulates hand position for reaching. Neuropsychologia, 49(5), 1287–1293.
Abstract: Action requires knowledge of our body location in space. Here we asked if interactions with the external world prior to a reaching action influence how visual location information is used. We investigated if the temporal synchrony between viewing and feeling touch modulates the integration of visual and proprioceptive body location information for action. We manipulated the synchrony between viewing and feeling touch in the Rubber Hand Illusion paradigm prior to participants performing a ballistic reaching task to a visually specified target. When synchronous touch was given, reaching trajectories were significantly shifted compared to asynchronous touch. The direction of this shift suggests that touch influences the encoding of hand position for action. On the basis of this data and previous findings, we propose that the brain uses correlated cues from passive touch and vision to update its own position for action and experience of self-location.
|
|
|
|
Friedman, J., & Korman, M. (2016). Offline Optimization of the Relative Timing of Movements in a Sequence Is Blocked by Retroactive Behavioral Interference. Front. Hum. Neurosci., 10, 623.
Abstract: Acquisition of motor skills often involves the concatenation of single movements into sequences. Along the course of learning, sequential performance becomes progressively faster and smoother, presumably by optimization of both motor planning and motor execution. Following its encoding during training, “how-to” memory undergoes consolidation, reflecting transformations in performance and its neurobiological underpinnings over time. This offline post-training memory process is characterized by two phenomena: reduced sensitivity to interference and the emergence of delayed, typically overnight, gains in performance. Here, using a training protocol that effectively induces motor sequence memory consolidation, we tested temporal and kinematic parameters of performance within (online) and between (offline) sessions, and their sensitivity to retroactive interference. One group learned a given finger-to-thumb opposition sequence (FOS), and showed robust delayed (consolidation) gains in the number of correct sequences performed at 24 h. A second group learned an additional (interference) FOS shortly after the first and did not show delayed gains. Reduction of touch times and inter-movement intervals significantly contributed to the overall offline improvement of performance overnight. However, only the offline inter-movement interval shortening was selectively blocked by the interference experience. Velocity and amplitude, comprising movement time, also significantly changed across the consolidation period but were interference-insensitive. Moreover, they paradoxically canceled out each other. Current results suggest that shifts in the representation of the trained sequence are subserved by multiple processes: from distinct changes in kinematic characteristics of individual finger movements to high-level, temporal reorganization of the movements as a unit. Each of these processes has a distinct time course and a specific susceptibility to retroactive interference. This multiple-component view may bridge the gap in understanding the link between the behavioral changes, which define online and offline learning, and the biological mechanisms that support those changes.
|
|
