Accurate control of forces produced by the fingers is essential for performing object manipulation. This study examines the indices of finger interaction when accurate time profiles of force are produced in different directions, while using one of the fingers or all four fingers of the hand. We hypothesized that patterns of unintended force production among shear force components may involve features not observed in the earlier studies of vertical force production. In particular, we expected to see unintended forces generated by non-task fingers not in the direction on the instructed force but in the opposite direction as well as substantial force production in directions orthogonal to the instructed direction. We also tested a hypothesis that multi-finger synergies, quantified using the framework of the uncontrolled manifold hypothesis, will help reduce across-trials variance of both total force magnitude and direction. Young, healthy subjects were required to produce accurate ramps of force in five different directions by pressing on force sensors with the fingers of the right (dominant) hand. The index finger induced the smallest unintended forces in non-task fingers. The little finger showed the smallest unintended forces when it was a non-task finger. Task fingers showed substantial force production in directions orthogonal to the intended force direction. During four-finger tasks, individual force vectors typically pointed off the task direction, with these deviations nearly perfectly matched to produce a resultant force in the task direction. Multi-finger synergy indices reflected strong co-variation in the space of finger modes (commands to fingers) that reduced variability of the total force magnitude and direction across trials. The synergy indices increased in magnitude over the first 30% of the trial time and then stayed at a nearly constant level. The synergy index for stabilization of total force magnitude was higher for shear force components as compared to the downward pressing force component. The results suggest complex interactions between enslaving and synergic force adjustments, possibly reflecting the experience with everyday prehensile tasks. For the first time, the data document multi-finger synergies stabilizing both shear force magnitude and force vector direction. These synergies may play a major role in stabilizing the hand action during object manipulation.