Visual space is perceived as continuous and stable even though visual inputs from the left and right visual fields are initially processed separately within the two cortical hemispheres. In the research reported here, we examined whether the visual system utilizes a dynamic recalibration mechanism to integrate these representations and to maintain alignment across the visual fields. Subjects adapted to randomly oriented moving lines that straddled the vertical meridian; these lines were vertically offset between the left and right hemifields. Subsequent vernier alignment judgments revealed a negative aftereffect: An offset in the same direction as the adaptation was required to correct the perceived misalignment. This aftereffect was specific to adaptation to vertical, but not horizontal, misalignments and also occurred following adaptation to movie clips and patterns without coherent motion. Our results demonstrate that the visual system unifies the left and right halves of visual space by continuously recalibrating the alignment of elements across the visual fields.