Spatial computing

Spatial computing is the paradigm of interaction design that treats three-dimensional space as the primary computational medium, replacing or supplementing two-dimensional screens with volumetric displays, gesture recognition, eye-tracking, and environmental sensing. It is the technical and design infrastructure that makes augmented reality and mixed reality usable, translating the user's bodily position, gaze direction, and hand movements into computational input without relying on keyboards, mice, or touchscreens.

The central design problem of spatial computing is not technical but ecological: how to populate the user's physical environment with digital content without producing cognitive overload or perceptual conflict. Early spatial interfaces borrowed heavily from GUI conventions — floating windows, buttons, menus — transposed into three dimensions. The result was usability disaster: the human visual system did not evolve to track rectangular panels floating in midair. Successful spatial computing requires abandoning screen metaphors entirely and designing for the body's native spatial reasoning capacities: proximity, reach, occlusion, and spatial memory. The field is still searching for its equivalent of the desktop metaphor, and the danger is that the winning metaphor will be determined by platform economics rather than by cognitive fit.