A system and method enable creation and modification of digital objects within an extended reality (XR) environment using voice commands in combination with detected physical user inputs. An XR hardware device detects a spoken command requesting creation or modification of a digital object and detects a physical input indicative of a spatial location within the XR environment. Spatial coordinates corresponding to the physical input are determined, and a representation of the digital object is displayed at the determined spatial coordinates. Visual attributes of the digital object may be assigned or modified based on additional spoken instructions and user interactions, including gesture-based inputs and measurement selection interfaces.