A metaverse application receives a first frame of a video. The metaverse application determines facial landmarks of the user in the first frame. The metaverse application generates an animation frame that includes an avatar and a background based on the facial landmarks and the first frame. The metaverse application determines a head orientation of the user in the first frame based on the facial landmarks. The metaverse application maps an orientation of the mobile device to the head orientation of the user. For each additional frame of the video subsequent to the first frame, the metaverse application updates the orientation of the mobile device. The metaverse application generates subsequent animation frames that include the avatar and the background based on the updated orientation of the mobile device in relation to the head orientation.