A control system on a material transfer vehicle includes a path planning system that plans a path from the material transfer vehicle to a container, and a navigation system that navigates the material transfer vehicle along the navigation path. An auto unloading system automatically controls the material transfer vehicle as it approaches the container, positions itself closely proximate the container, and unloads material into the container. A handoff control system uses position-based criteria to determine when to switch from controlling the material transfer vehicle using the path planning system to controlling the material transfer vehicle using the auto unload system. The handoff control system generates a control signal triggering the auto unload system to begin controlling the material transfer vehicle when the position-based criteria are met.