An autonomous pile driving system comprises an arm of an autonomous offroad vehicle (AOV) configured to hold and drive a pile, a chute configured to stabilize the pile as the pile is being driven. The autonomous pile driving system further comprises a controller configured to identify a location in the geographic area where a pile is to be driven (e.g., installed) and position the chute at the location. The controller aligns the pile secured by the AOV with an opening of the chute and inserts the pile into the chute by actuating an arm (or other suitable component) of the AOV securing the pile.