Computer-implemented methods may include monitoring, during a ride provided by an autonomous vehicle (AV), sensor data generated by one or more sensors associated with the AV. The sensor data may include image data, audio data, seat sensor data, or seatbelt sensor data indicative of passenger behavior. The sensor data may be analyzed to evaluate passenger comfort or discomfort during the AV ride. Based on the analysis, one or more passenger ride preferences associated with changeable features of the AV may be inferred. The inferred passenger ride preferences may be stored in association with the passenger and may be applied during a subsequent AV ride carrying the passenger. Various other methods, systems, and computer-readable media are also disclosed.