In an example embodiment, a solution is provided that allows users to interact directly with underlying object data lake storages in hyperscalers when accessing user data. This feature is known as direct access. Use of this solution increases performance of the user systems and the cloud systems, without impacting the functionality nor increasing the complexity. This is true even for Spark users, where the driver abstracts the communication path between the Spark application and HDL files. This results in an opt-in solution that allows users to reduce their cost by increasing complexity.