Aspects of the subject disclosure may include, for example, a device comprising a processing system and a memory storing executable instructions that, when executed by the processing system, cause the processing system to schedule retrieval of a dataset stored in a cloud network and determine rules, from a preconfigured set of rules, for checking data quality in the dataset. The processing system can identify data quality exceptions in the dataset using the determined rules and generate an exception report based on the identified exceptions. In some embodiments, the processing system adjusts a size of a job cluster to enable caching of the dataset, caches the entirety of the dataset to reduce re-reads or re-queries during processing, and performs corrective actions to correct data in the dataset to remove the data quality exceptions. Other embodiments are disclosed.