A method includes receiving input data from external data sources. The input data is received by a data product pipeline. The method also includes extracting a portion of the input data using the data product pipeline to produce extracted data. The method also includes transferring the extracted data from the data product pipeline to a data product raw storage. The method also includes receiving the input data directly from the external data sources. The method also includes transferring the extracted data and the input data from the data product raw storage back to the data product pipeline. The method also includes receiving data products. The method also includes transforming the input data, the extracted data, and the data products into transformed data using the data product pipeline. The method also includes transferring the transformed data to a data product artifact storage.