A device that generates a data connector. The device accesses an index based on representations of documents storing information describing APIs for accessing data source systems, and generates a prompt for a LLM based on information extracted from the index that requests information for accessing data from the data source system. The device provides the generated prompt to the LLM and receives a response describing information associated with the data source. The device determines a measure of ambiguity for the response and, responsive to the measure of ambiguity indicating more than a threshold ambiguity, generates an additional prompt that requests more specific information compared to the information received in the response. The device generates a data connector based on a connector knowledge representation corresponding to the response and deploys the data connector for accessing data from the data source system.