Systems and methods are provided for a multi-tenant collective communication fabric for optimal utilization of communication links between compute nodes of an interconnected system. Examples include allocating a plurality of compute nodes to a first workload and obtaining a topology of the interconnected system representative of an indirect path between the allocated compute nodes. The indirect path comprises a non-allocated compute node of the interconnected system. The examples include creating plurality of slices of resources of the non-allocated compute node, with a first slice dedicated to processing and forwarding data traffic along the indirect path and a second slice configured for allocation to a second workload. The examples also include executing the first workload by the allocated compute nodes and the non-allocated compute node, wherein data traffic from the plurality of allocated compute nodes is communicated via the indirect communication path.