Whether the workload generated by aicb simulator supports to express the overlap between computation and communication?

[32HD]

No description provided.

[zhouheyang-alibaba]

The workload of AICB has not yet shown support for demonstrating the overlap of computation and communication, and currently only has some fixed overlap strategies, such as computation and communication overlapping in backward .
Future updates will include scenarios of computation and communication overlap.
If anyone is interested, contributions are welcome.

[Huoyuan100861]

Due to the numerous overlap strategies implemented across different frameworks, and the fact that the same overlap strategy can achieve varying overlap rates in different scenarios, it is extremely challenging to implement a unified overlap simulation. In SimAI-Analytical, we have implemented customizable overlap rates for each communication group, which proves to be both concise and efficient.