intra_pipeline_hetero.txt

Park, Jay H., et al. "{HetPipe}: Enabling large {DNN} training on (whimpy) heterogeneous {GPU} clusters through integration of pipelined model parallelism and data parallelism." 2020 USENIX Annual Technical Conference (USENIX ATC 20). 2020.;https://www.usenix.org/conference/atc20/presentation/park;122;See section 7 for HetPipe's intra-pipeline layer partition algorithm(ILP)
Liu, Ji, et al. "Heterps: Distributed deep learning with reinforcement learning based scheduling in heterogeneous environments." Future Generation Computer Systems 148 (2023): 106-117.;https://www.sciencedirect.com/science/article/pii/S0167739X23002157;31; This paper uses reinforcement learning to select device for every layer