[WIP] Support Ray monitoring

[Superskyyy]

Ray is a popular distributed computing framework that powered the training of all kinds of AI workloads, e.g., ChatGPT. My current work goes deep into the Ray side so I'd like to start working on monitoring Ray with SkyWalking, I will draft a SWIP first and share here.

[wu-sheng]

Is that a Python framework?

[wu-sheng]

Meanwhile, if this is a client framework, why SWIP is considered? Is there a backend relative change?

[Superskyyy]

Both client and server sides are needed since the Ray cluster performance is also critical. Ray backend already ships metrics for scraping, so I will add a dedicated dashboard.

[wu-sheng]

That makes sense. Please be advised, current service hierarchy concept, which requires you to build the link between virtual services and server services. I am not sure which kind of virtual service you could treat the remote from the client side.

[Superskyyy]

Ok, I need to read about that concept to understand a bit more.

[wu-sheng]

We have built this into v10, https://skywalking.apache.org/docs/main/next/en/concepts-and-designs/service-hierarchy/

Also, the showcase has some of that hierarchy recognition already.