Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: remote monitoring integration steps from Interplai #347

Open
wants to merge 2 commits into
base: main
Choose a base branch
from
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -0,0 +1,52 @@
​ **Autoware Interplai Teleoperation Design**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**Autoware Interplai Teleoperation Design**
# Autoware Interplai Teleoperation Design


**Remote Monitoring - Architecture:**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**Remote Monitoring - Architecture:**
## Remote Monitoring - Architecture


![image-20230404160609015](/home/dark/snap/typora/78/.config/Typora/typora-user-images/image-20230404160609015.png)

**Phase – 1 (Remote monitoring):**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**Phase – 1 (Remote monitoring):**
### Phase – 1 (Remote monitoring)


**On Vehicle Side:**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**On Vehicle Side:**
#### On Vehicle Side


- ROS2 node for starting/ launching the robot script
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- ROS2 node for starting/ launching the robot script
- ROS 2 node for starting and launching the robot script

for ex: WebRTCDataTransferNode
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
for ex: WebRTCDataTransferNode
- Example: `WebRTCDataTransferNode`

- Gstream pipeline for gathering video data from 4 cameras and audio from 1 microphone
- Data channel for transmitting/ receiving control commands
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Data channel for transmitting/ receiving control commands
- Data channel for transmitting and receiving control commands

- Registering the vehicle ID on signaling server (communication medium)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Registering the vehicle ID on signaling server (communication medium)
- Register the vehicle ID on the signaling server (communication medium).


- Integrate ROS2 node (WebRTCDataTransferNode) inside launch file of Autoware Universe
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Integrate ROS2 node (WebRTCDataTransferNode) inside launch file of Autoware Universe
- Integrate the ROS 2 node (`WebRTCDataTransferNode`) inside launch file of Autoware Universe.


- Communicate with the signaling server, hosted on (ex: AWS, GCP) where Vehicle ID can get registered
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Communicate with the signaling server, hosted on (ex: AWS, GCP) where Vehicle ID can get registered
- Communicate with the signaling server, hosted on (e.g. AWS, GCP) where the Vehicle ID can get registered.

e.g. is preferred over ex::


**Dash board:**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**Dash board:**
##### Dashboard


![image-20230404160644152](/home/dark/snap/typora/78/.config/Typora/typora-user-images/image-20230404160644152.png)

**On Remote Side:**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**On Remote Side:**
#### On Remote Side


- Web login setup for remote user for monitoring the vehicle

- Option to choose the remote monitoring on web page

- ID mapping between vehicle and remote operator happens on signaling server , to allow only authenticated access
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- ID mapping between vehicle and remote operator happens on signaling server , to allow only authenticated access
- ID mapping between vehicle and remote operator happens on signaling server, to allow only authenticated access.


- Disconnect button for closing the remote monitoring
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Disconnect button for closing the remote monitoring
- Disconnect button to close the remote monitoring.


**Phase – 2 (Tele-operation):**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
**Phase – 2 (Tele-operation):**
### Phase – 2 (Tele-operation)


In addition to phase – 1,

- We have option to send GPS coordinates from vehicle to remote web page, to monitor the vehicle state

- We can send control commands via data channel from operator web page using joystick to vehicle

- Control commands: Throttle, Steering

- We have ROS2 topic “operator_control_command”, which accepts the incoming control commands from operator
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- We have ROS2 topic operator_control_command, which accepts the incoming control commands from operator
- We have ROS 2 topic `operator_control_command`, which accepts the incoming control commands from operator.


Application: Tele-operation for parking lot
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Application: Tele-operation for parking lot
Application: Teleoperation for parking lot

I think we can use without the dash symbol https://en.wikipedia.org/wiki/Teleoperation


Vehicle to Infrastructure communication
-5G Modem(simcom,quectel)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
-5G Modem(simcom,quectel)
- 5G Modem (e.g. SIMCom, Quectel)


- Auto-ware platform’s “emergency stop” can be reused for safe teleoperation as redudant safety system
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- Auto-ware platform’s “emergency stop” can be reused for safe teleoperation as redudant safety system
- Autoware platform’s “emergency stop” can be reused for safe teleoperation as redundant safety system

Loading