-
Notifications
You must be signed in to change notification settings - Fork 141
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docs: remote monitoring integration steps from Interplai #347
base: main
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
Original file line number | Diff line number | Diff line change | ||||
---|---|---|---|---|---|---|
@@ -0,0 +1,52 @@ | ||||||
**Autoware Interplai Teleoperation Design** | ||||||
|
||||||
**Remote Monitoring - Architecture:** | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
![image-20230404160609015](/home/dark/snap/typora/78/.config/Typora/typora-user-images/image-20230404160609015.png) | ||||||
|
||||||
**Phase – 1 (Remote monitoring):** | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
**On Vehicle Side:** | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
- ROS2 node for starting/ launching the robot script | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
for ex: WebRTCDataTransferNode | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
- Gstream pipeline for gathering video data from 4 cameras and audio from 1 microphone | ||||||
- Data channel for transmitting/ receiving control commands | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
- Registering the vehicle ID on signaling server (communication medium) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
- Integrate ROS2 node (WebRTCDataTransferNode) inside launch file of Autoware Universe | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
- Communicate with the signaling server, hosted on (ex: AWS, GCP) where Vehicle ID can get registered | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
**Dash board:** | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
![image-20230404160644152](/home/dark/snap/typora/78/.config/Typora/typora-user-images/image-20230404160644152.png) | ||||||
|
||||||
**On Remote Side:** | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
- Web login setup for remote user for monitoring the vehicle | ||||||
|
||||||
- Option to choose the remote monitoring on web page | ||||||
|
||||||
- ID mapping between vehicle and remote operator happens on signaling server , to allow only authenticated access | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
- Disconnect button for closing the remote monitoring | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
**Phase – 2 (Tele-operation):** | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
In addition to phase – 1, | ||||||
|
||||||
- We have option to send GPS coordinates from vehicle to remote web page, to monitor the vehicle state | ||||||
|
||||||
- We can send control commands via data channel from operator web page using joystick to vehicle | ||||||
|
||||||
- Control commands: Throttle, Steering | ||||||
|
||||||
- We have ROS2 topic “operator_control_command”, which accepts the incoming control commands from operator | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
Application: Tele-operation for parking lot | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
I think we can use without the dash symbol https://en.wikipedia.org/wiki/Teleoperation |
||||||
|
||||||
Vehicle to Infrastructure communication | ||||||
-5G Modem(simcom,quectel) | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
||||||
|
||||||
- Auto-ware platform’s “emergency stop” can be reused for safe teleoperation as redudant safety system | ||||||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Suggested change
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.