Skip to content

Commit

Permalink
Browse files Browse the repository at this point in the history
  • Loading branch information
gefei committed Jan 29, 2024
1 parent ace2fb8 commit 2fcf3d0
Show file tree
Hide file tree
Showing 13 changed files with 72 additions and 37 deletions.
4 changes: 2 additions & 2 deletions index.xml
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ Crawler: We built a crawler which can extract learning material names and keywor
<pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>

<guid>https://htw-imi-showtime.github.io/tryout/ws23/bachelor/b7-ar-interaction-city/features/</guid>
<description>Communication Wifi To ensure that our hardware can communicate smoothly in the same network, we use a Raspberry Pi as a WLAN hotspot. This ensures an uninterrupted connection and enables our devices to work together optimally.
<description>Communication Wi-Fi To ensure that our hardware can communicate smoothly in the same network, we use a Raspberry Pi as a WLAN hotspot. This ensures an uninterrupted connection and enables our devices to work together optimally.
MQTT Communication takes place via MQTT, an open network protocol for machine-to-machine communication. The Arduino uses the MQTT protocol to send messages to the Raspberry Pi, which acts as an MQTT broker. At the same time, the HoloLens glasses subscribe to these messages to receive real-time information.</description>
</item>

Expand Down Expand Up @@ -765,7 +765,7 @@ To see our progress visually, we created a lively Miro board connected to our Ga
<guid>https://htw-imi-showtime.github.io/tryout/ws23/bachelor/b7-ar-interaction-city/technology/</guid>
<description>Organisation and Communication We used Mattermost for our internal communication and for issue tracking.
Mattermost Development HoloLens To develop the AR/XR App that is running on the HoloLens 2 we used Visual Studio (Code) and Unity with MRTK2.
Raspberry The Rapsberry Pi runs the Debian Raspberry Distribution and is the communication middleware. It serves as the mqtt broker and the wifi hotspot that the arduino and hololens connect too. The Raspberry Pi was set up with the CLI</description>
Programming Language: C# Raspberry The Raspberry Pi runs the Debian Raspberry Distribution and is the communication middleware. It serves as the MQTT broker and the Wi-Fi hotspot that the Arduino and HoloLens connect too.</description>
</item>

<item>
Expand Down
6 changes: 3 additions & 3 deletions projects/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -195,16 +195,16 @@ <h3>AvataVR</h3>
<div>
<span class="type">B7 Bachelor</span>
<a href="/tryout/ws23/bachelor/b7-ar-interaction-city/">
<h3>VisionIO</h3>
<h3>Vision.IO</h3>
</a>
<p>VisionIO shows the possibilities of merging the augmented world with the real world. Transform what you see in the augmented reality world with the help of physical interactions. Immerse yourself in a new experience that turns augmented reality into extended reality.</p>
<p>Vision.IO, a digital-haptic city model for information communication through XR/AR showcases the potential of merging augmented reality with physical interactions. This immersive experience transforms augmented reality into extended reality, offering an innovative way to perceive and interact with urban environments.</p>
<a href="/tryout/ws23/bachelor/b7-ar-interaction-city/">-> Details</a>
</div>




<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/Logo.png" alt="VisionIO">
<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/Logo.png" alt="Vision.IO">
</section>
<hr class="alternate">

Expand Down
Binary file added ws23/bachelor/b7-ar-interaction-city/Com.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file modified ws23/bachelor/b7-ar-interaction-city/Logo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
14 changes: 4 additions & 10 deletions ws23/bachelor/b7-ar-interaction-city/features/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@
<header class="project-header">
<h1>
<span class="type">B7 Bachelor</span>
VisionIO
Vision.IO
<span class="underscore-spacer"> </span>
</h1>
<section style="text-align: right;">
Expand Down Expand Up @@ -122,21 +122,15 @@ <h3>
</h3>
<div class="spacer"></div>
<div class="content">
<h4 id="wifi">Wifi</h4>
<h4 id="wi-fi">Wi-Fi</h4>
<p>To ensure that our hardware can communicate smoothly in the same network, we use a Raspberry Pi as a WLAN hotspot. This ensures an uninterrupted connection and enables our devices to work together optimally.</p>
<h4 id="mqtt">MQTT</h4>
<p>Communication takes place via MQTT, an open network protocol for machine-to-machine communication.
The Arduino uses the MQTT protocol to send messages to the Raspberry Pi, which acts as an MQTT broker. At the same time, the HoloLens glasses subscribe to these messages to receive real-time information. This seamless exchange enables efficient communication between the devices, with the Raspberry Pi acting as the central intermediary to establish the connection between the Arduino and the HoloLens.</p>
<section class="gallery">
<figure>
<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/Wifi.png" alt="Wifi Logo">
<figcaption>Wifi</figcaption>
</figure>
<figure>
<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/MQTT.png" alt="MQTT Logo">
<figcaption>MQTT</figcaption>
<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/Com.png" alt="Communication">
<figcaption>Communication Schema</figcaption>
</figure>
</section>

</div>
</section>
Expand Down
5 changes: 3 additions & 2 deletions ws23/bachelor/b7-ar-interaction-city/future/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@
<header class="project-header">
<h1>
<span class="type">B7 Bachelor</span>
VisionIO
Vision.IO
<span class="underscore-spacer"> </span>
</h1>
<section style="text-align: right;">
Expand Down Expand Up @@ -123,7 +123,8 @@ <h3>
<div class="spacer"></div>
<div class="content">
Our project is very open and creates a basis for extended reality. You can consider incorporating new interactions, such as switches or touch panels, or changing the platform and running the project on a tablet or VR glasses.
New use cases can also be devised and tested. This project could be used very well in industry for maintenance work on machines and establish communication from the machine to the goggles.
New use cases can also be devised and tested. This project could be used very well in industry for maintenance work on machines and establish communication from the machine to the goggles. Further applications could be in a learning environment, where content could not only be shown, but things could be changed haptically, and you could directly see the impact. Be it in schools to present practical laboratory experiments that would otherwise not be possible in the classroom, or in medical training to practice surgical techniques.
This project creates the platform for all this and much more.
</div>
</section>

Expand Down
22 changes: 18 additions & 4 deletions ws23/bachelor/b7-ar-interaction-city/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@
<header class="project-header">
<h1>
<span class="type">B7 Bachelor</span>
VisionIO
Vision.IO
<span class="underscore-spacer"> </span>
</h1>
<section style="text-align: right;">
Expand Down Expand Up @@ -118,18 +118,32 @@ <h4>Supervision</h4>


<p class="intro">
VisionIO shows the possibilities of merging the augmented world with the real world. Transform what you see in the augmented reality world with the help of physical interactions. Immerse yourself in a new experience that turns augmented reality into extended reality.
Vision.IO, a digital-haptic city model for information communication through XR/AR showcases the potential of merging augmented reality with physical interactions. This immersive experience transforms augmented reality into extended reality, offering an innovative way to perceive and interact with urban environments.
</p>

<section>









<figure>
<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/Logo.png" alt="Logo">

</figure>

<section>
<h3>

Our Goal

</h3>
<div class="spacer"></div>
<div class="content">
With VisionIO, we want to show that it is possible to expand augmented reality. Simple interactions, such as pressing a button, turning a knob or exchanging objects in the real world, change the augmented world.
With Vision.IO, we want to show that it is possible to expand augmented reality. Simple interactions, such as pressing a button, turning a knob or exchanging objects in the real world, change the augmented world.
To illustrate this interaction, our model shows what the world will look like in 2050. Based on the interactions, you can adjust the energy mix, rebuild factories or replace houses and thus decide how sustainable the individual sectors are.
</div>
</section>
Expand Down
8 changes: 4 additions & 4 deletions ws23/bachelor/b7-ar-interaction-city/index.xml
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
<channel>
<title>VisionIO on IMI Showtime</title>
<title>Vision.IO on IMI Showtime</title>
<link>https://htw-imi-showtime.github.io/tryout/ws23/bachelor/b7-ar-interaction-city/</link>
<description>Recent content in VisionIO on IMI Showtime</description>
<description>Recent content in Vision.IO on IMI Showtime</description>
<generator>Hugo -- gohugo.io</generator>
<language>de-de</language><atom:link href="https://htw-imi-showtime.github.io/tryout/ws23/bachelor/b7-ar-interaction-city/index.xml" rel="self" type="application/rss+xml" />
<item>
Expand All @@ -12,7 +12,7 @@
<pubDate>Mon, 01 Jan 0001 00:00:00 +0000</pubDate>

<guid>https://htw-imi-showtime.github.io/tryout/ws23/bachelor/b7-ar-interaction-city/features/</guid>
<description>Communication Wifi To ensure that our hardware can communicate smoothly in the same network, we use a Raspberry Pi as a WLAN hotspot. This ensures an uninterrupted connection and enables our devices to work together optimally.
<description>Communication Wi-Fi To ensure that our hardware can communicate smoothly in the same network, we use a Raspberry Pi as a WLAN hotspot. This ensures an uninterrupted connection and enables our devices to work together optimally.
MQTT Communication takes place via MQTT, an open network protocol for machine-to-machine communication. The Arduino uses the MQTT protocol to send messages to the Raspberry Pi, which acts as an MQTT broker. At the same time, the HoloLens glasses subscribe to these messages to receive real-time information.</description>
</item>

Expand All @@ -33,7 +33,7 @@ MQTT Communication takes place via MQTT, an open network protocol for machine-to
<guid>https://htw-imi-showtime.github.io/tryout/ws23/bachelor/b7-ar-interaction-city/technology/</guid>
<description>Organisation and Communication We used Mattermost for our internal communication and for issue tracking.
Mattermost Development HoloLens To develop the AR/XR App that is running on the HoloLens 2 we used Visual Studio (Code) and Unity with MRTK2.
Raspberry The Rapsberry Pi runs the Debian Raspberry Distribution and is the communication middleware. It serves as the mqtt broker and the wifi hotspot that the arduino and hololens connect too. The Raspberry Pi was set up with the CLI</description>
Programming Language: C# Raspberry The Raspberry Pi runs the Debian Raspberry Distribution and is the communication middleware. It serves as the MQTT broker and the Wi-Fi hotspot that the Arduino and HoloLens connect too.</description>
</item>

<item>
Expand Down
Binary file added ws23/bachelor/b7-ar-interaction-city/model.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
20 changes: 18 additions & 2 deletions ws23/bachelor/b7-ar-interaction-city/process/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@
<header class="project-header">
<h1>
<span class="type">B7 Bachelor</span>
VisionIO
Vision.IO
<span class="underscore-spacer"> </span>
</h1>
<section style="text-align: right;">
Expand Down Expand Up @@ -148,12 +148,28 @@ <h3>
</h3>
<div class="spacer"></div>
<div class="content">
We initially split the development into three sub-projects. We had to create a basis for the Arduino, the Raspberry had to be set up and the Unity project for the HoloLens also needed a basis. We then started to establish communication between the Arduino and the Raspberry Pi and then between the Raspberry Pi and the HoloLens.
We initially split the development into three subprojects. We had to create a basis for the Arduino, the Raspberry had to be set up and the Unity project for the HoloLens also needed a basis. We then started to establish communication between the Arduino and the Raspberry Pi and between the Raspberry Pi and the HoloLens.
Once the communication between the hardware was working, we were able to focus on improving it and also building the Unity model so that the data sent from the Arduino to the HoloLens also controlled interactions in the HoloLens.
</div>
</section>










<figure>
<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/model.png" alt="City Model">

<figcaption>City Model</figcaption>

</figure>


</main>
<footer>
<section>
Expand Down
22 changes: 16 additions & 6 deletions ws23/bachelor/b7-ar-interaction-city/technology/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@
<header class="project-header">
<h1>
<span class="type">B7 Bachelor</span>
VisionIO
Vision.IO
<span class="underscore-spacer"> </span>
</h1>
<section style="text-align: right;">
Expand Down Expand Up @@ -143,12 +143,21 @@ <h3>
<div class="content">
<h4 id="hololens">HoloLens</h4>
<p>To develop the AR/XR App that is running on the HoloLens 2 we used Visual Studio (Code) and Unity with MRTK2.</p>
<ul>
<li>Programming Language: C#</li>
</ul>
<h4 id="raspberry">Raspberry</h4>
<p>The Rapsberry Pi runs the Debian Raspberry Distribution and is the communication middleware.
It serves as the mqtt broker and the wifi hotspot that the arduino and hololens connect too.
<p>The Raspberry Pi runs the Debian Raspberry Distribution and is the communication middleware.
It serves as the MQTT broker and the Wi-Fi hotspot that the Arduino and HoloLens connect too.
The Raspberry Pi was set up with the CLI</p>
<ul>
<li>Programming Language: Bash</li>
</ul>
<h4 id="arduino">Arduino</h4>
<p>The Arduino was developed using the Arduino IDE</p>
<ul>
<li>Programming Language: C++</li>
</ul>
<section class="gallery">
<figure>
<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/Hololens.png" alt="Hololens Logo">
Expand Down Expand Up @@ -185,18 +194,19 @@ <h3>
<div class="content">
<h4 id="interactions">Interactions</h4>
<ul>
<li>Arduino Uno Wifi Rev2</li>
<li>Arduino UNO WiFi Rev2</li>
<li>Button</li>
<li>Potenziometer</li>
<li>Potentiometer</li>
<li>PN532 NFC/RFID Reader</li>
<li>LED</li>
</ul>
<h4 id="communication">Communication</h4>
<ul>
<li>Raspberry Pi 3</li>
</ul>
<h4 id="xrar-apps">XR/AR Apps</h4>
<ul>
<li>Hololens 2</li>
<li>HoloLens 2</li>
</ul>
<section class="gallery">
<figure>
Expand Down
2 changes: 1 addition & 1 deletion ws23/bachelor/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ <h1>

<li ><a href="/tryout/ws23/bachelor/b5-smartlibrary/">SmartLibrary - It&#39;s A Match!</a></li>

<li ><a href="/tryout/ws23/bachelor/b7-ar-interaction-city/">VisionIO</a></li>
<li ><a href="/tryout/ws23/bachelor/b7-ar-interaction-city/">Vision.IO</a></li>

</ul>
</div>
Expand Down
6 changes: 3 additions & 3 deletions ws23/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -214,16 +214,16 @@ <h3>AvataVR</h3>
<div>
<span class="type">B7 Bachelor</span>
<a href="/tryout/ws23/bachelor/b7-ar-interaction-city/">
<h3>VisionIO</h3>
<h3>Vision.IO</h3>
</a>
<p>VisionIO shows the possibilities of merging the augmented world with the real world. Transform what you see in the augmented reality world with the help of physical interactions. Immerse yourself in a new experience that turns augmented reality into extended reality.</p>
<p>Vision.IO, a digital-haptic city model for information communication through XR/AR showcases the potential of merging augmented reality with physical interactions. This immersive experience transforms augmented reality into extended reality, offering an innovative way to perceive and interact with urban environments.</p>
<a href="/tryout/ws23/bachelor/b7-ar-interaction-city/">-> Details</a>
</div>




<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/Logo.png" alt="VisionIO">
<img src="/tryout/ws23/bachelor/b7-ar-interaction-city/Logo.png" alt="Vision.IO">
</section>
<hr class="alternate">

Expand Down

0 comments on commit 2fcf3d0

Please sign in to comment.