Skip to content
@Sense-Scape

SenseScape

Section Summary

Summary

System Overview

Getting Started

System Overview

Feature Development Timeline

Soak Testing

Analysis Tool

Simulation Tool

The Sensor

Summary

Primarily a central place to keep all my work relating to acoustics - software, hardware, modelling and system design. It can also be described as an audio streaming platform which receives data from multiple audio sensors, stores the data and forwards it to a pretty Svelte UI which shows time and frequency domain data

System Overview

graph LR; 

AudioSensor1 ---> ProcessingServer
AudioSensor2 ---> ProcessingServer
AudioSimulator1 ---> ProcessingServer

ProcessingServer --->GoTCPWebSocketAdapter
ProcessingServer --> AudioStorage

GoTCPWebSocketAdapter --->SvelteKitUI
Loading
  • AudioSensor - RasperryPi with Respeaker array which transmits multiple channels of audio data
  • AudioSimulator - Windows simullator which can generate multiple channels with a specific tone and phase offset
  • ProcessingServer - Server which hanfles multiple TCP connections from sensors, write their audio data as WAV and forwards it to the websocket converter
  • GoTCPWebSocketAdapter - Forwards data from server to web front end
  • SvelteKitUI - UI that displays sensor data

Getting Started

Contact me (Grant Norrie) on linkedin. I shall provide an RPi 3B + image. Flash this turn on the PI and it will automatically start recording all audio and provide a UI to see what is going on. Below is are examples of the UI:

Live Data View

UI1

View multiple live or simulated data streams from multiple devices. System information is also propogated to the UI.

GPS Position View

UI2

Multiple Sensor positions (set statically or using a live GPS position) may be sent to and displayed on a map.

TDOA (In Developement)

UI2_1

Example of TDOA alogorithm operating on simulated data. Intersection of the red line is the position of the transmitter. Green dots are the position of the receivers. TDOA of live data is currently being worked on.

Stored Audio Files

UI3

Audio files will be generated and written to a user specified location. In this case an external drive.

Feature Development Timeline

timeline
    Milestone 1 : Simulator (Done) : Processing Server (Done) : Live Storage (Done) : Live UI (Done) : Hardware Prototype (Done) : Data Collection (Done)
    Milestone 2 : Full Linux Support (Done) : Playback (Done) : Fixed Installation (Done) : Produce Mic Array (Done)  : GPS (time, pos) (Done) : Handle Multiple HW (Done)
    Milestone 3 : Mechanicals (Housing, BMS) (Done) : Soak Testing (Done) : Data Collection (Done) : BOM Generation (Done)
    Milestone 4 : TDOA (In Progress) : Direction Finding : Multi Sensor Deployment (In Progress) : Live GIS : Remote Deployment (In Progress)

Loading

SOAK Testing Results

Thanks @wolffshots for running this test - Almost 10 days then the power supply got knocked :)

state

Analysis Tool

Summary: Pretty Pictures

image

Simulation Tool

Summary: Math

image

The Sensor

Summary: ooooh, ahhhh, so fancy (but not really)

4e0ccd7e-6c5c-412c-84ba-0f0250fa754c

Pinned Loading

  1. Base_Module Base_Module Public

    Base Module on which all other modules are derived

    C++

  2. Generic_Modules Generic_Modules Public

    Cross platform processing modules

    C++ 1

  3. Windows_Modules Windows_Modules Public archive

    Processing modules created for Windows

    C++

  4. Chunk_Types Chunk_Types Public

    Data from processing modules encapsulated by these classes

    C++

  5. ESP32_Modules ESP32_Modules Public archive

    Processing modules created for ESP32 (IDF 5)

    C++

  6. Python_Simulations Python_Simulations Public

    Some simulations on topics of interest that I have put together

    Jupyter Notebook

Repositories

Showing 10 of 22 repositories
  • .github Public
    Sense-Scape/.github’s past year of commit activity
    0 0 0 0 Updated Jan 5, 2025
  • Generic_Modules Public

    Cross platform processing modules

    Sense-Scape/Generic_Modules’s past year of commit activity
    C++ 0 1 3 (1 issue needs help) 1 Updated Dec 31, 2024
  • Base_Module Public

    Base Module on which all other modules are derived

    Sense-Scape/Base_Module’s past year of commit activity
    C++ 0 0 0 0 Updated Dec 26, 2024
  • googletest Public Forked from google/googletest

    GoogleTest - Google Testing and Mocking Framework

    Sense-Scape/googletest’s past year of commit activity
    C++ 0 BSD-3-Clause 10,786 0 0 Updated Dec 16, 2024
  • Python_Simulations Public

    Some simulations on topics of interest that I have put together

    Sense-Scape/Python_Simulations’s past year of commit activity
    Jupyter Notebook 0 0 1 0 Updated Nov 14, 2024
  • Sense-Scape/Signal_Analysis_Tool’s past year of commit activity
    Python 0 0 1 0 Updated Oct 9, 2024
  • Proc_Serv Public

    SenseScape Processing Sever - Received data from remote audio sensors, stores data as wav files, processes and transmits to user interfaces

    Sense-Scape/Proc_Serv’s past year of commit activity
    C++ 1 0 0 0 Updated Aug 31, 2024
  • TCP_Websocket_Adapter Public

    Converts chunks received over TCP connections to web socket data which is forwarded to svelte UI

    Sense-Scape/TCP_Websocket_Adapter’s past year of commit activity
    Go 0 0 0 0 Updated Aug 24, 2024
  • Sensor_Viewer Public
    Sense-Scape/Sensor_Viewer’s past year of commit activity
    Svelte 0 0 5 2 Updated Aug 4, 2024
  • Sense-Scape/Linux_Installer’s past year of commit activity
    Python 0 0 0 0 Updated Jul 24, 2024

Top languages

Loading…

Most used topics

Loading…