Research on how to best encode data within audio stream

[vmdocua]

Research on how to best encode data within audio stream (e.g. sequence of beeps), and tools/reprostim-timesync-stimuli to present that audio cue upon win.flip so we could match that timing to qrcode information in visual stream.

• Review https://psychopy.org/api/sound/playback.html and possibly use PTB's facilities in PsychoPy for precise audio placement in time.
• Add representation with error correction, e.g. https://github.com/sfp932705/ecc .
• Research psychopy installation and sound setup on different OS (Linux, MacOS) and singularity container.
• Create audio codes generation/parsing prototype.
• Tunning for repronim-timesync-stimuli script (click options, dynamic output file name, execution modes, loging and other misc preparation for Refactor tools/reprostim-timesync-stimuli for full automation #120).

NOTE: below listed issues for the next PR on the same plate:

• Distortion for soundcodes.
• Tests for soundcodes.
• PTB sound engine setup under Linux and singularity container.

[yarikoptic]

just a comment on some additional utilities we identified while researching online, if e.g. approaching from aspect of watermarking:

• https://github.com/wavmark/wavmark -- "AI"-based

[yarikoptic]

here is how I was adding distortion at the level of encoded data before going to audio stream

❯ git diff
diff --git a/tools/audio-codes.py b/tools/audio-codes.py
index abf1273..8464ed3 100644
--- a/tools/audio-codes.py
+++ b/tools/audio-codes.py
@@ -113,6 +113,9 @@ class AudioFrame:
         if self.use_ecc:
             b = bytes(self.rsc.encode(b))
             logger.debug(f"  - ecc       : {len(b)} bytes, {b}")
+            for i in [0, 1]:
+                # distortion
+                b = b[:i] + bytes([(b[i]+1)]) + b[i+1:]
         return b

[yarikoptic]

replace overlay.img with repronim-psychopy--2024.1.4.overlay or alike

[yarikoptic]

to add more stuff (before we modify the ./generate_container.sh script) you can use

❯ sudo singularity exec --overlay repronim-psychopy--2024.1.4.overlay repronim-psychopy--2024.1.4.sing python3 -m pip install psychopy-sounddevice

for python level and

❯ sudo singularity exec --overlay repronim-psychopy--2024.1.4.overlay repronim-psychopy--2024.1.4.sing apt-get install -y pulseaudio-utils