sonoUno server

The sonification-as-a-service platform.

Intro

This app provides a basic account API on top of a MongoDB store with the following features:

• Registration
• Email verification
• Password reset
• JWT auth login and refresh
• User and transform model CRUD

Backend Requirements

• Python 3.10
• Docker.
• Docker Compose.
• Poetry for Python package and environment management.

Frontend Requirements

• Not implemented in this repository

Backend local development

• Start the stack with Docker Compose:

compose/run-dev.sh

• Now you can open your browser and interact with these URLs:

Frontend, built with Docker, with routes handled based on the path: http://localhost

Backend, JSON based web API based on OpenAPI: http://localhost:8001/api/

Automatic interactive documentation with Swagger UI (from the OpenAPI backend): http://localhost/docs

Alternative automatic documentation with ReDoc (from the OpenAPI backend): http://localhost/redoc

The MinIO servers: http://localhost:9001

mongo-express, MongoDB web administration: http://localhost:8081

General workflow

The dependencies are managed with Poetry, go there and install it.

From ./backend/ you can install all the dependencies with:

$ poetry install

Then you can start a shell session with the new environment with:

$ poetry shell

Secret salt generation

For new environment a salt should be generated and kept secret. To do that, just run the script:

backend/scripts/gen_salt.py

There are other settings in config.py and the included .env file. Assuming you've changed the SALT value, everything should run as-is if there is a local MongoDB instance running (see below for a Docker solution). Any email links will be printed to the console by default.

Tests

To run the test suite:

compose/run-tests-backend.sh

Example

In this example, we will create a user and get an access token in order to create a dummy transform in the MongoDB database. Thi transform is then applied on data stored in the MinIO servers.

import requests

SERVER_URL = DATA_URL = 'http://37.187.38.200'
EMAIL = "[email protected]"
PASSWORD = 'password'
SOURCE = """
import pickle
from typing import Any, NamedTuple

import requests

from streamunolib import exposed

def loader(url: str):
    response = requests.get(url)
    response.raise_for_status()
    return pickle.loads(response.content)

@exposed
def inner_stage(x: list[int], increment: int) -> list[int]:
    return [_ + increment for _ in x]

class PipelineOutput(NamedTuple):
    processed_data: list[int]
    metadata: dict[str, Any]

@exposed
def pipeline(url: str, increment: int = 3) -> PipelineOutput:
    data = loader(url)
    processed_data = inner_stage(data, increment)
    return processed_data, {'status': 'Successfully incremented', 'length': len(data)}
"""

# Create user if it doesn't exist
user = {
    'email': EMAIL,
    'password': PASSWORD,
}
response = requests.post(f'{SERVER_URL}/users', json=user)
if response.status_code == 409:
    print(f'Email {EMAIL} is already registered.')
else:
    response.raise_for_status()

# Log in user
response = requests.post(f'{SERVER_URL}/iam/login', json=user)
response.raise_for_status()
access_token = response.json()['access_token']
session = requests.Session()
session.headers['Authorization'] = f'Bearer {access_token}'

# Create transform
transform_in = {
    'name': 'Test transformation',
    'public': True,
    'language': 'python',
    'source': SOURCE,
    'entry_point': {'name': 'pipeline'}
}
response = session.post(f'{SERVER_URL}/transforms', json=transform_in)
response.raise_for_status()
transform = response.json()

# Create job
job_in = {
    'transform_id': transform['_id'],
    'inputs': [
        {
            'id': 'pipeline.url',
            'value': f'{DATA_URL}:9000/test-bucket-staging/list.pickle',
        },
    ],
}
response = session.post(f'{SERVER_URL}/jobs', json=job_in)
response.raise_for_status()
job = response.json()
print(job['outputs'])