0.18.18

Hardware metrics

The CLI introduces a new command, dstack stats, which displays real-time hardware metrics for runs, including CPU,
memory, and GPU usage per replica and job.

$ dstack stats hot-frog-1
 NAME        CPU  MEMORY           GPU                        
 hot-frog-1  2%   15307MB/49152MB  #0 22764MB/24576MB 0% Util 

Use the -w option to view stats updating every few seconds in the loop.

You can also retrieve the metrics using the REST API.

Docker inside dstack

Run configurations now have a new optional privileged property (equivalent to the
--privileged Docker CLI flag).
When it is set to true, the run container gets extended privileges, making it possible to use Docker inside
dstack.

To use Docker and Docker Compose within dstack, set the image property
to dstackai/dind. Additionally, you must invoke start-dockerd as the first command to start the Docker daemon.

type: task
name: misc-task-dind

image: dstackai/dind
privileged: true

commands:
  - start-dockerd
  - docker compose up

Dev environment example

type: dev-environment
name: vscode-dind

image: dstackai/dind
privileged: true
ide: vscode

init:
  - start-dockerd

See more examples in examples/misc/docker-compose.

Note

The privileged property is only supported by VM backends (all backends except runpod, vastai, and kubernetes).

What's changed

• [Feature] Track hardware metrics by @r4victor in #1827
• [Feature] Add privileged run property by @un-def in #1835
• [Feature] Run container as --privileged if DSTACK_DOCKER_PRIVILEGED by @mtaran in #1821
• [Feature] Added the Code button on the model page in UI by @olgenn in #1825
• [Feature] Publish dstackai/dind image by @un-def in #1837
• [Bugfix] Fix running NVIDIA NIM images by @jvstme in #1843
• [Bugfix] Mitigate concurrent dstack attach issues by @un-def in #1816
• [Bugfix] Fixed runs ordering and pagination in UI by @un-def in #1812
• [Bugfix] Removed dummy Test fleet in UI by @priyanshuverma-dev in #1819
• [UX] Display the SSH and vscode prompt to after executing init commands by @fool1280 in #1818
• [Blog] AMD MI300X inference benchmark by @peterschmidt85 and @Bihan in #1808
• [Docs] Add AWS EFA support info by @un-def in #1803
• [Docs] Fixed typos and added minor enhancements by @FarukhS52 in #1810 and #1811
• [Docs] Fixed typos and added minor enhancements by @amantyagiprojects in #1800
• [Docs] Use correct discord server invite in readme by @sravan1946 in #1824
• [Docs] Fixed a minor issue in README.md by @Hacker24a9 in #1823
• [Docs] Fixed typos and added minor enhancements @VaibhavWakde52 in #1813
• [UX] Show run error on the run page in the UI by @olgenn in #1829
• [UX] Normalize AMD Instinct accelerator names by @un-def in #1817
• [Bugfix] Fixed the issue with attaching volume to existing instance by @un-def in #1836
• [Bugfix] Fix GCP config public_ips not allowed via the API by @r4victor in #1840
• [Internal] Don't cache GpuVendor in global var by @un-def in #1845
• [Internal] Fix shim tests binding to 0 port by @r4victor in #1846

New contributors

• @FarukhS52 made their first contribution in #1810
• @amantyagiprojects made their first contribution in #1800
• @priyanshuverma-dev made their first contribution in #1819
• @sravan1946 made their first contribution in #1824
• @Hacker24a9 made their first contribution in #1823
• @VaibhavWakde52 made their first contribution in #1813
• @fool1280 made their first contribution in #1818
• @mtaran made their first contribution in #1821

Full changelog: 0.18.17...0.18.18