Situational Instructions Database (SID) is a dataset for dynamic task guidance. It contains situationally-aware instructions for performing a wide range of everyday tasks or completing scenarios in 3D environments. The dataset provides step-by-step instructions for these scenarios which are grounded in the context of the situation. This context is defined through a scenario-specific scene graph that captures the objects, their attributes, and their relations in the environment. The dataset is designed to enable research in the areas of grounded language learning, instruction following, and situated dialogue.
For complete documentation, please see the dataset card.
The complete dataset is available online. To access the dataset, you need to sign up for a free account on Hugging Face and request access to the dataset. Access requests are manually reviewed and approved.
Note
A demo is available here to provide an overview of the dataset. This can be used to explore some samples from the dataset before requesting access.
We provide the Croissant 🥐 metadata for SID here.
If you find the dataset useful, please cite the following papers:
@inproceedings{khan2024situational,
title={Situational Instructions Database: Task Guidance in Dynamic Environments},
author={Khan, Muhammad Saif Ullah and Sinha, Sankalp and Afzal, Muhammad Zeshan and Stricker, Didier},
booktitle={OpenReview},
year={2024}
}The dataset is licensed under Creative Commons Attribution-NonCommercial 4.0 International License. By using the dataset, you agree to the terms of the license.