MNI PD node trainee and staff user testing

[surchs]

Context

With PI approval, we now finally want to go to our target users, show them the tools we've built for them (particularly the discovery flow) and see if they find them as useful as we think they will. To make this concrete, we have a number of predictions that we intend on testing.

Hypotheses (in #185):

• If users find our tool helpful, they will ask us to add other users to the demo
  • confirmed if: we get asked to add at least 2 more users in the first month (?)
• If users are interested in what the tool does for them, they will log into our app multiple times over a 1 month period
  • confirmed if: at least half of our invited users visit the app more than once in a one month period
  • visits could be measured by sign-in events, assuming that auth0 counts them correctly and users have to sign in often enough (e.g. every 2-3 days)
• If a user believes query results are useful for their work, they will try running the BIC script
  • confirmed if: the BIC link script has been run at least once by someone not from our team / a user in the 1 month period
  • "has been run" will be measured by having the script dump a record in a logfile when run

Why

• To start getting real user feedback to inform our feature development
• To start testing the effect of our development on how users interact with the tools
• To make sure we create a useful system for the MNI

Outcomes

• re-annotate the datasets with the new assessment tool libraries

What

• [ ]