NDIF Hot Swapping: Feedback Requested

NDIF Hot Swapping Pilot Program Feedback

This thread is to collect feedback from the NDIF hot swapping pilot program. Please comment on this thread with feedback, bugs, and any other issues related to hot swapping that you’d like to report!

Feedback Focus Areas

We have a few specific areas where we’d like detailed feedback about your experience, but if other items come up, feel free to also add them in the comments.

Hot Swapping

  1. Model timeout parameters
  2. User control over model takedown
  3. Any other pain points

API usability

  1. Blockers within NNsight
  2. Workbench UI: would it be useful to integrate with hot swapped models?
  3. Features you’d like to have

Tutorials/Documentation

  1. Onboarding time - How long does it take you to start running real experiments using NDIF? How can we optimize this process?
  2. Tutorial clarity and content

Looking forward to hearing your opinions!