NNsight 0.5 is now the default version for NDIF and NNsight! You will need to update your to NNsight 0.5 to continue accessing remote NDIF models. Check your version if you run into issues: nnsight.__version__
NNsight 0.5 is a major update that vastly increases NNsight’s power and (hopefully!) usability. Check out the official NNsight 0.5 walkthrough here!
New Functionality:
- Improved debugging: No more proxies, and you can use any Python code within the tracing context!
- Access intermediate values using
.source. (Details) - Skip module execution using
.skip. (Details) - Cache activations during tracing. (Details)
Breaking Changes:
- Model execution order is enforced. If you break execution order, NNsight will let you know by throwing an error.
- Cross-prompt interventions using multiple invokes require use of a
barrier, which signals to NNsight to gather the variables for each batch. (Details) - Backwards pass syntax has changed. (Details)
Thank you all for your valuable feedback during our NNsight 0.5 prerelease. As you test NNsight 0.5 with the NDIF backend, please report any issues or feedback on this forum.
We are actively porting over all our tutorials and documentation to NNsight 0.5. We aim to complete this by the end of next week (8/29/2025), but there may be some discrepancies as we complete this process!