Skip to content

Commit

Permalink
Add Hello XAI notebook (#2150)
Browse files Browse the repository at this point in the history
Add basic OV XAI notebook
  • Loading branch information
negvet authored Jul 12, 2024
1 parent 117df38 commit 7ed9d9d
Show file tree
Hide file tree
Showing 6 changed files with 488 additions and 3 deletions.
2 changes: 1 addition & 1 deletion .ci/ignore_pip_conflicts.txt
Original file line number Diff line number Diff line change
Expand Up @@ -26,4 +26,4 @@ notebooks/yolov10-optimization/yolov10-optimization.ipynb # nncf from git
notebooks/person-counting-webcam/person-counting.ipynb # numpy should be installed first
notebooks/llava-multimodal-chatbot/videollava-multimodal-chatbot.ipynb # torchvision < 0.17.0
notebooks/parler-tts-text-to-speech/parler-tts-text-to-speech.ipynb # torch >= 2.2
notebooks/stable-diffusion-v3/stable-diffusion-v3.ipynb # diffusers from git
notebooks/stable-diffusion-v3/stable-diffusion-v3.ipynb # diffusers from git
3 changes: 2 additions & 1 deletion .ci/ignore_treon_docker.txt
Original file line number Diff line number Diff line change
Expand Up @@ -70,4 +70,5 @@ notebooks/hunyuan-dit-image-generation/hunyuan-dit-image-generation.ipynb
notebooks/stable-diffusion-v3/stable-diffusion-v3.ipynb
notebooks/pixart/pixart.ipynb
notebooks/llm-rag-llamaindex/llm-rag-llamaindex.ipynb
notebooks/minicpm-v-multimodal-chatbot/minicpm-v-multimodal-chatbot.ipynb
notebooks/minicpm-v-multimodal-chatbot/minicpm-v-multimodal-chatbot.ipynb
notebooks/explainable-ai-1-basic/explainable-ai-1-basic.ipynb
6 changes: 5 additions & 1 deletion .ci/skipped_notebooks.yml
Original file line number Diff line number Diff line change
Expand Up @@ -524,11 +524,15 @@
skips:
- device:
- cpu
- notebook: notebooks/explainable-ai-1-basic/explainable-ai-1-basic.ipynb
skips:
- python:
- '3.8'
- '3.9'
- notebook: notebooks/minicpm-v-multimodal-chatbot/minicpm-v-multimodal-chatbot.ipynb
skips:
- os:
- macos-12
- ubuntu-20.04
- ubuntu-22.04
- windows-2019

3 changes: 3 additions & 0 deletions .ci/spellcheck/.pyspelling.wordlist.txt
Original file line number Diff line number Diff line change
Expand Up @@ -231,6 +231,8 @@ enum
et
Evol
EVS
eXplainable
Explainer
facto
fastcomposer
FastComposer
Expand Down Expand Up @@ -911,6 +913,7 @@ WTQ
wuerstchen
WuerstchenDiffNeXt
Würstchen
XAI
XCode
Xeon
xl
Expand Down
21 changes: 21 additions & 0 deletions notebooks/explainable-ai-1-basic/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
# eXplainable AI (XAI) for OpenVINO™ IR Models
[![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/explainable-ai-1-basic/explainable-ai-1-basic.ipynb)

The notebook will cover the following topics:

* Explanation of [OpenVINO™ Explainable AI (XAI)](https://github.com/openvinotoolkit/openvino_xai/) and saliency maps.
* How to create saliency map for OpenVINO™ IR models using [OpenVINO™ Explainable AI (XAI)](https://github.com/openvinotoolkit/openvino_xai/).

## Saliency Map

A saliency map is a visualization technique that highlights regions of the interest in an image from the model perspective. For example, it can be used to explain classification model predictions for a particular label. Here is an example of a saliency map that you will get in this notebook:

<p align="center">
<img width="80%" src="https://github-production-user-asset-6210df.s3.amazonaws.com/17028475/343197195-ccb67c0b-c58e-4beb-889f-af0aff21cb66.jpg?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240626%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240626T141846Z&X-Amz-Expires=300&X-Amz-Signature=cbad9a773f45d590b47c4fc2cf0c0c3a09fc1f77961eaa934eb0d110d990e2b2&X-Amz-SignedHeaders=host&actor_id=17028475&key_id=0&repo_id=806947463"/>
</p>

## Installation Instructions

This is a self-contained example that relies solely on its own code.</br>
We recommend running the notebook in a virtual environment. You only need a Jupyter server to start.
For details, please refer to [Installation Guide](../../README.md).
456 changes: 456 additions & 0 deletions notebooks/explainable-ai-1-basic/explainable-ai-1-basic.ipynb

Large diffs are not rendered by default.

0 comments on commit 7ed9d9d

Please sign in to comment.