update readme

tlatkowski · May 7, 2019 · 80b854d · 80b854d
1 parent bb79527
commit 80b854d
Show file tree

Hide file tree

Showing 4 changed files with 12 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -143,6 +143,16 @@ The below pictures presents Multihead Siamese Nets GUI for:
 2. Negative example:
 
 ![](https://github.com/tlatkowski/multihead-siamese-nets/blob/master/pics/negative_sample.png)
+
+# Attention weights visualization
+In order to visualize multihead attention weights for compared sentences use GUI demo - check 
+'Visualize attention weights' checkbox which is visible after choosing model based on multihead attention mechanism.
+
+The example of attention weights visualization looks as follows (4 attention heads):
+
+![](https://github.com/tlatkowski/multihead-siamese-nets/blob/master/pics/attention1.png) 
+![](https://github.com/tlatkowski/multihead-siamese-nets/blob/master/pics/attention2.png) 
+
 # Comparison of models
 
 Experiments performed on GPU **Nvidia GeForce GTX 1080Ti**.

diff --git a/pics/attention1.png b/pics/attention1.png
diff --git a/pics/attention2.png b/pics/attention2.png
diff --git a/utils/visualization.py b/utils/visualization.py
@@ -7,7 +7,8 @@
 def visualize_attention_weights(attention_weights, sentence: str,
                                 cmap='coolwarm'):  # cmap='gist_gray'
     interactive(True)
-    num_heads = np.shape(attention_weights)[0]
+    # num_heads = np.shape(attention_weights)[0]
+    num_heads = 4
     xticklabels = sentence.split(' ')
     yticklabels = xticklabels