bertviz online with Winfy

We have hosted the application bertviz in order to run this application in our online workstations with Wine or directly.

Quick description about bertviz:

BertViz is an interactive tool for visualizing attention in Transformer language models such as BERT, GPT2, or T5. It can be run inside a Jupyter or Colab notebook through a simple Python API that supports most Huggingface models. BertViz extends the Tensor2Tensor visualization tool by Llion Jones, providing multiple views that each offer a unique lens into the attention mechanism. The head view visualizes attention for one or more attention heads in the same layer. It is based on the excellent Tensor2Tensor visualization tool. The model view shows a bird's-eye view of attention across all layers and heads. The neuron view visualizes individual neurons in the query and key vectors and shows how they are used to compute attention.

Features:

• Visualize Attention in NLP Models
• Run BertViz in a Jupyter Notebook
• Run BertViz in Colab
• Neuron View
• Model View
• Head View

Programming Language: Python.
Categories: