Meta_AI_Blender_Bot.ipynb

{
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {},
      "source": [
        "<a href=\"https://colab.research.google.com/github/NahuelCostaCortez/AI_notebooks/blob/main/Meta_AI_Blender_Bot.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "UahVKS1KXfID"
      },
      "source": [
        "# 🤖💬 Facebook BlenderBot\n",
        "\n",
        "> Notebook adaptado de [este cuaderno](https://colab.research.google.com/drive/1NX-GFLeMpQm9fZXlclPs9sB30Z-IA6T7) de [Quantum Stat.](http://www.quantumstat.com/)"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "KRZHRPNDp_R8"
      },
      "source": [
        "Ejecuta el siguiente comando para comprobar que tienes la aceleración por hardware con la GPU disponible. En caso de estar habilitada, podrás activarla en el menú 'Entorno de ejecución' > 'Cambiar tipo de entorno de ejecución' > 'Acelerador por Hardware'."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 353
        },
        "id": "3d3AfX0Do8BA",
        "outputId": "e11a151b-3fb1-4e8e-8aaa-2ff74ae4bba3",
        "vscode": {
          "languageId": "python"
        }
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Wed Jun 24 11:42:59 2020       \n",
            "+-----------------------------------------------------------------------------+\n",
            "| NVIDIA-SMI 450.36.06    Driver Version: 418.67       CUDA Version: 10.1     |\n",
            "|-------------------------------+----------------------+----------------------+\n",
            "| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |\n",
            "| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |\n",
            "|                               |                      |               MIG M. |\n",
            "|===============================+======================+======================|\n",
            "|   0  Tesla P100-PCIE...  Off  | 00000000:00:04.0 Off |                    0 |\n",
            "| N/A   38C    P0    27W / 250W |      0MiB / 16280MiB |      0%      Default |\n",
            "|                               |                      |                 ERR! |\n",
            "+-------------------------------+----------------------+----------------------+\n",
            "                                                                               \n",
            "+-----------------------------------------------------------------------------+\n",
            "| Processes:                                                                  |\n",
            "|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |\n",
            "|        ID   ID                                                   Usage      |\n",
            "|=============================================================================|\n",
            "|  No running processes found                                                 |\n",
            "+-----------------------------------------------------------------------------+\n"
          ]
        }
      ],
      "source": [
        "!nvidia-smi"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 134
        },
        "id": "nPmSE5bDhaWk",
        "outputId": "697b2671-e292-4717-a164-baa753eea9ab",
        "vscode": {
          "languageId": "python"
        }
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Cloning into 'ParlAI'...\n",
            "remote: Enumerating objects: 156, done.\u001b[K\n",
            "remote: Counting objects: 100% (156/156), done.\u001b[K\n",
            "remote: Compressing objects: 100% (106/106), done.\u001b[K\n",
            "remote: Total 30407 (delta 82), reused 88 (delta 49), pack-reused 30251\u001b[K\n",
            "Receiving objects: 100% (30407/30407), 58.58 MiB | 33.63 MiB/s, done.\n",
            "Resolving deltas: 100% (21596/21596), done.\n"
          ]
        }
      ],
      "source": [
        "!git clone https://github.com/facebookresearch/ParlAI.git"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 34
        },
        "id": "SFMx_kohwC7l",
        "outputId": "83664d1e-6ca8-45bc-e059-3d6906d62220",
        "vscode": {
          "languageId": "python"
        }
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "/content/ParlAI\n"
          ]
        }
      ],
      "source": [
        "cd ParlAI/"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "3m1YoG7VwDbt",
        "outputId": "9d5088c0-f16e-4118-827c-492e070726c4",
        "vscode": {
          "languageId": "python"
        }
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "running develop\n",
            "running egg_info\n",
            "creating parlai.egg-info\n",
            "writing parlai.egg-info/PKG-INFO\n",
            "writing dependency_links to parlai.egg-info/dependency_links.txt\n",
            "writing entry points to parlai.egg-info/entry_points.txt\n",
            "writing requirements to parlai.egg-info/requires.txt\n",
            "writing top-level names to parlai.egg-info/top_level.txt\n",
            "writing manifest file 'parlai.egg-info/SOURCES.txt'\n",
            "reading manifest template 'MANIFEST.in'\n",
            "writing manifest file 'parlai.egg-info/SOURCES.txt'\n",
            "running build_ext\n",
            "Creating /usr/local/lib/python3.6/dist-packages/parlai.egg-link (link to .)\n",
            "Adding parlai 0.1.20200624 to easy-install.pth file\n",
            "Installing parlai script to /usr/local/bin\n",
            "\n",
            "Installed /content/ParlAI\n",
            "Processing dependencies for parlai==0.1.20200624\n",
            "Searching for websocket-server==0.4\n",
            "Reading https://pypi.org/simple/websocket-server/\n",
            "Downloading https://files.pythonhosted.org/packages/74/64/e86581ee7775a2e08aca530b41e1a1e3ee6b320233b1eff301dcb86d1636/websocket_server-0.4.tar.gz#sha256=91cd4b565d1e1b00ef107abcb2840a8090868b19543f3b38e1962d5f975d0c04\n",
            "Best match: websocket-server 0.4\n",
            "Processing websocket_server-0.4.tar.gz\n",
            "Writing /tmp/easy_install-md1jqtyz/websocket_server-0.4/setup.cfg\n",
            "Running websocket_server-0.4/setup.py -q bdist_egg --dist-dir /tmp/easy_install-md1jqtyz/websocket_server-0.4/egg-dist-tmp-cts8t3vn\n",
            "zip_safe flag not set; analyzing archive contents...\n",
            "Moving websocket_server-0.4-py3.6.egg to /usr/local/lib/python3.6/dist-packages\n",
            "Adding websocket-server 0.4 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/websocket_server-0.4-py3.6.egg\n",
            "Searching for websocket-client==0.56.0\n",
            "Reading https://pypi.org/simple/websocket-client/\n",
            "Downloading https://files.pythonhosted.org/packages/29/19/44753eab1fdb50770ac69605527e8859468f3c0fd7dc5a76dd9c4dbd7906/websocket_client-0.56.0-py2.py3-none-any.whl#sha256=1151d5fb3a62dc129164292e1227655e4bbc5dd5340a5165dfae61128ec50aa9\n",
            "Best match: websocket-client 0.56.0\n",
            "Processing websocket_client-0.56.0-py2.py3-none-any.whl\n",
            "Installing websocket_client-0.56.0-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding websocket-client 0.56.0 to easy-install.pth file\n",
            "Installing wsdump.py script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/websocket_client-0.56.0-py3.6.egg\n",
            "Searching for Unidecode==1.1.1\n",
            "Reading https://pypi.org/simple/Unidecode/\n",
            "Downloading https://files.pythonhosted.org/packages/d0/42/d9edfed04228bacea2d824904cae367ee9efd05e6cce7ceaaedd0b0ad964/Unidecode-1.1.1-py2.py3-none-any.whl#sha256=1d7a042116536098d05d599ef2b8616759f02985c85b4fef50c78a5aaf10822a\n",
            "Best match: Unidecode 1.1.1\n",
            "Processing Unidecode-1.1.1-py2.py3-none-any.whl\n",
            "Installing Unidecode-1.1.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding Unidecode 1.1.1 to easy-install.pth file\n",
            "Installing unidecode script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/Unidecode-1.1.1-py3.6.egg\n",
            "Searching for typing-extensions==3.7.4.1\n",
            "Reading https://pypi.org/simple/typing-extensions/\n",
            "Downloading https://files.pythonhosted.org/packages/03/92/705fe8aca27678e01bbdd7738173b8e7df0088a2202c80352f664630d638/typing_extensions-3.7.4.1-py3-none-any.whl#sha256=cf8b63fedea4d89bab840ecbb93e75578af28f76f66c35889bd7065f5af88575\n",
            "Best match: typing-extensions 3.7.4.1\n",
            "Processing typing_extensions-3.7.4.1-py3-none-any.whl\n",
            "Installing typing_extensions-3.7.4.1-py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding typing-extensions 3.7.4.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/typing_extensions-3.7.4.1-py3.6.egg\n",
            "Searching for tqdm==4.36.1\n",
            "Reading https://pypi.org/simple/tqdm/\n",
            "Downloading https://files.pythonhosted.org/packages/e1/c1/bc1dba38b48f4ae3c4428aea669c5e27bd5a7642a74c8348451e0bd8ff86/tqdm-4.36.1-py2.py3-none-any.whl#sha256=dd3fcca8488bb1d416aa7469d2f277902f26260c45aa86b667b074cd44b3b115\n",
            "Best match: tqdm 4.36.1\n",
            "Processing tqdm-4.36.1-py2.py3-none-any.whl\n",
            "Installing tqdm-4.36.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding tqdm 4.36.1 to easy-install.pth file\n",
            "Installing tqdm script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/tqdm-4.36.1-py3.6.egg\n",
            "Searching for tokenizers==0.4.2\n",
            "Reading https://pypi.org/simple/tokenizers/\n",
            "Downloading https://files.pythonhosted.org/packages/2e/0a/096a279ee20a206a58ba9af3251c7271fb9493bed3bf29bfe4c58fcbfe4c/tokenizers-0.4.2-cp36-cp36m-manylinux1_x86_64.whl#sha256=da8e1593ef2a73cb0d2ebaf06183e8acd304ef1a272c526884a686ded9cf4d27\n",
            "Best match: tokenizers 0.4.2\n",
            "Processing tokenizers-0.4.2-cp36-cp36m-manylinux1_x86_64.whl\n",
            "Installing tokenizers-0.4.2-cp36-cp36m-manylinux1_x86_64.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding tokenizers 0.4.2 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/tokenizers-0.4.2-py3.6-linux-x86_64.egg\n",
            "Searching for sphinx-autodoc-typehints==1.10.3\n",
            "Reading https://pypi.org/simple/sphinx-autodoc-typehints/\n",
            "Downloading https://files.pythonhosted.org/packages/00/83/87b8890a93b3994b49960716009c1effb6f7a1fef3a1ec553fda2a7c84de/sphinx_autodoc_typehints-1.10.3-py3-none-any.whl#sha256=27c9e6ef4f4451766ab8d08b2d8520933b97beb21c913f3df9ab2e59b56e6c6c\n",
            "Best match: sphinx-autodoc-typehints 1.10.3\n",
            "Processing sphinx_autodoc_typehints-1.10.3-py3-none-any.whl\n",
            "Installing sphinx_autodoc_typehints-1.10.3-py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sphinx-autodoc-typehints 1.10.3 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sphinx_autodoc_typehints-1.10.3-py3.6.egg\n",
            "Searching for sphinx_rtd_theme==0.4.3\n",
            "Reading https://pypi.org/simple/sphinx_rtd_theme/\n",
            "Downloading https://files.pythonhosted.org/packages/60/b4/4df37087a1d36755e3a3bfd2a30263f358d2dea21938240fa02313d45f51/sphinx_rtd_theme-0.4.3-py2.py3-none-any.whl#sha256=00cf895504a7895ee433807c62094cf1e95f065843bf3acd17037c3e9a2becd4\n",
            "Best match: sphinx-rtd-theme 0.4.3\n",
            "Processing sphinx_rtd_theme-0.4.3-py2.py3-none-any.whl\n",
            "Installing sphinx_rtd_theme-0.4.3-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sphinx-rtd-theme 0.4.3 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sphinx_rtd_theme-0.4.3-py3.6.egg\n",
            "Searching for Sphinx==2.2.0\n",
            "Reading https://pypi.org/simple/Sphinx/\n",
            "Downloading https://files.pythonhosted.org/packages/8e/4c/95a21788db2e1653e931420f561015a0bbc9bd4660c4520467ab9e733eb2/Sphinx-2.2.0-py3-none-any.whl#sha256=839a3ed6f6b092bb60f492024489cc9e6991360fb9f52ed6361acd510d261069\n",
            "Best match: Sphinx 2.2.0\n",
            "Processing Sphinx-2.2.0-py3-none-any.whl\n",
            "Installing Sphinx-2.2.0-py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding Sphinx 2.2.0 to easy-install.pth file\n",
            "Installing sphinx-apidoc script to /usr/local/bin\n",
            "Installing sphinx-autogen script to /usr/local/bin\n",
            "Installing sphinx-build script to /usr/local/bin\n",
            "Installing sphinx-quickstart script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/Sphinx-2.2.0-py3.6.egg\n",
            "Searching for sh==1.12.14\n",
            "Reading https://pypi.org/simple/sh/\n",
            "Downloading https://files.pythonhosted.org/packages/4a/22/17b22ef5b049f12080f5815c41bf94de3c229217609e469001a8f80c1b3d/sh-1.12.14-py2.py3-none-any.whl#sha256=ae3258c5249493cebe73cb4e18253a41ed69262484bad36fdb3efcb8ad8870bb\n",
            "Best match: sh 1.12.14\n",
            "Processing sh-1.12.14-py2.py3-none-any.whl\n",
            "Installing sh-1.12.14-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sh 1.12.14 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sh-1.12.14-py3.6.egg\n",
            "Searching for requests-mock==1.7.0\n",
            "Reading https://pypi.org/simple/requests-mock/\n",
            "Downloading https://files.pythonhosted.org/packages/8c/f1/66c54a412543b29454102ae74b1454fce2d307b1c36e6bd2e9818394df88/requests_mock-1.7.0-py2.py3-none-any.whl#sha256=510df890afe08d36eca5bb16b4aa6308a6f85e3159ad3013bac8b9de7bd5a010\n",
            "Best match: requests-mock 1.7.0\n",
            "Processing requests_mock-1.7.0-py2.py3-none-any.whl\n",
            "Installing requests_mock-1.7.0-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding requests-mock 1.7.0 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/requests_mock-1.7.0-py3.6.egg\n",
            "Searching for requests==2.22.0\n",
            "Reading https://pypi.org/simple/requests/\n",
            "Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl#sha256=9cf5292fcd0f598c671cfc1e0d7d1a7f13bb8085e9a590f48c010551dc6c4b31\n",
            "Best match: requests 2.22.0\n",
            "Processing requests-2.22.0-py2.py3-none-any.whl\n",
            "Installing requests-2.22.0-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding requests 2.22.0 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/requests-2.22.0-py3.6.egg\n",
            "Searching for recommonmark==0.6.0\n",
            "Reading https://pypi.org/simple/recommonmark/\n",
            "Downloading https://files.pythonhosted.org/packages/94/de/334aaf73df8c0e77fb07f883d1e274344526196c137ef3479cb5e5aef086/recommonmark-0.6.0-py2.py3-none-any.whl#sha256=2ec4207a574289355d5b6ae4ae4abb29043346ca12cdd5f07d374dc5987d2852\n",
            "Best match: recommonmark 0.6.0\n",
            "Processing recommonmark-0.6.0-py2.py3-none-any.whl\n",
            "Installing recommonmark-0.6.0-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding recommonmark 0.6.0 to easy-install.pth file\n",
            "Installing cm2html script to /usr/local/bin\n",
            "Installing cm2latex script to /usr/local/bin\n",
            "Installing cm2man script to /usr/local/bin\n",
            "Installing cm2pseudoxml script to /usr/local/bin\n",
            "Installing cm2xetex script to /usr/local/bin\n",
            "Installing cm2xml script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/recommonmark-0.6.0-py3.6.egg\n",
            "Searching for regex==2019.8.19\n",
            "Reading https://pypi.org/simple/regex/\n",
            "Downloading https://files.pythonhosted.org/packages/6f/a6/99eeb5904ab763db87af4bd71d9b1dfdd9792681240657a4c0a599c10a81/regex-2019.08.19.tar.gz#sha256=587b62d48ca359d2d4f02d486f1f0aa9a20fbaf23a9d4198c4bed72ab2f6c849\n",
            "Best match: regex 2019.8.19\n",
            "Processing regex-2019.08.19.tar.gz\n",
            "Writing /tmp/easy_install-re84ffxx/regex-2019.08.19/setup.cfg\n",
            "Running regex-2019.08.19/setup.py -q bdist_egg --dist-dir /tmp/easy_install-re84ffxx/regex-2019.08.19/egg-dist-tmp-07rp_g0f\n",
            "BASE_DIR is /tmp/easy_install-re84ffxx/regex-2019.08.19\n",
            "/usr/local/lib/python3.6/dist-packages/setuptools/dist.py:454: UserWarning: Normalizing '2019.08.19' to '2019.8.19'\n",
            "  warnings.warn(tmpl.format(**locals()))\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:\u001b[m\u001b[K In function ‘\u001b[01m\u001b[Kfolded_char_at\u001b[m\u001b[K’:\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:10625:9:\u001b[m\u001b[K \u001b[01;35m\u001b[Kwarning: \u001b[m\u001b[Kvariable ‘\u001b[01m\u001b[Kfolded_len\u001b[m\u001b[K’ set but not used [\u001b[01;35m\u001b[K-Wunused-but-set-variable\u001b[m\u001b[K]\n",
            "     int \u001b[01;35m\u001b[Kfolded_len\u001b[m\u001b[K;\n",
            "         \u001b[01;35m\u001b[K^~~~~~~~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:\u001b[m\u001b[K In function ‘\u001b[01m\u001b[Kfuzzy_match_group_fld\u001b[m\u001b[K’:\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:11503:10:\u001b[m\u001b[K \u001b[01;35m\u001b[Kwarning: \u001b[m\u001b[K‘\u001b[01m\u001b[Kdata.new_text_pos\u001b[m\u001b[K’ may be used uninitialized in this function [\u001b[01;35m\u001b[K-Wmaybe-uninitialized\u001b[m\u001b[K]\n",
            "     if (!\u001b[01;35m\u001b[Krecord_fuzzy(state, data.fuzzy_type, data.new_text_pos - data.step)\u001b[m\u001b[K)\n",
            "          \u001b[01;35m\u001b[K^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:\u001b[m\u001b[K In function ‘\u001b[01m\u001b[Kfuzzy_match_string_fld\u001b[m\u001b[K’:\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:11270:10:\u001b[m\u001b[K \u001b[01;35m\u001b[Kwarning: \u001b[m\u001b[K‘\u001b[01m\u001b[Kdata.new_text_pos\u001b[m\u001b[K’ may be used uninitialized in this function [\u001b[01;35m\u001b[K-Wmaybe-uninitialized\u001b[m\u001b[K]\n",
            "     if (!\u001b[01;35m\u001b[Krecord_fuzzy(state, data.fuzzy_type, data.new_text_pos - data.step)\u001b[m\u001b[K)\n",
            "          \u001b[01;35m\u001b[K^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:\u001b[m\u001b[K In function ‘\u001b[01m\u001b[Kbasic_match\u001b[m\u001b[K’:\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:11608:10:\u001b[m\u001b[K \u001b[01;35m\u001b[Kwarning: \u001b[m\u001b[K‘\u001b[01m\u001b[Kdata.new_text_pos\u001b[m\u001b[K’ may be used uninitialized in this function [\u001b[01;35m\u001b[K-Wmaybe-uninitialized\u001b[m\u001b[K]\n",
            "     if (!\u001b[01;35m\u001b[Krecord_fuzzy(state, data.fuzzy_type, data.new_text_pos - data.step)\u001b[m\u001b[K)\n",
            "          \u001b[01;35m\u001b[K^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:11522:18:\u001b[m\u001b[K \u001b[01;36m\u001b[Knote: \u001b[m\u001b[K‘\u001b[01m\u001b[Kdata.new_text_pos\u001b[m\u001b[K’ was declared here\n",
            "     RE_FuzzyData \u001b[01;36m\u001b[Kdata\u001b[m\u001b[K;\n",
            "                  \u001b[01;36m\u001b[K^~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:11369:10:\u001b[m\u001b[K \u001b[01;35m\u001b[Kwarning: \u001b[m\u001b[K‘\u001b[01m\u001b[Kdata.new_text_pos\u001b[m\u001b[K’ may be used uninitialized in this function [\u001b[01;35m\u001b[K-Wmaybe-uninitialized\u001b[m\u001b[K]\n",
            "     if (!\u001b[01;35m\u001b[Krecord_fuzzy(state, data.fuzzy_type, data.new_text_pos - data.step)\u001b[m\u001b[K)\n",
            "          \u001b[01;35m\u001b[K^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\u001b[m\u001b[K\n",
            "\u001b[01m\u001b[Kregex_3/_regex.c:11288:18:\u001b[m\u001b[K \u001b[01;36m\u001b[Knote: \u001b[m\u001b[K‘\u001b[01m\u001b[Kdata.new_text_pos\u001b[m\u001b[K’ was declared here\n",
            "     RE_FuzzyData \u001b[01;36m\u001b[Kdata\u001b[m\u001b[K;\n",
            "                  \u001b[01;36m\u001b[K^~~~\u001b[m\u001b[K\n",
            "zip_safe flag not set; analyzing archive contents...\n",
            "regex.__pycache__._regex.cpython-36: module references __file__\n",
            "creating /usr/local/lib/python3.6/dist-packages/regex-2019.8.19-py3.6-linux-x86_64.egg\n",
            "Extracting regex-2019.8.19-py3.6-linux-x86_64.egg to /usr/local/lib/python3.6/dist-packages\n",
            "Adding regex 2019.8.19 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/regex-2019.8.19-py3.6-linux-x86_64.egg\n",
            "Searching for pyzmq==18.1.0\n",
            "Reading https://pypi.org/simple/pyzmq/\n",
            "Downloading https://files.pythonhosted.org/packages/75/89/6f0ea51ffa9c2c00c0ab0460f137b16a5ab5b47e3b060c5b1fc9ca425836/pyzmq-18.1.0-cp36-cp36m-manylinux1_x86_64.whl#sha256=b645a49376547b3816433a7e2d2a99135c8e651e50497e7ecac3bd126e4bea16\n",
            "Best match: pyzmq 18.1.0\n",
            "Processing pyzmq-18.1.0-cp36-cp36m-manylinux1_x86_64.whl\n",
            "Installing pyzmq-18.1.0-cp36-cp36m-manylinux1_x86_64.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding pyzmq 18.1.0 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/pyzmq-18.1.0-py3.6-linux-x86_64.egg\n",
            "Searching for pyyaml==5.1\n",
            "Reading https://pypi.org/simple/pyyaml/\n",
            "Downloading https://files.pythonhosted.org/packages/9f/2c/9417b5c774792634834e730932745bc09a7d36754ca00acf1ccd1ac2594d/PyYAML-5.1.tar.gz#sha256=436bc774ecf7c103814098159fbb84c2715d25980175292c648f2da143909f95\n",
            "Best match: PyYAML 5.1\n",
            "Processing PyYAML-5.1.tar.gz\n",
            "Writing /tmp/easy_install-6_r202d_/PyYAML-5.1/setup.cfg\n",
            "Running PyYAML-5.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-6_r202d_/PyYAML-5.1/egg-dist-tmp-42kzu51t\n",
            "In file included from \u001b[01m\u001b[Kext/_yaml.c:591:0\u001b[m\u001b[K:\n",
            "\u001b[01m\u001b[Kext/_yaml.h:2:10:\u001b[m\u001b[K \u001b[01;31m\u001b[Kfatal error: \u001b[m\u001b[Kyaml.h: No such file or directory\n",
            " #include \u001b[01;31m\u001b[K<yaml.h>\u001b[m\u001b[K\n",
            "          \u001b[01;31m\u001b[K^~~~~~~~\u001b[m\u001b[K\n",
            "compilation terminated.\n",
            "Error compiling module, falling back to pure Python\n",
            "zip_safe flag not set; analyzing archive contents...\n",
            "Moving PyYAML-5.1-py3.6-linux-x86_64.egg to /usr/local/lib/python3.6/dist-packages\n",
            "Adding PyYAML 5.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/PyYAML-5.1-py3.6-linux-x86_64.egg\n",
            "Searching for py-rouge==1.1\n",
            "Reading https://pypi.org/simple/py-rouge/\n",
            "Downloading https://files.pythonhosted.org/packages/9c/1d/0bdbaf559fb7afe32308ebc84a2028600988212d7eb7fb9f69c4e829e4a0/py_rouge-1.1-py3-none-any.whl#sha256=9ae2a859a9edc6d25f3908e48706f7d82d6e78ea18954560c4cb21897dc1d270\n",
            "Best match: py-rouge 1.1\n",
            "Processing py_rouge-1.1-py3-none-any.whl\n",
            "Installing py_rouge-1.1-py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding py-rouge 1.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/py_rouge-1.1-py3.6.egg\n",
            "Searching for py-gfm==0.1.4\n",
            "Reading https://pypi.org/simple/py-gfm/\n",
            "Downloading https://files.pythonhosted.org/packages/21/e0/be291e07b5e72e83285e4c0caf8060db0ab8d26f60bda254651e41493652/py_gfm-0.1.4-py2.py3-none-any.whl#sha256=d873541bcae194cc3b5053858719668834d3f1829342f0566ab3a48d0d744d58\n",
            "Best match: py-gfm 0.1.4\n",
            "Processing py_gfm-0.1.4-py2.py3-none-any.whl\n",
            "Installing py_gfm-0.1.4-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding py-gfm 0.1.4 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/py_gfm-0.1.4-py3.6.egg\n",
            "Searching for pexpect==4.7.0\n",
            "Reading https://pypi.org/simple/pexpect/\n",
            "Downloading https://files.pythonhosted.org/packages/0e/3e/377007e3f36ec42f1b84ec322ee12141a9e10d808312e5738f52f80a232c/pexpect-4.7.0-py2.py3-none-any.whl#sha256=2094eefdfcf37a1fdbfb9aa090862c1a4878e5c7e0e7e7088bdb511c558e5cd1\n",
            "Best match: pexpect 4.7.0\n",
            "Processing pexpect-4.7.0-py2.py3-none-any.whl\n",
            "Installing pexpect-4.7.0-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding pexpect 4.7.0 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/pexpect-4.7.0-py3.6.egg\n",
            "Searching for pytest==5.3.2\n",
            "Reading https://pypi.org/simple/pytest/\n",
            "Downloading https://files.pythonhosted.org/packages/19/cf/711f1d887cb92c5155c9a1eb338f1b5d2411b50e4492a3b20e4a188a22b2/pytest-5.3.2-py3-none-any.whl#sha256=e41d489ff43948babd0fad7ad5e49b8735d5d55e26628a58673c39ff61d95de4\n",
            "Best match: pytest 5.3.2\n",
            "Processing pytest-5.3.2-py3-none-any.whl\n",
            "Installing pytest-5.3.2-py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding pytest 5.3.2 to easy-install.pth file\n",
            "Installing py.test script to /usr/local/bin\n",
            "Installing pytest script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/pytest-5.3.2-py3.6.egg\n",
            "Searching for nltk==3.4.5\n",
            "Reading https://pypi.org/simple/nltk/\n",
            "Downloading https://files.pythonhosted.org/packages/f6/1d/d925cfb4f324ede997f6d47bea4d9babba51b49e87a767c170b77005889d/nltk-3.4.5.zip#sha256=bed45551259aa2101381bbdd5df37d44ca2669c5c3dad72439fa459b29137d94\n",
            "Best match: nltk 3.4.5\n",
            "Processing nltk-3.4.5.zip\n",
            "Writing /tmp/easy_install-5ugzzki5/nltk-3.4.5/setup.cfg\n",
            "Running nltk-3.4.5/setup.py -q bdist_egg --dist-dir /tmp/easy_install-5ugzzki5/nltk-3.4.5/egg-dist-tmp-lpagz2dj\n",
            "warning: no files found matching 'README.txt'\n",
            "warning: no files found matching 'Makefile' under directory '*.txt'\n",
            "warning: no previously-included files matching '*~' found anywhere in distribution\n",
            "creating /usr/local/lib/python3.6/dist-packages/nltk-3.4.5-py3.6.egg\n",
            "Extracting nltk-3.4.5-py3.6.egg to /usr/local/lib/python3.6/dist-packages\n",
            "Adding nltk 3.4.5 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/nltk-3.4.5-py3.6.egg\n",
            "Searching for joblib==0.14.1\n",
            "Reading https://pypi.org/simple/joblib/\n",
            "Downloading https://files.pythonhosted.org/packages/28/5c/cf6a2b65a321c4a209efcdf64c2689efae2cb62661f8f6f4bb28547cf1bf/joblib-0.14.1-py2.py3-none-any.whl#sha256=bdb4fd9b72915ffb49fde2229ce482dd7ae79d842ed8c2b4c932441495af1403\n",
            "Best match: joblib 0.14.1\n",
            "Processing joblib-0.14.1-py2.py3-none-any.whl\n",
            "Installing joblib-0.14.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding joblib 0.14.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/joblib-0.14.1-py3.6.egg\n",
            "Searching for torch==1.4.0\n",
            "Reading https://pypi.org/simple/torch/\n",
            "Downloading https://files.pythonhosted.org/packages/24/19/4804aea17cd136f1705a5e98a00618cb8f6ccc375ad8bfa437408e09d058/torch-1.4.0-cp36-cp36m-manylinux1_x86_64.whl#sha256=8856f334aa9ecb742c1504bd2563d0ffb8dceb97149c8d72a04afa357f667dbc\n",
            "Best match: torch 1.4.0\n",
            "Processing torch-1.4.0-cp36-cp36m-manylinux1_x86_64.whl\n",
            "Installing torch-1.4.0-cp36-cp36m-manylinux1_x86_64.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding torch 1.4.0 to easy-install.pth file\n",
            "Installing convert-caffe2-to-onnx script to /usr/local/bin\n",
            "Installing convert-onnx-to-caffe2 script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/torch-1.4.0-py3.6-linux-x86_64.egg\n",
            "Searching for GitPython==3.0.3\n",
            "Reading https://pypi.org/simple/GitPython/\n",
            "Downloading https://files.pythonhosted.org/packages/ff/f8/05f58bd7852dad7edcf70a8de953b4fa39f61cdc13812ae62118be6ffa23/GitPython-3.0.3-py3-none-any.whl#sha256=6e97b9f0954807f30c2dd8e3165731ed6c477a1b365f194b69d81d7940a08332\n",
            "Best match: GitPython 3.0.3\n",
            "Processing GitPython-3.0.3-py3-none-any.whl\n",
            "Installing GitPython-3.0.3-py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding GitPython 3.0.3 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/GitPython-3.0.3-py3.6.egg\n",
            "Searching for gitdb2==2.0.5\n",
            "Reading https://pypi.org/simple/gitdb2/\n",
            "Downloading https://files.pythonhosted.org/packages/da/30/a407568aa8d8f25db817cf50121a958722f3fc5f87e3a6fba1f40c0633e3/gitdb2-2.0.5-py2.py3-none-any.whl#sha256=e3a0141c5f2a3f635c7209d56c496ebe1ad35da82fe4d3ec4aaa36278d70648a\n",
            "Best match: gitdb2 2.0.5\n",
            "Processing gitdb2-2.0.5-py2.py3-none-any.whl\n",
            "Installing gitdb2-2.0.5-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding gitdb2 2.0.5 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/gitdb2-2.0.5-py3.6.egg\n",
            "Searching for flake8-bugbear==19.8.0\n",
            "Reading https://pypi.org/simple/flake8-bugbear/\n",
            "Downloading https://files.pythonhosted.org/packages/9f/f8/170861859fb8ae97923b4fc28501dd25209925e25face836562d3e3f5ea2/flake8_bugbear-19.8.0-py35.py36.py37-none-any.whl#sha256=ded4d282778969b5ab5530ceba7aa1a9f1b86fa7618fc96a19a1d512331640f8\n",
            "Best match: flake8-bugbear 19.8.0\n",
            "Processing flake8_bugbear-19.8.0-py35.py36.py37-none-any.whl\n",
            "Installing flake8_bugbear-19.8.0-py35.py36.py37-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding flake8-bugbear 19.8.0 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/flake8_bugbear-19.8.0-py3.6.egg\n",
            "Searching for flake8==3.7.8\n",
            "Reading https://pypi.org/simple/flake8/\n",
            "Downloading https://files.pythonhosted.org/packages/26/de/3f815a99d86eb10464ea7bd6059c0172c7ca97d4bdcfca41051b388a653b/flake8-3.7.8-py2.py3-none-any.whl#sha256=8e9dfa3cecb2400b3738a42c54c3043e821682b9c840b0448c0503f781130696\n",
            "Best match: flake8 3.7.8\n",
            "Processing flake8-3.7.8-py2.py3-none-any.whl\n",
            "Installing flake8-3.7.8-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding flake8 3.7.8 to easy-install.pth file\n",
            "Installing flake8 script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/flake8-3.7.8-py3.6.egg\n",
            "Searching for docformatter==1.3.0\n",
            "Reading https://pypi.org/simple/docformatter/\n",
            "Downloading https://files.pythonhosted.org/packages/35/52/41c0152a44873c8f11f0f9fe21b680588ae0e2b20e4a0a9b4812f8decbdc/docformatter-1.3.tar.gz#sha256=c68c8db0952d7ec6423581915fde3f23d4be5eccc11eb28a3415b5cd0a1e4f73\n",
            "Best match: docformatter 1.3\n",
            "Processing docformatter-1.3.tar.gz\n",
            "Writing /tmp/easy_install-60rznojs/docformatter-1.3/setup.cfg\n",
            "Running docformatter-1.3/setup.py -q bdist_egg --dist-dir /tmp/easy_install-60rznojs/docformatter-1.3/egg-dist-tmp-agzzb_hs\n",
            "warning: no previously-included files found matching '.pre-commit-hooks.yaml'\n",
            "warning: no previously-included files found matching '.travis.yml'\n",
            "warning: no previously-included files found matching 'Makefile'\n",
            "zip_safe flag not set; analyzing archive contents...\n",
            "Moving docformatter-1.3-py3.6.egg to /usr/local/lib/python3.6/dist-packages\n",
            "Adding docformatter 1.3 to easy-install.pth file\n",
            "Installing docformatter script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/docformatter-1.3-py3.6.egg\n",
            "Searching for emoji==0.5.4\n",
            "Reading https://pypi.org/simple/emoji/\n",
            "Downloading https://files.pythonhosted.org/packages/40/8d/521be7f0091fe0f2ae690cc044faf43e3445e0ff33c574eae752dd7e39fa/emoji-0.5.4.tar.gz#sha256=60652d3a2dcee5b8af8acb097c31776fb6d808027aeb7221830f72cdafefc174\n",
            "Best match: emoji 0.5.4\n",
            "Processing emoji-0.5.4.tar.gz\n",
            "Writing /tmp/easy_install-o1l6reju/emoji-0.5.4/setup.cfg\n",
            "Running emoji-0.5.4/setup.py -q bdist_egg --dist-dir /tmp/easy_install-o1l6reju/emoji-0.5.4/egg-dist-tmp-x2kxcb94\n",
            "Moving emoji-0.5.4-py3.6.egg to /usr/local/lib/python3.6/dist-packages\n",
            "Adding emoji 0.5.4 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/emoji-0.5.4-py3.6.egg\n",
            "Searching for docutils==0.14\n",
            "Reading https://pypi.org/simple/docutils/\n",
            "Downloading https://files.pythonhosted.org/packages/36/fa/08e9e6e0e3cbd1d362c3bbee8d01d0aedb2155c4ac112b19ef3cae8eed8d/docutils-0.14-py3-none-any.whl#sha256=02aec4bd92ab067f6ff27a38a38a41173bf01bed8f89157768c1573f53e474a6\n",
            "Best match: docutils 0.14\n",
            "Processing docutils-0.14-py3-none-any.whl\n",
            "Installing docutils-0.14-py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding docutils 0.14 to easy-install.pth file\n",
            "Installing rst2odt_prepstyles.py script to /usr/local/bin\n",
            "Installing rst2latex.py script to /usr/local/bin\n",
            "Installing rst2xml.py script to /usr/local/bin\n",
            "Installing rst2man.py script to /usr/local/bin\n",
            "Installing rst2html5.py script to /usr/local/bin\n",
            "Installing rstpep2html.py script to /usr/local/bin\n",
            "Installing rst2odt.py script to /usr/local/bin\n",
            "Installing rst2pseudoxml.py script to /usr/local/bin\n",
            "Installing rst2html4.py script to /usr/local/bin\n",
            "Installing rst2xetex.py script to /usr/local/bin\n",
            "Installing rst2s5.py script to /usr/local/bin\n",
            "Installing rst2html.py script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/docutils-0.14-py3.6.egg\n",
            "Searching for botocore==1.12.246\n",
            "Reading https://pypi.org/simple/botocore/\n",
            "Downloading https://files.pythonhosted.org/packages/6d/22/398af6ea8d5c6bac57154442068613df74e7adbf255417c6894ef49fda42/botocore-1.12.246-py2.py3-none-any.whl#sha256=6dcc121be4917cc731577a2ddff67b89cee6a4b0ec30241ce207a80a0d41990a\n",
            "Best match: botocore 1.12.246\n",
            "Processing botocore-1.12.246-py2.py3-none-any.whl\n",
            "Installing botocore-1.12.246-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding botocore 1.12.246 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/botocore-1.12.246-py3.6.egg\n",
            "Searching for boto3==1.9.246\n",
            "Reading https://pypi.org/simple/boto3/\n",
            "Downloading https://files.pythonhosted.org/packages/5b/cd/a888759c39670cac6b74027d3e3a93073ecb99135b1292d15bc2f3b6f90a/boto3-1.9.246-py2.py3-none-any.whl#sha256=9a84be232ff6432312c16b8e52cc5a01e6ff461cb9b50b3cafee24c6876a5012\n",
            "Best match: boto3 1.9.246\n",
            "Processing boto3-1.9.246-py2.py3-none-any.whl\n",
            "Installing boto3-1.9.246-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding boto3 1.9.246 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/boto3-1.9.246-py3.6.egg\n",
            "Searching for sphinxcontrib-serializinghtml\n",
            "Reading https://pypi.org/simple/sphinxcontrib-serializinghtml/\n",
            "Downloading https://files.pythonhosted.org/packages/9a/ca/bfad79b79b3821d0c6361c431f0ef4aec16ee248338b2c2013008b34d345/sphinxcontrib_serializinghtml-1.1.4-py2.py3-none-any.whl#sha256=f242a81d423f59617a8e5cf16f5d4d74e28ee9a66f9e5b637a18082991db5a9a\n",
            "Best match: sphinxcontrib-serializinghtml 1.1.4\n",
            "Processing sphinxcontrib_serializinghtml-1.1.4-py2.py3-none-any.whl\n",
            "Installing sphinxcontrib_serializinghtml-1.1.4-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sphinxcontrib-serializinghtml 1.1.4 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sphinxcontrib_serializinghtml-1.1.4-py3.6.egg\n",
            "Searching for sphinxcontrib-qthelp\n",
            "Reading https://pypi.org/simple/sphinxcontrib-qthelp/\n",
            "Downloading https://files.pythonhosted.org/packages/2b/14/05f9206cf4e9cfca1afb5fd224c7cd434dcc3a433d6d9e4e0264d29c6cdb/sphinxcontrib_qthelp-1.0.3-py2.py3-none-any.whl#sha256=bd9fc24bcb748a8d51fd4ecaade681350aa63009a347a8c14e637895444dfab6\n",
            "Best match: sphinxcontrib-qthelp 1.0.3\n",
            "Processing sphinxcontrib_qthelp-1.0.3-py2.py3-none-any.whl\n",
            "Installing sphinxcontrib_qthelp-1.0.3-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sphinxcontrib-qthelp 1.0.3 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sphinxcontrib_qthelp-1.0.3-py3.6.egg\n",
            "Searching for sphinxcontrib-jsmath\n",
            "Reading https://pypi.org/simple/sphinxcontrib-jsmath/\n",
            "Downloading https://files.pythonhosted.org/packages/c2/42/4c8646762ee83602e3fb3fbe774c2fac12f317deb0b5dbeeedd2d3ba4b77/sphinxcontrib_jsmath-1.0.1-py2.py3-none-any.whl#sha256=2ec2eaebfb78f3f2078e73666b1415417a116cc848b72e5172e596c871103178\n",
            "Best match: sphinxcontrib-jsmath 1.0.1\n",
            "Processing sphinxcontrib_jsmath-1.0.1-py2.py3-none-any.whl\n",
            "Installing sphinxcontrib_jsmath-1.0.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sphinxcontrib-jsmath 1.0.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sphinxcontrib_jsmath-1.0.1-py3.6.egg\n",
            "Searching for sphinxcontrib-htmlhelp\n",
            "Reading https://pypi.org/simple/sphinxcontrib-htmlhelp/\n",
            "Downloading https://files.pythonhosted.org/packages/36/62/8222554b29b3acde8420128d6d3999c5904d40922ef4b6ccb370e2be7421/sphinxcontrib_htmlhelp-1.0.3-py2.py3-none-any.whl#sha256=3c0bc24a2c41e340ac37c85ced6dafc879ab485c095b1d65d2461ac2f7cca86f\n",
            "Best match: sphinxcontrib-htmlhelp 1.0.3\n",
            "Processing sphinxcontrib_htmlhelp-1.0.3-py2.py3-none-any.whl\n",
            "Installing sphinxcontrib_htmlhelp-1.0.3-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sphinxcontrib-htmlhelp 1.0.3 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sphinxcontrib_htmlhelp-1.0.3-py3.6.egg\n",
            "Searching for sphinxcontrib-devhelp\n",
            "Reading https://pypi.org/simple/sphinxcontrib-devhelp/\n",
            "Downloading https://files.pythonhosted.org/packages/c5/09/5de5ed43a521387f18bdf5f5af31d099605c992fd25372b2b9b825ce48ee/sphinxcontrib_devhelp-1.0.2-py2.py3-none-any.whl#sha256=8165223f9a335cc1af7ffe1ed31d2871f325254c0423bc0c4c7cd1c1e4734a2e\n",
            "Best match: sphinxcontrib-devhelp 1.0.2\n",
            "Processing sphinxcontrib_devhelp-1.0.2-py2.py3-none-any.whl\n",
            "Installing sphinxcontrib_devhelp-1.0.2-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sphinxcontrib-devhelp 1.0.2 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sphinxcontrib_devhelp-1.0.2-py3.6.egg\n",
            "Searching for sphinxcontrib-applehelp\n",
            "Reading https://pypi.org/simple/sphinxcontrib-applehelp/\n",
            "Downloading https://files.pythonhosted.org/packages/dc/47/86022665a9433d89a66f5911b558ddff69861766807ba685de2e324bd6ed/sphinxcontrib_applehelp-1.0.2-py2.py3-none-any.whl#sha256=806111e5e962be97c29ec4c1e7fe277bfd19e9652fb1a4392105b43e01af885a\n",
            "Best match: sphinxcontrib-applehelp 1.0.2\n",
            "Processing sphinxcontrib_applehelp-1.0.2-py2.py3-none-any.whl\n",
            "Installing sphinxcontrib_applehelp-1.0.2-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding sphinxcontrib-applehelp 1.0.2 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/sphinxcontrib_applehelp-1.0.2-py3.6.egg\n",
            "Searching for idna<2.9,>=2.5\n",
            "Reading https://pypi.org/simple/idna/\n",
            "Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl#sha256=ea8b7f6188e6fa117537c3df7da9fc686d485087abf6ac197f9c46432f7e4a3c\n",
            "Best match: idna 2.8\n",
            "Processing idna-2.8-py2.py3-none-any.whl\n",
            "Installing idna-2.8-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding idna 2.8 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/idna-2.8-py3.6.egg\n",
            "Searching for commonmark>=0.8.1\n",
            "Reading https://pypi.org/simple/commonmark/\n",
            "Downloading https://files.pythonhosted.org/packages/b1/92/dfd892312d822f36c55366118b95d914e5f16de11044a27cf10a7d71bbbf/commonmark-0.9.1-py2.py3-none-any.whl#sha256=da2f38c92590f83de410ba1a3cbceafbc74fee9def35f9251ba9a971d6d66fd9\n",
            "Best match: commonmark 0.9.1\n",
            "Processing commonmark-0.9.1-py2.py3-none-any.whl\n",
            "Installing commonmark-0.9.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding commonmark 0.9.1 to easy-install.pth file\n",
            "Installing cmark script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/commonmark-0.9.1-py3.6.egg\n",
            "Searching for markdown<3.0\n",
            "Reading https://pypi.org/simple/markdown/\n",
            "Downloading https://files.pythonhosted.org/packages/6d/7d/488b90f470b96531a3f5788cf12a93332f543dbab13c423a5e7ce96a0493/Markdown-2.6.11-py2.py3-none-any.whl#sha256=9ba587db9daee7ec761cfc656272be6aabe2ed300fece21208e4aab2e457bc8f\n",
            "Best match: Markdown 2.6.11\n",
            "Processing Markdown-2.6.11-py2.py3-none-any.whl\n",
            "Installing Markdown-2.6.11-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding Markdown 2.6.11 to easy-install.pth file\n",
            "Installing markdown_py script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/Markdown-2.6.11-py3.6.egg\n",
            "Searching for pluggy<1.0,>=0.12\n",
            "Reading https://pypi.org/simple/pluggy/\n",
            "Downloading https://files.pythonhosted.org/packages/a0/28/85c7aa31b80d150b772fbe4a229487bc6644da9ccb7e427dd8cc60cb8a62/pluggy-0.13.1-py2.py3-none-any.whl#sha256=966c145cd83c96502c3c3868f50408687b38434af77734af1e9ca461a4081d2d\n",
            "Best match: pluggy 0.13.1\n",
            "Processing pluggy-0.13.1-py2.py3-none-any.whl\n",
            "Installing pluggy-0.13.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding pluggy 0.13.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/pluggy-0.13.1-py3.6.egg\n",
            "Searching for smmap2>=2.0.0\n",
            "Reading https://pypi.org/simple/smmap2/\n",
            "Downloading https://files.pythonhosted.org/packages/3e/11/2dae3df2f19c43e156cce8e02c0080b46821faf816b839a2023ef7b6b84f/smmap2-3.0.1-py3-none-any.whl#sha256=0cb6ea470b1ad9a65a02ca7f4c7ae601861f7dd24a43812ca51cfca2892bb524\n",
            "Best match: smmap2 3.0.1\n",
            "Processing smmap2-3.0.1-py3-none-any.whl\n",
            "Installing smmap2-3.0.1-py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding smmap2 3.0.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/smmap2-3.0.1-py3.6.egg\n",
            "Searching for pyflakes<2.2.0,>=2.1.0\n",
            "Reading https://pypi.org/simple/pyflakes/\n",
            "Downloading https://files.pythonhosted.org/packages/84/f2/ed0ffb887f8138a8fe5a621b8c0bb9598bfb3989e029f6c6a85ee66628ee/pyflakes-2.1.1-py2.py3-none-any.whl#sha256=17dbeb2e3f4d772725c777fabc446d5634d1038f234e77343108ce445ea69ce0\n",
            "Best match: pyflakes 2.1.1\n",
            "Processing pyflakes-2.1.1-py2.py3-none-any.whl\n",
            "Installing pyflakes-2.1.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding pyflakes 2.1.1 to easy-install.pth file\n",
            "Installing pyflakes script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/pyflakes-2.1.1-py3.6.egg\n",
            "Searching for pycodestyle<2.6.0,>=2.5.0\n",
            "Reading https://pypi.org/simple/pycodestyle/\n",
            "Downloading https://files.pythonhosted.org/packages/0e/0c/04a353e104d2f324f8ee5f4b32012618c1c86dd79e52a433b64fceed511b/pycodestyle-2.5.0-py2.py3-none-any.whl#sha256=95a2219d12372f05704562a14ec30bc76b05a5b297b21a5dfe3f6fac3491ae56\n",
            "Best match: pycodestyle 2.5.0\n",
            "Processing pycodestyle-2.5.0-py2.py3-none-any.whl\n",
            "Installing pycodestyle-2.5.0-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding pycodestyle 2.5.0 to easy-install.pth file\n",
            "Installing pycodestyle script to /usr/local/bin\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/pycodestyle-2.5.0-py3.6.egg\n",
            "Searching for mccabe<0.7.0,>=0.6.0\n",
            "Reading https://pypi.org/simple/mccabe/\n",
            "Downloading https://files.pythonhosted.org/packages/87/89/479dc97e18549e21354893e4ee4ef36db1d237534982482c3681ee6e7b57/mccabe-0.6.1-py2.py3-none-any.whl#sha256=ab8a6258860da4b6677da4bd2fe5dc2c659cff31b3ee4f7f5d64e79735b80d42\n",
            "Best match: mccabe 0.6.1\n",
            "Processing mccabe-0.6.1-py2.py3-none-any.whl\n",
            "Installing mccabe-0.6.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding mccabe 0.6.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/mccabe-0.6.1-py3.6.egg\n",
            "Searching for untokenize\n",
            "Reading https://pypi.org/simple/untokenize/\n",
            "Downloading https://files.pythonhosted.org/packages/f7/46/e7cea8159199096e1df52da20a57a6665da80c37fb8aeb848a3e47442c32/untokenize-0.1.1.tar.gz#sha256=3865dbbbb8efb4bb5eaa72f1be7f3e0be00ea8b7f125c69cbd1f5fda926f37a2\n",
            "Best match: untokenize 0.1.1\n",
            "Processing untokenize-0.1.1.tar.gz\n",
            "Writing /tmp/easy_install-kklz29mh/untokenize-0.1.1/setup.cfg\n",
            "Running untokenize-0.1.1/setup.py -q bdist_egg --dist-dir /tmp/easy_install-kklz29mh/untokenize-0.1.1/egg-dist-tmp-vo084gee\n",
            "warning: no previously-included files found matching '.travis.yml'\n",
            "warning: no previously-included files found matching 'Makefile'\n",
            "warning: no previously-included files found matching 'test_acid.py'\n",
            "zip_safe flag not set; analyzing archive contents...\n",
            "Moving untokenize-0.1.1-py3.6.egg to /usr/local/lib/python3.6/dist-packages\n",
            "Adding untokenize 0.1.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/untokenize-0.1.1-py3.6.egg\n",
            "Searching for s3transfer<0.3.0,>=0.2.0\n",
            "Reading https://pypi.org/simple/s3transfer/\n",
            "Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl#sha256=b780f2411b824cb541dbcd2c713d0cb61c7d1bcadae204cdddda2b35cef493ba\n",
            "Best match: s3transfer 0.2.1\n",
            "Processing s3transfer-0.2.1-py2.py3-none-any.whl\n",
            "Installing s3transfer-0.2.1-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding s3transfer 0.2.1 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/s3transfer-0.2.1-py3.6.egg\n",
            "Searching for smmap>=3.0.1\n",
            "Reading https://pypi.org/simple/smmap/\n",
            "Downloading https://files.pythonhosted.org/packages/b0/9a/4d409a6234eb940e6a78dfdfc66156e7522262f5f2fecca07dc55915952d/smmap-3.0.4-py2.py3-none-any.whl#sha256=54c44c197c819d5ef1991799a7e30b662d1e520f2ac75c9efbeb54a742214cf4\n",
            "Best match: smmap 3.0.4\n",
            "Processing smmap-3.0.4-py2.py3-none-any.whl\n",
            "Installing smmap-3.0.4-py2.py3-none-any.whl to /usr/local/lib/python3.6/dist-packages\n",
            "Adding smmap 3.0.4 to easy-install.pth file\n",
            "\n",
            "Installed /usr/local/lib/python3.6/dist-packages/smmap-3.0.4-py3.6.egg\n",
            "Searching for scipy==1.4.1\n",
            "Best match: scipy 1.4.1\n",
            "Adding scipy 1.4.1 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for scikit-learn==0.22.2.post1\n",
            "Best match: scikit-learn 0.22.2.post1\n",
            "Adding scikit-learn 0.22.2.post1 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for Pillow==7.0.0\n",
            "Best match: Pillow 7.0.0\n",
            "Adding Pillow 7.0.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for numpy==1.18.5\n",
            "Best match: numpy 1.18.5\n",
            "Adding numpy 1.18.5 to easy-install.pth file\n",
            "Installing f2py script to /usr/local/bin\n",
            "Installing f2py3 script to /usr/local/bin\n",
            "Installing f2py3.6 script to /usr/local/bin\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for h5py==2.10.0\n",
            "Best match: h5py 2.10.0\n",
            "Adding h5py 2.10.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for six==1.12.0\n",
            "Best match: six 1.12.0\n",
            "Adding six 1.12.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for snowballstemmer==2.0.0\n",
            "Best match: snowballstemmer 2.0.0\n",
            "Adding snowballstemmer 2.0.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for setuptools==47.3.1\n",
            "Best match: setuptools 47.3.1\n",
            "Adding setuptools 47.3.1 to easy-install.pth file\n",
            "Installing easy_install script to /usr/local/bin\n",
            "Installing easy_install-3.8 script to /usr/local/bin\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for packaging==20.4\n",
            "Best match: packaging 20.4\n",
            "Adding packaging 20.4 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for imagesize==1.2.0\n",
            "Best match: imagesize 1.2.0\n",
            "Adding imagesize 1.2.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for Babel==2.8.0\n",
            "Best match: Babel 2.8.0\n",
            "Adding Babel 2.8.0 to easy-install.pth file\n",
            "Installing pybabel script to /usr/local/bin\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for alabaster==0.7.12\n",
            "Best match: alabaster 0.7.12\n",
            "Adding alabaster 0.7.12 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for Pygments==2.1.3\n",
            "Best match: Pygments 2.1.3\n",
            "Adding Pygments 2.1.3 to easy-install.pth file\n",
            "Installing pygmentize script to /usr/local/bin\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for Jinja2==2.11.2\n",
            "Best match: Jinja2 2.11.2\n",
            "Adding Jinja2 2.11.2 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for urllib3==1.24.3\n",
            "Best match: urllib3 1.24.3\n",
            "Adding urllib3 1.24.3 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for chardet==3.0.4\n",
            "Best match: chardet 3.0.4\n",
            "Adding chardet 3.0.4 to easy-install.pth file\n",
            "Installing chardetect script to /usr/local/bin\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for certifi==2020.4.5.2\n",
            "Best match: certifi 2020.4.5.2\n",
            "Adding certifi 2020.4.5.2 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for ptyprocess==0.6.0\n",
            "Best match: ptyprocess 0.6.0\n",
            "Adding ptyprocess 0.6.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for wcwidth==0.2.4\n",
            "Best match: wcwidth 0.2.4\n",
            "Adding wcwidth 0.2.4 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for py==1.8.2\n",
            "Best match: py 1.8.2\n",
            "Adding py 1.8.2 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for more-itertools==8.4.0\n",
            "Best match: more-itertools 8.4.0\n",
            "Adding more-itertools 8.4.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for importlib-metadata==1.6.1\n",
            "Best match: importlib-metadata 1.6.1\n",
            "Adding importlib-metadata 1.6.1 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for attrs==19.3.0\n",
            "Best match: attrs 19.3.0\n",
            "Adding attrs 19.3.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for entrypoints==0.3\n",
            "Best match: entrypoints 0.3\n",
            "Adding entrypoints 0.3 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for python-dateutil==2.8.1\n",
            "Best match: python-dateutil 2.8.1\n",
            "Adding python-dateutil 2.8.1 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for jmespath==0.10.0\n",
            "Best match: jmespath 0.10.0\n",
            "Adding jmespath 0.10.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for pyparsing==2.4.7\n",
            "Best match: pyparsing 2.4.7\n",
            "Adding pyparsing 2.4.7 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for pytz==2018.9\n",
            "Best match: pytz 2018.9\n",
            "Adding pytz 2018.9 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for MarkupSafe==1.1.1\n",
            "Best match: MarkupSafe 1.1.1\n",
            "Adding MarkupSafe 1.1.1 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Searching for zipp==3.1.0\n",
            "Best match: zipp 3.1.0\n",
            "Adding zipp 3.1.0 to easy-install.pth file\n",
            "\n",
            "Using /usr/local/lib/python3.6/dist-packages\n",
            "Finished processing dependencies for parlai==0.1.20200624\n"
          ]
        }
      ],
      "source": [
        "!python setup.py develop"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 185
        },
        "id": "flvyweIpwE4h",
        "outputId": "da4f0ca4-e5bc-4405-c300-4d56bba10461",
        "vscode": {
          "languageId": "python"
        }
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "Collecting subword-nmt\n",
            "  Cloning https://github.com/rsennrich/subword-nmt.git to /tmp/pip-install-k9cr5ff2/subword-nmt\n",
            "  Running command git clone -q https://github.com/rsennrich/subword-nmt.git /tmp/pip-install-k9cr5ff2/subword-nmt\n",
            "Building wheels for collected packages: subword-nmt\n",
            "  Building wheel for subword-nmt (setup.py) ... \u001b[?25l\u001b[?25hdone\n",
            "  Created wheel for subword-nmt: filename=subword_nmt-0.3.7-cp36-none-any.whl size=130155 sha256=ccb509698c6c1e4f3820ef79f257ab959d934e2ad6885b490f9aa344ad41402a\n",
            "  Stored in directory: /tmp/pip-ephem-wheel-cache-xjzl6gdn/wheels/05/2b/3a/73cd213b79c18512c76a9ea40329a6819fa9276e232679d834\n",
            "Successfully built subword-nmt\n",
            "Installing collected packages: subword-nmt\n",
            "Successfully installed subword-nmt-0.3.7\n"
          ]
        }
      ],
      "source": [
        "!pip install 'git+https://github.com/rsennrich/subword-nmt.git#egg=subword-nmt'"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "w9NEQhOiX0Sg"
      },
      "source": [
        "# Facebook BlenderBot **2.7B**\n",
        "\n",
        "Instrucciones de uso del modelo BlenderBot: \n",
        "> Ejecuta la celda a continuación para ejecutar el script ***interactive.py*** y así poder arrancar al bot. En caso de querer ejecutar la versión que sólo admite y ofrece respuestas correctas (sin lenguaje agresivo, ofensivo, etc) deberás de ejecutar el modelo ***safe_interactive.py.***\n",
        "\n",
        "> De los tres modelos facilitados por [FacebookAI](https://parl.ai/projects/recipes/) *(Small: **90M**, Medium: **2.7B**, Big: **9.4B**)*  el siguiente comando ejecutará el modelo de tamaño medio: ***blender_3B***. En función del hardware disponible podrías probar el modelo de mayor tamaño en tu propio sistema haciendo uso de los mismo comandos.\n",
        "\n",
        "> Durante el diálogo con BlenderBot, podrás ejecutar el comando **[DONE]** para finalizar la conversación y generar un nuevo chatbot con nueva personalidad con el que poder hablar. Verás al final de cada conversación finalizada cuál era la personalidad interpretada por tu chatbot."
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/",
          "height": 1000
        },
        "id": "JdC8nvnLY_Lj",
        "outputId": "093bc2d6-2560-4fe1-da0f-7cbfdfb442d4",
        "vscode": {
          "languageId": "python"
        }
      },
      "outputs": [
        {
          "name": "stdout",
          "output_type": "stream",
          "text": [
            "\n",
            "                                 /@&%###%&&@@#\n",
            "                      .,*/((((##@@@&%%#%%&&@@@&%%#/*.\n",
            "             #@@&&&%%%%##(((///*****//(((###%%%&&&@@@@@&&%#%%#.\n",
            "         .%&@@@@@&&&%%%####((((////((((####%%%&&&@@@@@&&%%#%%####,\n",
            "           ./,,#(//**,,.....,,,,***////((((########%%%%%%%%###(((\n",
            "              /*(//**,,,....,,,,***////((((########%%%%%%%%###(#%*\n",
            "               (*,...      ...,,,***//////((((((///////(/*...,/#@@@(\n",
            "               **,,..         ...,,,,,,,,,,........,,*///*...*(#@@@@&&*\n",
            "               ./,,..          ...,,,,,,,,,........,,*//*,...*#/,,,,,/%#\n",
            "                (*,..          ...,,,,,,,,,........,,*//*,..,/(      .,#(\n",
            "                **,..          ...,,,,,,,,,.........,*//*,..,((       .,(#\n",
            "                 /*,..          ....,,,,,,,.....  ..,***,,,,(#         ..#&\n",
            "                 **,..          ....,,,,,,,....   ..,***,,,*#.         .,%@\n",
            "                 ./,...       B l e n d e r B o t ...***,,,*#          .*%@\n",
            "                  /*,..          ...,,,,,,,....    .,**,,,,/#         ..(%/\n",
            "                  /*,,..         ...,,,,,,,...    ..,*,,,,,(.         ..#&\n",
            "                  ,/*,..         ...,,,,,,,...    ..,*,,,,*#         ..*%(\n",
            "                   /*,..         ...,,,,,.....    ..,*,*,,/(         ..#&\n",
            "                   /**,..        ...,,,,.....    ...,***,*(.       ,,(%.\n",
            "                    (/*,,..      ....,,.....     ...,****(&@@@&&&#,\n",
            "                     (/*,,...   .....,,......     ..,****#@,\n",
            "                     *(/*,,/....*(###%(,(%%##(*.  ./,,**(\n",
            "                      ,//**(,........,/((#.........*,**(\n",
            "                      .(#//*,,,,,,.*.,/((%/,,.....,,*/@\n",
            "                    ((######//****,/.,/(#%#***,***(&@@@@@(\n",
            "                   *&%%#####%%%%%%%#//(#%&%%&&@@@@@@@@@@@@*\n",
            "                   &&%%%###((((((####%%%%&&&&&@@@@@@@@@@&&@.\n",
            "                  *##%%%##(((((((####%%%%%&&&&@@@@@@@@@&#/*,\n",
            "                 .(##%#/,  .,*((##%%%&&&&%%%#####%&&@&&%#(/*.\n",
            "                 /(###(,   .,*/(##%%%&&&&%%%######%&&&&%#(/*,\n",
            "                */((((*.  ..,//((##%%%%%%%%#######%&&&&%%#(/*,\n",
            "               .//(((/,   .,*//((###%%%%%%########%%&&&%%#((/,.\n",
            "              .&####(((((((((######%%%%%%%%&&&&&&&@@@@@@@@@@@@@#\n",
            "               *&#.   .*/((((#######%%%%%%&&&&&&&@@@@@#/.   (&/\n",
            "11:45:03 INFO | building data: /content/ParlAI/data/models/blender/blender_3B/BST3B.tgz\n",
            "11:45:03 INFO | Downloading http://parl.ai/downloads/_models/blender/BST3B.tgz to /content/ParlAI/data/models/blender/blender_3B/BST3B.tgz\n",
            "Downloading BST3B.tgz: 100% 4.95G/4.95G [01:35<00:00, 51.8MB/s]\n",
            "11:48:54 WARN | overriding opt['task'] to blended_skill_talk (previously: internal:blended_skill_talk,wizard_of_wikipedia,convai2:normalized,empathetic_dialogues)\n",
            "11:48:54 WARN | overriding opt['model_file'] to /content/ParlAI/data/models/blender/blender_3B/model (previously: /checkpoint/edinan/20200331/finetune_bst_gen_baseline_convai2_normal/de6/model)\n",
            "11:48:54 INFO | Using CUDA\n",
            "11:48:54 INFO | loading dictionary from /content/ParlAI/data/models/blender/blender_3B/model.dict\n",
            "11:48:54 INFO | num words = 8008\n",
            "11:48:54 INFO | TransformerGenerator: full interactive mode on.\n",
            "11:49:45 INFO | Total parameters: 2,696,268,800 (2,695,613,440 trainable)\n",
            "11:49:45 INFO | Loading existing model params from /content/ParlAI/data/models/blender/blender_3B/model\n",
            "[ optional arguments: ] \n",
            "[  display_examples: False ]\n",
            "[  display_ignore_fields: label_candidates,text_candidates ]\n",
            "[  display_prettify: False ]\n",
            "[  interactive_task: True ]\n",
            "[  save_world_logs: False ]\n",
            "[ Main ParlAI Arguments: ] \n",
            "[  batchsize: 128 ]\n",
            "[  datapath: /content/ParlAI/data ]\n",
            "[  datatype: train ]\n",
            "[  download_path: /content/ParlAI/downloads ]\n",
            "[  dynamic_batching: None ]\n",
            "[  hide_labels: False ]\n",
            "[  image_mode: raw ]\n",
            "[  init_opt: None ]\n",
            "[  loglevel: info ]\n",
            "[  multitask_weights: [1.0, 3.0, 3.0, 3.0] ]\n",
            "[  numthreads: 1 ]\n",
            "[  show_advanced_args: False ]\n",
            "[  task: blended_skill_talk ]\n",
            "[ ParlAI Model Arguments: ] \n",
            "[  dict_class: parlai.core.dict:DictionaryAgent ]\n",
            "[  init_model: /checkpoint/parlai/zoo/meena/20200319_meenav0data_tall_2.7B_adamoptimizer/20200319_13.3ppl_200kupdates/model ]\n",
            "[  model: transformer/generator ]\n",
            "[  model_file: /content/ParlAI/data/models/blender/blender_3B/model ]\n",
            "[ Local Human Arguments: ] \n",
            "[  local_human_candidates_file: None ]\n",
            "[  single_turn: False ]\n",
            "[ ParlAI Image Preprocessing Arguments: ] \n",
            "[  image_cropsize: 224 ]\n",
            "[  image_size: 256 ]\n",
            "[ Transformer Arguments: ] \n",
            "[  activation: gelu ]\n",
            "[  attention_dropout: 0.0 ]\n",
            "[  dropout: 0.1 ]\n",
            "[  embedding_size: 2560 ]\n",
            "[  embeddings_scale: True ]\n",
            "[  ffn_size: 10240 ]\n",
            "[  learn_positional_embeddings: False ]\n",
            "[  model_parallel: True ]\n",
            "[  n_decoder_layers: 24 ]\n",
            "[  n_encoder_layers: 2 ]\n",
            "[  n_heads: 32 ]\n",
            "[  n_layers: 2 ]\n",
            "[  n_positions: 128 ]\n",
            "[  n_segments: 0 ]\n",
            "[  output_scaling: 1.0 ]\n",
            "[  relu_dropout: 0.0 ]\n",
            "[  share_word_embeddings: True ]\n",
            "[  variant: prelayernorm ]\n",
            "[ Torch Generator Agent: ] \n",
            "[  beam_block_list_filename: None ]\n",
            "[  beam_block_ngram: 3 ]\n",
            "[  beam_context_block_ngram: 3 ]\n",
            "[  beam_delay: 30 ]\n",
            "[  beam_length_penalty: 0.65 ]\n",
            "[  beam_min_length: 20 ]\n",
            "[  beam_size: 10 ]\n",
            "[  compute_tokenized_bleu: False ]\n",
            "[  inference: beam ]\n",
            "[  skip_generation: False ]\n",
            "[  temperature: 1.0 ]\n",
            "[  topk: 10 ]\n",
            "[  topp: 0.9 ]\n",
            "[ TorchAgent Arguments: ] \n",
            "[  add_p1_after_newln: False ]\n",
            "[  delimiter:    ]\n",
            "[  embedding_projection: random ]\n",
            "[  embedding_type: random ]\n",
            "[  force_fp16_tokens: True ]\n",
            "[  fp16: True ]\n",
            "[  fp16_impl: mem_efficient ]\n",
            "[  gpu: -1 ]\n",
            "[  history_add_global_end_token: end ]\n",
            "[  history_size: -1 ]\n",
            "[  interactive_mode: True ]\n",
            "[  label_truncate: 128 ]\n",
            "[  no_cuda: False ]\n",
            "[  person_tokens: False ]\n",
            "[  rank_candidates: False ]\n",
            "[  split_lines: False ]\n",
            "[  text_truncate: 128 ]\n",
            "[  truncate: 128 ]\n",
            "[  use_reply: label ]\n",
            "[ Optimizer Arguments: ] \n",
            "[  adafactor_eps: [1e-30, 0.001] ]\n",
            "[  adam_eps: 1e-08 ]\n",
            "[  betas: [0.9, 0.999] ]\n",
            "[  gradient_clip: 0.1 ]\n",
            "[  learningrate: 7e-06 ]\n",
            "[  momentum: 0 ]\n",
            "[  nesterov: True ]\n",
            "[  nus: [0.7] ]\n",
            "[  optimizer: mem_eff_adam ]\n",
            "[  weight_decay: None ]\n",
            "[ Dictionary Arguments: ] \n",
            "[  bpe_debug: False ]\n",
            "[  dict_endtoken: __end__ ]\n",
            "[  dict_file: /content/ParlAI/data/models/blender/blender_3B/model.dict ]\n",
            "[  dict_initpath: None ]\n",
            "[  dict_language: english ]\n",
            "[  dict_lower: False ]\n",
            "[  dict_max_ngram_size: -1 ]\n",
            "[  dict_maxtokens: -1 ]\n",
            "[  dict_minfreq: 0 ]\n",
            "[  dict_nulltoken: __null__ ]\n",
            "[  dict_starttoken: __start__ ]\n",
            "[  dict_textfields: text,labels ]\n",
            "[  dict_tokenizer: bytelevelbpe ]\n",
            "[  dict_unktoken: __unk__ ]\n",
            "[ BPEHelper Arguments: ] \n",
            "[  bpe_add_prefix_space: True ]\n",
            "[  bpe_merge: /content/ParlAI/data/models/blender/blender_3B/model.dict-merges.txt ]\n",
            "[  bpe_vocab: /content/ParlAI/data/models/blender/blender_3B/model.dict-vocab.json ]\n",
            "[ Learning Rate Scheduler: ] \n",
            "[  invsqrt_lr_decay_gamma: -1 ]\n",
            "[  lr_scheduler: reduceonplateau ]\n",
            "[  lr_scheduler_decay: 0.5 ]\n",
            "[  lr_scheduler_patience: 3 ]\n",
            "[  max_lr_steps: -1 ]\n",
            "[  update_freq: 2 ]\n",
            "[  warmup_rate: 0.0001 ]\n",
            "[  warmup_updates: 100 ]\n",
            "[ BST Interactive World: ] \n",
            "[  display_partner_persona: True ]\n",
            "[  include_initial_utterances: False ]\n",
            "[  include_personas: True ]\n",
            "[  safe_personas_only: True ]\n",
            "\u001b[1;31mEnter [DONE] if you want to end the episode, [EXIT] to quit.\u001b[0;0m\n",
            "11:52:04 INFO | creating task(s): blended_skill_talk\n",
            "[ loading personas.. ]\n",
            "\n",
            "  [NOTE: In the BST paper both partners have a persona.\n",
            "         You can choose to ignore yours, the model never sees it.\n",
            "         In the Blender paper, this was not used for humans.\n",
            "         You can also turn personas off with --include-personas False]\n",
            "\n",
            "[building data: /content/ParlAI/data/blended_skill_talk]\n",
            "11:52:04 INFO | Downloading http://parl.ai/downloads/blended_skill_talk/blended_skill_talk.tar.gz to /content/ParlAI/data/blended_skill_talk/blended_skill_talk.tar.gz\n",
            "Downloading blended_skill_talk.tar.gz: 100% 38.1M/38.1M [00:01<00:00, 30.7MB/s]\n",
            "11:52:07 INFO | Downloading http://parl.ai/downloads/blended_skill_talk/personas_list.txt to /content/ParlAI/data/blended_skill_talk/persona_list.txt\n",
            "Downloading persona_list.txt: 0.00B [00:00, ?B/s]\n",
            "11:52:08 INFO | Downloading http://parl.ai/downloads/blended_skill_talk/topic_to_persona_list.txt to /content/ParlAI/data/blended_skill_talk/topic_to_persona_list.txt\n",
            "Downloading topic_to_persona_list.txt: 0.00B [00:00, ?B/s]\n",
            "11:52:08 INFO | Downloading http://parl.ai/downloads/blended_skill_talk/ed_persona_topicifier__train__both_sides.json to /content/ParlAI/data/blended_skill_talk/ed_persona_topicifier__train__both_sides.json\n",
            "Downloading ed_persona_topicifier__train__both_sides.json: 0.00B [00:01, ?B/s]\n",
            "11:52:10 INFO | Downloading http://parl.ai/downloads/blended_skill_talk/ed_persona_topicifier__train__experiencer_only.json to /content/ParlAI/data/blended_skill_talk/ed_persona_topicifier__train__experiencer_only.json\n",
            "Downloading ed_persona_topicifier__train__experiencer_only.json: 0.00B [00:01, ?B/s]\n",
            "11:52:11 INFO | Downloading http://parl.ai/downloads/blended_skill_talk/ed_persona_topicifier__valid__experiencer_only.json to /content/ParlAI/data/blended_skill_talk/ed_persona_topicifier__valid__experiencer_only.json\n",
            "Downloading ed_persona_topicifier__valid__experiencer_only.json: 0.00B [00:02, ?B/s]\n",
            "11:52:14 INFO | Downloading http://parl.ai/downloads/blended_skill_talk/ed_persona_topicifier__test__experiencer_only.json to /content/ParlAI/data/blended_skill_talk/ed_persona_topicifier__test__experiencer_only.json\n",
            "Downloading ed_persona_topicifier__test__experiencer_only.json: 0.00B [00:03, ?B/s]\n",
            "11:52:18 INFO | Downloading http://parl.ai/downloads/blended_skill_talk/safe_personas_2.txt to /content/ParlAI/data/blended_skill_talk/safe_personas.txt\n",
            "Downloading safe_personas.txt: 0.00B [00:00, ?B/s]\n",
            "Loading /content/ParlAI/data/blended_skill_talk/train.json.\n",
            "Saving to /content/ParlAI/data/blended_skill_talk/train.txt\n",
            "Loading /content/ParlAI/data/blended_skill_talk/valid.json.\n",
            "Saving to /content/ParlAI/data/blended_skill_talk/valid.txt\n",
            "Loading /content/ParlAI/data/blended_skill_talk/test.json.\n",
            "Saving to /content/ParlAI/data/blended_skill_talk/test.txt\n",
            "\u001b[0;34m[context]:\u001b[0;0m \u001b[1myour persona: i have a job as a dj at a radio station.\n",
            "your persona: i once drove a car ! my friend told me what to do while i drove.\n",
            "Disc jockey\u001b[0;0m\n",
            "\u001b[0mEnter Your Message:\u001b[0;0m "
          ]
        }
      ],
      "source": [
        "!python /content/ParlAI/parlai/scripts/interactive.py -t blended_skill_talk -mf zoo:blender/blender_3B/model"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "pcaTM7xKJTQq",
        "vscode": {
          "languageId": "python"
        }
      },
      "outputs": [],
      "source": []
    }
  ],
  "metadata": {
    "accelerator": "GPU",
    "colab": {
      "machine_shape": "hm",
      "provenance": []
    },
    "kernelspec": {
      "display_name": "Python 3",
      "name": "python3"
    }
  },
  "nbformat": 4,
  "nbformat_minor": 0
}