Stable_Diffusion_WebUi_Altryne.ipynb

{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "Stable Diffusion WebUi - Altryne",
      "provenance": [],
      "collapsed_sections": [
        "4eodrBxeCgOW",
        "RXasLtrYC9uj",
        "MVJzvQGdDn6C",
        "vhZQqFGxEHcA",
        "Wt_tzv_eJ9Qz",
        "ip0o1IqmQNON",
        "E1kYjBY9Rmi-"
      ],
      "machine_shape": "hm",
      "include_colab_link": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "language_info": {
      "name": "python"
    },
    "accelerator": "GPU",
    "gpuClass": "standard"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "view-in-github",
        "colab_type": "text"
      },
      "source": [
        "<a href=\"https://colab.research.google.com/github/altryne/sd-webui-colab/blob/main/Stable_Diffusion_WebUi_Altryne.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "jnXUwtACCHOy"
      },
      "source": [
        "# Welcome to Stable Diffusion WebUI 1.4! by [@altryne](https://twitter.com/altryne/) |  [![ko-fi](https://ko-fi.com/img/githubbutton_sm.svg)](https://ko-fi.com/N4N3DWMR1) \n",
        "\n",
        "This colab runs the latest webui version from the repo https://github.com/hlky/stable-diffusion-webui\n",
        "\n",
        "---\n",
        "\n",
        "If this colab helped you, support me on ko-fi and don't forget to subscribe to my awesome list https://github.com/altryne/awesome-ai-art-image-synthesis\n"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [],
      "metadata": {
        "id": "uKA724szI_aG"
      }
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "4eodrBxeCgOW"
      },
      "source": [
        "## 1 -  Setup stage"
      ]
    },
    {
      "cell_type": "markdown",
      "source": [
        "### 1.0"
      ],
      "metadata": {
        "id": "YiG8fBPrI99p"
      }
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "cAsdhafsBvEr"
      },
      "outputs": [],
      "source": [
        "!nvidia-smi -L"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "RXasLtrYC9uj"
      },
      "source": [
        "### 1.1 Download repo and install\n",
        "\n",
        "Clone git repo and setup miniconda\n"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "cellView": "form",
        "id": "LSCxESSsDGVh"
      },
      "outputs": [],
      "source": [
        "#@markdown ## Download the stable-diffusion webui repo\n",
        "#@markdown And install colab related conda (uncheck stable version if you like new features)\n",
        "%cd /content\n",
        "!git clone https://github.com/hlky/stable-diffusion\n",
        "%cd /content/stable-diffusion\n",
        "stable_version = True #@param {type:\"boolean\"}\n",
        "if stable_version: \n",
        "  !git checkout colab-pin\n",
        "\n",
        "import sys\n",
        "!wget https://repo.anaconda.com/miniconda/Miniconda3-latest-Linux-x86_64.sh\n",
        "!chmod +x Miniconda3-latest-Linux-x86_64.sh\n",
        "!bash ./Miniconda3-latest-Linux-x86_64.sh -b -f -p /usr/local\n",
        "sys.path.append('/usr/local/lib/python3.7/site-packages/')\n",
        "!rm Miniconda3-latest-Linux-x86_64.sh"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "MVJzvQGdDn6C"
      },
      "source": [
        "### 1.2 Environment setup\n",
        "Setup environment, Gfpgan and Real-ESRGAN. Takes about 5-6 minutes"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "PvH2zyoiD0q8",
        "cellView": "form"
      },
      "outputs": [],
      "source": [
        "#@markdown ### Set up conda environment - Takes a while\n",
        "!conda env update -n base -f /content/stable-diffusion/environment.yaml "
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "vhZQqFGxEHcA"
      },
      "source": [
        "### 1.3 Setup Upscalers - CFPGan and ESRGAN"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "cellView": "form",
        "id": "M3o7slcTEQvp"
      },
      "outputs": [],
      "source": [
        "\n",
        "#@markdown ### Build upscalers support\n",
        "#@markdown **GFPGAN** Automatically correct distorted faces with a built-in GFPGAN option, fixes them in less than half a second\n",
        "#@markdown **ESRGAN** Boosts the resolution of images with a built-in RealESRGAN option\n",
        "#@markdown LDSR and GoBig enable amazing upscale options in the new Image Lab\n",
        "\n",
        "add_CFP = True #@param {type:\"boolean\"} \n",
        "add_ESR = True #@param {type:\"boolean\"}\n",
        "add_LDSR = False #@param {type:\"boolean\"} \n",
        "#@markdown ⚠️ LDSR is 1.9GB and make take time to download\n",
        "\n",
        "if add_CFP:\n",
        "  %cd /content/stable-diffusion/src/gfpgan/\n",
        "  !pip install basicsr facexlib yapf lmdb opencv-python pyyaml tb-nightly --no-deps\n",
        "  !python setup.py develop\n",
        "  !pip install realesrgan\n",
        "  !wget https://github.com/TencentARC/GFPGAN/releases/download/v1.3.0/GFPGANv1.3.pth -P experiments/pretrained_models\n",
        "if add_ESR:\n",
        "  %cd /content/stable-diffusion/src/realesrgan/\n",
        "  !wget https://github.com/xinntao/Real-ESRGAN/releases/download/v0.1.0/RealESRGAN_x4plus.pth -P experiments/pretrained_models\n",
        "  !wget https://github.com/xinntao/Real-ESRGAN/releases/download/v0.2.2.4/RealESRGAN_x4plus_anime_6B.pth -P experiments/pretrained_models\n",
        "if add_LDSR:\n",
        "  %cd /content/stable-diffusion/src\n",
        "  !git clone https://github.com/devilismyfriend/latent-diffusion\n",
        "  %cd latent-diffusion\n",
        "  %mkdir -p experiments/\n",
        "  %cd experiments/\n",
        "  %mkdir -p pretrained_models\n",
        "  %cd pretrained_models\n",
        "  #project.yaml download\n",
        "  !wget -O project.yaml https://heibox.uni-heidelberg.de/f/31a76b13ea27482981b4/?dl=1\n",
        "  #model.ckpt model download\n",
        "  !wget -O model.ckpt https://heibox.uni-heidelberg.de/f/578df07c8fc04ffbadf3/?dl=1\n",
        "\n",
        "%cd /content/stable-diffusion/\n",
        "!wget https://github.com/matomo-org/travis-scripts/blob/master/fonts/Arial.ttf?raw=true -O arial.ttf"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "mBFOSYR91AeT"
      },
      "source": [
        "### 1.4 Connect to Google Drive"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "cellView": "form",
        "id": "vkgBVo5OEpqn"
      },
      "outputs": [],
      "source": [
        "#@markdown # Load the stable-diffusion model\n",
        "\n",
        "#@markdown **Model Path Variables**\n",
        "# ask for the link\n",
        "print(\"Local Path Variables:\\n\")\n",
        "\n",
        "models_path = \"/content/models\" #@param {type:\"string\"}\n",
        "output_path = \"/content/output\" #@param {type:\"string\"}\n",
        "\n",
        "#@markdown **Download the model if it isn't already in the 'models_path' folder (Optional)**\n",
        "\n",
        "#@markdown To download the model, you need to have accepted the terms [HERE](https://huggingface.co/CompVis/stable-diffusion-v1-4)\n",
        "#@markdown and have copied a token from [HERE](https://huggingface.co/settings/tokens)\n",
        "download_if_missing = False #@param {type:\"boolean\"}\n",
        "token = \"\" #@param {type:\"string\"}\n",
        "\n",
        "#@markdown **Google Drive Path Variables (Optional)**\n",
        "mount_google_drive = True #@param {type:\"boolean\"}\n",
        "force_remount = False\n",
        "\n",
        "%cd /content/\n",
        "import os\n",
        "mount_success = True\n",
        "if mount_google_drive:\n",
        "    from google.colab import drive\n",
        "    try:\n",
        "        drive_path = \"/content/drive\"\n",
        "        drive.mount(drive_path,force_remount=force_remount)\n",
        "        models_path_gdrive = \"/content/drive/MyDrive/AI/models\" #@param {type:\"string\"}\n",
        "        output_path_gdrive = \"/content/drive/MyDrive/AI/StableDiffusion\" #@param {type:\"string\"}\n",
        "        models_path = models_path_gdrive\n",
        "        output_path = output_path_gdrive\n",
        "    except:\n",
        "        print(\"...error mounting drive or with drive path variables\")\n",
        "        print(\"...reverting to default path variables\")\n",
        "        mount_success = False\n",
        "\n",
        "os.makedirs(models_path, exist_ok=True)\n",
        "os.makedirs(output_path, exist_ok=True)\n",
        "\n",
        "if download_if_missing:\n",
        "    if not mount_success:\n",
        "        print(\"Downloading model to \" + models_path + \" due to gdrive mount error\")\n",
        "    if token == \"\":\n",
        "        print(\"No token provided. Assuming model is already in \" + models_path)\n",
        "    elif not os.path.exists(models_path + '/sd-v1-4.ckpt'):\n",
        "        !git lfs install --system --skip-repo\n",
        "        !mkdir sd-model\n",
        "        %cd /content/sd-model/\n",
        "        !git init\n",
        "        !git remote add -f origin \"https://USER:{token}@huggingface.co/CompVis/stable-diffusion-v-1-4-original\"\n",
        "        !git config core.sparsecheckout true\n",
        "        !echo \"sd-v1-4.ckpt\" > .git/info/sparse-checkout\n",
        "        !git pull origin main\n",
        "        !mv '/content/sd-model/sd-v1-4.ckpt' '{models_path}/'\n",
        "    else:\n",
        "        print(\"Model already downloaded, moving to next step\")\n",
        "\n",
        "print(f\"models_path: {models_path}\")\n",
        "print(f\"output_path: {output_path}\")"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "Wt_tzv_eJ9Qz"
      },
      "source": [
        "## 2 - Run the Stable Diffusion webui"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ip0o1IqmQNON"
      },
      "source": [
        "### 2.1 Optional - Set webUI settings and configs before running "
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "cellView": "form",
        "id": "3t1DaxIfRmSm"
      },
      "outputs": [],
      "source": [
        "#@markdown # Launch preferences - Advanced\n",
        "share_password=\"\" #@param {type:\"string\"}\n",
        "#@markdown * Add a password to your webui\n",
        "defaults=\"configs/webui/webui.yaml\" #@param {type:\"string\"}\n",
        "#@markdown * path to configuration file providing UI defaults, uses same format as cli parameter)  \n",
        "#@markdown Edit this file if you want to change the default settings UI launches with\n",
        "\n",
        "#@markdown ---\n",
        "save_metadata = False #@param {type:\"boolean\"}\n",
        "#@markdown * Whether to embed the generation parameters in the sample images\n",
        "skip_grid = False #@param {type:\"boolean\"}\n",
        "#@markdown * Do not save a grid, only individual samples. Helpful when evaluating lots of samples\n",
        "skip_save = False #@param {type:\"boolean\"}\n",
        "#@markdown * Do not save individual samples as files. For speed measurements\n",
        "optimized = False #@param {type:\"boolean\"}\n",
        "#@markdown * Load the model onto the device piecemeal instead of all at once to reduce VRAM usage at the cost of performance\n",
        "optimized_turbo = True #@param {type:\"boolean\"}\n",
        "#@markdown * Alternative optimization mode that does not save as much VRAM but runs siginificantly faster\n",
        "no_verify_input = False #@param {type:\"boolean\"}\n",
        "#@markdown * Do not verify input to check if it's too long\n",
        "no_half = False #@param {type:\"boolean\"}\n",
        "#@markdown * Do not switch the model to 16-bit floats\n",
        "no_progressbar_hiding = True #@param {type:\"boolean\"}\n",
        "#@markdown * Do not hide progressbar in gradio UI\n",
        "extra_models_cpu = False #@param {type:\"boolean\"}\n",
        "#@markdown * Run extra models (GFGPAN/ESRGAN) on cpu\n",
        "esrgan_cpu = True #@param {type:\"boolean\"}\n",
        "#@markdown * run ESRGAN on cpu\n",
        "gfpgan_cpu = False #@param {type:\"boolean\"}\n",
        "#@markdown * run GFPGAN on cpu\n",
        "\n",
        "\n",
        "run_string_with_variables = {\n",
        " '--save-metadata': f'{save_metadata}',\n",
        " '--skip-grid': f'{skip_grid}',\n",
        " '--skip-save': f'{skip_save}',\n",
        " '--optimized': f'{optimized}',\n",
        " '--optimized-turbo': f'{optimized_turbo}',\n",
        " '--no-verify-input': f'{no_verify_input}',\n",
        " '--no-half': f'{no_half}',\n",
        " '--no-progressbar-hiding': f'{no_progressbar_hiding}',\n",
        " '--extra-models-cpu': f'{extra_models_cpu}',\n",
        " '--esrgan-cpu': f'{esrgan_cpu}',\n",
        " '--gfpgan-cpu': f'{gfpgan_cpu}'}\n",
        "\n",
        "only_true_vars = {k for (k,v) in run_string_with_variables.items() if v == 'True'}\n",
        "vars = \" \".join(only_true_vars)\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "E1kYjBY9Rmi-"
      },
      "source": [
        "## 3 - Launch WebUI for stable diffusion"
      ]
    },
    {
      "cell_type": "code",
      "execution_count": null,
      "metadata": {
        "id": "BTH_drY9KZ4k",
        "cellView": "form"
      },
      "outputs": [],
      "source": [
        "#@markdown ** keep in mind that this script is set to run for ever, google will disconnect you after 90 minutes on free tiers\n",
        "\n",
        "#@markdown # Important - click the public URL to launch WebUI in another tab\n",
        "#@markdown ![](https://user-images.githubusercontent.com/463317/187105407-dd9b0f4e-c8da-49d3-8c78-1767f5c9aa83.jpg)\n",
        "\n",
        "#fix adding share_password to the launch params, and also changin {vars} to $vars as it was causing webui.py to fail.\n",
        "\n",
        "%cd /content/stable-diffusion\n",
        "\n",
        "if share_password == \"\":\n",
        "  !python scripts/webui.py \\\n",
        "  --ckpt '{models_path}/sd-v1-4.ckpt' \\\n",
        "  --outdir '{output_path}' \\\n",
        "  --share $vars\n",
        "else:\n",
        "  !python scripts/webui.py \\\n",
        "  --ckpt '{models_path}/sd-v1-4.ckpt' \\\n",
        "  --outdir '{output_path}' \\\n",
        "  --share-password '{share_password}' \\\n",
        "  --share $vars\n",
        "\n"
      ]
    },
    {
      "cell_type": "code",
      "source": [],
      "metadata": {
        "id": "iZ-X7HxeRNRQ"
      },
      "execution_count": null,
      "outputs": []
    }
  ]
}