400 Key Dependencies

title: “Containerization Key Dependencies” tags: [“kb”]

Containerization Key Dependencies

This document lists the critical dependencies utilized across the project’s containerization strategy.

1. Base Images

  • nvidia/cuda:11.7.1-runtime-ubuntu20.04: The primary base image for AI/ML applications, providing CUDA runtime and an Ubuntu environment.
  • alpine:3.12 (staging): Used as a staging image in the multi-stage build process for the custom linuxserver/ubuntu-baseimage.
  • scratch: The ultimate minimal base image used as the final stage for the custom linuxserver/ubuntu-baseimage.

2. System Packages (via apt-get or similar)

A comprehensive list of system packages installed includes:

  • wget
  • fonts-dejavu-core
  • rsync
  • git
  • libglib2.0-0
  • build-essential
  • libssl-dev
  • libffi-dev
  • python-dev
  • python3-pip
  • apt-utils
  • locales
  • curl
  • patch
  • tzdata
  • gnupg
  • jellyfin-server
  • jellyfin-ffmpeg5
  • jellyfin-web
  • libfontconfig1
  • libfreetype6
  • libssl1.1
  • mesa-va-drivers

3. Python Environments

  • Miniconda: Used for environment management in hlky/stable-diffusion.
  • virtualenv: Employed by naifu for isolated Python environments.
  • pip: The ubiquitous Python package installer used across all Python applications.

4. Python Libraries

4.1. AI/ML & Vision Related

  • pytorch
  • torchvision
  • cudatoolkit
  • transformers
  • sentence_transformers
  • faiss-cpu
  • einops
  • pytorch_lightning
  • ftfy
  • scikit-image
  • torchdiffeq
  • opencv-python-headless
  • CLIP

4.2. Web Frameworks

  • fastapi
  • uvicorn

4.3. Utilities

  • dotmap
  • omegaconf
  • jsonmerge
  • Pillow
  • pyngrok

5. Git Repositories (Application Code and Models)

The following Git repositories are cloned and used within the Docker images:

  • https://github.com/hlky/stable-diffusion.git
  • https://github.com/hlky/sd-enable-textual-inversion.git
  • https://gitea.cheapassbox.com/acmcarther/naifu.git
  • https://github.com/CompVis/stable-diffusion.git
  • https://github.com/sczhou/CodeFormer.git
  • https://github.com/salesforce/BLIP.git
  • https://github.com/CompVis/taming-transformers.git
  • https://github.com/crowsonkb/k-diffusion.git
  • https://github.com/AUTOMATIC1111/stable-diffusion-webui.git
  • https://github.com/TencentARC/GFPGAN.git
  • https://openai/CLIP.git

6. Container Orchestration Helpers

  • s6-overlay: Essential for process supervision and initialization within containers built by the linuxserver team.
  • docker/dockerfile:1: A syntax directive used in Dockerfiles.

7. Internal Libraries (Implied)

  • hydra_node.config
  • hydra_node.models
  • hydra_node.sanitize