Skip to content

Latest commit

 

History

History
20 lines (14 loc) · 1 KB

README.md

File metadata and controls

20 lines (14 loc) · 1 KB

Adlik: Serving Engine

Serving Engine schematic diagram

  1. Model upload, upgrade, versioning, inference and monitoring.
  2. Unified inference interfaces for different runtimes.
  3. Unified management and scheduling of multi-runtime, multi-model and multi-instance.
  4. Automatic selection of inference runtime.
  5. Supporting customized runtime and ML runtime.

Usage

First, Confirm that the environment where adlik is installed is the Ubuntu operating system. If you do not have the ubuntu system on your environment, but you still want to use Adlik, you can install the Adlik in docker. And in this way, you need to configure available mirror source (for example: Tsinghua Open Source Mirror) for your docker and pull an ubuntu docker images.

Second, use Git clone the Adlik code or download zip.

Third, follow the build step to build the Adlik.