Skip to content

DJL dependency management

This document outlines how DJL manages its dependencies and how developers can find DJL packages they need.

External dependencies

We try our best to minimize the external dependencies. The core DJL library only has 4 external dependencies:

Which DJL package do I need?

Although DJL itself has many packages, but in a real production environment, the minimal dependencies can be:

  • ai.djl:api
  • one of the engine package (e.g. ai.djl.pytorch:pytorch-engine)
  • native library of selected engine for no internet use case (e.g. ai.djl.pytorch:pytorch-native-cpu:1.11.0:linux-x86_64 + ai.djl.pytorch:pytorch-jni). See How to distribute DJL application for more detail.

We don't recommend include more than one engine into your project unless you need both of them. DJL will load all engines into memory as long as they are in classpath, and those engines usually consume significant of memory.

Using Bill of Materials module (BOM)

To automatically manage DJL packages' versions, we recommend you use the Bill of Materials. It can simplify your project's dependency management and make sure Maven picks the compatible versions of DJL modules.

See How to use DJL's BOM for detail.

List of DJL packages published on Maven Central

Group ID Artifact ID Description
ai.djl api DJL core API, contains top level, engine-agnostic classes for both inference and training
bom Bill of Materials (BOM), used to manage DJL package dependencies
basicdataset Contains a collection of built-in datasets
model-zoo Contains a collection of built-in engine-agnostic models
examples (deprecated) Contains DJL examples
repository (deprecated, use api instead) Contain classes for DJL Repository API. The package is moved into api in newer releases
ai.djl.mxnet mxnet-engine Apache MXNet engine adapter
mxnet-model-zoo Contains state of the art Apache MXNet symbolic models
mxnet-native-mkl(osx-x86_64) Contains Apache MXNet native library for macOS
mxnet-native-mkl(win-x86_64) Contains Apache MXNet native library for Windows
mxnet-native-mkl(linux-x86_64) Contains Apache MXNet native library for Linux
mxnet-native-cu112(linux-x86_64) Contains Apache MXNet native library for Linux with CUDA 11.2
mxnet-native-cu102(linux-x86_64) Contains Apache MXNet native library for Linux with CUDA 10.2
mxnet-native-auto (deprecated) No longer needed since DJL 0.15.0
mxnet-native-cu110(linux-x86_64) (deprecated) Contains Apache MXNet native library <= 1.8.1 for Linux with CUDA 11.0
mxnet-native-cu101(linux-x86_64) (deprecated) Contains Apache MXNet native library <= 1.7.0 for Linux with CUDA 10.1
mxnet-native-cu92(linux-x86_64) (deprecated) Contains Apache MXNet native library <= 1.6.0 for Linux with CUDA 9.2
ai.djl.pytorch pytorch-engine PyTorch engine adapter
pytorch-model-zoo Contains state of the art PyTorch torch script models
pytorch-native-cpu(osx-x86_64) Contains PyTorch native library for macOS
pytorch-native-cpu(osx-aarch64) Contains PyTorch native library for macOS M1
pytorch-native-cpu(win-x86_64) Contains PyTorch native library for Windows
pytorch-native-cpu(linux-x86_64) Contains PyTorch native library for Linux
pytorch-native-cu118(linux-x86_64) Contains PyTorch native library for Linux with CUDA 11.7
pytorch-native-cu118(win-x86_64) Contains PyTorch native library for Windows with CUDA 11.7
pytorch-native-cu118-precxx11(linux-x86_64) Contains PyTorch native library for Linux with CUDA 11.7
pytorch-native-cpu-precxx11(linux-x86_64) Contains PyTorch native library for centOS 7 and Ubuntu 14.04
pytorch-native-cpu-precxx11(linux-aarch64) Contains PyTorch native library for Linux ARM
pytorch-jni Contains PyTorch JNI native library
pytorch-native-auto (deprecated) No longer needed since DJL 0.15.0
pytorch-native-cu117(linux-x86_64) (deprecated) Contains PyTorch native library for Linux with CUDA 11.7
pytorch-native-cu117(win-x86_64) (deprecated) Contains PyTorch native library for Windows with CUDA 11.7
pytorch-native-cu117-precxx11(linux-x86_64) (deprecated) Contains PyTorch native library for Linux with CUDA 11.7
pytorch-native-cu116(linux-x86_64) (deprecated) Contains PyTorch native library for Linux with CUDA 11.6
pytorch-native-cu116(win-x86_64) (deprecated) Contains PyTorch native library for Windows with CUDA 11.6
pytorch-native-cu116-precxx11(linux-x86_64) (deprecated) Contains PyTorch native library for Linux with CUDA 11.6
pytorch-native-cu113(linux-x86_64) (deprecated) Contains PyTorch native library for Linux with CUDA 11.3
pytorch-native-cu113(win-x86_64) (deprecated) Contains PyTorch native library for Windows with CUDA 11.3
pytorch-native-cu111(linux-x86_64) (deprecated) Contains PyTorch native library for Linux with CUDA 11.1
pytorch-native-cu111(win-x86_64) (deprecated) Contains PyTorch native library for Windows with CUDA 11.1
pytorch-native-cu102(linux-x86_64) (deprecated) Contains PyTorch native library for Linux with CUDA 10.2
pytorch-native-cu102(win-x86_64) (deprecated) Contains PyTorch native library for Windows with CUDA 10.2
pytorch-native-cu101(linux-x86_64) (deprecated) Contains PyTorch native library <= 1.7.1 for Linux with CUDA 10.1
pytorch-native-cu101(win-x86_64) (deprecated) Contains PyTorch native library <= 1.7.1 for Windows with CUDA 10.1
pytorch-native-cu92(linux-x86_64) (deprecated) Contains PyTorch native library <= 1.6.0 for Linux with CUDA 9.2
pytorch-native-cu92(win-x86_64) (deprecated) Contains PyTorch native library <= 1.6.0 for Windows with CUDA 9.2
pytorch-engine-precxx11 (deprecated) PyTorch engine adapter <= 0.9.0 specific for precxx11 environment like CentOs 7 and Ubuntu 14.04
ai.djl.tensorflow tensorflow-engine TensorFlow engine adapter
tensorflow-api A redistribution of tensorFlow core java API 2.x
tensorflow-model-zoo Contains state of the art TensorFlow saved bundle models
tensorflow-native-cpu(osx-x86_64) Contains TensorFlow native library for macOS
tensorflow-native-cpu(linux-x86_64) Contains TensorFlow native library for Linux
tensorflow-native-cpu(win-x86_64) Contains TensorFlow native library for Windows
tensorflow-native-cu113(linux-x86_84) Contains TensorFlow native library for Linux with CUDA 11.3
tensorflow-native-cu110 (linux-x86_84) (deprecated) Contains TensorFlow native library for Linux with CUDA 11.0
tensorflow-native-auto (deprecated) No longer needed since DJL 0.15.0
tensorflow-native-cu101(linux-x86_84) (deprecated) Contains TensorFlow native library <= 2.3.0 for Linux with CUDA 10.1
ai.djl.paddlepaddle paddlepaddle-engine (deprecated) PaddlePaddle engine adapter
paddlepaddle-model-zoo (deprecated) Contains state of the art PaddlePaddle models
paddlepaddle-native-cpu(osx-x86_64) (deprecated) Contains PaddlePaddle native library for macOS
paddlepaddle-native-cpu(linux-x86_64) (deprecated) Contains PaddlePaddle native library for Linux
paddlepaddle-native-cpu(win-x86_64) (deprecated) Contains PaddlePaddle native library for Windows
paddlepaddle-native-cu102(linux-x86_64) (deprecated) Contains PaddlePaddle native library for Linux with CUDA 10.2
paddlepaddle-native-cu112(linux-x86_64) (deprecated) Contains PaddlePaddle native library for Linux with CUDA 11.2
paddlepaddle-native-cu110(win-x86_64) (deprecated) Contains PaddlePaddle native library for Windows with CUDA 11.0
paddlepaddle-native-cu101 (deprecated) Contains PaddlePaddle native library <= 2.0.2 for Linux with CUDA 10.1
paddlepaddle-native-auto (deprecated) No longer needed since DJL 0.15.0
ai.djl.onnxruntime onnxruntime-engine ONNX Runtime engine adapter
onnxruntime-api(deprecated) Please use com.microsoft.onnxruntime:onnxruntime instead
onnxruntime-native-auto(deprecated) Please use com.microsoft.onnxruntime:onnxruntime instead
onnxruntime-native-cpu(deprecated) Please use com.microsoft.onnxruntime:onnxruntime instead
ai.djl.tflite tflite-engine (deprecated) TensorFlow Lite engine adapter
tflite-native-cpu(osx-x86_64) (deprecated) Contains TensorFlow Lite native library for macOS
tflite-native-cpu(linux-x86_64) (deprecated) Contains TensorFlow Lite native library for Linux
tflite-native-auto (deprecated) No longer needed since DJL 0.15.0
ai.djl.tensorrt tensorrt TensorRT engine adapter
ai.djl.python python Python engine adapter
ai.djl.ml.lightgbm lightgbm LightGBM engine adapter
ai.djl.ml.xgboost xgboost XGBoost engine adapter
xgboost-gpu XGBoost engine adapter for GPU
ai.djl.android core Contains Android specific utilities (e.g. ImageFactory) for DJL
pytorch-native Contains DJL PyTorch Android native package
onnxruntime Contains DJL Onnxruntime Android package
ai.djl.audio audio DJL audio support extension
ai.djl.aws aws-ai Contains classes that make it easy for DJL to access AWS services
ai.djl.fasttext fasttext Contains NLP utility classes NLP for fastText
ai.djl.hadoop hadoop Contains classes that make it easy for DJL access HDFS
ai.djl.opencv opencv DJL OpenCV extension for high performance image processing
ai.djl.sentencepiece sentencepiece Contains NLP utility classes for SentencePiece
ai.djl.timeseries timeseries Contains Time Series data processing utility classes
ai.djl.tablesaw tablesaw Contains Tabular data processing utility classes
ai.djl.tokenizers tokenizers DJL Huggingface tokenizers extension for NLP tokenize processing
ai.djl.serving wlm DJL Serving WorkLoadManager
ai.djl.spark spark_2.12 DJL Spark extension
spark (deprecated)