Skip to main content
Running Datalab’s containers requires a Google Cloud service account key to pull the container image. If the terms of your agreement require a license, we’ll also provide a license key.

​
License-enabled containers

Copy your license key, download the service account key, and run the script in this Github repository to get up-and-running: 
export DATALAB_LICENSE_KEY=your-license-key
export SERVICE_ACCOUNT_KEY_FILE=path/to/key.json
./run-datalab-inference-container.sh

​
Fully-airgapped containers

A license key is not required to run a fully-airgapped container. If the terms of your agreement require a fully-airgapped container, we will provide:
  • Access to private registries that contain those images.
  • A Google Cloud service account key to pull images.
  • Directions for how to run the container.

​
www.datalab.to must be reachable

Our on-prem license requires that https://www.datalab.to is reachable in order to:
  1. Activate and register your license with our servers.
  2. Send usage metrics.

​
Usage data sent to Datalab

License activation and usage heartbeats do not send private data to Datalab. Our intent is to ensure compliance with our license and to easily support customers when they run into problems. The container sends the following to our servers:
  1. On container startup we activate your license. In that request, we send information about your hardware and OS available in /proc and /sys (in the container, not on your host).
  2. At regular intervals we send usage heartbeats that contain:
    1. The # of successful/failed inference requests completed since the last heartbeat
    2. The # of inference requests submitted to the container over a recent time window

​
I need a fully-airgapped deployment

We also support fully-airgapped deployments that do not require a license. Get started by filling out this form. Please reach out to us at support@datalab.to if you have questions.

​
Hardware Requirements

Container TypeGPU RequiredMinimum VRAMRecommended Use
markerYes (CUDA)24 GBStandard document conversion with Surya OCR
chandraYes (CUDA)80 GBFull Chandra VLM for highest accuracy
chandra-smallYes (CUDA)16 GBSmaller Chandra variants (2B/4B models)

​
Health Check

Verify your container is running: 
curl http://localhost:8000/health_check
Expected response: 
{"status": "healthy"}

​
Next Steps

On-Prem API

API reference for the on-prem container image.

On-Prem Overview

Compare open-source and paid on-prem deployment options.

Cloud Quickstart

Try the cloud-hosted API for quick evaluation.

Error Codes

Understand HTTP error codes and troubleshooting steps.