CosmicAC Logo

Managed Inference Job

Guides for creating Managed Inference Jobs and connecting clients to them.

Step-by-step guides for common tasks with a Managed Inference Job. These guides assume you have already installed CosmicAC. If you have not, follow the installation guide.

Guides

How to create an API key through the CosmicAC web interface

Create an API key to authenticate requests to an endpoint.

How to create a Managed Inference Job through the CosmicAC web interface

Create a Managed Inference Job in the web interface.

How to connect to a Managed Inference endpoint

Point a client at the endpoint and send requests.

Managed Inference Job

Understand what a Managed Inference Job is and when to use it.

Create a Managed Inference Job

Create a Managed Inference Job from the CLI.

Inference commands

CLI commands to run inference on a model.

Model commands

CLI commands to inspect deployed models.

How to set up SSH and Tailscale on a GPU Container Job

Previous Page

How to create an API key (CosmicAC web interface)

Next Page

On this page

GuidesRelated