Skip to main content

Machine Configuration

When deploying Polaris LLM through the Microsoft Azure Marketplace offer, you will be asked to perform standard configuration for the underlying resources. Due to the specific requirements of LLM workloads, NVIDIA H100 GPU is required. The respective cloud provider's standard interface is used for this configuration. For details, refer to the section specific to your cloud provider below.

Azure​

To deploy Polaris LLM on Azure, configure your managed application with the following parameters:

  • Subscription: Specify the subscription where the resources will be created.
  • Resource Group: Define the resource group where the resources will be created.
  • Region: Select a region where H100 GPUs are available.
  • Machine Type: NDm H100 v5 virtual machine series is required for LLM workloads.
  • Managed Identity: Choose to create a new managed identity or use an existing one.
info

H100 GPU availability might be limited in certain regions. Please verify availability before deployment.

tip

For further configuration needs, please get in touch.