Subscribing To a Mistral LLM Service and Deploying it

As an OUTSCALE Marketplace buyer, you can subscribe to a Mistral large language model (LLM) service from the catalog, and then deploy it in the cloudgouv-eu-west-1 Region.

A Mistral LLM service includes a large language model (LLM), a virtual machine (VM), and a flexible GPU (fGPU), deployed on an inference instance dedicated to a LLM.

A Mistral LLM service is billed from the date of deployment on a monthly basis. Any month begun is billed in full.

SSL protocol is not yet supported for current deployments. For security reasons, we recommend that you do not expose the VM on which your service is deployed publicly.

Subscribing To a Mistral LLM Service

To subscribe to a Mistral LLM service:

In the Marketplace interface, click the Catalog tab.
The product catalog appears.
Use the filters on the left-hand side to find the desired LLM service.
Click the desired LLM service card.
The LLM service page appears.
Click Proceed to subscription.
The Subscription page appears.
Click Subscribe.
Your subscription is confirmed and you can deploy the LLM service from the My services page.

Deploying a Mistral LLM Service

Before you begin :

For security reasons, we recommend you create an Elastic Identity Management (EIM) user in the corresponding OUTSCALE account and attach the policy below to this user. For more information, see Elastic Identity Management (EIM).

Details

{
"Statement": [
      {
        "Effect": "Allow",
        "Action": [
          "api:CreateVms",
          "api:DeleteVms",
          "api:ReadAccounts",
          "api:ReadNets",
          "api:ReadSecurityGroups",
          "api:ReadSubnets",
          "api:ReadSubregions",
          "api:ReadVms",
          "api:UpdateVm"
        ],
        "Resource": [
          "*"
        ]
      }
    ]
}

Create a Net in the cloudgouv-eu-west-1 Region. For more information, see Creating a Net.
Create at least one security group. For more information, see Creating a Security Group.

When configuring the rules of your security group, you must open a flow on port 5000.

To deploy a Mistral LLM service:

In the Marketplace interface, click the user menu , then My subscriptions.
The My subscriptions page appears.
Click Access my services from the corresponding subscription card.
The My services page appears.
Click Deploy service.
Type the access keys of the desired user and click Next.

You will have to authenticate with these access keys to manage the service later on. For more information about access keys, see About Access Keys.

Select a Net.

If you did not create the necessary resources at the start of the procedure, you can create them at this stage, then click Reload resources within 30 minutes before the session expires. You will then be able to select the newly created resources.
At the recap stage, you can edit the selected resources by clicking for the desired resources.

Select a Subnet in the cloudgouv-eu-west-1a or the cloudgouv-eu-west-1b Subregion, depending on what is indicated in the interface.

For more information, see Creating a Subnet in a Net.

For security reasons, we recommend that you place your VM in a Subnet that is not directly exposed to the Internet. For more information about the best practices on Net architecture, see Implementing a 3-Tier Architecture with Public and Private Subnets.

Select a Subnet and click Next.
Select one or more security groups and click Next.
Click Deploy the service.
The LLM service deployment is launched and you can monitor the state of the associated VM from Cockpit.

There can be a delay of approximately 10 minutes between the creation of the virtual machine associated with your Mistral LLM service, and the moment you can start using your LLM service.

For more information about the queries to run to use you model once it is deployed, see Querying a Mistral Model.

Related Pages