mistralai/Mistral-7B-Instruct-v0.3

About

The Mistral-7B-Instruct-v0.3 Large Language Model (LLM) is an instruct fine-tuned version of the Mistral-7B-v0.3.

Mistral-7B-v0.3 has the following changes compared to Mistral-7B-v0.2

It is recommended to use mistralai/Mistral-7B-Instruct-v0.3 with mistral-inference. For HF transformers code snippets, please keep scrolling.

After installing mistralinference, a mistral-chat CLI command should be available in your environment. You can chat with the model using

If you want to use Hugging Face transformers to generate text, you can do something like this.

To use this example, you'll need transformers version 4.42.0 or higher. Please see the function calling guide in the transformers docs…

Excerpted from huggingface.co/mistralai/Mistral-7B-Instruct-v0.3