Downloading the Model

This guide explains how to download a recommended model from HuggingFace, a widely used model repository, using our model downloader script. Contact your Solutions Engineer for the download script.

Model Selection

We currently leverage Phi-4 as our preferred Language Model, clocking in at 14 billion parameters but punching above it's weight.

Prerequisites

Before you begin, ensure you have:

Python 3.6 or later installed
The required libraries:
- transformers
- sentence-transformers
- huggingface_hub
- torch (required by transformers)

You can install these dependencies with:

pip install transformers sentence-transformers huggingface_hub torch

Model License

Phi-4 is currently governed by an MIT License.

How to Download the Model

Run the model downloader script. You need to download BOTH models.

python model_downloader.py "microsoft/Phi-4" "/path/to/save/directory"

python model_downloader.py "sentence-transformers/all-MiniLM-L6-v2" "/path/to/save/directory"

Next Steps

After downloading, you can use the model with the RegScale AI Inference Server.