snowflake / arctic

Model Overview

Description:

Snowflake Artic generates code and text. Snowflake Arctic is a family of enterprise-grade models built by Snowflake. This is a general-purpose LLM using a custom MoE architecture that exhibits top-tier intelligence in enterprise tasks such as code generation, SQL generation, instruction following and more while also being capable of text generation for general purposes.

Third-Party Community Consideration

This model is not owned or developed by NVIDIA. This model has been developed and built to a third-party’s requirements for this application and use case; see link to Non-NVIDIA Arctic Model Card.

License and Terms of use

GOVERNING TERMS: Your use of this API is governed by the NVIDIA API Trial Service Terms of Use; and the use of this model is governed by the NVIDIA AI Foundation Models Community License and Apache 2.0 Terms of Use.

References(s):

Arctic Blog

Model Architecture: Custom hybrid dense+MoE architecture

Architecture Type: Transformer

Network Architecture: Sparse Mixture of Experts

Input:

Input Format: Text

Input Parameters: Temperature, Top P, Max Output Tokens

Output:

Output Format: Text

Software Integration:

  • Supported Hardware Platform(s): Hopper

[Preferred/Supported] Operating System(s):

  • Linux

Model Version(s):

Model version: 0.1

Inference:

Engine: Triton, vLLM

Test Hardware: Other