API Reference

Creates a model response for the given chat conversation.

post
https://integrate.api.nvidia.com/v1/chat/completions

Given a list of messages comprising a conversation, the model will return a response. Compatible with OpenAI. See https://platform.openai.com/docs/api-reference/chat/create

Recent Requests
Log in to see full request history
TimeStatusUser Agent
Retrieving recent requests…
LoadingLoading…
Body Params
string
Defaults to meta/muse-glimmer-30b
messages
array of objects
required

A list of messages comprising the conversation so far. The roles of the messages must be alternating between user and assistant. The last input message should have role user. A message with the the system role is optional, and must be the very first message if it is present; context is also optional, but must come before a user question.

Messages*
number
0 to 1
Defaults to 0.95

The sampling temperature to use for text generation. Muse Glimmer is a reasoning model and expects to be sampled rather than decoded greedily - the recommended pair is temperature 0.95 with top_p 1.0. Greedy decoding measurably degrades it.

number
≤ 1
Defaults to 1

The top-p sampling mass used for text generation. The top-p value determines the probability mass that is sampled at sampling time. For example, if top_p = 0.2, only the most likely tokens (summing to 0.2 cumulative probability) will be sampled. It is not recommended to modify both temperature and top_p in the same call.

array | null
integer
1 to 131072
Defaults to 2048

The maximum number of tokens to generate in any given call. Note that the model is not aware of this value, and generation will simply stop at the number of tokens specified. Reasoning shares this budget, so leave headroom on reasoning-heavy prompts.

0 to 18446744073709552000

If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same seed and parameters should return the same result.

boolean
Defaults to false

If set, partial message deltas will be sent. Tokens will be sent as data-only server-sent events (SSE) as they become available (JSON responses are prefixed by data: ), with the stream terminated by a data: [DONE] message.

string | ChatCompletionNamedToolChoiceParam | null
Defaults to auto

Controls which (if any) tool the model calls. none disables tool calling; auto lets the model choose.

array | string | null

A string or list of strings where the API stops generating further tokens. The returned text does not contain the stop sequence.

number
-2 to 2
Defaults to 0

Penalises new tokens by their existing frequency in the text so far, reducing verbatim repetition.

number
-2 to 2
Defaults to 0

Positive values penalise tokens that have already appeared, encouraging the model to move on to new topics.

string
enum
Defaults to high

How much reasoning the model should do before answering. Higher values generally produce a longer trace in reasoning_content, which shares the max_tokens budget with the answer.

Allowed:
chat_template_kwargs
object

Extra keyword arguments forwarded to the model's chat template, e.g. {"reasoning_strength": "low"}.

Headers
string
enum
Defaults to application/json

Generated from available response content types

Allowed:
Responses

Updated less than a minute ago

Did this page help you?
Language
Credentials
Bearer
LoadingLoading…
Response
Click Try It! to start a request and see the response here! Or choose an example:
application/json
text/event-stream

Updated less than a minute ago

Did this page help you?
country_code