The passthrough use case lets you use the service as a proxy to the large language model (LLM). The service sends text (no additional prompts or other information) to the LLM and returns a response.
Bearer token used for authentication. Format: Authorization: Bearer ACCESS_TOKEN.
application/json
"application/json"
Unique identifier for the model.
The batch of key:value pairs used as inputs in the prediction. Up to 32 inputs per request are allowed.
32NOTE: If both useSystemPrompt and dataType are present, the value in dataType is used.
Provides fields and values that specify ranges for tokens. Fields used for specific use cases and models are specified. The default values are used if other values are not specified.
OK