Optional
ai21Optional
baseOptional
cacheOptional
callbackUse callbacks
instead
Optional
callbacksOptional
concurrencyUse maxConcurrency
instead
Optional
countOptional
frequencyOptional
logitOptional
maxThe maximum number of concurrent calls that can be made.
Defaults to Infinity
, which means no limit.
Optional
maxThe maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Optional
maxOptional
metadataOptional
minOptional
modelOptional
numOptional
onCustom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
Optional
presenceOptional
stopOptional
tagsOptional
temperatureOptional
topPOptional
verboseGenerated using TypeDoc
Interface for AI21 input parameters.