Optional apiOptional cacheOptional callbackUse callbacks instead
Optional callbacksOptional concurrencyUse maxConcurrency instead
Optional maxThe maximum number of concurrent calls that can be made.
Defaults to Infinity, which means no limit.
Optional maxThe maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Optional maxMaximum number of tokens to generate in the completion.
Optional metadataOptional modelModel to use
Optional onCustom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
Optional tagsOptional temperatureSampling temperature to use
Optional verboseGenerated using TypeDoc
Interface for the input parameters specific to the Cohere model.