Average model response time for the past few minutes.
Depends on model size, server load, and request size.
The average prompt length for this model is -- tokens.
OutputLimittokens
OUTPUT TOKEN LIMITS
Some models limit Response Length for each reply.
This model averages -- output tokens per reply.