developer_uid: zonemercy
submission_id: chaiml-muster-v3a-kakit-_3784_v4
model_name: chaiml-muster-v3a-kakit-_3784_v4
model_group: ChaiML/muster-v3a-kakit-
status: inactive
timestamp: 2026-02-15T17:27:19+00:00
num_battles: 10532
num_wins: 5636
celo_rating: 1321.24
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/muster-v3a-kakit-q235b-lr1e4ep1r64g4
model_architecture: Qwen3MoeForCausalLM
model_num_parameters: 18790207488.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-muster-v3a-kakit-_3784_v4
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/muster-v3a-kakit-q235b-lr1e4ep1r64g4
model_size: 19B
ranking_group: single
us_pacific_date: 2026-02-15
win_ratio: 0.5351310292442081
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|user|>', '</think>', '<|im_end|>', '<|assistant|>', '####', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-muster-v3a-kakit-3784-v4-uploader
Waiting for job on chaiml-muster-v3a-kakit-3784-v4-uploader to finish
chaiml-muster-v3a-kakit-3784-v4-uploader: Using quantization_mode: w4a16
chaiml-muster-v3a-kakit-3784-v4-uploader: Checking if ChaiML/muster-v3a-kakit-q235b-lr1e4ep1r64g4-W4A16 already exists in ChaiML
chaiml-muster-v3a-kakit-3784-v4-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-muster-v3a-kakit-3784-v4-uploader: Downloading snapshot of ChaiML/muster-v3a-kakit-q235b-lr1e4ep1r64g4-W4A16...
chaiml-muster-v3a-kakit-3784-v4-uploader: Downloaded in 51.676s
chaiml-muster-v3a-kakit-3784-v4-uploader: Processed model ChaiML/muster-v3a-kakit-q235b-lr1e4ep1r64g4 in 52.282s
chaiml-muster-v3a-kakit-3784-v4-uploader: creating bucket guanaco-vllm-models
chaiml-muster-v3a-kakit-3784-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3a-kakit-3784-v4-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-muster-v3a-kakit-3784-v4-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-muster-v3a-kakit-3784-v4-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-muster-v3a-kakit-3784-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3a-kakit-3784-v4-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-muster-v3a-kakit-3784-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3a-kakit-3784-v4-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-muster-v3a-kakit-3784-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3a-kakit-3784-v4-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-muster-v3a-kakit-3784-v4-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-muster-v3a-kakit-3784-v4-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-muster-v3a-kakit-3784-v4-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-muster-v3a-kakit-3784-v4-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-muster-v3a-kakit-3784-v4-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-muster-v3a-kakit-3784-v4-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-muster-v3a-kakit-3784-v4-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-muster-v3a-kakit-3784-v4-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/.gitattributes
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/added_tokens.json
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/tokenizer_config.json
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/chat_template.jinja
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/generation_config.json
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/special_tokens_map.json
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/quantization_config.json
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/merges.txt
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/vocab.json
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/config.json
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/tokenizer.json
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model.safetensors.index.json
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00027-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00027-of-00027.safetensors
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00022-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00022-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00003-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00003-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00012-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00012-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00008-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00008-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00021-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00021-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00025-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00025-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00017-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00017-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00010-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00010-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00005-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00005-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00004-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00004-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00009-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00009-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00006-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00006-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00011-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00011-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00013-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00013-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00026-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00026-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00015-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00015-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00019-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00019-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00023-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00023-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00002-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00002-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00014-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00014-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00001-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00001-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00018-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00018-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00007-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00007-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00024-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00024-of-00027.safetensors
chaiml-muster-v3a-kakit-3784-v4-uploader: cp /dev/shm/model_output/model-00016-of-00027.safetensors s3://guanaco-vllm-models/chaiml-muster-v3a-kakit-3784-v4/default/model-00016-of-00027.safetensors
Job chaiml-muster-v3a-kakit-3784-v4-uploader completed after 660.8s with status: succeeded
Stopping job with name chaiml-muster-v3a-kakit-3784-v4-uploader
Pipeline stage VLLMUploader completed in 662.73s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-muster-v3a-kakit-3784-v4
Waiting for inference service chaiml-muster-v3a-kakit-3784-v4 to be ready
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Unable to record family friendly update due to error: Invalid JSON input: Expecting value: line 1 column 1 (char 0)
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048-_2678_v3: ('http://chaiml-mistral-24b-2048-2678-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Inference service chaiml-muster-v3a-kakit-3784-v4 ready after 853.1188063621521s
Pipeline stage VLLMDeployer completed in 853.99s
run pipeline stage %s
Running pipeline stage StressChecker
Failed to get response for submission chaiml-mistral-24b-2048_54327_v6: ('http://chaiml-mistral-24b-2048-54327-v6-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.321345806121826s
Received healthy response to inference request in 2.4638195037841797s
Received healthy response to inference request in 1.8040828704833984s
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 2.0268213748931885s
Received healthy response to inference request in 1.766963243484497s
Received healthy response to inference request in 2.2882399559020996s
Received healthy response to inference request in 1.9866373538970947s
Received healthy response to inference request in 2.301748275756836s
Received healthy response to inference request in 2.170586585998535s
Received healthy response to inference request in 2.154860496520996s
Received healthy response to inference request in 1.8518376350402832s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.3038580417633057s
Received healthy response to inference request in 2.099466323852539s
Received healthy response to inference request in 1.8372316360473633s
Received healthy response to inference request in 2.1473634243011475s
Received healthy response to inference request in 2.163132667541504s
Received healthy response to inference request in 1.7143704891204834s
Received healthy response to inference request in 2.2469687461853027s
Received healthy response to inference request in 1.6686615943908691s
Received healthy response to inference request in 1.8783226013183594s
Received healthy response to inference request in 1.997864007949829s
Received healthy response to inference request in 2.217900514602661s
Received healthy response to inference request in 2.0609629154205322s
Received healthy response to inference request in 2.3780150413513184s
Received healthy response to inference request in 2.496413469314575s
Received healthy response to inference request in 2.133877754211426s
Received healthy response to inference request in 2.3001718521118164s
Received healthy response to inference request in 2.2483654022216797s
Received healthy response to inference request in 1.8792612552642822s
30 requests
1 failed requests
5th percentile: 1.7380372285842896
10th percentile: 1.8003709077835084
20th percentile: 1.873025608062744
30th percentile: 1.9944960117340087
40th percentile: 2.0840649604797363
50th percentile: 2.1511119604110718
60th percentile: 2.1895121574401855
70th percentile: 2.2603277683258054
80th percentile: 2.30217022895813
90th percentile: 2.3865954875946045
95th percentile: 2.481746184825897
99th percentile: 15.020930852890029
mean time: 2.7015243212382
%s, retrying in %s seconds...
Received healthy response to inference request in 2.0099546909332275s
Received healthy response to inference request in 2.980605125427246s
Received healthy response to inference request in 2.8125200271606445s
Received healthy response to inference request in 1.9174573421478271s
Received healthy response to inference request in 2.295654535293579s
Received healthy response to inference request in 2.0681583881378174s
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
Received healthy response to inference request in 1.9647696018218994s
Received healthy response to inference request in 2.236989974975586s
Received healthy response to inference request in 2.142970323562622s
Received healthy response to inference request in 1.9515457153320312s
Received healthy response to inference request in 2.0892210006713867s
Received healthy response to inference request in 1.9430370330810547s
Received healthy response to inference request in 2.197908639907837s
Received healthy response to inference request in 1.9282443523406982s
Received healthy response to inference request in 1.862227439880371s
Received healthy response to inference request in 2.092501640319824s
Received healthy response to inference request in 1.9946658611297607s
Received healthy response to inference request in 2.382218837738037s
Received healthy response to inference request in 1.891801357269287s
Received healthy response to inference request in 2.2943179607391357s
Received healthy response to inference request in 1.661679983139038s
Received healthy response to inference request in 2.146352529525757s
Received healthy response to inference request in 2.444524049758911s
Received healthy response to inference request in 2.180330991744995s
Received healthy response to inference request in 2.145571231842041s
Received healthy response to inference request in 2.0221974849700928s
Received healthy response to inference request in 2.7739145755767822s
Received healthy response to inference request in 2.592595338821411s
Received healthy response to inference request in 1.9392986297607422s
Received healthy response to inference request in 2.2645652294158936s
30 requests
0 failed requests
5th percentile: 1.8755357027053834
10th percentile: 1.914891743659973
20th percentile: 1.9422893524169922
30th percentile: 1.9856969833374023
40th percentile: 2.0497740268707276
50th percentile: 2.117735981941223
60th percentile: 2.1599439144134522
70th percentile: 2.245262551307678
80th percentile: 2.312967395782471
90th percentile: 2.6107272624969484
95th percentile: 2.7951475739479066
99th percentile: 2.9318604469299316
mean time: 2.1742599964141847
Pipeline stage StressChecker completed in 159.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
chaiml-muster-v3a-kakit-_3784_v4 status is now deployed due to DeploymentManager action
chaiml-muster-v3a-kakit-_3784_v4 status is now inactive due to auto deactivation removed underperforming models