chaiml-jessie-brawl-sta_45767

developer_uid: chai_backend_admin
submission_id: chaiml-jessie-brawl-sta_45767_v1
model_name: chaiml-jessie-brawl-sta_45767_v1
model_group: ChaiML/Jessie-Brawl-Star
status: torndown
timestamp: 2026-03-09T05:32:58+00:00
num_battles: 13360
num_wins: 5878
celo_rating: 1514.12
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/Jessie-Brawl-Stars260304071122_sft
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-jessie-brawl-sta_45767_v1
is_internal_developer: True
language_model: ChaiML/Jessie-Brawl-Stars260304071122_sft
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-04
win_ratio: 0.4399700598802395
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['You:', '</s>', '####\n', '####', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-jessie-brawl-sta-45767-v1-uploader
Waiting for job on chaiml-jessie-brawl-sta-45767-v1-uploader to finish
chaiml-jessie-brawl-sta-45767-v1-uploader: Using quantization_mode: fp8
chaiml-jessie-brawl-sta-45767-v1-uploader: Checking if ChaiML/Jessie-Brawl-Stars260304071122_sft-FP8 already exists in ChaiML
chaiml-jessie-brawl-sta-45767-v1-uploader: Downloading snapshot of ChaiML/Jessie-Brawl-Stars260304071122_sft...
chaiml-jessie-brawl-sta-45767-v1-uploader: Downloaded in 99.676s
chaiml-jessie-brawl-sta-45767-v1-uploader: Loading /tmp/model_input...
chaiml-jessie-brawl-sta-45767-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-jessie-brawl-sta-45767-v1-uploader: `torch_dtype` is deprecated! Use `dtype` instead!
chaiml-jessie-brawl-sta-45767-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-jessie-brawl-sta-45767-v1-uploader: Applying quantization...
chaiml-jessie-brawl-sta-45767-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-jessie-brawl-sta-45767-v1-uploader: 2026-03-03T23:22:45.434149-0800 | reset | INFO - Compression lifecycle reset
chaiml-jessie-brawl-sta-45767-v1-uploader: 2026-03-03T23:22:45.435120-0800 | from_modifiers | INFO - Creating recipe from modifiers
chaiml-jessie-brawl-sta-45767-v1-uploader: 2026-03-03T23:22:45.501301-0800 | initialize | INFO - Compression lifecycle initialized for 1 modifiers
chaiml-jessie-brawl-sta-45767-v1-uploader: 2026-03-03T23:22:45.501576-0800 | IndependentPipeline | INFO - Inferred `DataFreePipeline` for `QuantizationModifier`
chaiml-jessie-brawl-sta-45767-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-jessie-brawl-sta-45767-v1-uploader: 2026-03-03T23:23:15.262807-0800 | finalize | INFO - Compression lifecycle finalized for 1 modifiers
chaiml-jessie-brawl-sta-45767-v1-uploader: 2026-03-03T23:23:17.377758-0800 | post_process | WARNING - Optimized model is not saved. To save, please provide`output_dir` as input arg.Ex. `oneshot(..., output_dir=...)`
chaiml-jessie-brawl-sta-45767-v1-uploader: Saving to /dev/shm/model_output...
chaiml-jessie-brawl-sta-45767-v1-uploader: 2026-03-03T23:23:17.404679-0800 | get_model_compressor | INFO - skip_sparsity_compression_stats set to True. Skipping sparsity compression statistic calculations. No sparsity compressor will be applied.
chaiml-jessie-brawl-sta-45767-v1-uploader: Cleaning quantization config in /dev/shm/model_output
chaiml-jessie-brawl-sta-45767-v1-uploader: Pushing to ChaiML/Jessie-Brawl-Stars260304071122_sft-FP8
chaiml-jessie-brawl-sta-45767-v1-uploader: Checking if ChaiML/Jessie-Brawl-Stars260304071122_sft-FP8 already exists in ChaiML
chaiml-jessie-brawl-sta-45767-v1-uploader: Creating repo ChaiML/Jessie-Brawl-Stars260304071122_sft-FP8 and uploading /dev/shm/model_output to it
chaiml-jessie-brawl-sta-45767-v1-uploader: ---------- 2026-03-03 23:24:04 (0:00:00) ----------
chaiml-jessie-brawl-sta-45767-v1-uploader: Files:   hashed 6/13 (276.1K/24.9G) | pre-uploaded: 0/0 (0.0/24.9G) (+13 unsure) | committed: 0/13 (0.0/24.9G) | ignored: 0
chaiml-jessie-brawl-sta-45767-v1-uploader: Workers: hashing: 7 | get upload mode: 5 | pre-uploading: 0 | committing: 0 | waiting: 114
chaiml-jessie-brawl-sta-45767-v1-uploader: ---------------------------------------------------
chaiml-jessie-brawl-sta-45767-v1-uploader: Processed model ChaiML/Jessie-Brawl-Stars260304071122_sft in 254.904s
chaiml-jessie-brawl-sta-45767-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-jessie-brawl-sta-45767-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-jessie-brawl-sta-45767-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-jessie-brawl-sta-45767-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-jessie-brawl-sta-45767-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-jessie-brawl-sta-45767-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-jessie-brawl-sta-45767-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-jessie-brawl-sta-45767-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-jessie-brawl-sta-45767-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-jessie-brawl-sta-45767-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-jessie-brawl-sta-45767-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-jessie-brawl-sta-45767-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-jessie-brawl-sta-45767-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-jessie-brawl-sta-45767-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/recipe.yaml
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/tokenizer_config.json
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/config.json
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/model.safetensors.index.json
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/special_tokens_map.json
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/generation_config.json
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/tokenizer.json
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/model-00006-of-00006.safetensors
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/model-00005-of-00006.safetensors
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/model-00002-of-00006.safetensors
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/model-00001-of-00006.safetensors
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/model-00003-of-00006.safetensors
chaiml-jessie-brawl-sta-45767-v1-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-jessie-brawl-sta-45767-v1/default/model-00004-of-00006.safetensors
Job chaiml-jessie-brawl-sta-45767-v1-uploader completed after 285.88s with status: succeeded
Stopping job with name chaiml-jessie-brawl-sta-45767-v1-uploader
Pipeline stage VLLMUploader completed in 286.81s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.20s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-jessie-brawl-sta-45767-v1
Waiting for inference service chaiml-jessie-brawl-sta-45767-v1 to be ready
Inference service chaiml-jessie-brawl-sta-45767-v1 ready after 150.36023664474487s
Pipeline stage VLLMDeployer completed in 150.85s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.6972808837890625s
Received healthy response to inference request in 2.8418664932250977s
Received healthy response to inference request in 2.724529504776001s
Received healthy response to inference request in 2.7106692790985107s
Received healthy response to inference request in 2.798891544342041s
Received healthy response to inference request in 2.675891876220703s
Received healthy response to inference request in 2.0003039836883545s
Received healthy response to inference request in 2.297982692718506s
Received healthy response to inference request in 2.7701914310455322s
Received healthy response to inference request in 2.8567073345184326s
Received healthy response to inference request in 1.9418532848358154s
Received healthy response to inference request in 2.642890453338623s
Received healthy response to inference request in 2.1896932125091553s
Received healthy response to inference request in 2.664303779602051s
Received healthy response to inference request in 2.3303651809692383s
Received healthy response to inference request in 2.6714375019073486s
Received healthy response to inference request in 2.629152297973633s
Received healthy response to inference request in 2.6613895893096924s
Received healthy response to inference request in 2.6461527347564697s
Received healthy response to inference request in 2.6674153804779053s
Received healthy response to inference request in 2.6456103324890137s
Received healthy response to inference request in 2.6887083053588867s
Received healthy response to inference request in 2.812800407409668s
Received healthy response to inference request in 2.813488483428955s
Received healthy response to inference request in 2.644808292388916s
Received healthy response to inference request in 2.672719717025757s
Received healthy response to inference request in 2.6582558155059814s
Received healthy response to inference request in 2.7579848766326904s
Received healthy response to inference request in 1.96516752243042s
30 requests
1 failed requests
5th percentile: 1.9809789299964904
10th percentile: 2.1707542896270753
20th percentile: 2.569394874572754
30th percentile: 2.6453697204589846
40th percentile: 2.660136079788208
50th percentile: 2.669426441192627
60th percentile: 2.6810184478759767
70th percentile: 2.7148273468017576
80th percentile: 2.775931453704834
90th percentile: 2.8163262844085692
95th percentile: 2.850028955936432
99th percentile: 15.163649866580979
mean time: 3.175631380081177
%s, retrying in %s seconds...
Received healthy response to inference request in 2.6719870567321777s
Received healthy response to inference request in 2.084028720855713s
Received healthy response to inference request in 2.817375898361206s
Received healthy response to inference request in 2.6878278255462646s
Received healthy response to inference request in 2.6547038555145264s
Received healthy response to inference request in 2.6550040245056152s
Received healthy response to inference request in 2.765094518661499s
Received healthy response to inference request in 2.6635522842407227s
Received healthy response to inference request in 2.7130422592163086s
Received healthy response to inference request in 2.8212313652038574s
Received healthy response to inference request in 2.765397787094116s
Received healthy response to inference request in 2.684727668762207s
Received healthy response to inference request in 2.721888780593872s
Received healthy response to inference request in 2.7402288913726807s
Received healthy response to inference request in 2.733180284500122s
Received healthy response to inference request in 2.7166595458984375s
Received healthy response to inference request in 2.995087146759033s
Received healthy response to inference request in 2.544591188430786s
Received healthy response to inference request in 2.7759413719177246s
Received healthy response to inference request in 2.3561112880706787s
Received healthy response to inference request in 2.442286252975464s
Received healthy response to inference request in 2.6763980388641357s
Received healthy response to inference request in 2.8141002655029297s
Received healthy response to inference request in 2.7981319427490234s
Received healthy response to inference request in 2.6632742881774902s
Received healthy response to inference request in 2.7945284843444824s
Received healthy response to inference request in 2.8290181159973145s
Received healthy response to inference request in 2.808837890625s
Received healthy response to inference request in 2.850862503051758s
Received healthy response to inference request in 2.738861083984375s
30 requests
0 failed requests
5th percentile: 2.394890022277832
10th percentile: 2.5343606948852537
20th percentile: 2.6616202354431153
30th percentile: 2.675074744224548
40th percentile: 2.702956485748291
50th percentile: 2.727534532546997
60th percentile: 2.750175142288208
70th percentile: 2.781517505645752
80th percentile: 2.809890365600586
90th percentile: 2.822010040283203
95th percentile: 2.841032528877258
99th percentile: 2.9532620000839236
mean time: 2.699465354283651
Pipeline stage StressChecker completed in 186.66s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
Shutdown handler de-registered
chaiml-jessie-brawl-sta_45767_v1 status is now deployed due to DeploymentManager action
chaiml-jessie-brawl-sta_45767_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-jessie-brawl-sta_45767_v1 status is now torndown due to DeploymentManager action