developer_uid: richhx
submission_id: chaiml-02f4-69d4-linear_30131_v8
model_name: chaiml-02f4-69d4-linear_30131_v8
model_group: ChaiML/02f4-69d4-linear-
status: inactive
timestamp: 2026-03-05T18:57:01+00:00
num_battles: 3313
num_wins: 1707
celo_rating: 9276.65
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/02f4-69d4-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-02f4-69d4-linear_30131_v8
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/02f4-69d4-linear-w01-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.5152429821913673
generation_params: {'temperature': 0.7, 'top_p': 0.95, 'min_p': 0.025, 'top_k': 80, 'presence_penalty': 0.4, 'frequency_penalty': 0.4, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-02f4-69d4-linear-30131-v8-uploader
Waiting for job on chaiml-02f4-69d4-linear-30131-v8-uploader to finish
chaiml-02f4-69d4-linear-30131-v8-uploader: Using quantization_mode: fp8
chaiml-02f4-69d4-linear-30131-v8-uploader: Repo ChaiML/02f4-69d4-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-02f4-69d4-linear-30131-v8-uploader: Checking if ChaiML/02f4-69d4-linear-w01-FP8 already exists in ChaiML
chaiml-02f4-69d4-linear-30131-v8-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-02f4-69d4-linear-30131-v8-uploader: Downloading snapshot of ChaiML/02f4-69d4-linear-w01-FP8...
chaiml-02f4-69d4-linear-30131-v8-uploader: Downloaded in 13.073s
chaiml-02f4-69d4-linear-30131-v8-uploader: Processed model ChaiML/02f4-69d4-linear-w01-FP8 in 16.620s
chaiml-02f4-69d4-linear-30131-v8-uploader: creating bucket guanaco-vllm-models
chaiml-02f4-69d4-linear-30131-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v8-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-02f4-69d4-linear-30131-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-02f4-69d4-linear-30131-v8-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-02f4-69d4-linear-30131-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v8-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-02f4-69d4-linear-30131-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v8-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-02f4-69d4-linear-30131-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v8-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-02f4-69d4-linear-30131-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v8-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-02f4-69d4-linear-30131-v8-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-02f4-69d4-linear-30131-v8-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-02f4-69d4-linear-30131-v8-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-02f4-69d4-linear-30131-v8-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-02f4-69d4-linear-30131-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-02f4-69d4-linear-30131-v8-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/.gitattributes
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/model.safetensors.index.json
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/special_tokens_map.json
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/config.json
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/tokenizer_config.json
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/generation_config.json
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/recipe.yaml
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/tokenizer.json
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/model-00006-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/model-00005-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v8-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v8/default/model-00002-of-00006.safetensors
Job chaiml-02f4-69d4-linear-30131-v8-uploader completed after 52.41s with status: succeeded
Stopping job with name chaiml-02f4-69d4-linear-30131-v8-uploader
Pipeline stage VLLMUploader completed in 52.92s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.68s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-02f4-69d4-linear-30131-v8
Waiting for inference service chaiml-02f4-69d4-linear-30131-v8 to be ready
Inference service chaiml-02f4-69d4-linear-30131-v8 ready after 150.6482629776001s
Pipeline stage VLLMDeployer completed in 151.13s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.877835273742676s
Received healthy response to inference request in 2.9366652965545654s
Received healthy response to inference request in 3.2377614974975586s
Received healthy response to inference request in 2.8317055702209473s
Received healthy response to inference request in 2.7124459743499756s
Received healthy response to inference request in 2.8830933570861816s
Received healthy response to inference request in 2.7956695556640625s
Received healthy response to inference request in 3.613820791244507s
Received healthy response to inference request in 2.9682037830352783s
Received healthy response to inference request in 3.0061538219451904s
Received healthy response to inference request in 2.924558162689209s
Received healthy response to inference request in 2.91487455368042s
Received healthy response to inference request in 3.294891595840454s
Received healthy response to inference request in 2.8272781372070312s
Received healthy response to inference request in 3.970172882080078s
Received healthy response to inference request in 2.782874584197998s
Received healthy response to inference request in 3.628282070159912s
Received healthy response to inference request in 2.9446911811828613s
Received healthy response to inference request in 2.9730076789855957s
Received healthy response to inference request in 3.070852756500244s
Received healthy response to inference request in 3.0747766494750977s
Received healthy response to inference request in 2.9045472145080566s
Received healthy response to inference request in 2.875892400741577s
Received healthy response to inference request in 3.3330533504486084s
Received healthy response to inference request in 2.8103129863739014s
Received healthy response to inference request in 2.9288599491119385s
Received healthy response to inference request in 2.812826633453369s
Received healthy response to inference request in 3.788541078567505s
Received healthy response to inference request in 2.872295379638672s
Received healthy response to inference request in 2.7635245323181152s
30 requests
0 failed requests
5th percentile: 2.7722320556640625
10th percentile: 2.794390058517456
20th percentile: 2.8243878364562987
30th percentile: 2.8748132944107057
40th percentile: 2.8959656715393067
50th percentile: 2.9267090559005737
60th percentile: 2.954096221923828
70th percentile: 3.0255635023117065
80th percentile: 3.249187517166138
90th percentile: 3.6152669191360474
95th percentile: 3.7164245247840877
99th percentile: 3.917499659061432
mean time: 3.0453156232833862
Pipeline stage StressChecker completed in 106.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.19s
Shutdown handler de-registered
chaiml-02f4-69d4-linear_30131_v8 status is now deployed due to DeploymentManager action
chaiml-02f4-69d4-linear_30131_v8 status is now inactive due to system request