developer_uid: rirv938
submission_id: chaiml-reward-fresh-dat_37656_v2
model_name: chaiml-reward-fresh-dat_37656_v2
model_group: ChaiML/reward_fresh_data
status: torndown
timestamp: 2026-03-28T21:31:43+00:00
num_battles: 11169
num_wins: 5603
celo_rating: 8466.16
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/reward_fresh_data_cp6248_1_merged
model_architecture: LlamaForSequenceClassification
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 512
max_output_tokens: 1
reward_model: default
display_name: chaiml-reward-fresh-dat_37656_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/reward_fresh_data_cp6248_1_merged
model_size: 8B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.5016563703106813
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 512, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-reward-fresh-dat-37656-v2-uploader
Waiting for job on chaiml-reward-fresh-dat-37656-v2-uploader to finish
chaiml-reward-fresh-dat-37656-v2-uploader: Using quantization_mode: none
chaiml-reward-fresh-dat-37656-v2-uploader: Downloading snapshot of ChaiML/reward_fresh_data_cp6248_1_merged...
chaiml-reward-fresh-dat-37656-v2-uploader: Downloaded in 11.161s
chaiml-reward-fresh-dat-37656-v2-uploader: Processed model ChaiML/reward_fresh_data_cp6248_1_merged in 17.049s
chaiml-reward-fresh-dat-37656-v2-uploader: creating bucket guanaco-vllm-models
chaiml-reward-fresh-dat-37656-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-fresh-dat-37656-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-reward-fresh-dat-37656-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-reward-fresh-dat-37656-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-reward-fresh-dat-37656-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-fresh-dat-37656-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-reward-fresh-dat-37656-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-fresh-dat-37656-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-reward-fresh-dat-37656-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-fresh-dat-37656-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-reward-fresh-dat-37656-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-reward-fresh-dat-37656-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-reward-fresh-dat-37656-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-reward-fresh-dat-37656-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-reward-fresh-dat-37656-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-reward-fresh-dat-37656-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-reward-fresh-dat-37656-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-reward-fresh-dat-37656-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-reward-fresh-dat-37656-v2/default
chaiml-reward-fresh-dat-37656-v2-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-reward-fresh-dat-37656-v2/default/README.md
chaiml-reward-fresh-dat-37656-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-reward-fresh-dat-37656-v2/default/generation_config.json
chaiml-reward-fresh-dat-37656-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-reward-fresh-dat-37656-v2/default/.gitattributes
chaiml-reward-fresh-dat-37656-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-reward-fresh-dat-37656-v2/default/tokenizer_config.json
chaiml-reward-fresh-dat-37656-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-reward-fresh-dat-37656-v2/default/config.json
chaiml-reward-fresh-dat-37656-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-reward-fresh-dat-37656-v2/default/tokenizer.json
chaiml-reward-fresh-dat-37656-v2-uploader: cp /dev/shm/model_output/model.safetensors s3://guanaco-vllm-models/chaiml-reward-fresh-dat-37656-v2/default/model.safetensors
Job chaiml-reward-fresh-dat-37656-v2-uploader completed after 52.07s with status: succeeded
Stopping job with name chaiml-reward-fresh-dat-37656-v2-uploader
Pipeline stage VLLMUploader completed in 52.62s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.43s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-reward-fresh-dat-37656-v2
Waiting for inference service chaiml-reward-fresh-dat-37656-v2 to be ready
2026-03-25T19:54:07.816162+00:00 monitor updated for chaiml-reward-fresh-dat_37656_v2
2026-03-25T19:55:07.915903+00:00 monitor updated for chaiml-reward-fresh-dat_37656_v2
2026-03-25T19:56:07.999341+00:00 monitor updated for chaiml-reward-fresh-dat_37656_v2
Inference service chaiml-reward-fresh-dat-37656-v2 ready after 160.45230627059937s
Pipeline stage VLLMDeployer completed in 161.01s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.447119951248169s
Received healthy response to inference request in 3.799593448638916s
Received healthy response to inference request in 3.6364057064056396s
Received healthy response to inference request in 2.7875516414642334s
Received healthy response to inference request in 4.873800754547119s
5 requests
0 failed requests
5th percentile: 2.9573224544525147
10th percentile: 3.127093267440796
20th percentile: 3.4666348934173583
30th percentile: 3.669043254852295
40th percentile: 3.7343183517456056
50th percentile: 3.799593448638916
60th percentile: 4.229276371002197
70th percentile: 4.658959293365478
80th percentile: 4.988464593887329
90th percentile: 5.217792272567749
95th percentile: 5.332456111907959
99th percentile: 5.424187183380127
mean time: 4.108894300460816
Pipeline stage StressChecker completed in 21.64s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.79s
Shutdown handler de-registered
chaiml-reward-fresh-dat_37656_v2 status is now deployed due to DeploymentManager action
chaiml-reward-fresh-dat_37656_v2 status is now inactive due to auto deactivation removed underperforming models
chaiml-reward-fresh-dat_37656_v2 status is now torndown due to DeploymentManager action