chaiml-02f4-69d4-linear-w01

developer_uid: chai_backend_admin

submission_id: chaiml-02f4-69d4-linear-w01_v48

model_name: chaiml-02f4-69d4-linear-w01_v48

model_group: ChaiML/02f4-69d4-linear-

status: torndown

timestamp: 2025-12-29T21:26:36+00:00

num_battles: 11069

num_wins: 5770

celo_rating: 1308.01

family_friendly_score: 0.4878

family_friendly_standard_error: 0.007068962583010325

submission_type: basic

model_repo: ChaiML/02f4-69d4-linear-w01

model_architecture: MistralForCausalLM

model_num_parameters: 24096691200.0

best_of: 8

max_input_tokens: 1024

max_output_tokens: 64

reward_model: default

display_name: chaiml-02f4-69d4-linear-w01_v48

is_internal_developer: True

language_model: ChaiML/02f4-69d4-linear-w01

model_size: 24B

ranking_group: single

us_pacific_date: 2025-12-26

win_ratio: 0.5212756346553438

generation_params: {'temperature': 0.7, 'top_p': 0.95, 'min_p': 0.025, 'top_k': 80, 'presence_penalty': 0.4, 'frequency_penalty': 0.4, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-02f4-69d4-linear-w01-v48
Waiting for inference service chaiml-02f4-69d4-linear-w01-v48 to be ready
Inference service chaiml-02f4-69d4-linear-w01-v48 ready after 201.82993483543396s
Pipeline stage VLLMDeployer completed in 202.35s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0468358993530273s
Received healthy response to inference request in 2.282060146331787s
Received healthy response to inference request in 2.2349071502685547s
Received healthy response to inference request in 2.7688252925872803s
Received healthy response to inference request in 2.252469062805176s
Received healthy response to inference request in 2.2709314823150635s
Received healthy response to inference request in 2.40407657623291s
Received healthy response to inference request in 2.2457265853881836s
Received healthy response to inference request in 2.203977346420288s
Received healthy response to inference request in 2.206733226776123s
Received healthy response to inference request in 2.696540117263794s
Received healthy response to inference request in 2.1948952674865723s
Received healthy response to inference request in 2.5547397136688232s
Received healthy response to inference request in 2.5820446014404297s
Received healthy response to inference request in 2.5724050998687744s
Received healthy response to inference request in 2.5796403884887695s
Received healthy response to inference request in 2.802396297454834s
Received healthy response to inference request in 2.365110397338867s
Received healthy response to inference request in 2.30169415473938s
Received healthy response to inference request in 2.6640326976776123s
Received healthy response to inference request in 2.232597589492798s
Received healthy response to inference request in 2.230210304260254s
Received healthy response to inference request in 2.3190252780914307s
Received healthy response to inference request in 2.3197884559631348s
Received healthy response to inference request in 2.260622978210449s
Received healthy response to inference request in 2.197749376296997s
Received healthy response to inference request in 2.209141254425049s
Received healthy response to inference request in 2.710167646408081s
Received healthy response to inference request in 2.283733606338501s
Received healthy response to inference request in 2.538041591644287s
30 requests
0 failed requests
5th percentile: 2.200551962852478
10th percentile: 2.2064576387405395
20th percentile: 2.232120132446289
30th percentile: 2.250446319580078
40th percentile: 2.2776086807250975
50th percentile: 2.3103597164154053
60th percentile: 2.3806968688964845
70th percentile: 2.5600393295288084
80th percentile: 2.5984422206878666
90th percentile: 2.716033411026001
95th percentile: 2.7872893452644347
99th percentile: 2.9759484148025517
mean time: 2.4177039861679077
Pipeline stage StressChecker completed in 75.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.85s
Shutdown handler de-registered
chaiml-02f4-69d4-linear-w01_v48 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 7437.60s
Shutdown handler de-registered
chaiml-02f4-69d4-linear-w01_v48 status is now torndown due to DeploymentManager action