chaiml-02f4-69d4-linear_76375

developer_uid: chai_backend_admin

submission_id: chaiml-02f4-69d4-linear_76375_v3

model_name: chaiml-02f4-69d4-linear_76375_v3

model_group: ChaiML/02f4-69d4-linear-

status: torndown

timestamp: 2025-12-29T21:26:36+00:00

num_battles: 9998

num_wins: 5243

celo_rating: 1309.4

family_friendly_score: 0.496

family_friendly_standard_error: 0.007070841534074993

submission_type: basic

model_repo: ChaiML/02f4-69d4-linear-w01-W4A16-G128-AutoRound

model_architecture: MistralForCausalLM

model_num_parameters: 24096691200.0

best_of: 8

max_input_tokens: 1024

max_output_tokens: 64

reward_model: default

display_name: chaiml-02f4-69d4-linear_76375_v3

ineligible_reason: num_battles<10000

is_internal_developer: True

language_model: ChaiML/02f4-69d4-linear-w01-W4A16-G128-AutoRound

model_size: 24B

ranking_group: single

us_pacific_date: 2025-12-26

win_ratio: 0.5244048809761952

generation_params: {'temperature': 0.7, 'top_p': 0.95, 'min_p': 0.025, 'top_k': 80, 'presence_penalty': 0.4, 'frequency_penalty': 0.4, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-02f4-69d4-linear-76375-v3
Waiting for inference service chaiml-02f4-69d4-linear-76375-v3 to be ready
Inference service chaiml-02f4-69d4-linear-76375-v3 ready after 130.8922519683838s
Pipeline stage VLLMDeployer completed in 131.35s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.1531774997711182s
Received healthy response to inference request in 1.2344377040863037s
Received healthy response to inference request in 0.9315252304077148s
Received healthy response to inference request in 1.0350213050842285s
Received healthy response to inference request in 1.0319583415985107s
Received healthy response to inference request in 1.1122264862060547s
Received healthy response to inference request in 1.0502312183380127s
Received healthy response to inference request in 0.9426953792572021s
Received healthy response to inference request in 0.9579951763153076s
Received healthy response to inference request in 1.2691292762756348s
Received healthy response to inference request in 1.0205633640289307s
Received healthy response to inference request in 0.9518861770629883s
Received healthy response to inference request in 1.1212880611419678s
Received healthy response to inference request in 1.2448320388793945s
Received healthy response to inference request in 1.316408634185791s
Received healthy response to inference request in 0.9517636299133301s
Received healthy response to inference request in 1.0973305702209473s
Received healthy response to inference request in 2.0000550746917725s
Received healthy response to inference request in 1.533560037612915s
Received healthy response to inference request in 1.038928747177124s
Received healthy response to inference request in 0.9828214645385742s
Received healthy response to inference request in 1.277707576751709s
Received healthy response to inference request in 1.0727441310882568s
Received healthy response to inference request in 1.0991580486297607s
Received healthy response to inference request in 0.966132640838623s
Received healthy response to inference request in 1.336597204208374s
Received healthy response to inference request in 0.9646899700164795s
Received healthy response to inference request in 1.3122179508209229s
Received healthy response to inference request in 1.152008295059204s
Received healthy response to inference request in 1.178424596786499s
30 requests
0 failed requests
5th percentile: 0.9467760920524597
10th percentile: 0.9518739223480225
20th percentile: 0.9658441066741943
30th percentile: 1.0285398483276367
40th percentile: 1.0457102298736571
50th percentile: 1.098244309425354
60th percentile: 1.1335761547088623
70th percentile: 1.1952285289764402
80th percentile: 1.2708449363708496
90th percentile: 1.3184274911880494
95th percentile: 1.444926762580871
99th percentile: 1.8647715139389043
mean time: 1.1445838610331218
Pipeline stage StressChecker completed in 37.49s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-02f4-69d4-linear_76375_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 3216.83s
Shutdown handler de-registered
chaiml-02f4-69d4-linear_76375_v3 status is now torndown due to DeploymentManager action