developer_uid: chai_backend_admin
submission_id: chaiml-2a6f-69d4-linear-w01_v21
model_name: chaiml-2a6f-69d4-linear-w01_v21
model_group: ChaiML/2a6f-69d4-linear-
status: torndown
timestamp: 2025-12-30T03:26:26+00:00
num_battles: 8723
num_wins: 4541
celo_rating: 1305.97
family_friendly_score: 0.5266
family_friendly_standard_error: 0.007061054312211456
submission_type: basic
model_repo: ChaiML/2a6f-69d4-linear-w01
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 7
max_input_tokens: 1280
max_output_tokens: 64
reward_model: default
display_name: chaiml-2a6f-69d4-linear-w01_v21
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/2a6f-69d4-linear-w01
model_size: 24B
ranking_group: single
us_pacific_date: 2025-12-26
win_ratio: 0.5205777828728648
generation_params: {'temperature': 0.9, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.45, 'frequency_penalty': 0.45, 'stopping_words': ['\n'], 'max_input_tokens': 1280, 'best_of': 7, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-2a6f-69d4-linear-w01-v21
Waiting for inference service chaiml-2a6f-69d4-linear-w01-v21 to be ready
Inference service chaiml-2a6f-69d4-linear-w01-v21 ready after 210.82268834114075s
Pipeline stage VLLMDeployer completed in 211.32s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2180004119873047s
Received healthy response to inference request in 2.2850444316864014s
Received healthy response to inference request in 2.243514060974121s
Received healthy response to inference request in 2.1573562622070312s
Received healthy response to inference request in 2.1868553161621094s
Received healthy response to inference request in 2.2485246658325195s
Received healthy response to inference request in 2.184634208679199s
Received healthy response to inference request in 2.379746675491333s
Received healthy response to inference request in 2.2458982467651367s
Received healthy response to inference request in 2.4615724086761475s
Received healthy response to inference request in 2.183676242828369s
Received healthy response to inference request in 2.292177438735962s
Received healthy response to inference request in 2.349846839904785s
Received healthy response to inference request in 2.1815593242645264s
Received healthy response to inference request in 2.203840970993042s
Received healthy response to inference request in 2.2039239406585693s
Received healthy response to inference request in 2.179903507232666s
Received healthy response to inference request in 2.2895596027374268s
Received healthy response to inference request in 2.2807931900024414s
Received healthy response to inference request in 2.20112681388855s
Received healthy response to inference request in 2.281956195831299s
Received healthy response to inference request in 2.263054847717285s
Received healthy response to inference request in 2.1865885257720947s
Received healthy response to inference request in 2.1963491439819336s
Received healthy response to inference request in 2.3091375827789307s
Received healthy response to inference request in 2.331658363342285s
Received healthy response to inference request in 2.207315444946289s
Received healthy response to inference request in 2.4938032627105713s
Received healthy response to inference request in 2.2594196796417236s
Received healthy response to inference request in 2.425877809524536s
30 requests
0 failed requests
5th percentile: 2.180648624897003
10th percentile: 2.1834645509719848
20th percentile: 2.1868019580841063
30th percentile: 2.2030267238616945
40th percentile: 2.2137264251708983
50th percentile: 2.247211456298828
60th percentile: 2.2701501846313477
70th percentile: 2.286398983001709
80th percentile: 2.3136417388916017
90th percentile: 2.3843597888946535
95th percentile: 2.445509839057922
99th percentile: 2.4844563150405885
mean time: 2.2644238471984863
Pipeline stage StressChecker completed in 70.54s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
chaiml-2a6f-69d4-linear-w01_v21 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2931.83s
Shutdown handler de-registered
chaiml-2a6f-69d4-linear-w01_v21 status is now torndown due to DeploymentManager action