chaiml-ca18-c13f-linear-w01

developer_uid: chai_backend_admin

submission_id: chaiml-ca18-c13f-linear-w01_v34

model_name: chaiml-ca18-c13f-linear-w01_v34

model_group: ChaiML/ca18-c13f-linear-

status: torndown

timestamp: 2025-12-30T02:56:25+00:00

num_battles: 7278

num_wins: 3545

celo_rating: 1315.72

family_friendly_score: 0.5166

family_friendly_standard_error: 0.007067169730521547

submission_type: basic

model_repo: ChaiML/ca18-c13f-linear-w01

model_architecture: MistralForCausalLM

model_num_parameters: 12772070400.0

best_of: 7

max_input_tokens: 1280

max_output_tokens: 60

reward_model: default

display_name: chaiml-ca18-c13f-linear-w01_v34

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: ChaiML/ca18-c13f-linear-w01

model_size: 13B

ranking_group: single

us_pacific_date: 2025-12-26

win_ratio: 0.4870843638362187

generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.15, 'frequency_penalty': 0.15, 'stopping_words': ['</s>', '\n', 'You:', '###'], 'max_input_tokens': 1280, 'best_of': 7, 'max_output_tokens': 60}

formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ca18-c13f-linear-w01-v34
Waiting for inference service chaiml-ca18-c13f-linear-w01-v34 to be ready
Inference service chaiml-ca18-c13f-linear-w01-v34 ready after 141.01425957679749s
Pipeline stage VLLMDeployer completed in 141.52s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.301591157913208s
Received healthy response to inference request in 1.2410807609558105s
Received healthy response to inference request in 1.3872714042663574s
Received healthy response to inference request in 1.2379481792449951s
Received healthy response to inference request in 1.2115485668182373s
Received healthy response to inference request in 1.23488187789917s
Received healthy response to inference request in 1.2833166122436523s
Received healthy response to inference request in 1.311953067779541s
Received healthy response to inference request in 1.2330164909362793s
Received healthy response to inference request in 1.227315902709961s
Received healthy response to inference request in 1.2365481853485107s
Received healthy response to inference request in 1.2526776790618896s
Received healthy response to inference request in 1.2392377853393555s
Received healthy response to inference request in 1.2206737995147705s
Received healthy response to inference request in 1.2126004695892334s
Received healthy response to inference request in 1.2385287284851074s
Received healthy response to inference request in 1.8688249588012695s
Received healthy response to inference request in 1.2237904071807861s
Received healthy response to inference request in 1.2158102989196777s
Received healthy response to inference request in 1.4920554161071777s
Received healthy response to inference request in 1.3085823059082031s
Received healthy response to inference request in 1.2864174842834473s
Received healthy response to inference request in 1.3673334121704102s
Received healthy response to inference request in 1.2201461791992188s
Received healthy response to inference request in 1.4107306003570557s
Received healthy response to inference request in 1.2717773914337158s
Received healthy response to inference request in 1.2510054111480713s
Received healthy response to inference request in 1.250366449356079s
Received healthy response to inference request in 1.2978575229644775s
Received healthy response to inference request in 1.2179927825927734s
30 requests
0 failed requests
5th percentile: 1.2140448927879333
10th percentile: 1.2177745342254638
20th percentile: 1.223167085647583
30th percentile: 1.2343222618103027
40th percentile: 1.2382965087890625
50th percentile: 1.2457236051559448
60th percentile: 1.2603175640106201
70th percentile: 1.2898494958877562
80th percentile: 1.3092564582824706
90th percentile: 1.3896173238754272
95th percentile: 1.4554592490196225
99th percentile: 1.7595617914199833
mean time: 1.2917627096176147
Pipeline stage StressChecker completed in 41.27s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.57s
Shutdown handler de-registered
chaiml-ca18-c13f-linear-w01_v34 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 1843.08s
Shutdown handler de-registered
chaiml-ca18-c13f-linear-w01_v34 status is now torndown due to DeploymentManager action