chaiml-2fe5-c13f-linear-w01

developer_uid: richhx

submission_id: chaiml-2fe5-c13f-linear-w01_v36

model_name: chaiml-2fe5-c13f-linear-w01_v36

model_group: ChaiML/2fe5-c13f-linear-

status: protected

timestamp: 2026-01-10T17:42:51+00:00

num_battles: 6971

num_wins: 3571

celo_rating: 1316.88

family_friendly_score: 0.5344

family_friendly_standard_error: 0.007054312723433801

submission_type: basic

model_repo: ChaiML/2fe5-c13f-linear-w01

model_architecture: MistralForCausalLM

model_num_parameters: 12772070400.0

best_of: 10

max_input_tokens: 1024

max_output_tokens: 64

reward_model: default

display_name: chaiml-2fe5-c13f-linear-w01_v36

ineligible_reason: model is not deployable

is_internal_developer: True

language_model: ChaiML/2fe5-c13f-linear-w01

model_size: 13B

ranking_group: single

us_pacific_date: 2026-01-07

win_ratio: 0.5122650982642376

generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['Bot:', '<|eot_id|>', 'User:', '</s>', '####', 'You:', '\n', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 10, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-2fe5-c13f-linear-w01-v36
Waiting for inference service chaiml-2fe5-c13f-linear-w01-v36 to be ready
Inference service chaiml-2fe5-c13f-linear-w01-v36 ready after 150.63444352149963s
Pipeline stage VLLMDeployer completed in 151.16s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.3562188148498535s
Received healthy response to inference request in 1.6985442638397217s
Received healthy response to inference request in 1.4398109912872314s
Received healthy response to inference request in 1.2640528678894043s
Received healthy response to inference request in 1.2870738506317139s
Received healthy response to inference request in 1.269599437713623s
Received healthy response to inference request in 1.276304006576538s
Received healthy response to inference request in 1.319896936416626s
Received healthy response to inference request in 1.5888257026672363s
Received healthy response to inference request in 1.7339675426483154s
Received healthy response to inference request in 1.6961207389831543s
Received healthy response to inference request in 1.5437819957733154s
Received healthy response to inference request in 1.6564350128173828s
Received healthy response to inference request in 1.6263282299041748s
Received healthy response to inference request in 1.4092044830322266s
Received healthy response to inference request in 1.3911809921264648s
Received healthy response to inference request in 1.427891731262207s
Received healthy response to inference request in 1.3846056461334229s
Received healthy response to inference request in 1.2690157890319824s
Received healthy response to inference request in 1.3481166362762451s
Received healthy response to inference request in 1.3353970050811768s
Received healthy response to inference request in 1.3164033889770508s
Received healthy response to inference request in 1.318631887435913s
Received healthy response to inference request in 1.2892227172851562s
Received healthy response to inference request in 1.3478021621704102s
Received healthy response to inference request in 1.346238136291504s
Received healthy response to inference request in 1.5741264820098877s
Received healthy response to inference request in 1.4243974685668945s
Received healthy response to inference request in 1.5478768348693848s
Received healthy response to inference request in 1.5688631534576416s
30 requests
0 failed requests
5th percentile: 1.2692784309387206
10th percentile: 1.2756335496902467
20th percentile: 1.310967254638672
30th percentile: 1.3307469844818116
40th percentile: 1.3479908466339112
50th percentile: 1.3878933191299438
60th percentile: 1.4257951736450196
70th percentile: 1.5450104475021362
80th percentile: 1.5770663261413576
90th percentile: 1.66040358543396
95th percentile: 1.6974536776542664
99th percentile: 1.7236947917938232
mean time: 1.4351978302001953
Pipeline stage StressChecker completed in 45.40s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.88s
Shutdown handler de-registered
chaiml-2fe5-c13f-linear-w01_v36 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2491.35s
Shutdown handler de-registered
chaiml-2fe5-c13f-linear-w01_v36 status is now protected due to ABTestQueueItem