function_mebit_2025-12-09

developer_uid: chai_backend_admin

submission_id: function_mebit_2025-12-09

model_name: function_mebit_2025-12-09

model_group:

status: torndown

timestamp: 2025-12-12T20:01:26+00:00

num_battles: 5815

num_wins: 3087

celo_rating: 1315.15

family_friendly_score: 0.5072

family_friendly_standard_error: 0.007070334645545429

submission_type: function

display_name: function_mebit_2025-12-09

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-09

win_ratio: 0.5308684436801375

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.7163667678833008s
Received healthy response to inference request in 1.8230440616607666s
Received healthy response to inference request in 1.5677416324615479s
Received healthy response to inference request in 1.5634968280792236s
Received healthy response to inference request in 1.8148362636566162s
Received healthy response to inference request in 1.5759210586547852s
Received healthy response to inference request in 1.6576862335205078s
Received healthy response to inference request in 1.6333460807800293s
Received healthy response to inference request in 1.7406537532806396s
Received healthy response to inference request in 1.6927800178527832s
10 requests
0 failed requests
5th percentile: 1.5654069900512695
10th percentile: 1.5673171520233153
20th percentile: 1.5742851734161376
30th percentile: 1.616118574142456
40th percentile: 1.6479501724243164
50th percentile: 1.6752331256866455
60th percentile: 1.7022147178649902
70th percentile: 1.7236528635025024
80th percentile: 1.755490255355835
90th percentile: 1.8156570434570312
95th percentile: 1.8193505525588989
99th percentile: 1.822305359840393
mean time: 1.67858726978302
Pipeline stage StressChecker completed in 18.05s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_mebit_2025-12-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2296.46s
Shutdown handler de-registered
function_mebit_2025-12-09 status is now inactive due to auto deactivation removed underperforming models
function_mebit_2025-12-09 status is now torndown due to DeploymentManager action