developer_uid: chai_backend_admin
submission_id: function_mejun_2025-11-20
model_name: function_mejun_2025-11-20
model_group:
status: torndown
timestamp: 2025-11-23T15:51:28+00:00
num_battles: 7424
num_wins: 3845
celo_rating: 1302.84
family_friendly_score: 0.5048
family_friendly_standard_error: 0.007070741969553125
submission_type: function
display_name: function_mejun_2025-11-20
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-11-20
win_ratio: 0.5179148706896551
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.3504159450531006s
Received healthy response to inference request in 1.5190563201904297s
Received healthy response to inference request in 1.133190393447876s
Received healthy response to inference request in 1.5169780254364014s
Received healthy response to inference request in 1.6902339458465576s
5 requests
0 failed requests
5th percentile: 1.176635503768921
10th percentile: 1.2200806140899658
20th percentile: 1.3069708347320557
30th percentile: 1.3837283611297608
40th percentile: 1.450353193283081
50th percentile: 1.5169780254364014
60th percentile: 1.5178093433380127
70th percentile: 1.518640661239624
80th percentile: 1.5532918453216553
90th percentile: 1.6217628955841064
95th percentile: 1.655998420715332
99th percentile: 1.6833868408203125
mean time: 1.441974925994873
Pipeline stage StressChecker completed in 8.44s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_mejun_2025-11-20 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2825.55s
Shutdown handler de-registered
function_mejun_2025-11-20 status is now torndown due to DeploymentManager action