function_bemob_2025-12-09

developer_uid: chai_backend_admin

submission_id: function_bemob_2025-12-09

model_name: function_bemob_2025-12-09

model_group:

status: torndown

timestamp: 2025-12-12T22:21:10+00:00

num_battles: 7980

num_wins: 4344

celo_rating: 1325.66

family_friendly_score: 0.5294

family_friendly_standard_error: 0.0070588333313657435

submission_type: function

display_name: function_bemob_2025-12-09

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-09

win_ratio: 0.544360902255639

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.434337615966797s
Received healthy response to inference request in 2.49833607673645s
Received healthy response to inference request in 2.610353708267212s
Received healthy response to inference request in 2.388044834136963s
Received healthy response to inference request in 2.1877191066741943s
Received healthy response to inference request in 2.2617201805114746s
Received healthy response to inference request in 6.613989353179932s
Received healthy response to inference request in 2.8938889503479004s
Received healthy response to inference request in 2.1955857276916504s
Received healthy response to inference request in 3.0481157302856445s
10 requests
0 failed requests
5th percentile: 2.1912590861320496
10th percentile: 2.194799065589905
20th percentile: 2.24849328994751
30th percentile: 2.3501474380493166
40th percentile: 2.4542195796966553
50th percentile: 2.554344892501831
60th percentile: 2.723767805099487
70th percentile: 2.9401569843292235
80th percentile: 3.125360107421875
90th percentile: 3.7523027896881094
95th percentile: 5.183146071434018
99th percentile: 6.3278206968307495
mean time: 3.0132091283798217
Pipeline stage StressChecker completed in 31.54s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.58s
Shutdown handler de-registered
function_bemob_2025-12-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2669.79s
Shutdown handler de-registered
function_bemob_2025-12-09 status is now inactive due to auto deactivation removed underperforming models
function_bemob_2025-12-09 status is now torndown due to DeploymentManager action