function_kefem_2026-01-02

developer_uid: chai_backend_admin

submission_id: function_kefem_2026-01-02

model_name: abtest_blend

model_group:

status: torndown

timestamp: 2026-01-05T08:56:37+00:00

num_battles: 1920

num_wins: 920

celo_rating: 9999.0

family_friendly_score: 0.569

family_friendly_standard_error: 0.007003413453452538

submission_type: function

display_name: abtest_blend

is_internal_developer: True

ranking_group: single

us_pacific_date: 2026-01-02

win_ratio: 0.4791666666666667

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.1019091606140137s
Received healthy response to inference request in 1.633518934249878s
Received healthy response to inference request in 1.4376790523529053s
Received healthy response to inference request in 1.9408857822418213s
Received healthy response to inference request in 1.9711694717407227s
Received healthy response to inference request in 1.0965216159820557s
Received healthy response to inference request in 2.874572515487671s
Received healthy response to inference request in 1.302274227142334s
Received healthy response to inference request in 2.5840697288513184s
Received healthy response to inference request in 0.7669539451599121s
10 requests
0 failed requests
5th percentile: 0.9152593970298767
10th percentile: 1.0635648488998413
20th percentile: 1.100831651687622
30th percentile: 1.2421647071838378
40th percentile: 1.3835171222686768
50th percentile: 1.5355989933013916
60th percentile: 1.756465673446655
70th percentile: 1.9499708890914917
80th percentile: 2.093749523162842
90th percentile: 2.6131200075149534
95th percentile: 2.7438462615013117
99th percentile: 2.8484272646903994
mean time: 1.670955443382263
Pipeline stage StressChecker completed in 19.54s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.02s
Shutdown handler de-registered
function_kefem_2026-01-02 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 1376.34s
Shutdown handler de-registered
function_kefem_2026-01-02 status is now inactive due to admin request
function_kefem_2026-01-02 status is now torndown due to DeploymentManager action