developer_uid: chai_backend_admin
submission_id: function_terat_2025-04-08
model_name: function_terat_2025-04-08
model_group:
status: torndown
timestamp: 2025-04-08T19:32:05+00:00
num_battles: 6586
num_wins: 3328
celo_rating: 1282.74
family_friendly_score: 0.506
family_friendly_standard_error: 0.007070558676653493
submission_type: function
display_name: function_terat_2025-04-08
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-08
win_ratio: 0.505314303067112
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.011248826980591s
Received healthy response to inference request in 3.281799554824829s
Received healthy response to inference request in 4.074346542358398s
Received healthy response to inference request in 3.6956305503845215s
Received healthy response to inference request in 3.7525222301483154s
5 requests
0 failed requests
5th percentile: 3.0653589725494386
10th percentile: 3.1194691181182863
20th percentile: 3.2276894092559814
30th percentile: 3.3645657539367675
40th percentile: 3.5300981521606447
50th percentile: 3.6956305503845215
60th percentile: 3.718387222290039
70th percentile: 3.741143894195557
80th percentile: 3.816887092590332
90th percentile: 3.9456168174743653
95th percentile: 4.009981679916382
99th percentile: 4.061473569869995
mean time: 3.563109540939331
%s, retrying in %s seconds...
Received healthy response to inference request in 3.3717451095581055s
Received healthy response to inference request in 3.0752830505371094s
Received healthy response to inference request in 3.0587432384490967s
Received healthy response to inference request in 2.729008674621582s
Received healthy response to inference request in 3.4994308948516846s
5 requests
0 failed requests
5th percentile: 2.794955587387085
10th percentile: 2.860902500152588
20th percentile: 2.9927963256835937
30th percentile: 3.062051200866699
40th percentile: 3.0686671257019045
50th percentile: 3.0752830505371094
60th percentile: 3.193867874145508
70th percentile: 3.312452697753906
80th percentile: 3.397282266616821
90th percentile: 3.448356580734253
95th percentile: 3.473893737792969
99th percentile: 3.4943234634399416
mean time: 3.146842193603516
Pipeline stage StressChecker completed in 35.48s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_terat_2025-04-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3307.33s
Shutdown handler de-registered
function_terat_2025-04-08 status is now inactive due to auto deactivation removed underperforming models
function_terat_2025-04-08 status is now torndown due to DeploymentManager action