developer_uid: chai_backend_admin
submission_id: function_gereb_2025-05-12
model_name: function_gereb_2025-05-12
model_group:
status: torndown
timestamp: 2025-05-12T22:04:41+00:00
num_battles: 2083316
num_wins: 1093638
celo_rating: 1298.8
family_friendly_score: 0.5562
family_friendly_standard_error: 0.007026258748437891
submission_type: function
display_name: function_gereb_2025-05-12
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-12
win_ratio: 0.5249506075890551
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7746012210845947s
Received healthy response to inference request in 4.417332887649536s
Received healthy response to inference request in 3.285397529602051s
Received healthy response to inference request in 2.6973023414611816s
Received healthy response to inference request in 5.1977698802948s
5 requests
0 failed requests
5th percentile: 2.7127621173858643
10th percentile: 2.728221893310547
20th percentile: 2.759141445159912
30th percentile: 2.876760482788086
40th percentile: 3.0810790061950684
50th percentile: 3.285397529602051
60th percentile: 3.738171672821045
70th percentile: 4.190945816040039
80th percentile: 4.573420286178589
90th percentile: 4.885595083236694
95th percentile: 5.041682481765747
99th percentile: 5.166552400588989
mean time: 3.6744807720184327
%s, retrying in %s seconds...
Received healthy response to inference request in 2.0157227516174316s
Received healthy response to inference request in 3.859492301940918s
Received healthy response to inference request in 2.577751636505127s
Received healthy response to inference request in 2.833078145980835s
Received healthy response to inference request in 3.0941946506500244s
5 requests
0 failed requests
5th percentile: 2.1281285285949707
10th percentile: 2.2405343055725098
20th percentile: 2.465345859527588
30th percentile: 2.6288169384002686
40th percentile: 2.7309475421905516
50th percentile: 2.833078145980835
60th percentile: 2.937524747848511
70th percentile: 3.0419713497161864
80th percentile: 3.2472541809082034
90th percentile: 3.5533732414245605
95th percentile: 3.706432771682739
99th percentile: 3.828880395889282
mean time: 2.876047897338867
Pipeline stage StressChecker completed in 35.28s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
Shutdown handler de-registered
function_gereb_2025-05-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3220.97s
Shutdown handler de-registered
function_gereb_2025-05-12 status is now inactive due to auto deactivation removed underperforming models
function_gereb_2025-05-12 status is now torndown due to DeploymentManager action