developer_uid: chai_backend_admin
submission_id: function_jigat_2025-05-08
model_name: function_jigat_2025-05-08
model_group:
status: torndown
timestamp: 2025-05-08T10:30:42+00:00
num_battles: 8556
num_wins: 4249
celo_rating: 1282.81
family_friendly_score: 0.5528
family_friendly_standard_error: 0.007031531269929758
submission_type: function
display_name: function_jigat_2025-05-08
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-08
win_ratio: 0.4966105656848995
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.642422676086426s
Received healthy response to inference request in 3.9620001316070557s
Received healthy response to inference request in 3.3568546772003174s
Received healthy response to inference request in 4.347222566604614s
Received healthy response to inference request in 2.4748992919921875s
5 requests
0 failed requests
5th percentile: 2.6512903690338137
10th percentile: 2.8276814460754394
20th percentile: 3.1804636001586912
30th percentile: 3.4139682769775392
40th percentile: 3.5281954765319825
50th percentile: 3.642422676086426
60th percentile: 3.7702536582946777
70th percentile: 3.8980846405029297
80th percentile: 4.039044618606567
90th percentile: 4.193133592605591
95th percentile: 4.2701780796051025
99th percentile: 4.331813669204712
mean time: 3.55667986869812
%s, retrying in %s seconds...
Received healthy response to inference request in 2.455641508102417s
Received healthy response to inference request in 2.990748405456543s
Received healthy response to inference request in 3.0710620880126953s
Received healthy response to inference request in 2.914189100265503s
Received healthy response to inference request in 3.2401797771453857s
5 requests
0 failed requests
5th percentile: 2.547351026535034
10th percentile: 2.639060544967651
20th percentile: 2.822479581832886
30th percentile: 2.929500961303711
40th percentile: 2.960124683380127
50th percentile: 2.990748405456543
60th percentile: 3.022873878479004
70th percentile: 3.054999351501465
80th percentile: 3.104885625839233
90th percentile: 3.1725327014923095
95th percentile: 3.206356239318848
99th percentile: 3.233415069580078
mean time: 2.934364175796509
Pipeline stage StressChecker completed in 34.67s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.57s
Shutdown handler de-registered
function_jigat_2025-05-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3061.06s
Shutdown handler de-registered
function_jigat_2025-05-08 status is now inactive due to auto deactivation removed underperforming models
function_jigat_2025-05-08 status is now torndown due to DeploymentManager action