function_jelus_2025-07-29

developer_uid: chai_backend_admin

submission_id: function_jelus_2025-07-29

model_name: function_jelus_2025-07-29

model_group:

status: torndown

timestamp: 2025-07-29T22:59:42+00:00

num_battles: 5406

num_wins: 2821

celo_rating: 1292.46

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: function_jelus_2025-07-29

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-07-29

win_ratio: 0.5218275989641139

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.769192218780518s
Received healthy response to inference request in 5.359644174575806s
Received healthy response to inference request in 4.368254661560059s
Received healthy response to inference request in 1.9703047275543213s
Received healthy response to inference request in 4.003052473068237s
5 requests
0 failed requests
5th percentile: 2.3768542766571046
10th percentile: 2.783403825759888
20th percentile: 3.596502923965454
30th percentile: 4.076092910766602
40th percentile: 4.22217378616333
50th percentile: 4.368254661560059
60th percentile: 4.764810466766358
70th percentile: 5.161366271972656
80th percentile: 5.441553783416748
90th percentile: 5.6053730010986325
95th percentile: 5.687282609939575
99th percentile: 5.752810297012329
mean time: 4.294089651107788
%s, retrying in %s seconds...
Received healthy response to inference request in 3.1183760166168213s
Received healthy response to inference request in 3.766348361968994s
Received healthy response to inference request in 6.615400314331055s
Received healthy response to inference request in 6.344169616699219s
Received healthy response to inference request in 4.228649616241455s
5 requests
0 failed requests
5th percentile: 3.2479704856872558
10th percentile: 3.3775649547576903
20th percentile: 3.6367538928985597
30th percentile: 3.8588086128234864
40th percentile: 4.0437291145324705
50th percentile: 4.228649616241455
60th percentile: 5.07485761642456
70th percentile: 5.921065616607666
80th percentile: 6.398415756225586
90th percentile: 6.50690803527832
95th percentile: 6.561154174804687
99th percentile: 6.604551086425781
mean time: 4.814588785171509
%s, retrying in %s seconds...
Received healthy response to inference request in 2.4800102710723877s
Received healthy response to inference request in 3.0316615104675293s
Received healthy response to inference request in 2.7307026386260986s
Received healthy response to inference request in 1.9809472560882568s
Received healthy response to inference request in 3.597360372543335s
5 requests
0 failed requests
5th percentile: 2.080759859085083
10th percentile: 2.1805724620819094
20th percentile: 2.3801976680755614
30th percentile: 2.53014874458313
40th percentile: 2.6304256916046143
50th percentile: 2.7307026386260986
60th percentile: 2.8510861873626707
70th percentile: 2.9714697360992433
80th percentile: 3.1448012828826903
90th percentile: 3.371080827713013
95th percentile: 3.484220600128174
99th percentile: 3.574732418060303
mean time: 2.7641364097595216
Pipeline stage StressChecker completed in 62.44s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.92s
Shutdown handler de-registered
function_jelus_2025-07-29 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('None: None')
Shutdown handler de-registered
function_jelus_2025-07-29 status is now inactive due to auto deactivation removed underperforming models
function_jelus_2025-07-29 status is now torndown due to DeploymentManager action