function_gurer_2025-08-18

developer_uid: NischayDnk

submission_id: function_gurer_2025-08-18

model_name: function_gurer_2025-08-18

model_group:

status: torndown

timestamp: 2025-08-18T13:24:52+00:00

num_battles: 6886

num_wins: 4032

celo_rating: 1306.83

family_friendly_score: 0.5616

family_friendly_standard_error: 0.007017199441372605

submission_type: function

display_name: function_gurer_2025-08-18

is_internal_developer: False

ranking_group: single

us_pacific_date: 2025-08-18

win_ratio: 0.5855358698809178

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.8241920471191406s
Received healthy response to inference request in 1.8521957397460938s
Received healthy response to inference request in 2.012634754180908s
Received healthy response to inference request in 1.57670259475708s
5 requests
1 failed requests
5th percentile: 1.6262004852294922
10th percentile: 1.6756983757019044
20th percentile: 1.7746941566467285
30th percentile: 1.8297927856445313
40th percentile: 1.8409942626953124
50th percentile: 1.8521957397460938
60th percentile: 1.9163713455200195
70th percentile: 1.9805469512939453
80th percentile: 5.6322906970977815
90th percentile: 12.87160258293152
95th percentile: 16.491258525848387
99th percentile: 19.386983280181884
mean time: 5.4753279209136965
%s, retrying in %s seconds...
Received healthy response to inference request in 2.0296413898468018s
Received healthy response to inference request in 1.934966802597046s
Received healthy response to inference request in 1.730334758758545s
Received healthy response to inference request in 1.4322247505187988s
Received healthy response to inference request in 1.6285955905914307s
5 requests
0 failed requests
5th percentile: 1.4714989185333252
10th percentile: 1.5107730865478515
20th percentile: 1.5893214225769043
30th percentile: 1.6489434242248535
40th percentile: 1.6896390914916992
50th percentile: 1.730334758758545
60th percentile: 1.8121875762939452
70th percentile: 1.8940403938293457
80th percentile: 1.953901720046997
90th percentile: 1.9917715549468995
95th percentile: 2.0107064723968504
99th percentile: 2.0258544063568116
mean time: 1.7511526584625243
Pipeline stage StressChecker completed in 39.13s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_gurer_2025-08-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3234.58s
Shutdown handler de-registered
function_gurer_2025-08-18 status is now inactive due to auto deactivation removed underperforming models
function_gurer_2025-08-18 status is now torndown due to DeploymentManager action