function_hipor_2025-07-07

developer_uid: chai_backend_admin

submission_id: function_hipor_2025-07-07

model_name: function_hipor_2025-07-07

model_group:

status: torndown

timestamp: 2025-07-07T22:28:15+00:00

num_battles: 7085

num_wins: 3624

celo_rating: 1295.83

family_friendly_score: 0.531

family_friendly_standard_error: 0.00705746413380897

submission_type: function

display_name: function_hipor_2025-07-07

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-07-07

win_ratio: 0.5115031757233592

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.6302263736724854s
Received healthy response to inference request in 5.930716276168823s
Received healthy response to inference request in 2.181401014328003s
Received healthy response to inference request in 4.963519334793091s
5 requests
1 failed requests
5th percentile: 2.2711660861968994
10th percentile: 2.360931158065796
20th percentile: 2.540461301803589
30th percentile: 3.0968849658966064
40th percentile: 4.030202150344849
50th percentile: 4.963519334793091
60th percentile: 5.350398111343384
70th percentile: 5.737276887893676
80th percentile: 8.767190694808964
90th percentile: 14.440139532089233
95th percentile: 17.276613950729367
99th percentile: 19.54579348564148
mean time: 7.163790273666382
%s, retrying in %s seconds...
Received healthy response to inference request in 3.108004331588745s
Received healthy response to inference request in 2.8051297664642334s
Received healthy response to inference request in 2.695601463317871s
Received healthy response to inference request in 4.609838247299194s
Received healthy response to inference request in 2.7667248249053955s
5 requests
0 failed requests
5th percentile: 2.709826135635376
10th percentile: 2.7240508079528807
20th percentile: 2.7525001525878907
30th percentile: 2.774405813217163
40th percentile: 2.789767789840698
50th percentile: 2.8051297664642334
60th percentile: 2.926279592514038
70th percentile: 3.047429418563843
80th percentile: 3.4083711147308353
90th percentile: 4.009104681015015
95th percentile: 4.309471464157104
99th percentile: 4.549764890670776
mean time: 3.197059726715088
Pipeline stage StressChecker completed in 54.39s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_hipor_2025-07-07 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 6951.57s
Shutdown handler de-registered
function_hipor_2025-07-07 status is now inactive due to auto deactivation removed underperforming models
function_hipor_2025-07-07 status is now torndown due to DeploymentManager action