developer_uid: chai_backend_admin
submission_id: function_melom_2025-12-15
model_name: function_melom_2025-12-15
model_group:
status: torndown
timestamp: 2025-12-18T13:31:11+00:00
num_battles: 5434
num_wins: 2762
celo_rating: 1298.8
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_melom_2025-12-15
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.5082811924917188
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 6.391212701797485s
Received healthy response to inference request in 10.327858686447144s
Received healthy response to inference request in 7.164521932601929s
Received healthy response to inference request in 14.331817626953125s
Received healthy response to inference request in 15.931720972061157s
Received healthy response to inference request in 3.4724278450012207s
Received healthy response to inference request in 4.331429481506348s
Received healthy response to inference request in 7.612650394439697s
Received healthy response to inference request in 3.1800289154052734s
10 requests
1 failed requests
5th percentile: 3.3116084337234497
10th percentile: 3.443187952041626
20th percentile: 4.159629154205322
30th percentile: 5.773277735710144
40th percentile: 6.855198240280151
50th percentile: 7.388586163520813
60th percentile: 8.698733711242674
70th percentile: 11.529046368598937
80th percentile: 14.651798295974732
90th percentile: 16.35593054294586
95th percentile: 18.26487361192703
99th percentile: 19.79202806711197
mean time: 9.291748523712158
%s, retrying in %s seconds...
Received healthy response to inference request in 8.667478799819946s
Received healthy response to inference request in 7.7903313636779785s
Received healthy response to inference request in 9.153551816940308s
Received healthy response to inference request in 2.899414539337158s
Received healthy response to inference request in 19.96350121498108s
Received healthy response to inference request in 3.273390769958496s
Received healthy response to inference request in 6.331992149353027s
Received healthy response to inference request in 7.38372540473938s
Received healthy response to inference request in 10.782629251480103s
Received healthy response to inference request in 5.051422595977783s
10 requests
0 failed requests
5th percentile: 3.0677038431167603
10th percentile: 3.2359931468963623
20th percentile: 4.695816230773926
30th percentile: 5.947821283340454
40th percentile: 6.9630321025848385
50th percentile: 7.587028384208679
60th percentile: 8.141190338134765
70th percentile: 8.813300704956054
80th percentile: 9.479367303848267
90th percentile: 11.700716447830198
95th percentile: 15.83210883140563
99th percentile: 19.137222738265994
mean time: 8.129743790626526
%s, retrying in %s seconds...
Received healthy response to inference request in 5.229506492614746s
Received healthy response to inference request in 4.831024169921875s
Received healthy response to inference request in 3.9742956161499023s
Received healthy response to inference request in 4.762115955352783s
Received healthy response to inference request in 3.4731264114379883s
Received healthy response to inference request in 7.327888488769531s
Received healthy response to inference request in 3.9345757961273193s
Received healthy response to inference request in 10.571029663085938s
Received healthy response to inference request in 2.1829755306243896s
Received healthy response to inference request in 4.786922931671143s
10 requests
0 failed requests
5th percentile: 2.763543426990509
10th percentile: 3.3441113233566284
20th percentile: 3.842285919189453
30th percentile: 3.9623796701431275
40th percentile: 4.446987819671631
50th percentile: 4.774519443511963
60th percentile: 4.804563426971436
70th percentile: 4.9505688667297365
80th percentile: 5.649182891845704
90th percentile: 7.652202606201171
95th percentile: 9.111616134643551
99th percentile: 10.279146957397462
mean time: 5.107346105575561
Pipeline stage StressChecker completed in 229.88s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.58s
Shutdown handler de-registered
function_melom_2025-12-15 status is now deployed due to DeploymentManager action
function_melom_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_melom_2025-12-15 status is now torndown due to DeploymentManager action