developer_uid: chai_backend_admin
submission_id: function_liken_2025-12-18
model_name: function_liken_2025-12-18
model_group:
status: torndown
timestamp: 2025-12-21T18:21:24+00:00
num_battles: 10128
num_wins: 5931
celo_rating: 1353.38
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_liken_2025-12-18
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.5856042654028436
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Unable to record family friendly update due to error: HTTPConnectionPool(host='chaiml-llama-1-8b-user-48416-v4-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Max retries exceeded with url: /v1/models/GPT-J-6B-lit-v2:predict (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x786d242db810>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
Failed to get response for submission chaiml-ca18-c13f-linear-w01_v9: HTTPConnectionPool(host='guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com', port=80): Max retries exceeded with url: /models/chaiml-ca18-c13f-linear-w01_v9/predict (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x786db56f02d0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 18.441537857055664s
Received healthy response to inference request in 9.384317398071289s
Received healthy response to inference request in 7.965354919433594s
Received healthy response to inference request in 3.977951765060425s
Received healthy response to inference request in 3.2670199871063232s
Received healthy response to inference request in 2.7217564582824707s
Received healthy response to inference request in 2.968526840209961s
Received healthy response to inference request in 4.266061544418335s
Received healthy response to inference request in 3.169180154800415s
10 requests
1 failed requests
5th percentile: 2.8328031301498413
10th percentile: 2.943849802017212
20th percentile: 3.1290494918823244
30th percentile: 3.237668037414551
40th percentile: 3.6935790538787843
50th percentile: 4.12200665473938
60th percentile: 5.745778894424436
70th percentile: 8.391043663024902
80th percentile: 11.195761489868165
90th percentile: 18.608142805099487
95th percentile: 19.35786507129669
99th percentile: 19.957642884254454
mean time: 7.626929426193238
%s, retrying in %s seconds...
Received healthy response to inference request in 2.257920742034912s
Received healthy response to inference request in 2.735541582107544s
Received healthy response to inference request in 2.4939441680908203s
Received healthy response to inference request in 3.268908977508545s
Received healthy response to inference request in 3.5401012897491455s
Received healthy response to inference request in 10.926238775253296s
Received healthy response to inference request in 2.808485269546509s
Received healthy response to inference request in 2.694887161254883s
Received healthy response to inference request in 3.462536334991455s
Received healthy response to inference request in 2.9202826023101807s
10 requests
0 failed requests
5th percentile: 2.364131283760071
10th percentile: 2.4703418254852294
20th percentile: 2.6546985626220705
30th percentile: 2.7233452558517457
40th percentile: 2.779307794570923
50th percentile: 2.8643839359283447
60th percentile: 3.0597331523895264
70th percentile: 3.326997184753418
80th percentile: 3.478049325942993
90th percentile: 4.278715038299558
95th percentile: 7.60247690677642
99th percentile: 10.261486401557924
mean time: 3.710884690284729
Pipeline stage StressChecker completed in 121.83s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_liken_2025-12-18 status is now deployed due to DeploymentManager action
function_liken_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_liken_2025-12-18 status is now torndown due to DeploymentManager action