developer_uid: chai_backend_admin
submission_id: function_telar_2025-08-15
model_name: function_telar_2025-08-15
model_group:
status: torndown
timestamp: 2025-08-15T20:48:57+00:00
num_battles: 6295
num_wins: 3507
celo_rating: 1289.56
family_friendly_score: 0.5272
family_friendly_standard_error: 0.00706059714188538
submission_type: function
display_name: function_telar_2025-08-15
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-08-15
win_ratio: 0.5571088165210485
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTP Request: %s %s "%s %d %s"
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.73992657661438s
Received healthy response to inference request in 3.572645425796509s
Received healthy response to inference request in 4.90951681137085s
Received healthy response to inference request in 3.4268429279327393s
5 requests
1 failed requests
5th percentile: 2.8773098468780516
10th percentile: 3.0146931171417237
20th percentile: 3.2894596576690676
30th percentile: 3.456003427505493
40th percentile: 3.514324426651001
50th percentile: 3.572645425796509
60th percentile: 4.107393980026245
70th percentile: 4.6421425342559814
80th percentile: 7.950203275680545
90th percentile: 14.031576204299927
95th percentile: 17.072262668609618
99th percentile: 19.50481184005737
mean time: 6.952376174926758
%s, retrying in %s seconds...
Received healthy response to inference request in 2.323922634124756s
Received healthy response to inference request in 2.829439878463745s
Received healthy response to inference request in 4.843141555786133s
Received healthy response to inference request in 2.856395959854126s
Received healthy response to inference request in 3.2104368209838867s
5 requests
0 failed requests
5th percentile: 2.4250260829925536
10th percentile: 2.5261295318603514
20th percentile: 2.7283364295959474
30th percentile: 2.8348310947418214
40th percentile: 2.8456135272979735
50th percentile: 2.856395959854126
60th percentile: 2.9980123043060303
70th percentile: 3.1396286487579346
80th percentile: 3.5369777679443364
90th percentile: 4.190059661865234
95th percentile: 4.516600608825684
99th percentile: 4.777833366394043
mean time: 3.212667369842529
Pipeline stage StressChecker completed in 53.19s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_telar_2025-08-15 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2958.66s
Shutdown handler de-registered
function_telar_2025-08-15 status is now inactive due to auto deactivation removed underperforming models
function_telar_2025-08-15 status is now torndown due to DeploymentManager action