submission_id: function_nasat_2025-07-10
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-10T02:55:24+00:00
model_name: function_nasat_2025-07-10
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 5.76919960975647s
Received healthy response to inference request in 4.779022693634033s
Received healthy response to inference request in 2.8318676948547363s
Received healthy response to inference request in 7.262223958969116s
5 requests
1 failed requests
5th percentile: 3.2212986946105957
10th percentile: 3.610729694366455
20th percentile: 4.389591693878174
30th percentile: 4.977058076858521
40th percentile: 5.373128843307495
50th percentile: 5.76919960975647
60th percentile: 6.366409349441528
70th percentile: 6.963619089126587
80th percentile: 9.834694623947145
90th percentile: 14.979635953903198
95th percentile: 17.552106618881222
99th percentile: 19.610083150863648
mean time: 8.153378248214722
%s, retrying in %s seconds...
Received healthy response to inference request in 3.240521192550659s
Received healthy response to inference request in 3.4289019107818604s
Received healthy response to inference request in 2.6233608722686768s
Received healthy response to inference request in 4.268687725067139s
Received healthy response to inference request in 3.07511568069458s
5 requests
0 failed requests
5th percentile: 2.7137118339538575
10th percentile: 2.8040627956390383
20th percentile: 2.9847647190093993
30th percentile: 3.1081967830657957
40th percentile: 3.1743589878082275
50th percentile: 3.240521192550659
60th percentile: 3.3158734798431397
70th percentile: 3.3912257671356203
80th percentile: 3.596859073638916
90th percentile: 3.9327733993530276
95th percentile: 4.1007305622100825
99th percentile: 4.235096292495728
mean time: 3.327317476272583
Pipeline stage StressChecker completed in 59.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_nasat_2025-07-10 status is now deployed due to DeploymentManager action
function_nasat_2025-07-10 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3854.21s
Shutdown handler de-registered
function_nasat_2025-07-10 status is now torndown due to DeploymentManager action