submission_id: function_kokos_2025-07-10
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-10T02:37:37+00:00
model_name: function_kokos_2025-07-10
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.314021110534668s
Received healthy response to inference request in 4.922592401504517s
Received healthy response to inference request in 1.7593169212341309s
Received healthy response to inference request in 2.7253713607788086s
Received healthy response to inference request in 3.8450498580932617s
5 requests
0 failed requests
5th percentile: 1.9525278091430665
10th percentile: 2.145738697052002
20th percentile: 2.5321604728698732
30th percentile: 2.9493070602416993
40th percentile: 3.3971784591674807
50th percentile: 3.8450498580932617
60th percentile: 4.032638359069824
70th percentile: 4.220226860046386
80th percentile: 4.435735368728638
90th percentile: 4.679163885116577
95th percentile: 4.8008781433105465
99th percentile: 4.898249549865723
mean time: 3.5132703304290773
%s, retrying in %s seconds...
Received healthy response to inference request in 2.5545170307159424s
Received healthy response to inference request in 3.5136783123016357s
Received healthy response to inference request in 2.2453107833862305s
Received healthy response to inference request in 3.861848831176758s
Received healthy response to inference request in 2.7171249389648438s
5 requests
0 failed requests
5th percentile: 2.307152032852173
10th percentile: 2.3689932823181152
20th percentile: 2.49267578125
30th percentile: 2.5870386123657227
40th percentile: 2.652081775665283
50th percentile: 2.7171249389648438
60th percentile: 3.0357462882995607
70th percentile: 3.3543676376342773
80th percentile: 3.58331241607666
90th percentile: 3.722580623626709
95th percentile: 3.7922147274017335
99th percentile: 3.847922010421753
mean time: 2.978495979309082
Pipeline stage StressChecker completed in 34.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.76s
Shutdown handler de-registered
function_kokos_2025-07-10 status is now deployed due to DeploymentManager action
function_kokos_2025-07-10 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4081.57s
Shutdown handler de-registered
function_kokos_2025-07-10 status is now torndown due to DeploymentManager action