function_sudet_2025-07-10

submission_id: function_sudet_2025-07-10

developer_uid: chai_backend_admin

status: torndown

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

timestamp: 2025-07-10T02:55:01+00:00

model_name: function_sudet_2025-07-10

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2458412647247314s
Received healthy response to inference request in 2.3167197704315186s
Received healthy response to inference request in 2.589130163192749s
Received healthy response to inference request in 2.153203010559082s
Received healthy response to inference request in 2.535553455352783s
5 requests
0 failed requests
5th percentile: 2.171730661392212
10th percentile: 2.1902583122253416
20th percentile: 2.2273136138916017
30th percentile: 2.2600169658660887
40th percentile: 2.2883683681488036
50th percentile: 2.3167197704315186
60th percentile: 2.4042532444000244
70th percentile: 2.4917867183685303
80th percentile: 2.5462687969207765
90th percentile: 2.5676994800567625
95th percentile: 2.5784148216247558
99th percentile: 2.5869870948791505
mean time: 2.368089532852173
Pipeline stage StressChecker completed in 13.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.82s
Shutdown handler de-registered
function_sudet_2025-07-10 status is now deployed due to DeploymentManager action
function_sudet_2025-07-10 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4343.86s
Shutdown handler de-registered
function_sudet_2025-07-10 status is now torndown due to DeploymentManager action