submission_id: function_gibib_2025-07-27
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-27T07:39:50+00:00
model_name: function_gibib_2025-07-27
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4366044998168945s
Received healthy response to inference request in 3.404043674468994s
Received healthy response to inference request in 5.577594757080078s
Received healthy response to inference request in 3.478198289871216s
Received healthy response to inference request in 2.6327197551727295s
5 requests
0 failed requests
5th percentile: 2.4758275508880616
10th percentile: 2.5150506019592287
20th percentile: 2.5934967041015624
30th percentile: 2.7869845390319825
40th percentile: 3.095514106750488
50th percentile: 3.404043674468994
60th percentile: 3.433705520629883
70th percentile: 3.4633673667907714
80th percentile: 3.898077583312989
90th percentile: 4.737836170196533
95th percentile: 5.157715463638305
99th percentile: 5.493618898391723
mean time: 3.5058321952819824
Pipeline stage StressChecker completed in 18.74s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_gibib_2025-07-27 status is now deployed due to DeploymentManager action
function_gibib_2025-07-27 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3595.43s
Shutdown handler de-registered
function_gibib_2025-07-27 status is now torndown due to DeploymentManager action