submission_id: function_noraf_2025-08-09
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-08-09T16:57:27+00:00
model_name: function_noraf_2025-08-09
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.376371145248413s
Received healthy response to inference request in 2.4739959239959717s
Received healthy response to inference request in 4.382136106491089s
Received healthy response to inference request in 4.483887672424316s
Received healthy response to inference request in 2.8463306427001953s
5 requests
0 failed requests
5th percentile: 2.5484628677368164
10th percentile: 2.622929811477661
20th percentile: 2.7718636989593506
30th percentile: 2.9523387432098387
40th percentile: 3.164354944229126
50th percentile: 3.376371145248413
60th percentile: 3.7786771297454833
70th percentile: 4.1809831142425535
80th percentile: 4.402486419677734
90th percentile: 4.443187046051025
95th percentile: 4.463537359237671
99th percentile: 4.479817609786988
mean time: 3.512544298171997
%s, retrying in %s seconds...
Received healthy response to inference request in 2.3715012073516846s
Received healthy response to inference request in 3.3363378047943115s
Received healthy response to inference request in 4.1454551219940186s
Received healthy response to inference request in 3.8044795989990234s
Received healthy response to inference request in 2.423391819000244s
5 requests
0 failed requests
5th percentile: 2.3818793296813965
10th percentile: 2.3922574520111084
20th percentile: 2.4130136966705322
30th percentile: 2.6059810161590575
40th percentile: 2.9711594104766847
50th percentile: 3.3363378047943115
60th percentile: 3.523594522476196
70th percentile: 3.710851240158081
80th percentile: 3.8726747035980225
90th percentile: 4.0090649127960205
95th percentile: 4.0772600173950195
99th percentile: 4.131816101074219
mean time: 3.2162331104278565
%s, retrying in %s seconds...
Received healthy response to inference request in 4.195761442184448s
Received healthy response to inference request in 2.57943058013916s
Received healthy response to inference request in 2.1156327724456787s
Received healthy response to inference request in 2.923013925552368s
Received healthy response to inference request in 2.3345420360565186s
5 requests
0 failed requests
5th percentile: 2.1594146251678468
10th percentile: 2.203196477890015
20th percentile: 2.2907601833343505
30th percentile: 2.383519744873047
40th percentile: 2.4814751625061033
50th percentile: 2.57943058013916
60th percentile: 2.716863918304443
70th percentile: 2.8542972564697267
80th percentile: 3.177563428878784
90th percentile: 3.686662435531616
95th percentile: 3.9412119388580322
99th percentile: 4.144851541519165
mean time: 2.8296761512756348
Pipeline stage StressChecker completed in 51.41s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
Shutdown handler de-registered
function_noraf_2025-08-09 status is now deployed due to DeploymentManager action
function_noraf_2025-08-09 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3543.10s
Shutdown handler de-registered
function_noraf_2025-08-09 status is now torndown due to DeploymentManager action