function_gatin_2026-02-25

submission_id: function_gatin_2026-02-25

developer_uid: chai_backend_admin

status: inactive

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

timestamp: 2026-02-25T21:08:00+00:00

model_name: function_gatin_2026-02-25

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.438420295715332s
Received healthy response to inference request in 3.7939975261688232s
Received healthy response to inference request in 3.481900691986084s
Received healthy response to inference request in 3.4732258319854736s
Received healthy response to inference request in 3.1413848400115967s
Received healthy response to inference request in 3.365015745162964s
Received healthy response to inference request in 3.1322743892669678s
Received healthy response to inference request in 3.1927332878112793s
Received healthy response to inference request in 3.2633514404296875s
Received healthy response to inference request in 3.734894037246704s
10 requests
0 failed requests
5th percentile: 3.136374092102051
10th percentile: 3.140473794937134
20th percentile: 3.182463598251343
30th percentile: 3.242165994644165
40th percentile: 3.3243500232696532
50th percentile: 3.401718020439148
60th percentile: 3.4523425102233887
70th percentile: 3.4758282899856567
80th percentile: 3.532499361038208
90th percentile: 3.740804386138916
95th percentile: 3.7674009561538697
99th percentile: 3.7886782121658324
mean time: 3.401719808578491
Pipeline stage StressChecker completed in 35.72s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.32s
Shutdown handler de-registered
function_gatin_2026-02-25 status is now deployed due to DeploymentManager action
function_gatin_2026-02-25 status is now inactive due to admin request