developer_uid: chai_backend_admin
submission_id: function_sokob_2026-01-12
model_name: function_sokob_2026-01-12
model_group:
status: torndown
timestamp: 2026-01-15T09:53:03+00:00
num_battles: 14
num_wins: 9
family_friendly_score: 0.5582
family_friendly_standard_error: 0.007023001637476671
submission_type: function
display_name: function_sokob_2026-01-12
is_internal_developer: True
ranking_group: single
us_pacific_date: 2026-01-12
win_ratio: 0.6428571428571429
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.367595911026001s
Received healthy response to inference request in 2.3035528659820557s
Received healthy response to inference request in 2.105076313018799s
Received healthy response to inference request in 3.030803680419922s
Received healthy response to inference request in 2.6151957511901855s
Received healthy response to inference request in 3.1019999980926514s
Received healthy response to inference request in 2.8494627475738525s
Received healthy response to inference request in 2.778980016708374s
Received healthy response to inference request in 2.9213833808898926s
Received healthy response to inference request in 2.977064371109009s
10 requests
0 failed requests
5th percentile: 2.1943907618522642
10th percentile: 2.28370521068573
20th percentile: 2.354787302017212
30th percentile: 2.54091579914093
40th percentile: 2.7134663105010985
50th percentile: 2.8142213821411133
60th percentile: 2.8782310009002687
70th percentile: 2.9380876779556275
80th percentile: 2.9878122329711916
90th percentile: 3.037923312187195
95th percentile: 3.069961655139923
99th percentile: 3.095592329502106
mean time: 2.705111503601074
Pipeline stage StressChecker completed in 28.37s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.16s
Shutdown handler de-registered
function_sokob_2026-01-12 status is now deployed due to DeploymentManager action
function_sokob_2026-01-12 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2920.44s
Shutdown handler de-registered
function_sokob_2026-01-12 status is now torndown due to DeploymentManager action