developer_uid: richhx
submission_id: chaiml-kaniwara-japan-fut_433_v8
model_name: chaiml-kaniwara-japan-fut_433_v8
model_group: ChaiML/Kaniwara-Japan-Fu
status: torndown
timestamp: 2026-03-14T15:17:04+00:00
num_battles: 51
num_wins: 21
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/Kaniwara-Japan-Future-RPG260223150837_sft
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-kaniwara-japan-fut_433_v8
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/Kaniwara-Japan-Future-RPG260223150837_sft
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-11
win_ratio: 0.4117647058823529
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '####', 'You:', '####\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kaniwara-japan-fut-433-v8-uploader
Waiting for job on chaiml-kaniwara-japan-fut-433-v8-uploader to finish
chaiml-kaniwara-japan-fut-433-v8-uploader: Using quantization_mode: fp8
chaiml-kaniwara-japan-fut-433-v8-uploader: Downloaded in 14.381s
chaiml-kaniwara-japan-fut-433-v8-uploader: Processed model ChaiML/Kaniwara-Japan-Future-RPG260223150837_sft in 17.813s
chaiml-kaniwara-japan-fut-433-v8-uploader: creating bucket guanaco-vllm-models
chaiml-kaniwara-japan-fut-433-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v8-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kaniwara-japan-fut-433-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kaniwara-japan-fut-433-v8-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kaniwara-japan-fut-433-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v8-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kaniwara-japan-fut-433-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v8-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kaniwara-japan-fut-433-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v8-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-kaniwara-japan-fut-433-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v8-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-kaniwara-japan-fut-433-v8-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kaniwara-japan-fut-433-v8-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kaniwara-japan-fut-433-v8-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kaniwara-japan-fut-433-v8-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kaniwara-japan-fut-433-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kaniwara-japan-fut-433-v8-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/config.json
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/tokenizer_config.json
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/recipe.yaml
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/generation_config.json
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/special_tokens_map.json
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/.gitattributes
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/model.safetensors.index.json
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/tokenizer.json
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/model-00006-of-00006.safetensors
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/model-00005-of-00006.safetensors
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/model-00004-of-00006.safetensors
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/model-00003-of-00006.safetensors
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/model-00001-of-00006.safetensors
chaiml-kaniwara-japan-fut-433-v8-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v8/default/model-00002-of-00006.safetensors
Job chaiml-kaniwara-japan-fut-433-v8-uploader completed after 56.42s with status: succeeded
Stopping job with name chaiml-kaniwara-japan-fut-433-v8-uploader
Pipeline stage VLLMUploader completed in 57.99s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.21s
run pipeline stage %s
Running pipeline stage VLLMDeployer
2026-03-11T15:09:26.450776+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v8
Creating inference service chaiml-kaniwara-japan-fut-433-v8
Waiting for inference service chaiml-kaniwara-japan-fut-433-v8 to be ready
2026-03-11T15:10:26.811910+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v8
2026-03-11T15:11:32.960902+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v8
Inference service chaiml-kaniwara-japan-fut-433-v8 ready after 182.74594593048096s
Pipeline stage VLLMDeployer completed in 184.32s
run pipeline stage %s
Running pipeline stage StressChecker
2026-03-11T15:12:33.210283+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v8
Received healthy response to inference request in 4.673326015472412s
Received healthy response to inference request in 4.708345174789429s
Received healthy response to inference request in 4.71190071105957s
Received healthy response to inference request in 4.4114649295806885s
Received healthy response to inference request in 2.804105520248413s
Received healthy response to inference request in 2.920753002166748s
Received healthy response to inference request in 3.2667274475097656s
Received healthy response to inference request in 4.311513662338257s
Received healthy response to inference request in 3.0061557292938232s
Received healthy response to inference request in 2.80613112449646s
Received healthy response to inference request in 2.809967279434204s
Received healthy response to inference request in 2.827115297317505s
Received healthy response to inference request in 3.040419101715088s
Received healthy response to inference request in 2.718621253967285s
Received healthy response to inference request in 2.767470598220825s
Received healthy response to inference request in 2.74988055229187s
Received healthy response to inference request in 2.71844220161438s
Received healthy response to inference request in 2.91520357131958s
2026-03-11T15:13:33.420887+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v8
Received healthy response to inference request in 2.8707120418548584s
Received healthy response to inference request in 2.8232271671295166s
Received healthy response to inference request in 2.7696585655212402s
Received healthy response to inference request in 2.7516274452209473s
Received healthy response to inference request in 3.4087324142456055s
Received healthy response to inference request in 2.7881979942321777s
Received healthy response to inference request in 2.7689740657806396s
Received healthy response to inference request in 3.1205756664276123s
Received healthy response to inference request in 2.866408586502075s
Received healthy response to inference request in 2.871034622192383s
Received healthy response to inference request in 2.9183437824249268s
Received healthy response to inference request in 2.9139132499694824s
30 requests
0 failed requests
5th percentile: 2.732687938213348
10th percentile: 2.7514527559280397
20th percentile: 2.7695216655731203
30th percentile: 2.8055234432220457
40th percentile: 2.8255600452423097
50th percentile: 2.8708733320236206
60th percentile: 2.916459655761719
70th percentile: 3.0164347410202024
80th percentile: 3.295128440856934
90th percentile: 4.437651038169861
95th percentile: 4.692586553096771
99th percentile: 4.710869605541229
mean time: 3.167964959144592
Pipeline stage StressChecker completed in 100.54s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.35s
Shutdown handler de-registered
chaiml-kaniwara-japan-fut_433_v8 status is now deployed due to DeploymentManager action
chaiml-kaniwara-japan-fut_433_v8 status is now inactive due to system request
chaiml-kaniwara-japan-fut_433_v8 status is now torndown due to DeploymentManager action