developer_uid: richhx
submission_id: chaiml-kaniwara-japan-fut_433_v9
model_name: chaiml-kaniwara-japan-fut_433_v9
model_group: ChaiML/Kaniwara-Japan-Fu
status: inactive
timestamp: 2026-03-18T15:38:22+00:00
num_battles: 16
num_wins: 8
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/Kaniwara-Japan-Future-RPG260223150837_sft
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-kaniwara-japan-fut_433_v9
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/Kaniwara-Japan-Future-RPG260223150837_sft
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-18
win_ratio: 0.5
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', 'You:', '\n', '</s>', '####\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-kaniwara-japan-fut-433-v9-uploader
Waiting for job on chaiml-kaniwara-japan-fut-433-v9-uploader to finish
chaiml-kaniwara-japan-fut-433-v9-uploader: Using quantization_mode: fp8
chaiml-kaniwara-japan-fut-433-v9-uploader: Checking if ChaiML/Kaniwara-Japan-Future-RPG260223150837_sft-FP8 already exists in ChaiML
chaiml-kaniwara-japan-fut-433-v9-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-kaniwara-japan-fut-433-v9-uploader: Downloading snapshot of ChaiML/Kaniwara-Japan-Future-RPG260223150837_sft-FP8...
2026-03-18T15:31:58.980157+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v9
chaiml-kaniwara-japan-fut-433-v9-uploader: Downloaded in 13.636s
chaiml-kaniwara-japan-fut-433-v9-uploader: Processed model ChaiML/Kaniwara-Japan-Future-RPG260223150837_sft in 17.051s
chaiml-kaniwara-japan-fut-433-v9-uploader: creating bucket guanaco-vllm-models
chaiml-kaniwara-japan-fut-433-v9-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v9-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-kaniwara-japan-fut-433-v9-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-kaniwara-japan-fut-433-v9-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-kaniwara-japan-fut-433-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v9-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-kaniwara-japan-fut-433-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v9-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-kaniwara-japan-fut-433-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v9-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-kaniwara-japan-fut-433-v9-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-kaniwara-japan-fut-433-v9-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-kaniwara-japan-fut-433-v9-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-kaniwara-japan-fut-433-v9-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-kaniwara-japan-fut-433-v9-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-kaniwara-japan-fut-433-v9-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-kaniwara-japan-fut-433-v9-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-kaniwara-japan-fut-433-v9-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/.gitattributes
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/recipe.yaml
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/special_tokens_map.json
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/model.safetensors.index.json
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/tokenizer_config.json
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/config.json
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/generation_config.json
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/tokenizer.json
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/model-00006-of-00006.safetensors
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/model-00005-of-00006.safetensors
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/model-00003-of-00006.safetensors
chaiml-kaniwara-japan-fut-433-v9-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-kaniwara-japan-fut-433-v9/default/model-00001-of-00006.safetensors
Job chaiml-kaniwara-japan-fut-433-v9-uploader completed after 97.79s with status: succeeded
Stopping job with name chaiml-kaniwara-japan-fut-433-v9-uploader
Pipeline stage VLLMUploader completed in 99.00s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.45s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-kaniwara-japan-fut-433-v9
Waiting for inference service chaiml-kaniwara-japan-fut-433-v9 to be ready
2026-03-18T15:32:59.166361+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v9
2026-03-18T15:33:59.345878+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v9
2026-03-18T15:34:59.566472+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v9
2026-03-18T15:35:59.779641+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v9
Inference service chaiml-kaniwara-japan-fut-433-v9 ready after 212.68847513198853s
Pipeline stage VLLMDeployer completed in 214.46s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.585604667663574s
Received healthy response to inference request in 4.560603857040405s
Received healthy response to inference request in 4.29089093208313s
Received healthy response to inference request in 4.308162450790405s
Received healthy response to inference request in 4.364264965057373s
Received healthy response to inference request in 2.7476398944854736s
Received healthy response to inference request in 2.8154213428497314s
Received healthy response to inference request in 2.919745922088623s
Received healthy response to inference request in 2.7670845985412598s
Received healthy response to inference request in 3.094038724899292s
Received healthy response to inference request in 2.9060311317443848s
Received healthy response to inference request in 2.802967071533203s
2026-03-18T15:36:59.991781+00:00 monitor updated for chaiml-kaniwara-japan-fut_433_v9
Received healthy response to inference request in 2.843078136444092s
Received healthy response to inference request in 2.828073501586914s
Received healthy response to inference request in 2.859119415283203s
Received healthy response to inference request in 2.756204605102539s
Received healthy response to inference request in 2.7498373985290527s
Received healthy response to inference request in 2.7558369636535645s
Received healthy response to inference request in 2.940504312515259s
Received healthy response to inference request in 3.079254627227783s
Received healthy response to inference request in 3.0700485706329346s
Received healthy response to inference request in 2.8617448806762695s
Received healthy response to inference request in 2.7511167526245117s
Received healthy response to inference request in 2.769465446472168s
Received healthy response to inference request in 3.0436034202575684s
Received healthy response to inference request in 2.9131832122802734s
Received healthy response to inference request in 2.770871877670288s
Received healthy response to inference request in 2.755783796310425s
Received healthy response to inference request in 2.765805721282959s
Received healthy response to inference request in 2.8226189613342285s
30 requests
0 failed requests
5th percentile: 2.750413107872009
10th percentile: 2.7553170919418335
20th percentile: 2.763885498046875
30th percentile: 2.7704499483108522
40th percentile: 2.8197399139404298
50th percentile: 2.8510987758636475
60th percentile: 2.90889196395874
70th percentile: 2.9714340448379515
80th percentile: 3.082211446762085
90th percentile: 4.313772702217102
95th percentile: 4.47225135564804
99th percentile: 4.578354432582855
mean time: 3.1166202386220294
Pipeline stage StressChecker completed in 98.88s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.37s
Shutdown handler de-registered
chaiml-kaniwara-japan-fut_433_v9 status is now deployed due to DeploymentManager action
chaiml-kaniwara-japan-fut_433_v9 status is now inactive due to system request