developer_uid: richhx
submission_id: chaiml-ocean-life25051_60844_v44
model_name: chaiml-ocean-life25051_60844_v44
model_group: ChaiML/ocean-life2505130
status: inactive
timestamp: 2026-01-19T18:01:43+00:00
num_battles: 15370
num_wins: 6978
celo_rating: 1268.7
family_friendly_score: 0.5429999999999999
family_friendly_standard_error: 0.007044870474323854
submission_type: basic
model_repo: ChaiML/ocean-life250513094323_sft
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
latencies: [{'batch_size': 1, 'throughput': 0.5511566243254131, 'latency_mean': 1.814302432537079, 'latency_p50': 1.8129076957702637, 'latency_p90': 1.9986525058746338}, {'batch_size': 3, 'throughput': 1.1187673338686774, 'latency_mean': 2.6688358211517333, 'latency_p50': 2.676438331604004, 'latency_p90': 2.941071557998657}, {'batch_size': 5, 'throughput': 1.4269016984227034, 'latency_mean': 3.483739252090454, 'latency_p50': 3.478124499320984, 'latency_p90': 3.944539284706116}, {'batch_size': 6, 'throughput': 1.522083339522926, 'latency_mean': 3.91404789686203, 'latency_p50': 3.9094401597976685, 'latency_p90': 4.467871880531311}, {'batch_size': 8, 'throughput': 1.6626330817482862, 'latency_mean': 4.749140976667404, 'latency_p50': 4.708439946174622, 'latency_p90': 5.443890237808227}, {'batch_size': 10, 'throughput': 1.7435629336399636, 'latency_mean': 5.703891847133637, 'latency_p50': 5.716236352920532, 'latency_p90': 6.575334310531616}]
gpu_counts: {'NVIDIA L40S': 1}
display_name: chaiml-ocean-life25051_60844_v44
is_internal_developer: True
language_model: ChaiML/ocean-life250513094323_sft
model_size: 24B
ranking_group: single
throughput_3p7s: 1.49
us_pacific_date: 2026-01-19
win_ratio: 0.4540013012361744
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '####', 'You:', '\n', '####\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name chaiml-ocean-life25051-60844-v44-mkmlizer
Waiting for job on chaiml-ocean-life25051-60844-v44-mkmlizer to finish
chaiml-ocean-life25051-60844-v44-mkmlizer: /root/miniconda3/envs/nvidia/lib/python3.11/site-packages/mk1/__init__.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
chaiml-ocean-life25051-60844-v44-mkmlizer:   __import__('pkg_resources').declare_namespace(__name__)
chaiml-ocean-life25051-60844-v44-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
chaiml-ocean-life25051-60844-v44-mkmlizer: ║                                                                     ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║   ██████   ██████  █████   ████  ████                               ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  ░░██████ ██████  ░░███   ███░  ░░███                               ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║   ░███░█████░███   ░███  ███     ░███                               ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║   ░███░░███ ░███   ░███████      ░███                               ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║   ░███ ░░░  ░███   ░███░░███     ░███                               ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║   ░███      ░███   ░███ ░░███    ░███                               ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║   █████     █████  █████ ░░████  █████                              ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  ░░░░░     ░░░░░  ░░░░░   ░░░░  ░░░░░                               ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║                                                                     ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  Version: 0.30.6+torch280                                           ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  Features: FLYWHEEL, CUDA                                           ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  Copyright 2023-2025 MK ONE TECHNOLOGIES Inc.                       ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  https://mk1.ai                                                     ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║                                                                     ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  The license key for the current software has been verified as      ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  belonging to:                                                      ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║                                                                     ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  Chai Research Corp.                                                ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ║                                                                     ║
chaiml-ocean-life25051-60844-v44-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
chaiml-ocean-life25051-60844-v44-mkmlizer: Downloaded to shared memory in 47.971s
chaiml-ocean-life25051-60844-v44-mkmlizer: Checking if ChaiML/ocean-life250513094323_sft already exists in ChaiML
chaiml-ocean-life25051-60844-v44-mkmlizer: quantizing model to /dev/shm/model_cache, profile:q4, folder:/tmp/tmpd13_4hik, device:0
chaiml-ocean-life25051-60844-v44-mkmlizer: Saving flywheel model at /dev/shm/model_cache
chaiml-ocean-life25051-60844-v44-mkmlizer: The tokenizer you are loading from '/tmp/tmpd13_4hik' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-ocean-life25051-60844-v44-mkmlizer: quantized model in 277.661s
chaiml-ocean-life25051-60844-v44-mkmlizer: Processed model ChaiML/ocean-life250513094323_sft in 325.632s
chaiml-ocean-life25051-60844-v44-mkmlizer: creating bucket guanaco-mkml-models
chaiml-ocean-life25051-60844-v44-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
chaiml-ocean-life25051-60844-v44-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/chaiml-ocean-life25051-60844-v44/nvidia
chaiml-ocean-life25051-60844-v44-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/chaiml-ocean-life25051-60844-v44/nvidia/config.json
chaiml-ocean-life25051-60844-v44-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/chaiml-ocean-life25051-60844-v44/nvidia/special_tokens_map.json
chaiml-ocean-life25051-60844-v44-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/chaiml-ocean-life25051-60844-v44/nvidia/tokenizer_config.json
chaiml-ocean-life25051-60844-v44-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/chaiml-ocean-life25051-60844-v44/nvidia/tokenizer.json
chaiml-ocean-life25051-60844-v44-mkmlizer: cp /dev/shm/model_cache/flywheel_model.1.safetensors s3://guanaco-mkml-models/chaiml-ocean-life25051-60844-v44/nvidia/flywheel_model.1.safetensors
chaiml-ocean-life25051-60844-v44-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/chaiml-ocean-life25051-60844-v44/nvidia/flywheel_model.0.safetensors
Job chaiml-ocean-life25051-60844-v44-mkmlizer completed after 442.2s with status: succeeded
Stopping job with name chaiml-ocean-life25051-60844-v44-mkmlizer
Pipeline stage MKMLizer completed in 443.35s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.26s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service chaiml-ocean-life25051-60844-v44
Waiting for inference service chaiml-ocean-life25051-60844-v44 to be ready
Inference service chaiml-ocean-life25051-60844-v44 ready after 152.21945452690125s
Pipeline stage MKMLDeployer completed in 153.32s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.649672508239746s
Received healthy response to inference request in 2.7105462551116943s
Received healthy response to inference request in 2.656839370727539s
Received healthy response to inference request in 1.9381911754608154s
Received healthy response to inference request in 2.3209550380706787s
5 requests
0 failed requests
5th percentile: 2.014743947982788
10th percentile: 2.0912967205047606
20th percentile: 2.244402265548706
30th percentile: 2.386698532104492
40th percentile: 2.518185520172119
50th percentile: 2.649672508239746
60th percentile: 2.6525392532348633
70th percentile: 2.6554059982299805
80th percentile: 2.66758074760437
90th percentile: 2.6890635013580324
95th percentile: 2.6998048782348634
99th percentile: 2.7083979797363282
mean time: 2.4552408695220946
Pipeline stage StressChecker completed in 14.41s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.31s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 1.03s
Shutdown handler de-registered
chaiml-ocean-life25051_60844_v44 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.09s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.08s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service chaiml-ocean-life25051-60844-v44-profiler
Waiting for inference service chaiml-ocean-life25051-60844-v44-profiler to be ready
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2461.82s
Shutdown handler de-registered