developer_uid: chai_backend_admin
submission_id: alexdaoud-trainer-humof_70649_v1
model_name: alexdaoud-trainer-humof_70649_v1
model_group: alexdaoud/trainer_humof_
status: torndown
timestamp: 2025-01-30T09:54:20+00:00
num_battles: 9049
num_wins: 4396
celo_rating: 1261.04
family_friendly_score: 0.6064
family_friendly_standard_error: 0.006909110507149239
submission_type: basic
model_repo: alexdaoud/trainer_humof_2025-01-27-checkpoint-59
model_architecture: MultiHeadLlamaClassifier
model_num_parameters: 8030261248.0
best_of: 1
max_input_tokens: 256
max_output_tokens: 1
display_name: alexdaoud-trainer-humof_70649_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: alexdaoud/trainer_humof_2025-01-27-checkpoint-59
model_size: 8B
ranking_group: single
us_pacific_date: 2025-01-30
win_ratio: 0.48579953586031605
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 256, 'best_of': 1, 'max_output_tokens': 1}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name alexdaoud-trainer-humof-70649-v1-mkmlizer
Waiting for job on alexdaoud-trainer-humof-70649-v1-mkmlizer to finish
alexdaoud-trainer-humof-70649-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║     _____            __           __                                ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║       /___/                                                         ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║                                                                     ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  Version: 0.11.37                                                   ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  https://mk1.ai                                                     ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║                                                                     ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  belonging to:                                                      ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║                                                                     ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  Chai Research Corp.                                                ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ║                                                                     ║
alexdaoud-trainer-humof-70649-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
alexdaoud-trainer-humof-70649-v1-mkmlizer: quantized model in 15.719s
alexdaoud-trainer-humof-70649-v1-mkmlizer: Processed model alexdaoud/trainer_humof_2025-01-27-checkpoint-59 in 47.835s
alexdaoud-trainer-humof-70649-v1-mkmlizer: creating bucket guanaco-mkml-models
alexdaoud-trainer-humof-70649-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
alexdaoud-trainer-humof-70649-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/alexdaoud-trainer-humof-70649-v1
alexdaoud-trainer-humof-70649-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/alexdaoud-trainer-humof-70649-v1/config.json
alexdaoud-trainer-humof-70649-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/alexdaoud-trainer-humof-70649-v1/special_tokens_map.json
alexdaoud-trainer-humof-70649-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/alexdaoud-trainer-humof-70649-v1/tokenizer_config.json
alexdaoud-trainer-humof-70649-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/alexdaoud-trainer-humof-70649-v1/flywheel_model.0.safetensors
alexdaoud-trainer-humof-70649-v1-mkmlizer: 
Loading 0:   0%|          | 0/292 [00:00<?, ?it/s]
Loading 0:   2%|▏         | 5/292 [00:00<00:08, 34.02it/s]
Loading 0:   4%|▍         | 13/292 [00:00<00:05, 55.55it/s]
Loading 0:   7%|▋         | 19/292 [00:00<00:05, 52.18it/s]
Loading 0:   9%|▊         | 25/292 [00:00<00:04, 54.69it/s]
Loading 0:  11%|█         | 32/292 [00:00<00:05, 49.96it/s]
Loading 0:  14%|█▍        | 41/292 [00:00<00:04, 51.32it/s]
Loading 0:  16%|█▋        | 48/292 [00:00<00:04, 54.74it/s]
Loading 0:  18%|█▊        | 54/292 [00:01<00:04, 55.03it/s]
Loading 0:  21%|██        | 60/292 [00:01<00:04, 49.65it/s]
Loading 0:  23%|██▎       | 66/292 [00:01<00:04, 52.04it/s]
Loading 0:  25%|██▍       | 72/292 [00:01<00:04, 53.62it/s]
Loading 0:  27%|██▋       | 78/292 [00:01<00:04, 49.38it/s]
Loading 0:  29%|██▉       | 84/292 [00:01<00:06, 34.34it/s]
Loading 0:  30%|███       | 89/292 [00:01<00:05, 36.61it/s]
Loading 0:  33%|███▎      | 95/292 [00:02<00:05, 36.29it/s]
Loading 0:  35%|███▌      | 103/292 [00:02<00:04, 44.15it/s]
Loading 0:  37%|███▋      | 109/292 [00:02<00:04, 43.69it/s]
Loading 0:  39%|███▉      | 115/292 [00:02<00:03, 47.11it/s]
Loading 0:  42%|████▏     | 122/292 [00:02<00:03, 46.73it/s]
Loading 0:  45%|████▍     | 130/292 [00:02<00:03, 53.97it/s]
Loading 0:  47%|████▋     | 136/292 [00:02<00:03, 51.50it/s]
Loading 0:  49%|████▊     | 142/292 [00:02<00:02, 53.49it/s]
Loading 0:  51%|█████     | 149/292 [00:03<00:02, 50.27it/s]
Loading 0:  54%|█████▍    | 157/292 [00:03<00:02, 56.95it/s]
Loading 0:  56%|█████▌    | 163/292 [00:03<00:02, 50.84it/s]
Loading 0:  58%|█████▊    | 169/292 [00:03<00:02, 51.60it/s]
Loading 0:  61%|██████    | 177/292 [00:03<00:02, 53.69it/s]
Loading 0:  63%|██████▎   | 183/292 [00:03<00:02, 51.18it/s]
Loading 0:  65%|██████▍   | 189/292 [00:04<00:03, 32.20it/s]
Loading 0:  66%|██████▋   | 194/292 [00:04<00:02, 34.90it/s]
Loading 0:  69%|██████▉   | 202/292 [00:04<00:02, 43.56it/s]
Loading 0:  71%|███████   | 208/292 [00:04<00:01, 44.43it/s]
Loading 0:  73%|███████▎  | 214/292 [00:04<00:01, 46.77it/s]
Loading 0:  76%|███████▌  | 221/292 [00:04<00:01, 45.35it/s]
Loading 0:  77%|███████▋  | 226/292 [00:04<00:01, 46.36it/s]
Loading 0:  79%|███████▉  | 232/292 [00:04<00:01, 49.55it/s]
Loading 0:  82%|████████▏ | 239/292 [00:05<00:01, 47.36it/s]
Loading 0:  85%|████████▍ | 247/292 [00:05<00:00, 55.09it/s]
Loading 0:  87%|████████▋ | 253/292 [00:05<00:00, 50.67it/s]
Loading 0:  89%|████████▊ | 259/292 [00:05<00:00, 50.76it/s]
Loading 0:  91%|█████████ | 266/292 [00:05<00:00, 48.01it/s]
Loading 0:  94%|█████████▍| 274/292 [00:05<00:00, 55.22it/s]
Loading 0:  96%|█████████▌| 280/292 [00:05<00:00, 51.96it/s]
Loading 0:  98%|█████████▊| 286/292 [00:06<00:00, 47.89it/s]
Loading 0: 100%|█████████▉| 291/292 [00:06<00:00, 36.72it/s]
                                                            

Job alexdaoud-trainer-humof-70649-v1-mkmlizer completed after 74.37s with status: succeeded
Stopping job with name alexdaoud-trainer-humof-70649-v1-mkmlizer
Pipeline stage MKMLizer completed in 74.84s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service alexdaoud-trainer-humof-70649-v1
Waiting for inference service alexdaoud-trainer-humof-70649-v1 to be ready
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Inference service alexdaoud-trainer-humof-70649-v1 ready after 200.667231798172s
Pipeline stage MKMLDeployer completed in 201.17s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3770716190338135s
Received healthy response to inference request in 2.071779727935791s
Received healthy response to inference request in 3.5576701164245605s
Received healthy response to inference request in 6.1259236335754395s
Received healthy response to inference request in 3.79997181892395s
5 requests
0 failed requests
5th percentile: 2.3328381061553953
10th percentile: 2.593896484375
20th percentile: 3.116013240814209
30th percentile: 3.413191318511963
40th percentile: 3.4854307174682617
50th percentile: 3.5576701164245605
60th percentile: 3.6545907974243166
70th percentile: 3.751511478424072
80th percentile: 4.265162181854248
90th percentile: 5.195542907714844
95th percentile: 5.660733270645141
99th percentile: 6.03288556098938
mean time: 3.786483383178711
%s, retrying in %s seconds...
Received healthy response to inference request in 2.1623997688293457s
Received healthy response to inference request in 4.089783668518066s
Received healthy response to inference request in 2.391284465789795s
Received healthy response to inference request in 2.52270770072937s
Received healthy response to inference request in 3.337648391723633s
5 requests
0 failed requests
5th percentile: 2.2081767082214356
10th percentile: 2.2539536476135256
20th percentile: 2.345507526397705
30th percentile: 2.41756911277771
40th percentile: 2.47013840675354
50th percentile: 2.52270770072937
60th percentile: 2.848683977127075
70th percentile: 3.17466025352478
80th percentile: 3.4880754470825197
90th percentile: 3.788929557800293
95th percentile: 3.9393566131591795
99th percentile: 4.059698257446289
mean time: 2.900764799118042
Pipeline stage StressChecker completed in 35.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.69s
Shutdown handler de-registered
alexdaoud-trainer-humof_70649_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3598.78s
Shutdown handler de-registered
alexdaoud-trainer-humof_70649_v1 status is now inactive due to auto deactivation removed underperforming models
alexdaoud-trainer-humof_70649_v1 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1