delta-vector-rei-12b

developer_uid: cycy233
submission_id: delta-vector-rei-12b_v1
model_name: delta-vector-rei-12b_v1
model_group: Delta-Vector/Rei-12B
status: torndown
timestamp: 2025-05-28T10:50:53+00:00
num_battles: 8440
num_wins: 3979
celo_rating: 1261.34
family_friendly_score: 0.5524
family_friendly_standard_error: 0.007032129691636808
submission_type: basic
model_repo: Delta-Vector/Rei-12B
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: delta-vector-rei-12b_v1
is_internal_developer: False
language_model: Delta-Vector/Rei-12B
model_size: 13B
ranking_group: single
us_pacific_date: 2025-05-28
win_ratio: 0.4714454976303318
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name delta-vector-rei-12b-v1-mkmlizer
Waiting for job on delta-vector-rei-12b-v1-mkmlizer to finish
delta-vector-rei-12b-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
delta-vector-rei-12b-v1-mkmlizer: ║     _____            __           __                                ║
delta-vector-rei-12b-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
delta-vector-rei-12b-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
delta-vector-rei-12b-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
delta-vector-rei-12b-v1-mkmlizer: ║       /___/                                                         ║
delta-vector-rei-12b-v1-mkmlizer: ║                                                                     ║
delta-vector-rei-12b-v1-mkmlizer: ║  Version: 0.12.8                                                    ║
delta-vector-rei-12b-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
delta-vector-rei-12b-v1-mkmlizer: ║  https://mk1.ai                                                     ║
delta-vector-rei-12b-v1-mkmlizer: ║                                                                     ║
delta-vector-rei-12b-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
delta-vector-rei-12b-v1-mkmlizer: ║  belonging to:                                                      ║
delta-vector-rei-12b-v1-mkmlizer: ║                                                                     ║
delta-vector-rei-12b-v1-mkmlizer: ║  Chai Research Corp.                                                ║
delta-vector-rei-12b-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
delta-vector-rei-12b-v1-mkmlizer: ║  Expiration: 2028-03-31 23:59:59                                    ║
delta-vector-rei-12b-v1-mkmlizer: ║                                                                     ║
delta-vector-rei-12b-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
delta-vector-rei-12b-v1-mkmlizer: Downloaded to shared memory in 48.611s
delta-vector-rei-12b-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmp292elw59, device:0
delta-vector-rei-12b-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
delta-vector-rei-12b-v1-mkmlizer: quantized model in 36.561s
delta-vector-rei-12b-v1-mkmlizer: Processed model Delta-Vector/Rei-12B in 85.173s
delta-vector-rei-12b-v1-mkmlizer: creating bucket guanaco-mkml-models
delta-vector-rei-12b-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
delta-vector-rei-12b-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/delta-vector-rei-12b-v1
delta-vector-rei-12b-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/delta-vector-rei-12b-v1/config.json
delta-vector-rei-12b-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/delta-vector-rei-12b-v1/special_tokens_map.json
delta-vector-rei-12b-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/delta-vector-rei-12b-v1/tokenizer_config.json
delta-vector-rei-12b-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/delta-vector-rei-12b-v1/flywheel_model.0.safetensors
delta-vector-rei-12b-v1-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/363 [00:06<18:34,  3.09s/it]
Loading 0:   2%|▏         | 6/363 [00:06<04:56,  1.20it/s]
Loading 0:   4%|▎         | 13/363 [00:06<01:45,  3.31it/s]
Loading 0:   5%|▍         | 18/363 [00:06<01:05,  5.27it/s]
Loading 0:   6%|▋         | 23/363 [00:06<00:43,  7.80it/s]
Loading 0:   8%|▊         | 29/363 [00:06<00:29, 11.34it/s]
Loading 0:   9%|▉         | 34/363 [00:06<00:22, 14.52it/s]
Loading 0:  11%|█         | 40/363 [00:07<00:19, 16.24it/s]
Loading 0:  12%|█▏        | 44/363 [00:07<00:17, 18.54it/s]
Loading 0:  14%|█▍        | 50/363 [00:07<00:13, 23.85it/s]
Loading 0:  15%|█▌        | 56/363 [00:07<00:11, 27.56it/s]
Loading 0:  17%|█▋        | 60/363 [00:07<00:10, 28.33it/s]
Loading 0:  18%|█▊        | 67/363 [00:07<00:08, 36.37it/s]
Loading 0:  20%|█▉        | 72/363 [00:07<00:07, 38.50it/s]
Loading 0:  21%|██▏       | 78/363 [00:08<00:07, 36.23it/s]
Loading 0:  23%|██▎       | 85/363 [00:08<00:06, 42.86it/s]
Loading 0:  25%|██▍       | 90/363 [00:08<00:06, 43.09it/s]
Loading 0:  26%|██▌       | 95/363 [00:08<00:06, 44.14it/s]
Loading 0:  28%|██▊       | 101/363 [00:08<00:05, 43.68it/s]
Loading 0:  29%|██▉       | 106/363 [00:08<00:06, 42.79it/s]
Loading 0:  31%|███       | 113/363 [00:08<00:05, 47.40it/s]
Loading 0:  33%|███▎      | 119/363 [00:08<00:05, 45.39it/s]
Loading 0:  34%|███▍      | 124/363 [00:09<00:07, 30.04it/s]
Loading 0:  36%|███▌      | 130/363 [00:09<00:06, 35.21it/s]
Loading 0:  37%|███▋      | 135/363 [00:09<00:06, 37.44it/s]
Loading 0:  39%|███▊      | 140/363 [00:09<00:05, 38.94it/s]
Loading 0:  40%|███▉      | 145/363 [00:09<00:05, 38.45it/s]
Loading 0:  41%|████▏     | 150/363 [00:09<00:06, 33.39it/s]
Loading 0:  43%|████▎     | 157/363 [00:10<00:05, 40.62it/s]
Loading 0:  45%|████▍     | 162/363 [00:10<00:04, 40.83it/s]
Loading 0:  46%|████▌     | 167/363 [00:10<00:04, 41.83it/s]
Loading 0:  47%|████▋     | 172/363 [00:10<00:04, 41.29it/s]
Loading 0:  49%|████▉     | 177/363 [00:10<00:05, 34.55it/s]
Loading 0:  51%|█████     | 184/363 [00:10<00:04, 42.38it/s]
Loading 0:  52%|█████▏    | 189/363 [00:10<00:04, 43.08it/s]
Loading 0:  53%|█████▎    | 194/363 [00:10<00:03, 43.67it/s]
Loading 0:  55%|█████▍    | 199/363 [00:11<00:03, 44.58it/s]
Loading 0:  56%|█████▌    | 204/363 [00:11<00:06, 26.48it/s]
Loading 0:  58%|█████▊    | 211/363 [00:11<00:04, 34.08it/s]
Loading 0:  60%|█████▉    | 216/363 [00:11<00:04, 36.26it/s]
Loading 0:  61%|██████    | 221/363 [00:11<00:03, 38.69it/s]
Loading 0:  63%|██████▎   | 227/363 [00:11<00:03, 39.67it/s]
Loading 0:  64%|██████▍   | 232/363 [00:12<00:03, 39.78it/s]
Loading 0:  66%|██████▌   | 239/363 [00:12<00:02, 44.88it/s]
Loading 0:  67%|██████▋   | 245/363 [00:12<00:02, 43.62it/s]
Loading 0:  69%|██████▉   | 250/363 [00:12<00:02, 42.58it/s]
Loading 0:  71%|███████   | 257/363 [00:12<00:02, 47.36it/s]
Loading 0:  72%|███████▏  | 263/363 [00:12<00:02, 44.91it/s]
Loading 0:  74%|███████▍  | 268/363 [00:12<00:02, 44.10it/s]
Loading 0:  75%|███████▌  | 274/363 [00:12<00:01, 47.90it/s]
Loading 0:  77%|███████▋  | 279/363 [00:13<00:01, 45.55it/s]
Loading 0:  78%|███████▊  | 284/363 [00:13<00:02, 31.74it/s]
Loading 0:  79%|███████▉  | 288/363 [00:13<00:02, 32.79it/s]
Loading 0:  81%|████████  | 293/363 [00:13<00:01, 35.97it/s]
Loading 0:  82%|████████▏ | 299/363 [00:13<00:01, 37.07it/s]
Loading 0:  83%|████████▎ | 303/363 [00:13<00:01, 35.06it/s]
Loading 0:  86%|████████▌ | 311/363 [00:13<00:01, 43.87it/s]
Loading 0:  87%|████████▋ | 317/363 [00:14<00:01, 42.90it/s]
Loading 0:  89%|████████▊ | 322/363 [00:14<00:01, 39.81it/s]
Loading 0:  90%|█████████ | 328/363 [00:14<00:00, 42.82it/s]
Loading 0:  92%|█████████▏| 333/363 [00:14<00:00, 42.55it/s]
Loading 0:  93%|█████████▎| 338/363 [00:14<00:00, 43.39it/s]
Loading 0:  94%|█████████▍| 343/363 [00:14<00:00, 43.64it/s]
Loading 0:  96%|█████████▌| 348/363 [00:14<00:00, 36.20it/s]
Loading 0:  98%|█████████▊| 355/363 [00:15<00:00, 43.76it/s]
Loading 0:  99%|█████████▉| 360/363 [00:15<00:00, 42.25it/s]
                                                            
Job delta-vector-rei-12b-v1-mkmlizer completed after 105.88s with status: succeeded
Stopping job with name delta-vector-rei-12b-v1-mkmlizer
Pipeline stage MKMLizer completed in 106.59s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service delta-vector-rei-12b-v1
Waiting for inference service delta-vector-rei-12b-v1 to be ready
Inference service delta-vector-rei-12b-v1 ready after 160.90325212478638s
Pipeline stage MKMLDeployer completed in 161.59s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3760509490966797s
Received healthy response to inference request in 1.950956106185913s
Received healthy response to inference request in 1.7381272315979004s
Received healthy response to inference request in 1.621344804763794s
Received healthy response to inference request in 1.792903184890747s
5 requests
0 failed requests
5th percentile: 1.6447012901306153
10th percentile: 1.6680577754974366
20th percentile: 1.714770746231079
30th percentile: 1.7490824222564698
40th percentile: 1.7709928035736084
50th percentile: 1.792903184890747
60th percentile: 1.8561243534088134
70th percentile: 1.9193455219268798
80th percentile: 2.0359750747680665
90th percentile: 2.206013011932373
95th percentile: 2.2910319805145263
99th percentile: 2.359047155380249
mean time: 1.8958764553070069
Pipeline stage StressChecker completed in 10.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.70s
Shutdown handler de-registered
delta-vector-rei-12b_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3008.18s
Shutdown handler de-registered
delta-vector-rei-12b_v1 status is now inactive due to auto deactivation removed underperforming models
delta-vector-rei-12b_v1 status is now torndown due to DeploymentManager action