zeroblu3-neuralpoppy-ev_10970

developer_uid: fengjiayi
submission_id: zeroblu3-neuralpoppy-ev_10970_v1
model_name: zeroblu3-neuralpoppy-ev_10970_v1
model_group: zeroblu3/NeuralPoppy-EVO
status: torndown
timestamp: 2025-01-23T05:30:31+00:00
num_battles: 5352
num_wins: 2676
celo_rating: 1217.24
family_friendly_score: 0.6008
family_friendly_standard_error: 0.006925884203479005
submission_type: basic
model_repo: zeroblu3/NeuralPoppy-EVO-L3-8B
model_architecture: LlamaForCausalLM
model_num_parameters: 8030261248.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: zeroblu3-neuralpoppy-ev_10970_v1
is_internal_developer: False
language_model: zeroblu3/NeuralPoppy-EVO-L3-8B
model_size: 8B
ranking_group: single
us_pacific_date: 2025-01-22
win_ratio: 0.5
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer
Waiting for job on zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer to finish
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║     _____            __           __                                ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║       /___/                                                         ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║                                                                     ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  Version: 0.11.12                                                   ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  https://mk1.ai                                                     ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║                                                                     ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  belonging to:                                                      ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║                                                                     ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  Chai Research Corp.                                                ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ║                                                                     ║
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: Downloaded to shared memory in 34.034s
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpioaseljm, device:0
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: quantized model in 27.705s
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: Processed model zeroblu3/NeuralPoppy-EVO-L3-8B in 61.739s
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: creating bucket guanaco-mkml-models
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zeroblu3-neuralpoppy-ev-10970-v1
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zeroblu3-neuralpoppy-ev-10970-v1/config.json
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zeroblu3-neuralpoppy-ev-10970-v1/special_tokens_map.json
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zeroblu3-neuralpoppy-ev-10970-v1/tokenizer_config.json
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zeroblu3-neuralpoppy-ev-10970-v1/tokenizer.json
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zeroblu3-neuralpoppy-ev-10970-v1/flywheel_model.0.safetensors
zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer: 
Loading 0:   0%|          | 0/291 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/291 [00:04<11:06,  2.31s/it]
Loading 0:   2%|▏         | 6/291 [00:04<02:59,  1.59it/s]
Loading 0:   4%|▍         | 13/291 [00:04<01:04,  4.30it/s]
Loading 0:   6%|▌         | 17/291 [00:05<00:44,  6.17it/s]
Loading 0:   8%|▊         | 22/291 [00:05<00:29,  9.27it/s]
Loading 0:   9%|▉         | 26/291 [00:05<00:22, 11.96it/s]
Loading 0:  11%|█         | 31/291 [00:05<00:15, 16.30it/s]
Loading 0:  12%|█▏        | 36/291 [00:05<00:12, 20.06it/s]
Loading 0:  14%|█▍        | 41/291 [00:05<00:10, 23.79it/s]
Loading 0:  15%|█▌        | 45/291 [00:05<00:09, 26.54it/s]
Loading 0:  17%|█▋        | 50/291 [00:05<00:07, 30.60it/s]
Loading 0:  19%|█▉        | 55/291 [00:05<00:06, 34.20it/s]
Loading 0:  21%|██        | 60/291 [00:06<00:10, 21.42it/s]
Loading 0:  23%|██▎       | 66/291 [00:06<00:08, 27.59it/s]
Loading 0:  24%|██▍       | 71/291 [00:06<00:07, 29.33it/s]
Loading 0:  26%|██▌       | 76/291 [00:06<00:06, 32.33it/s]
Loading 0:  28%|██▊       | 81/291 [00:06<00:06, 33.91it/s]
Loading 0:  29%|██▉       | 85/291 [00:06<00:05, 34.98it/s]
Loading 0:  31%|███       | 89/291 [00:07<00:05, 34.58it/s]
Loading 0:  32%|███▏      | 94/291 [00:07<00:05, 37.46it/s]
Loading 0:  34%|███▎      | 98/291 [00:07<00:05, 36.55it/s]
Loading 0:  35%|███▌      | 103/291 [00:07<00:04, 38.94it/s]
Loading 0:  37%|███▋      | 108/291 [00:07<00:04, 39.28it/s]
Loading 0:  39%|███▉      | 113/291 [00:07<00:04, 39.34it/s]
Loading 0:  41%|████      | 118/291 [00:07<00:04, 40.28it/s]
Loading 0:  42%|████▏     | 123/291 [00:08<00:05, 32.48it/s]
Loading 0:  45%|████▍     | 130/291 [00:08<00:04, 39.56it/s]
Loading 0:  46%|████▋     | 135/291 [00:08<00:03, 40.05it/s]
Loading 0:  48%|████▊     | 140/291 [00:08<00:03, 40.57it/s]
Loading 0:  50%|████▉     | 145/291 [00:08<00:03, 41.47it/s]
Loading 0:  52%|█████▏    | 150/291 [00:08<00:04, 34.17it/s]
Loading 0:  54%|█████▍    | 157/291 [00:08<00:03, 40.66it/s]
Loading 0:  56%|█████▌    | 162/291 [00:08<00:03, 41.10it/s]
Loading 0:  57%|█████▋    | 167/291 [00:09<00:04, 27.11it/s]
Loading 0:  59%|█████▉    | 171/291 [00:09<00:04, 29.10it/s]
Loading 0:  60%|██████    | 176/291 [00:09<00:03, 32.29it/s]
Loading 0:  62%|██████▏   | 180/291 [00:09<00:03, 33.68it/s]
Loading 0:  63%|██████▎   | 184/291 [00:09<00:03, 35.11it/s]
Loading 0:  65%|██████▍   | 188/291 [00:09<00:02, 34.72it/s]
Loading 0:  67%|██████▋   | 194/291 [00:09<00:02, 39.62it/s]
Loading 0:  68%|██████▊   | 199/291 [00:10<00:02, 41.85it/s]
Loading 0:  70%|███████   | 204/291 [00:10<00:02, 33.87it/s]
Loading 0:  73%|███████▎  | 211/291 [00:10<00:01, 41.10it/s]
Loading 0:  74%|███████▍  | 216/291 [00:10<00:01, 41.06it/s]
Loading 0:  76%|███████▌  | 221/291 [00:10<00:01, 40.53it/s]
Loading 0:  78%|███████▊  | 226/291 [00:10<00:01, 41.65it/s]
Loading 0:  79%|███████▉  | 231/291 [00:10<00:01, 34.37it/s]
Loading 0:  82%|████████▏ | 238/291 [00:11<00:01, 41.44it/s]
Loading 0:  84%|████████▎ | 243/291 [00:11<00:01, 41.37it/s]
Loading 0:  85%|████████▌ | 248/291 [00:11<00:01, 42.12it/s]
Loading 0:  87%|████████▋ | 253/291 [00:11<00:00, 42.09it/s]
Loading 0:  89%|████████▊ | 258/291 [00:11<00:00, 34.28it/s]
Loading 0:  91%|█████████ | 265/291 [00:11<00:00, 41.15it/s]
Loading 0:  93%|█████████▎| 270/291 [00:12<00:00, 28.88it/s]
Loading 0:  95%|█████████▍| 275/291 [00:12<00:00, 31.99it/s]
Loading 0:  96%|█████████▌| 280/291 [00:12<00:00, 35.33it/s]
Loading 0:  98%|█████████▊| 285/291 [00:12<00:00, 30.81it/s]
                                                            
Job zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer completed after 84.15s with status: succeeded
Stopping job with name zeroblu3-neuralpoppy-ev-10970-v1-mkmlizer
Pipeline stage MKMLizer completed in 84.64s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service zeroblu3-neuralpoppy-ev-10970-v1
Waiting for inference service zeroblu3-neuralpoppy-ev-10970-v1 to be ready
Inference service zeroblu3-neuralpoppy-ev-10970-v1 ready after 130.91404557228088s
Pipeline stage MKMLDeployer completed in 131.47s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.721970558166504s
Received healthy response to inference request in 1.2492380142211914s
Received healthy response to inference request in 1.4436566829681396s
Received healthy response to inference request in 1.4680430889129639s
Received healthy response to inference request in 1.5612168312072754s
5 requests
0 failed requests
5th percentile: 1.288121747970581
10th percentile: 1.3270054817199708
20th percentile: 1.40477294921875
30th percentile: 1.4485339641571044
40th percentile: 1.4582885265350343
50th percentile: 1.4680430889129639
60th percentile: 1.5053125858306884
70th percentile: 1.5425820827484131
80th percentile: 1.593367576599121
90th percentile: 1.6576690673828125
95th percentile: 1.6898198127746582
99th percentile: 1.7155404090881348
mean time: 1.4888250350952148
Pipeline stage StressChecker completed in 8.80s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.63s
Shutdown handler de-registered
zeroblu3-neuralpoppy-ev_10970_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2103.74s
Shutdown handler de-registered
zeroblu3-neuralpoppy-ev_10970_v1 status is now inactive due to auto deactivation removed underperforming models
zeroblu3-neuralpoppy-ev_10970_v1 status is now torndown due to DeploymentManager action