moondriller-anarchy-sol_62890

developer_uid: fengjiayi
submission_id: moondriller-anarchy-sol_62890_v1
model_name: moondriller-anarchy-sol_62890_v1
model_group: moondriller/anarchy-sola
status: torndown
timestamp: 2025-01-23T05:30:56+00:00
num_battles: 6107
num_wins: 2628
celo_rating: 1168.85
family_friendly_score: 0.5866
family_friendly_standard_error: 0.0069642004566209895
submission_type: basic
model_repo: moondriller/anarchy-solar-10B-v1
model_architecture: LlamaForCausalLM
model_num_parameters: 10731524096.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
display_name: moondriller-anarchy-sol_62890_v1
is_internal_developer: False
language_model: moondriller/anarchy-solar-10B-v1
model_size: 11B
ranking_group: single
us_pacific_date: 2025-01-22
win_ratio: 0.430325855575569
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name moondriller-anarchy-sol-62890-v1-mkmlizer
Waiting for job on moondriller-anarchy-sol-62890-v1-mkmlizer to finish
moondriller-anarchy-sol-62890-v1-mkmlizer: ╔═════════════════════════════════════════════════════════════════════╗
moondriller-anarchy-sol-62890-v1-mkmlizer: ║     _____            __           __                                ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║    / _/ /_ ___    __/ /  ___ ___ / /                                ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║   / _/ / // / |/|/ / _ \/ -_) -_) /                                 ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  /_//_/\_, /|__,__/_//_/\__/\__/_/                                  ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║       /___/                                                         ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║                                                                     ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  Version: 0.11.12                                                   ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  Copyright 2023 MK ONE TECHNOLOGIES Inc.                            ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  https://mk1.ai                                                     ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║                                                                     ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  The license key for the current software has been verified as      ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  belonging to:                                                      ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║                                                                     ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  Chai Research Corp.                                                ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  Account ID: 7997a29f-0ceb-4cc7-9adf-840c57b4ae6f                   ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║  Expiration: 2025-04-15 23:59:59                                    ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ║                                                                     ║
moondriller-anarchy-sol-62890-v1-mkmlizer: ╚═════════════════════════════════════════════════════════════════════╝
moondriller-anarchy-sol-62890-v1-mkmlizer: Downloaded to shared memory in 41.394s
moondriller-anarchy-sol-62890-v1-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpxekk23ty, device:0
moondriller-anarchy-sol-62890-v1-mkmlizer: Saving flywheel model at /dev/shm/model_cache
moondriller-anarchy-sol-62890-v1-mkmlizer: quantized model in 24.506s
moondriller-anarchy-sol-62890-v1-mkmlizer: Processed model moondriller/anarchy-solar-10B-v1 in 65.900s
moondriller-anarchy-sol-62890-v1-mkmlizer: creating bucket guanaco-mkml-models
moondriller-anarchy-sol-62890-v1-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
moondriller-anarchy-sol-62890-v1-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/moondriller-anarchy-sol-62890-v1
moondriller-anarchy-sol-62890-v1-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/moondriller-anarchy-sol-62890-v1/config.json
moondriller-anarchy-sol-62890-v1-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/moondriller-anarchy-sol-62890-v1/special_tokens_map.json
moondriller-anarchy-sol-62890-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/moondriller-anarchy-sol-62890-v1/tokenizer_config.json
moondriller-anarchy-sol-62890-v1-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/moondriller-anarchy-sol-62890-v1/tokenizer.json
moondriller-anarchy-sol-62890-v1-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/moondriller-anarchy-sol-62890-v1/flywheel_model.0.safetensors
moondriller-anarchy-sol-62890-v1-mkmlizer: 
Loading 0:   0%|          | 0/435 [00:00<?, ?it/s]
Loading 0:   1%|          | 5/435 [00:00<00:12, 33.55it/s]
Loading 0:   3%|▎         | 13/435 [00:00<00:08, 52.19it/s]
Loading 0:   4%|▍         | 19/435 [00:00<00:08, 47.27it/s]
Loading 0:   6%|▌         | 24/435 [00:00<00:08, 47.16it/s]
Loading 0:   7%|▋         | 29/435 [00:00<00:10, 40.54it/s]
Loading 0:   9%|▊         | 37/435 [00:00<00:07, 50.37it/s]
Loading 0:  10%|▉         | 43/435 [00:00<00:08, 45.81it/s]
Loading 0:  11%|█         | 48/435 [00:01<00:08, 45.98it/s]
Loading 0:  13%|█▎        | 55/435 [00:01<00:07, 51.73it/s]
Loading 0:  14%|█▍        | 61/435 [00:01<00:07, 49.04it/s]
Loading 0:  15%|█▌        | 67/435 [00:01<00:07, 50.31it/s]
Loading 0:  17%|█▋        | 74/435 [00:01<00:07, 46.57it/s]
Loading 0:  19%|█▉        | 82/435 [00:01<00:06, 53.77it/s]
Loading 0:  20%|██        | 88/435 [00:01<00:07, 48.37it/s]
Loading 0:  22%|██▏       | 94/435 [00:01<00:06, 49.69it/s]
Loading 0:  23%|██▎       | 100/435 [00:02<00:08, 38.47it/s]
Loading 0:  24%|██▍       | 105/435 [00:02<00:08, 39.08it/s]
Loading 0:  26%|██▌       | 112/435 [00:02<00:07, 44.77it/s]
Loading 0:  27%|██▋       | 118/435 [00:02<00:07, 43.95it/s]
Loading 0:  28%|██▊       | 123/435 [00:02<00:07, 41.94it/s]
Loading 0:  30%|██▉       | 129/435 [00:02<00:06, 45.32it/s]
Loading 0:  31%|███       | 134/435 [00:02<00:06, 44.59it/s]
Loading 0:  32%|███▏      | 139/435 [00:03<00:06, 44.51it/s]
Loading 0:  33%|███▎      | 145/435 [00:03<00:06, 42.75it/s]
Loading 0:  34%|███▍      | 150/435 [00:03<00:06, 42.73it/s]
Loading 0:  36%|███▌      | 157/435 [00:03<00:05, 47.52it/s]
Loading 0:  37%|███▋      | 163/435 [00:03<00:06, 44.27it/s]
Loading 0:  39%|███▊      | 168/435 [00:03<00:05, 44.82it/s]
Loading 0:  40%|████      | 175/435 [00:03<00:05, 49.31it/s]
Loading 0:  42%|████▏     | 181/435 [00:03<00:05, 44.04it/s]
Loading 0:  43%|████▎     | 186/435 [00:04<00:05, 41.92it/s]
Loading 0:  44%|████▍     | 192/435 [00:04<00:05, 45.58it/s]
Loading 0:  45%|████▌     | 197/435 [00:04<00:05, 44.17it/s]
Loading 0:  47%|████▋     | 203/435 [00:04<00:05, 41.98it/s]
Loading 0:  48%|████▊     | 208/435 [00:04<00:07, 29.24it/s]
Loading 0:  49%|████▊     | 212/435 [00:04<00:07, 29.34it/s]
Loading 0:  51%|█████     | 220/435 [00:05<00:05, 38.24it/s]
Loading 0:  52%|█████▏    | 226/435 [00:05<00:05, 37.85it/s]
Loading 0:  53%|█████▎    | 231/435 [00:05<00:05, 38.04it/s]
Loading 0:  55%|█████▍    | 238/435 [00:05<00:04, 43.74it/s]
Loading 0:  56%|█████▌    | 243/435 [00:05<00:04, 44.51it/s]
Loading 0:  57%|█████▋    | 248/435 [00:05<00:04, 37.93it/s]
Loading 0:  59%|█████▊    | 255/435 [00:05<00:04, 44.96it/s]
Loading 0:  60%|█████▉    | 260/435 [00:05<00:03, 44.25it/s]
Loading 0:  61%|██████    | 265/435 [00:06<00:03, 44.85it/s]
Loading 0:  62%|██████▏   | 270/435 [00:06<00:03, 45.41it/s]
Loading 0:  63%|██████▎   | 275/435 [00:06<00:04, 37.11it/s]
Loading 0:  65%|██████▌   | 283/435 [00:06<00:03, 46.18it/s]
Loading 0:  66%|██████▋   | 289/435 [00:06<00:03, 42.19it/s]
Loading 0:  68%|██████▊   | 294/435 [00:06<00:03, 41.18it/s]
Loading 0:  69%|██████▊   | 299/435 [00:06<00:03, 41.97it/s]
Loading 0:  70%|██████▉   | 304/435 [00:07<00:04, 31.14it/s]
Loading 0:  71%|███████   | 308/435 [00:07<00:04, 31.11it/s]
Loading 0:  72%|███████▏  | 312/435 [00:07<00:03, 31.08it/s]
Loading 0:  73%|███████▎  | 318/435 [00:07<00:03, 37.40it/s]
Loading 0:  74%|███████▍  | 323/435 [00:07<00:02, 39.62it/s]
Loading 0:  75%|███████▌  | 328/435 [00:07<00:02, 40.91it/s]
Loading 0:  77%|███████▋  | 333/435 [00:07<00:02, 43.20it/s]
Loading 0:  78%|███████▊  | 338/435 [00:08<00:02, 36.19it/s]
Loading 0:  79%|███████▉  | 345/435 [00:08<00:02, 42.24it/s]
Loading 0:  80%|████████  | 350/435 [00:08<00:02, 41.98it/s]
Loading 0:  82%|████████▏ | 355/435 [00:08<00:01, 43.65it/s]
Loading 0:  83%|████████▎ | 360/435 [00:08<00:01, 44.74it/s]
Loading 0:  84%|████████▍ | 365/435 [00:08<00:01, 36.26it/s]
Loading 0:  86%|████████▌ | 372/435 [00:08<00:01, 43.73it/s]
Loading 0:  87%|████████▋ | 377/435 [00:08<00:01, 43.36it/s]
Loading 0:  88%|████████▊ | 382/435 [00:09<00:01, 43.48it/s]
Loading 0:  89%|████████▉ | 387/435 [00:09<00:01, 44.53it/s]
Loading 0:  90%|█████████ | 392/435 [00:09<00:01, 37.31it/s]
Loading 0:  91%|█████████▏| 398/435 [00:09<00:00, 42.15it/s]
Loading 0:  93%|█████████▎| 403/435 [00:09<00:00, 37.45it/s]
Loading 0:  94%|█████████▍| 408/435 [00:11<00:02,  9.67it/s]
Loading 0:  94%|█████████▍| 411/435 [00:11<00:02, 10.94it/s]
Loading 0:  96%|█████████▌| 418/435 [00:11<00:01, 16.32it/s]
Loading 0:  97%|█████████▋| 422/435 [00:11<00:00, 18.83it/s]
Loading 0:  98%|█████████▊| 427/435 [00:11<00:00, 23.22it/s]
Loading 0:  99%|█████████▉| 432/435 [00:11<00:00, 27.05it/s]
                                                            
Job moondriller-anarchy-sol-62890-v1-mkmlizer completed after 187.83s with status: succeeded
Stopping job with name moondriller-anarchy-sol-62890-v1-mkmlizer
Pipeline stage MKMLizer completed in 188.30s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service moondriller-anarchy-sol-62890-v1
Waiting for inference service moondriller-anarchy-sol-62890-v1 to be ready
Inference service moondriller-anarchy-sol-62890-v1 ready after 140.77389097213745s
Pipeline stage MKMLDeployer completed in 141.80s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.704329490661621s
Received healthy response to inference request in 1.6253008842468262s
Received healthy response to inference request in 1.8468797206878662s
Received healthy response to inference request in 1.6577825546264648s
Received healthy response to inference request in 1.6841557025909424s
5 requests
0 failed requests
5th percentile: 1.6317972183227538
10th percentile: 1.6382935523986817
20th percentile: 1.6512862205505372
30th percentile: 1.6630571842193604
40th percentile: 1.6736064434051514
50th percentile: 1.6841557025909424
60th percentile: 1.6922252178192139
70th percentile: 1.7002947330474854
80th percentile: 1.73283953666687
90th percentile: 1.7898596286773683
95th percentile: 1.8183696746826172
99th percentile: 1.8411777114868164
mean time: 1.7036896705627442
Pipeline stage StressChecker completed in 9.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.67s
Shutdown handler de-registered
moondriller-anarchy-sol_62890_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2461.82s
Shutdown handler de-registered
moondriller-anarchy-sol_62890_v1 status is now inactive due to auto deactivation removed underperforming models
moondriller-anarchy-sol_62890_v1 status is now torndown due to DeploymentManager action