marinaraspaghetti-nemom_1739

developer_uid: Luna1040

submission_id: marinaraspaghetti-nemom_1739_v68

model_name: marinaraspaghetti-nemom_1739_v68

model_group: MarinaraSpaghetti/NemoMi

status: torndown

timestamp: 2025-02-14T07:26:07+00:00

num_battles: 5187

num_wins: 2557

celo_rating: 1254.48

family_friendly_score: 0.5676

family_friendly_standard_error: 0.007006143589736082

submission_type: basic

model_repo: MarinaraSpaghetti/NemoMix-Unleashed-12B

model_architecture: MistralForCausalLM

model_num_parameters: 12772070400.0

best_of: 8

max_input_tokens: 1024

max_output_tokens: 64

display_name: marinaraspaghetti-nemom_1739_v68

is_internal_developer: False

language_model: MarinaraSpaghetti/NemoMix-Unleashed-12B

model_size: 13B

ranking_group: single

us_pacific_date: 2025-02-13

win_ratio: 0.49296317717370347

generation_params: {'temperature': 0.77, 'top_p': 0.86, 'min_p': 0.07, 'top_k': 60, 'presence_penalty': 0.1, 'frequency_penalty': 0.1, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLizer
Starting job with name marinaraspaghetti-nemom-1739-v68-mkmlizer
Waiting for job on marinaraspaghetti-nemom-1739-v68-mkmlizer to finish
marinaraspaghetti-nemom-1739-v68-mkmlizer: Downloaded to shared memory in 33.125s
marinaraspaghetti-nemom-1739-v68-mkmlizer: quantizing model to /dev/shm/model_cache, profile:s0, folder:/tmp/tmpd0b94_pj, device:0
marinaraspaghetti-nemom-1739-v68-mkmlizer: Saving flywheel model at /dev/shm/model_cache
marinaraspaghetti-nemom-1739-v68-mkmlizer: quantized model in 38.861s
marinaraspaghetti-nemom-1739-v68-mkmlizer: Processed model MarinaraSpaghetti/NemoMix-Unleashed-12B in 71.987s
marinaraspaghetti-nemom-1739-v68-mkmlizer: creating bucket guanaco-mkml-models
marinaraspaghetti-nemom-1739-v68-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
marinaraspaghetti-nemom-1739-v68-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/marinaraspaghetti-nemom-1739-v68
marinaraspaghetti-nemom-1739-v68-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/marinaraspaghetti-nemom-1739-v68/config.json
marinaraspaghetti-nemom-1739-v68-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/marinaraspaghetti-nemom-1739-v68/special_tokens_map.json
marinaraspaghetti-nemom-1739-v68-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/marinaraspaghetti-nemom-1739-v68/tokenizer_config.json
marinaraspaghetti-nemom-1739-v68-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/marinaraspaghetti-nemom-1739-v68/tokenizer.json
marinaraspaghetti-nemom-1739-v68-mkmlizer: 
Loading 0:   0%|          | 0/363 [00:00<?, ?it/s]
Loading 0:   1%|          | 2/363 [00:06<18:44,  3.11s/it]
Loading 0:   2%|▏         | 6/363 [00:06<04:59,  1.19it/s]
Loading 0:   3%|▎         | 11/363 [00:06<02:12,  2.67it/s]
Loading 0:   4%|▍         | 15/363 [00:06<01:23,  4.14it/s]
Loading 0:   6%|▌         | 22/363 [00:06<00:44,  7.74it/s]
Loading 0:   7%|▋         | 27/363 [00:06<00:32, 10.28it/s]
Loading 0:   9%|▊         | 31/363 [00:07<00:26, 12.67it/s]
Loading 0:  10%|▉         | 35/363 [00:07<00:21, 15.20it/s]
Loading 0:  11%|█         | 40/363 [00:07<00:19, 16.52it/s]
Loading 0:  12%|█▏        | 43/363 [00:07<00:17, 17.80it/s]
Loading 0:  13%|█▎        | 49/363 [00:07<00:13, 24.01it/s]
Loading 0:  15%|█▍        | 53/363 [00:07<00:11, 25.84it/s]
Loading 0:  16%|█▌        | 58/363 [00:07<00:10, 30.03it/s]
Loading 0:  17%|█▋        | 62/363 [00:08<00:09, 30.39it/s]
Loading 0:  18%|█▊        | 67/363 [00:08<00:08, 34.41it/s]
Loading 0:  20%|█▉        | 71/363 [00:08<00:08, 33.94it/s]
Loading 0:  21%|██        | 76/363 [00:08<00:07, 37.72it/s]
Loading 0:  22%|██▏       | 81/363 [00:08<00:07, 37.89it/s]
Loading 0:  24%|██▎       | 86/363 [00:08<00:07, 39.49it/s]
Loading 0:  25%|██▌       | 91/363 [00:08<00:06, 40.50it/s]
Loading 0:  26%|██▋       | 96/363 [00:08<00:08, 31.91it/s]
Loading 0:  28%|██▊       | 101/363 [00:09<00:07, 35.85it/s]
Loading 0:  29%|██▉       | 105/363 [00:09<00:07, 33.07it/s]
Loading 0:  31%|███       | 112/363 [00:09<00:06, 40.11it/s]
Loading 0:  32%|███▏      | 117/363 [00:09<00:06, 38.68it/s]
Loading 0:  34%|███▎      | 122/363 [00:09<00:08, 28.62it/s]
Loading 0:  35%|███▍      | 126/363 [00:09<00:08, 29.18it/s]
Loading 0:  36%|███▌      | 130/363 [00:10<00:07, 30.21it/s]
Loading 0:  37%|███▋      | 134/363 [00:10<00:07, 30.07it/s]
Loading 0:  38%|███▊      | 139/363 [00:10<00:06, 32.74it/s]
Loading 0:  39%|███▉      | 143/363 [00:10<00:06, 31.93it/s]
Loading 0:  41%|████      | 148/363 [00:10<00:06, 34.83it/s]
Loading 0:  42%|████▏     | 152/363 [00:10<00:06, 33.83it/s]
Loading 0:  43%|████▎     | 157/363 [00:10<00:05, 36.83it/s]
Loading 0:  44%|████▍     | 161/363 [00:10<00:05, 35.10it/s]
Loading 0:  46%|████▌     | 166/363 [00:11<00:05, 37.71it/s]
Loading 0:  47%|████▋     | 170/363 [00:11<00:05, 35.94it/s]
Loading 0:  48%|████▊     | 175/363 [00:11<00:04, 38.47it/s]
Loading 0:  49%|████▉     | 179/363 [00:11<00:05, 36.27it/s]
Loading 0:  51%|█████     | 184/363 [00:11<00:04, 38.75it/s]
Loading 0:  52%|█████▏    | 188/363 [00:11<00:04, 36.67it/s]
Loading 0:  53%|█████▎    | 193/363 [00:11<00:04, 39.06it/s]
Loading 0:  54%|█████▍    | 197/363 [00:11<00:04, 36.19it/s]
Loading 0:  56%|█████▌    | 202/363 [00:12<00:05, 28.25it/s]
Loading 0:  57%|█████▋    | 206/363 [00:12<00:05, 28.39it/s]
Loading 0:  58%|█████▊    | 211/363 [00:12<00:04, 31.04it/s]
Loading 0:  59%|█████▉    | 215/363 [00:12<00:05, 28.94it/s]
Loading 0:  61%|██████    | 220/363 [00:12<00:04, 32.02it/s]
Loading 0:  62%|██████▏   | 224/363 [00:12<00:04, 31.67it/s]
Loading 0:  63%|██████▎   | 229/363 [00:12<00:03, 34.47it/s]
Loading 0:  64%|██████▍   | 233/363 [00:13<00:03, 33.32it/s]
Loading 0:  66%|██████▌   | 238/363 [00:13<00:03, 35.77it/s]
Loading 0:  67%|██████▋   | 242/363 [00:13<00:03, 33.92it/s]
Loading 0:  68%|██████▊   | 247/363 [00:13<00:03, 36.53it/s]
Loading 0:  69%|██████▉   | 251/363 [00:13<00:03, 34.50it/s]
Loading 0:  71%|███████   | 256/363 [00:13<00:02, 36.51it/s]
Loading 0:  72%|███████▏  | 260/363 [00:13<00:02, 34.38it/s]
Loading 0:  73%|███████▎  | 265/363 [00:13<00:02, 36.14it/s]
Loading 0:  74%|███████▍  | 269/363 [00:14<00:02, 34.04it/s]
Loading 0:  75%|███████▌  | 274/363 [00:14<00:02, 35.85it/s]
Loading 0:  77%|███████▋  | 278/363 [00:14<00:02, 33.93it/s]
Loading 0:  78%|███████▊  | 283/363 [00:14<00:03, 25.85it/s]
Loading 0:  79%|███████▉  | 286/363 [00:14<00:03, 24.88it/s]
Loading 0:  80%|████████  | 292/363 [00:14<00:02, 30.40it/s]
Loading 0:  82%|████████▏ | 296/363 [00:14<00:02, 30.24it/s]
Loading 0:  83%|████████▎ | 301/363 [00:15<00:01, 33.23it/s]
Loading 0:  84%|████████▍ | 305/363 [00:15<00:01, 32.17it/s]
Loading 0:  85%|████████▌ | 310/363 [00:15<00:01, 35.15it/s]
Loading 0:  87%|████████▋ | 314/363 [00:15<00:01, 33.74it/s]
Loading 0:  88%|████████▊ | 319/363 [00:15<00:01, 35.45it/s]
Loading 0:  89%|████████▉ | 323/363 [00:15<00:01, 33.69it/s]
Loading 0:  90%|█████████ | 328/363 [00:15<00:00, 35.60it/s]
Loading 0:  91%|█████████▏| 332/363 [00:16<00:00, 33.04it/s]
Loading 0:  93%|█████████▎| 337/363 [00:16<00:00, 35.09it/s]
Loading 0:  94%|█████████▍| 341/363 [00:16<00:00, 33.62it/s]
Loading 0:  95%|█████████▌| 346/363 [00:16<00:00, 35.96it/s]
Loading 0:  96%|█████████▋| 350/363 [00:16<00:00, 34.36it/s]
Loading 0:  98%|█████████▊| 355/363 [00:16<00:00, 36.08it/s]
Loading 0:  99%|█████████▉| 359/363 [00:16<00:00, 34.17it/s]
                                                            
Job marinaraspaghetti-nemom-1739-v68-mkmlizer completed after 194.76s with status: succeeded
Stopping job with name marinaraspaghetti-nemom-1739-v68-mkmlizer
Pipeline stage MKMLizer completed in 195.22s
run pipeline stage %s
Running pipeline stage MKMLTemplater
Pipeline stage MKMLTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage MKMLDeployer
Creating inference service marinaraspaghetti-nemom-1739-v68
Waiting for inference service marinaraspaghetti-nemom-1739-v68 to be ready
Retrying (%r) after connection broken by '%r': %s
Inference service marinaraspaghetti-nemom-1739-v68 ready after 190.7135727405548s
Pipeline stage MKMLDeployer completed in 191.21s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3375473022460938s
Received healthy response to inference request in 1.4010932445526123s
Received healthy response to inference request in 1.4895799160003662s
Received healthy response to inference request in 1.5565478801727295s
Received healthy response to inference request in 1.8472659587860107s
5 requests
0 failed requests
5th percentile: 1.418790578842163
10th percentile: 1.4364879131317139
20th percentile: 1.4718825817108154
30th percentile: 1.5029735088348388
40th percentile: 1.5297606945037843
50th percentile: 1.5565478801727295
60th percentile: 1.672835111618042
70th percentile: 1.7891223430633545
80th percentile: 1.9453222274780275
90th percentile: 2.1414347648620606
95th percentile: 2.239491033554077
99th percentile: 2.3179360485076903
mean time: 1.7264068603515625
Pipeline stage StressChecker completed in 9.88s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
run pipeline stage %s
Running pipeline stage TriggerMKMLProfilingPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage TriggerMKMLProfilingPipeline completed in 0.63s
Shutdown handler de-registered
marinaraspaghetti-nemom_1739_v68 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2686.03s
Shutdown handler de-registered
marinaraspaghetti-nemom_1739_v68 status is now inactive due to auto deactivation removed underperforming models
marinaraspaghetti-nemom_1739_v68 status is now torndown due to DeploymentManager action
marinaraspaghetti-nemom_1739_v68 status is now torndown due to DeploymentManager action
marinaraspaghetti-nemom_1739_v68 status is now torndown due to DeploymentManager action