zonemercy-graft-cogent-v_7573

submission_id: zonemercy-graft-cogent-v_7573_v6

developer_uid: zonemercy

alignment_samples: 30214

alignment_score: 4.302452509421002

best_of: 16

celo_rating: 1301.46

display_name: 0815v1-7

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}

gpu_counts: {'NVIDIA RTX A5000': 1}

is_internal_developer: True

language_model: zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1

latencies: [{'batch_size': 1, 'throughput': 0.6421741936343291, 'latency_mean': 1.557147386074066, 'latency_p50': 1.5470473766326904, 'latency_p90': 1.744460153579712}, {'batch_size': 2, 'throughput': 0.8561915135385708, 'latency_mean': 2.3274331212043764, 'latency_p50': 2.340199828147888, 'latency_p90': 2.558147358894348}, {'batch_size': 3, 'throughput': 0.9447686154215496, 'latency_mean': 3.166335371732712, 'latency_p50': 3.1889748573303223, 'latency_p90': 3.5797492027282716}, {'batch_size': 4, 'throughput': 0.9248492969011531, 'latency_mean': 4.312939705848694, 'latency_p50': 4.340110540390015, 'latency_p90': 4.762362933158874}, {'batch_size': 5, 'throughput': 0.9022565762216171, 'latency_mean': 5.5194861495494845, 'latency_p50': 5.562889575958252, 'latency_p90': 6.28474178314209}]

max_input_tokens: 512

max_output_tokens: 64

model_architecture: MistralForCausalLM

model_group: zonemercy/Graft-Cogent-v

model_name: 0815v1-7

model_num_parameters: 12772070400.0

model_repo: zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1

model_size: 13B

num_battles: 30214

num_wins: 17392

propriety_score: 0.7094811018577835

propriety_total_count: 3122.0

ranking_group: single

status: torndown

submission_type: basic

throughput_3p7s: 0.94

timestamp: 2024-08-15T18:20:08+00:00

us_pacific_date: 2024-08-15

win_ratio: 0.5756271926921295

Download Preferencedata

Resubmit model

Reference Models

Running pipeline stage MKMLizer
Starting job with name zonemercy-graft-cogent-v-7573-v6-mkmlizer
Waiting for job on zonemercy-graft-cogent-v-7573-v6-mkmlizer to finish
Stopping job with name zonemercy-graft-cogent-v-7573-v6-mkmlizer
%s, retrying in %s seconds...
Starting job with name zonemercy-graft-cogent-v-7573-v6-mkmlizer
Waiting for job on zonemercy-graft-cogent-v-7573-v6-mkmlizer to finish
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
zonemercy-graft-cogent-v-7573-v6-mkmlizer: quantized model in 41.375s
zonemercy-graft-cogent-v-7573-v6-mkmlizer: Processed model zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1 in 106.222s
zonemercy-graft-cogent-v-7573-v6-mkmlizer: creating bucket guanaco-mkml-models
zonemercy-graft-cogent-v-7573-v6-mkmlizer: Bucket 's3://guanaco-mkml-models/' created
zonemercy-graft-cogent-v-7573-v6-mkmlizer: uploading /dev/shm/model_cache to s3://guanaco-mkml-models/zonemercy-graft-cogent-v-7573-v6
zonemercy-graft-cogent-v-7573-v6-mkmlizer: cp /dev/shm/model_cache/config.json s3://guanaco-mkml-models/zonemercy-graft-cogent-v-7573-v6/config.json
zonemercy-graft-cogent-v-7573-v6-mkmlizer: cp /dev/shm/model_cache/special_tokens_map.json s3://guanaco-mkml-models/zonemercy-graft-cogent-v-7573-v6/special_tokens_map.json
zonemercy-graft-cogent-v-7573-v6-mkmlizer: cp /dev/shm/model_cache/tokenizer_config.json s3://guanaco-mkml-models/zonemercy-graft-cogent-v-7573-v6/tokenizer_config.json
zonemercy-graft-cogent-v-7573-v6-mkmlizer: cp /dev/shm/model_cache/tokenizer.json s3://guanaco-mkml-models/zonemercy-graft-cogent-v-7573-v6/tokenizer.json
zonemercy-graft-cogent-v-7573-v6-mkmlizer: cp /dev/shm/model_cache/flywheel_model.0.safetensors s3://guanaco-mkml-models/zonemercy-graft-cogent-v-7573-v6/flywheel_model.0.safetensors
Job zonemercy-graft-cogent-v-7573-v6-mkmlizer completed after 135.8s with status: succeeded
Stopping job with name zonemercy-graft-cogent-v-7573-v6-mkmlizer
Pipeline stage MKMLizer completed in 137.16s
Running pipeline stage MKMLKubeTemplater
Pipeline stage MKMLKubeTemplater completed in 0.09s
Running pipeline stage ISVCDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6
Waiting for inference service zonemercy-graft-cogent-v-7573-v6 to be ready
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Failed to get response for submission function_fahor_2024-08-15: no entry with id "function_fahor_2024-08-15" found on database!
Inference service zonemercy-graft-cogent-v-7573-v6 ready after 231.73025107383728s
Pipeline stage ISVCDeployer completed in 233.13s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.373199701309204s
Received healthy response to inference request in 2.1309714317321777s
Received healthy response to inference request in 2.117873430252075s
Received healthy response to inference request in 3.50740122795105s
Received healthy response to inference request in 3.640125274658203s
5 requests
0 failed requests
5th percentile: 2.120493030548096
10th percentile: 2.1231126308441164
20th percentile: 2.128351831436157
30th percentile: 2.179417085647583
40th percentile: 2.2763083934783936
50th percentile: 2.373199701309204
60th percentile: 2.8268803119659425
70th percentile: 3.2805609226226804
80th percentile: 3.5339460372924805
90th percentile: 3.587035655975342
95th percentile: 3.6135804653167725
99th percentile: 3.634816312789917
mean time: 2.753914213180542
Pipeline stage StressChecker completed in 14.42s
zonemercy-graft-cogent-v_7573_v6 status is now deployed due to DeploymentManager action
zonemercy-graft-cogent-v_7573_v6 status is now inactive due to admin request
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.29s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLProfilerTemplater completed in 0.32s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Ignoring service zonemercy-graft-cogent-v-7573-v6-profiler already deployed
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLProfilerTemplater completed in 0.19s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.13s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 140.331396818161s
Pipeline stage MKMLProfilerDeployer completed in 140.80s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplol596d:/code/chaiverse_profiler_1725330374 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplol596d --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725330374 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725330374/summary.json'
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Skipping teardown as no inference service was found
Pipeline stage MKMLProfilerDeleter completed in 1.43s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.12s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 150.36288213729858s
Pipeline stage MKMLProfilerDeployer completed in 150.95s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo5kpqj:/code/chaiverse_profiler_1725333423 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo5kpqj --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725333423 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725333423/summary.json'
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo5kpqj --namespace tenant-chaiml-guanaco -- bash -c 'cat /code/chaiverse_profiler_1725333423/summary.json'
Pipeline stage MKMLProfilerRunner completed in 546.16s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
Service zonemercy-graft-cogent-v-7573-v6-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 1.51s
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Skipping teardown as no inference service was found
Pipeline stage MKMLProfilerDeleter completed in 1.53s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.18s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 150.50301241874695s
Pipeline stage MKMLProfilerDeployer completed in 150.95s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deploh9fbj:/code/chaiverse_profiler_1725346997 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deploh9fbj --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725346997 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725346997/summary.json'
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deploh9fbj --namespace tenant-chaiml-guanaco -- bash -c 'cat /code/chaiverse_profiler_1725346997/summary.json'
Pipeline stage MKMLProfilerRunner completed in 540.04s
cleanup pipeline after completion
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
Service zonemercy-graft-cogent-v-7573-v6-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 1.54s
registered shutdown handler
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Skipping teardown as no inference service was found
Pipeline stage MKMLProfilerDeleter completed in 2.54s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.37s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
running shutdown handler
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
running shutdown handler
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
running shutdown handler
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
clean up pipeline due to error=%s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
running shutdown handler
running shutdown handler
running shutdown handler
running shutdown handler
running shutdown handler
running shutdown handler
running shutdown handler
running shutdown handler
running shutdown handler
%s, retrying in %s seconds...
running shutdown handler
running shutdown handler
de-registered shutdown handler
running shutdown handler
registered shutdown handler
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.46s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.38s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
running shutdown handler
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
running shutdown handler
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
%s, retrying in %s seconds...
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
running shutdown handler
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
running shutdown handler
clean up pipeline due to error=%s
running shutdown handler
running shutdown handler
de-registered shutdown handler
running shutdown handler
registered shutdown handler
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.48s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.36s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.48s
de-registered shutdown handler
registered shutdown handler
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.51s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.39s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Ignoring service zonemercy-graft-cogent-v-7573-v6-profiler already deployed
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.53s
de-registered shutdown handler
registered shutdown handler
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage MKMLProfilerDeleter completed in 0.54s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.44s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 152.07526206970215s
Pipeline stage MKMLProfilerDeployer completed in 153.60s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo2xcbg:/code/chaiverse_profiler_1725379349 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo2xcbg --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725379349 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725379349/summary.json'
%s, retrying in %s seconds...
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo2xcbg:/code/chaiverse_profiler_1725380126 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo2xcbg --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725380126 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725380126/summary.json'
%s, retrying in %s seconds...
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo2xcbg:/code/chaiverse_profiler_1725380906 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo2xcbg --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725380906 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725380906/summary.json'
clean up pipeline due to error=%s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
running shutdown handler
run pipeline stage %s
running shutdown handler
running shutdown handler
running shutdown handler
running shutdown handler
running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
running shutdown handler
running shutdown handler
running shutdown handler
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
Service zonemercy-graft-cogent-v-7573-v6-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 3.01s
de-registered shutdown handler
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Skipping teardown as no inference service was found
Pipeline stage MKMLProfilerDeleter completed in 2.67s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.40s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 152.108225107193s
Pipeline stage MKMLProfilerDeployer completed in 153.45s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplonnk4l:/code/chaiverse_profiler_1725381629 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplonnk4l --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725381629 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 30 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725381629/summary.json'
%s, retrying in %s seconds...
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplonnk4l:/code/chaiverse_profiler_1725381750 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplonnk4l --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725381750 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 30 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725381750/summary.json'
%s, retrying in %s seconds...
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplonnk4l:/code/chaiverse_profiler_1725381878 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplonnk4l --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725381878 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 30 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725381878/summary.json'
clean up pipeline due to error=%s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
Service zonemercy-graft-cogent-v-7573-v6-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 3.57s
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 141.99562692642212s
Pipeline stage MKMLProfilerDeployer completed in 143.44s
cleanup pipeline after completion
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
Service zonemercy-graft-cogent-v-7573-v6-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 3.34s
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 151.39781522750854s
Pipeline stage MKMLProfilerDeployer completed in 152.72s
cleanup pipeline after completion
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8:/code/chaiverse_profiler_1725385346 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8 --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725385346 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 30 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725385346/summary.json'
%s, retrying in %s seconds...
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8:/code/chaiverse_profiler_1725385467 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8 --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725385467 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 30 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725385467/summary.json'
%s, retrying in %s seconds...
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8:/code/chaiverse_profiler_1725385589 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8 --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725385589 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 30 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725385589/summary.json'
clean up pipeline due to error=%s
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8:/code/chaiverse_profiler_1725386362 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8 --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725386362 && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 30 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725386362/summary.json'
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo89gq8 --namespace tenant-chaiml-guanaco -- bash -c 'cat /code/chaiverse_profiler_1725386362/summary.json'
Pipeline stage MKMLProfilerRunner completed in 185.32s
cleanup pipeline after completion
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
Service zonemercy-graft-cogent-v-7573-v6-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 2.83s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.22s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 60.15566611289978s
Pipeline stage MKMLProfilerDeployer completed in 60.75s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo7s775:/code/chaiverse_profiler_1725389646 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo7s775 --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725389646 && chmod +x profiles.py && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725389646/summary.json'
registered shutdown handler
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo7s775:/code/chaiverse_profiler_1725390975 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo7s775 --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725390975 && python profiles.py profile --best_of_n 16 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725390975/summary.json'
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplo7s775 --namespace tenant-chaiml-guanaco -- bash -c 'cat /code/chaiverse_profiler_1725390975/summary.json'
Pipeline stage MKMLProfilerRunner completed in 557.99s
de-registered shutdown handler
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
Service zonemercy-graft-cogent-v-7573-v6-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 2.07s
run pipeline stage %s
Running pipeline stage MKMLProfilerTemplater
Pipeline stage MKMLProfilerTemplater completed in 0.23s
run pipeline stage %s
Running pipeline stage MKMLProfilerDeployer
Creating inference service zonemercy-graft-cogent-v-7573-v6-profiler
Waiting for inference service zonemercy-graft-cogent-v-7573-v6-profiler to be ready
Inference service zonemercy-graft-cogent-v-7573-v6-profiler ready after 120.27559208869934s
Pipeline stage MKMLProfilerDeployer completed in 120.88s
run pipeline stage %s
Running pipeline stage MKMLProfilerRunner
kubectl cp /code/guanaco/guanaco_inference_services/src/inference_scripts tenant-chaiml-guanaco/zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplox8nzn:/code/chaiverse_profiler_1725394278 --namespace tenant-chaiml-guanaco
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplox8nzn --namespace tenant-chaiml-guanaco -- sh -c 'cd /code/chaiverse_profiler_1725394278 && python profiles.py profile --best_of_n 16 --auto_batch 5 --batches 1,5,10,15,20,25,30,35,40,45,50,55,60,65,70,75,80,85,90,95,100,105,110,115,120,125,130,135,140,145,150,155,160,165,170,175,180,185,190,195 --samples 200 --input_tokens 512 --output_tokens 64 --summary /code/chaiverse_profiler_1725394278/summary.json'
kubectl exec -it zonemercy-graft-cogec2dfe602ddb31128a52549ddca4577a9-deplox8nzn --namespace tenant-chaiml-guanaco -- bash -c 'cat /code/chaiverse_profiler_1725394278/summary.json'
Pipeline stage MKMLProfilerRunner completed in 1200.36s
cleanup pipeline after completion
run pipeline stage %s
Running pipeline stage MKMLProfilerDeleter
Checking if service zonemercy-graft-cogent-v-7573-v6-profiler is running
Tearing down inference service zonemercy-graft-cogent-v-7573-v6-profiler
Service zonemercy-graft-cogent-v-7573-v6-profiler has been torndown
Pipeline stage MKMLProfilerDeleter completed in 1.74s
zonemercy-virgo-edit-v2-1e5_v2 status is now torndown due to DeploymentManager action
zonemercy-graft-cogent-v_7573_v6 status is now torndown due to DeploymentManager action

Start Time:

End Time:

Step (in hours or minutes, e.g. 1h, 10m):

Usage Metrics

Latency Metrics

Model Developer	Developer Rank	Model Rank	Model Rank By Developer	Elo Rating	Elo Rating By Developer	Alignment Score	Alignment Samples	User Alignment Score	User Alignment Question Responses	Submission ID	Parameters	Huggingface Repository	Variant	Number of Battles	Number of Battles By Developer	Win Ratio	Win Ratio By Developer	Type	Best of	Max Input Tokens	Max Output Tokens	Model Architecture	Model Group	Date	Overall Norm	Elo Norm	Alignment Norm	User Alignment Norm	Alt Ranking	Alt Ranking By Developer	Elo Rank	Alignment Rank	Ranking Group	Thoughput	GPU Counts
zonemercy	1	1.0	1.0	1301.46	1301.46	4.3	30214	0.71	3122.0	zonemercy-graft-cogent-v_7573_v6	13B	zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1	0815v1-7	30214	52673225	0.58	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-v	2024-08-15	1.98	2.12	1.72	0.22	2.0	1.0	2.0	41.0	single	0.94	{'NVIDIA RTX A5000': 1}
zonemercy	1	2.0	1.0	1273.7	1301.46	6.07	12026	0.67	1150.0	zonemercy-graft-cogent-v_7573_v2	13B	zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1	zonemercy-graft-cogent-v_7573_v2	12026	52673225	0.58	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-v	2024-08-14	1.87	1.54	2.5	-0.0	4.0	1.0	36.5	10.0	single
zonemercy	1	3.0	1.0	1292.84	1301.46	4.33	30926	0.73	3160.0	zonemercy-cogent-nemo-v1_3266_v8	13B	zonemercy/Cogent-Nemo-v1-1k1e5	0815v1-3	30926	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v1	2024-08-15	1.87	1.94	1.73	0.32	1.0	1.0	4.0	38.0	single	0.95	{'NVIDIA RTX A5000': 1}
zonemercy	1	4.0	1.0	1294.81	1301.46	4.09	11643	0.75	1177.0	zonemercy-cogent-nemo-v2-5e6_v13	13B	zonemercy/Cogent-Nemo-v2-5e6	0815v1-0	11643	52673225	0.57	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v2	2024-08-15	1.86	1.98	1.63	0.42	5.0	1.0	3.0	46.0	single
zonemercy	1	5.0	1.0	1270.86	1301.46	6.18	12379	0.68	1334.0	zonemercy-graft-cogent-v_7573_v5	13B	zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1	zonemercy-graft-cogent-v_7573_v5	12379	52673225	0.56	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-v	2024-08-14	1.85	1.48	2.55	0.04	11.0	1.0	54.0	8.0	single
zonemercy	1	6.0	1.0	1285.61	1301.46	4.44	30852	0.72	3156.0	zonemercy-graft-cogent-n_9815_v2	13B	zonemercy/Graft-Cogent-Nemo-v2.1-5e6	0815v1-8	30852	52673225	0.55	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-N	2024-08-15	1.79	1.79	1.78	0.27	3.0	1.0	12.0	33.0	single
zonemercy	1	7.0	1.0	1284.56	1301.46	4.42	28821	0.71	2895.0	zonemercy-graft-cogent-n_9815_v5	13B	zonemercy/Graft-Cogent-Nemo-v2.1-5e6	0815v1-3	28821	52673225	0.55	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-N	2024-08-15	1.77	1.77	1.78	0.23	6.0	1.0	15.0	36.0	single
zonemercy	1	8.0	1.0	1269.88	1301.46	5.73	10662	0.68	1236.0	zonemercy-graft-cogent-v_7573_v4	13B	zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1	zonemercy-graft-cogent-v_7573_v4	10662	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-v	2024-08-14	1.77	1.46	2.35	0.05	17.0	1.0	66.0	15.0	single
zonemercy	1	9.0	1.0	1269.02	1301.46	5.73	11079	0.7	1211.0	zonemercy-graft-cogent-v_7573_v3	13B	zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1	zonemercy-graft-cogent-v_7573_v3	11079	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-v	2024-08-14	1.76	1.44	2.35	0.19	19.0	1.0	70.0	14.0	single
zonemercy	1	10.0	1.0	1290.49	1301.46	3.68	10195	0.7	912.0	zonemercy-graft-cogent-v_7573_v7	13B	zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1	0815v1-7	10195	52673225	0.57	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-v	2024-08-21	1.74	1.89	1.45	0.16	13.0	1.0	7.0	60.0	single
zonemercy	1	11.0	1.0	1284.52	1301.46	4.17	9822	0.72	899.0	zonemercy-cogent-nemo-v2-5e6_v14	13B	zonemercy/Cogent-Nemo-v2-5e6	0815v1-1	9822	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v2	2024-08-15	1.73	1.76	1.66	0.27	8.0	1.0	16.0	43.0	single
zonemercy	1	12.0	1.0	1278.53	1301.46	4.58	9715	0.68	893.0	zonemercy-lexical-nemo-_1518_v20	13B	zonemercy/Lexical-Nemo-v4-1k1e5	0815v2-0	9715	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemo-v	2024-08-15	1.71	1.64	1.84	0.06	7.0	1.0	27.0	28.0	single
zonemercy	1	13.0	1.0	1280.15	1301.46	4.34	16560	0.7	1711.0	zonemercy-cogent-nemo-v2-5e6_v15	13B	zonemercy/Cogent-Nemo-v2-5e6	0815v1-2	16560	52673225	0.55	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v2	2024-08-15	1.7	1.67	1.74	0.16	11.0	1.0	25.0	37.0	single
zonemercy	1	14.0	1.0	1264.13	1301.46	5.71	13378	0.72	1224.0	zonemercy-cogent-nemo-v1_3266_v6	13B	zonemercy/Cogent-Nemo-v1-1k1e5	zonemercy-cogent-nemo-v1_3266_v6	13378	52673225	0.56	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v1	2024-08-14	1.69	1.34	2.34	0.3	25.5	1.0	129.0	16.0	single
zonemercy	1	15.0	1.0	1277.75	1301.46	4.44	9736	0.71	904.0	zonemercy-acute-nemo-v1-_4488_v7	13B	zonemercy/Acute-Nemo-v1-1e5ep1	0815v1-2	9736	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Acute-Nemo-v1-	2024-08-15	1.68	1.62	1.78	0.22	11.0	1.0	28.0	34.0	single
zonemercy	1	16.0	1.0	1256.9	1301.46	6.24	11538	0.7	1049.0	zonemercy-cogent-nemo-v1_4327_v4	13B	zonemercy/Cogent-Nemo-v1-1k1e5-ep1	zonemercy-cogent-nemo-v1_4327_v4	11538	52673225	0.54	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v1	2024-08-10	1.67	1.18	2.57	0.15	39.5	1.0	264.0	7.0	single
zonemercy	1	17.0	1.0	1276.0	1301.46	4.51	9384	0.73	953.0	zonemercy-lexical-nemov8_5966_v4	13B	zonemercy/Lexical-Nemov8-1k1e5	0815v2-1	9384	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemov8	2024-08-15	1.67	1.59	1.81	0.33	9.0	1.0	31.0	30.0	single
zonemercy	1	18.0	1.0	1271.01	1301.46	4.88	11842	0.67	1121.0	zonemercy-graft-cogent-v_7573_v1	13B	zonemercy/Graft-Cogent-v1-Acute-Nemo-v0-5e6ep1	0814v1-5	11842	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-v	2024-08-14	1.65	1.48	1.98	0.02	14.0	1.0	51.0	24.0	single
zonemercy	1	19.0	1.0	1261.43	1301.46	5.68	13593	0.74	1206.0	zonemercy-cogent-nemo-v1_4327_v5	13B	zonemercy/Cogent-Nemo-v1-1k1e5-ep1	zonemercy-cogent-nemo-v1_4327_v5	13593	52673225	0.55	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v1	2024-08-14	1.65	1.28	2.33	0.37	34.0	1.0	173.0	17.0	single
zonemercy	1	20.0	1.0	1280.76	1301.46	3.94	10939	0.75	985.0	zonemercy-lexical-nemov8_5966_v6	13B	zonemercy/Lexical-Nemov8-1k1e5	0815v2-3	10939	52673225	0.57	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemov8	2024-08-16	1.64	1.69	1.56	0.43	15.0	1.0	22.0	54.0	single
zonemercy	1	21.0	1.0	1272.13	1301.46	4.46	16913	0.73	1699.0	zonemercy-graft-cogent-n_9815_v9	13B	zonemercy/Graft-Cogent-Nemo-v2.1-5e6	0815v1-3	16913	52673225	0.54	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-N	2024-08-15	1.6	1.5	1.79	0.34	16.0	1.0	45.5	32.0	single
zonemercy	1	22.0	1.0	1253.1	1301.46	6.09	9499	0.71	1087.0	zonemercy-acute-nemo-v1-_4488_v3	13B	zonemercy/Acute-Nemo-v1-1e5ep1	zonemercy-acute-nemo-v1-_4488_v3	9499	52673225	0.54	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Acute-Nemo-v1-	2024-08-14	1.6	1.1	2.51	0.24	53.0	1.0	382.0	9.0	single
zonemercy	1	23.0	1.0	1270.37	1301.46	4.44	9935	0.72	1002.0	zonemercy-acute-nemo-v1-_4488_v6	13B	zonemercy/Acute-Nemo-v1-1e5ep1	0815v1-1	9935	52673225	0.55	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Acute-Nemo-v1-	2024-08-15	1.58	1.47	1.78	0.29	21.0	1.0	59.0	35.0	single
zonemercy	1	24.0	1.0	1273.46	1301.46	4.12	10476	0.7	958.0	zonemercy-lexical-nemo-_1518_v21	13B	zonemercy/Lexical-Nemo-v4-1k1e5	0815v2-0	10476	52673225	0.55	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemo-v	2024-08-16	1.57	1.53	1.64	0.15	18.0	1.0	38.0	45.0	single
zonemercy	1	25.0	1.0	1277.43	1301.46	3.74	10445	0.76	907.0	zonemercy-lexical-nemo-_1518_v22	13B	zonemercy/Lexical-Nemo-v4-1k1e5	0815v2-2	10445	52673225	0.56	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemo-v	2024-08-16	1.57	1.62	1.47	0.48	20.0	1.0	29.0	58.0	single
zonemercy	1	26.0	1.0	1268.9	1301.46	4.47	9890	0.73	1015.0	zonemercy-lexical-nemov8_5966_v8	13B	zonemercy/Lexical-Nemov8-1k1e5	0815v2-1	9890	52673225	0.55	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemov8	2024-08-21	1.56	1.44	1.79	0.33	22.0	1.0	72.5	31.0	single
zonemercy	1	27.0	1.0	1256.33	1301.46	5.55	9360	0.69	891.0	zonemercy-cogent-nemo-v1_3266_v7	13B	zonemercy/Cogent-Nemo-v1-1k1e5	0814v1-7	9360	52673225	0.54	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v1	2024-08-14	1.56	1.17	2.27	0.1	42.0	1.0	284.5	20.0	single
zonemercy	1	28.0	1.0	1248.17	1301.46	6.26	165840	0.73	16061.0	zonemercy-lexical-nemov8_5966_v1	13B	zonemercy/Lexical-Nemov8-1k1e5	0805v2-4	175556	52673225	0.54	0.64	basic	4.0	1024.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemov8	2024-08-05	1.55	1.0	2.58	0.32	75.0	1.0	521.5	6.0	single
zonemercy	1	29.0	1.0	1269.66	1301.46	4.31	10233	0.73	960.0	zonemercy-graft-virgo-v1_3528_v1	13B	zonemercy/Graft-Virgo-v1-Acute-v1	zonemercy-graft-virgo-v1_3528_v1	10233	52673225	0.55	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Graft-Virgo-v1	2024-08-21	1.55	1.45	1.73	0.33	24.0	1.0	67.5	40.0	single
zonemercy	1	30.0	1.0	1270.72	1301.46	4.03	10540	0.74	966.0	zonemercy-lexical-nemov8_5966_v5	13B	zonemercy/Lexical-Nemov8-1k1e5	0815v2-1	10540	52673225	0.55	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemov8	2024-08-16	1.52	1.47	1.6	0.39	23.0	1.0	55.0	52.0	single
zonemercy	1	31.0	1.0	1292.06	1301.46	1.72	106640	0.71	11368.0	zonemercy-cogent-nemo-v2-5e6_v18	13B	zonemercy/Cogent-Nemo-v2-5e6	0815v3-2	106640	52673225	0.5	0.64	basic	16.0	1024.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v2	2024-08-16	1.46	1.92	0.59	0.24	33.0	1.0	5.0	184.0	single
zonemercy	1	32.0	1.0	1291.25	1301.46	1.77	108706	0.71	10227.0	zonemercy-cogent-nemo-v2-5e6_v17	13B	zonemercy/Cogent-Nemo-v2-5e6	0815v3-2	108706	52673225	0.5	0.64	basic	16.0	1024.0	64.0	MistralForCausalLM	zonemercy/Cogent-Nemo-v2	2024-08-16	1.45	1.91	0.61	0.21	32.0	1.0	6.0	179.0	single
zonemercy	1	33.0	1.0	1248.17	1301.46	5.59	12094	0.68	1111.0	zonemercy-graft-cogent-v_3240_v1	13B	zonemercy/Graft-Cogent-v1-Acute-Nemo-v1-1e5ep1	0814v1-6	12094	52673225	0.53	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Graft-Cogent-v	2024-08-14	1.45	1.0	2.29	0.05	77.0	1.0	521.5	18.0	single
zonemercy	1	34.0	1.0	1256.36	1301.46	4.81	9553	0.71	830.0	zonemercy-lexical-nemov8_5966_v7	13B	zonemercy/Lexical-Nemov8-1k1e5	0815v2-1	9553	52673225	0.53	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemov8	2024-08-20	1.44	1.17	1.95	0.21	43.0	1.0	282.0	26.0	single
chai_backend_admin	2	35.0	35.0	1266.3	1303.03	3.88	10609	0.74	984.0	blend_domul_2024-08-22	n/a		blend_domul_2024-08-22	10609	243511388	0.54	1.0	blend						2024-08-21	1.44	1.38	1.54	0.36	27.0	27.0	98.0	55.0	blended
zonemercy	1	36.0	1.0	1248.93	1301.46	5.38	12373	0.71	1412.0	zonemercy-acute-nemo-v1-_4488_v1	13B	zonemercy/Acute-Nemo-v1-1e5ep1	0814v1-2	12373	52673225	0.53	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Acute-Nemo-v1-	2024-08-14	1.43	1.02	2.2	0.24	69.0	1.0	492.0	21.0	single
zonemercy	1	37.0	1.0	1240.99	1301.46	5.83	11555	0.75	1059.0	zonemercy-lexical-nemo-_1518_v16	13B	zonemercy/Lexical-Nemo-v4-1k1e5	zonemercy-lexical-nemo-_1518_v16	11555	52673225	0.52	0.64	basic	4.0	1024.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemo-v	2024-08-12	1.39	0.85	2.39	0.42	153.5	1.0	725.0	13.0	single
zonemercy	1	38.0	1.0	1268.93	1301.46	3.31	10529	0.73	1021.0	zonemercy-graft-virgo-v1_16_v1	13B	zonemercy/Graft-Virgo-v1-base-v1	zonemercy-graft-virgo-v1_16_v1	10529	52673225	0.55	0.64	basic	8.0	1024.0	64.0	MistralForCausalLM	zonemercy/Graft-Virgo-v1	2024-08-22	1.38	1.44	1.28	0.32	25.5	1.0	71.0	74.0	single
zonemercy	1	39.0	1.0	1239.6	1301.46	5.87	12977	0.71	1105.0	zonemercy-lexical-nemo-_1518_v17	13B	zonemercy/Lexical-Nemo-v4-1k1e5	zonemercy-lexical-nemo-_1518_v17	12977	52673225	0.52	0.64	basic	4.0	1024.0	64.0	MistralForCausalLM	zonemercy/Lexical-Nemo-v	2024-08-12	1.38	0.82	2.41	0.22	167.0	1.0	767.5	12.0	single
zonemercy	1	40.0	1.0	1264.73	1301.46	3.63	10756	0.71	958.0	zonemercy-virgo-edit-v2-1e5_v4	13B	zonemercy/Virgo-Edit-v2-1e5	0821v1-2	10756	52673225	0.54	0.64	basic	16.0	512.0	64.0	MistralForCausalLM	zonemercy/Virgo-Edit-v2-	2024-08-21	1.38	1.35	1.43	0.23	29.0	1.0	115.0	61.0	single