submission_id: blend_rarom_2024-02-29
developer_uid: chai_backend_admin
status: torndown
timestamp: 2024-02-29T09:03:10+00:00
model_name: blend_rarom_2024-02-29
tagged_submissions: [{'submission_id': 'chaiml-phase2-winner-13b2_v123', 'tags': ['sfw', 'nsfw']}, {'submission_id': 'khanhnto-khanhnto_v37', 'tags': ['sfw', 'nsfw']}, {'submission_id': 'anhnv125-llama-op-v17-1_v27', 'tags': ['sfw', 'nsfw']}, {'submission_id': 'thanhdaonguyen-once-upon-a-t_v19', 'tags': ['sfw', 'nsfw']}]
router: sfw_router
model_group:
num_battles: 662255
num_wins: 301935
celo_rating: 1120.91
propriety_score: 0.0
propriety_total_count: 0.0
submission_type: routed_blend
display_name: blend_rarom_2024-02-29
ineligible_reason: None
language_model: chaiml-phase2-winner-13b2_v123:sfw|nsfw,khanhnto-khanhnto_v37:sfw|nsfw,anhnv125-llama-op-v17-1_v27:sfw|nsfw,thanhdaonguyen-once-upon-a-t_v19:sfw|nsfw
model_size: n/a
reward_model: sfw_router
us_pacific_date: 2024-02-29
win_ratio: 0.4559195476062846
preference_data_url: None
Resubmit model
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Connection pool is full, discarding connection: %s
Failed to get response for submission anhnv125-llama-op-v17-1_v27: HTTPConnectionPool(host='anhnv125-llama-op-v17-1-v27-predictor-default.tenant-chaiml-guanaco.knative.ord1.coreweave.cloud', port=80): Read timed out. (read timeout=5.5)
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Scoring model output for bot %s
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Exception raised while processing tagging_function
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Failed to get response for submission cgato-thespice-7b-ft-v0-2_v1: (<class 'guanaco_model_service.schemas.Submission'>, <class 'cachetools.keys._HashedTuple'>, 'submission_id', 'neversleep-noromaidxopen_2041_v1')
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Exception raised while processing tagging_function
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
Connection pool is full, discarding connection: %s
blend_rarom_2024-02-29 status is now inactive due to auto deactivation removed underperforming models
blend_rarom_2024-02-29 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics