developer_uid: rirv938
submission_id: function_nubul_2025-04-03
model_name: dpo_data_collection
model_group:
status: inactive
timestamp: 2025-04-03T20:14:04+00:00
num_battles: 8661
num_wins: 4567
celo_rating: 1323.55
family_friendly_score: 0.5389999999999999
family_friendly_standard_error: 0.0070495248066802345
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-03
win_ratio: 0.5273063156679367
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.4397084712982178s
Received healthy response to inference request in 2.133589744567871s
Received healthy response to inference request in 3.3634305000305176s
Failed to get response for submission qwen-qwq-32b_v1: HTTPConnectionPool(host='qwen-qwq-32b-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 4.771911859512329s
Received healthy response to inference request in 2.3449904918670654s
5 requests
0 failed requests
5th percentile: 2.17586989402771
10th percentile: 2.2181500434875487
20th percentile: 2.3027103424072264
30th percentile: 2.548678493499756
40th percentile: 2.956054496765137
50th percentile: 3.3634305000305176
60th percentile: 3.3939416885375975
70th percentile: 3.424452877044678
80th percentile: 3.7061491489410403
90th percentile: 4.239030504226685
95th percentile: 4.505471181869507
99th percentile: 4.7186237239837645
mean time: 3.2107262134552004
Pipeline stage StressChecker completed in 17.14s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Failed to get response for submission rirv938-94p-6ff-rirv938_67490_v1: HTTPConnectionPool(host='rirv938-94p-6ff-rirv938-67490-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_nubul_2025-04-03 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4257.99s
Shutdown handler de-registered
function_nubul_2025-04-03 status is now inactive due to auto deactivation removed underperforming models
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1