function_gofas_2025-06-10

developer_uid: rirv938

submission_id: function_gofas_2025-06-10

model_name: dpo_data_collection

model_group:

status: torndown

timestamp: 2025-06-10T03:18:56+00:00

num_battles: 10112

num_wins: 5463

celo_rating: 1304.04

family_friendly_score: 0.563

family_friendly_standard_error: 0.007014713108887633

submission_type: function

display_name: dpo_data_collection

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-06-09

win_ratio: 0.5402492088607594

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.98270058631897s
Received healthy response to inference request in 5.405687093734741s
Received healthy response to inference request in 7.35898494720459s
Received healthy response to inference request in 2.8952338695526123s
Received healthy response to inference request in 3.143308401107788s
5 requests
0 failed requests
5th percentile: 2.9448487758636475
10th percentile: 2.9944636821746826
20th percentile: 3.093693494796753
30th percentile: 3.5957841396331784
40th percentile: 4.5007356166839605
50th percentile: 5.405687093734741
60th percentile: 6.036492490768433
70th percentile: 6.667297887802124
80th percentile: 7.057957458496094
90th percentile: 7.208471202850342
95th percentile: 7.283728075027466
99th percentile: 7.343933572769165
mean time: 5.15718297958374
%s, retrying in %s seconds...
Received healthy response to inference request in 7.657506704330444s
Received healthy response to inference request in 7.6726884841918945s
Received healthy response to inference request in 5.639837026596069s
Received healthy response to inference request in 5.543444633483887s
Received healthy response to inference request in 3.6069600582122803s
5 requests
0 failed requests
5th percentile: 3.9942569732666016
10th percentile: 4.381553888320923
20th percentile: 5.156147718429565
30th percentile: 5.562723112106323
40th percentile: 5.601280069351196
50th percentile: 5.639837026596069
60th percentile: 6.446904897689819
70th percentile: 7.253972768783569
80th percentile: 7.660543060302734
90th percentile: 7.666615772247314
95th percentile: 7.669652128219605
99th percentile: 7.672081212997437
mean time: 6.024087381362915
%s, retrying in %s seconds...
Received healthy response to inference request in 4.1984782218933105s
Received healthy response to inference request in 3.347397804260254s
Received healthy response to inference request in 3.5675551891326904s
Received healthy response to inference request in 3.4557862281799316s
Received healthy response to inference request in 2.54010009765625s
5 requests
0 failed requests
5th percentile: 2.701559638977051
10th percentile: 2.8630191802978517
20th percentile: 3.185938262939453
30th percentile: 3.3690754890441896
40th percentile: 3.4124308586120606
50th percentile: 3.4557862281799316
60th percentile: 3.500493812561035
70th percentile: 3.5452013969421388
80th percentile: 3.6937397956848144
90th percentile: 3.9461090087890627
95th percentile: 4.072293615341186
99th percentile: 4.173241300582886
mean time: 3.4218635082244875
Pipeline stage StressChecker completed in 76.75s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.82s
Shutdown handler de-registered
Failed to get response for submission chaiml-cyndonia24b-cpos_11400_v1: ('http://chaiml-cyndonia24b-cpos-11400-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
function_gofas_2025-06-10 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3902.32s
Shutdown handler de-registered
function_gofas_2025-06-10 status is now inactive due to auto deactivation removed underperforming models
function_gofas_2025-06-10 status is now torndown due to DeploymentManager action