The Mismeasure of Man and Models

Our work considers allocational harms that arise when model predictions are used to distribute scarce resources or opportunities.

Current Bias Metrics Do Not Reliably Reflect Allocation Disparities

Several methods have been proposed to audit large language models (LLMs) for bias when used in critical decision-making, such as resume screening for hiring. Yet, these methods focus on predictions, without considering how the predictions are used to make decisions. In many settings, making decisions involve prioritizing options due to limited resource constraints. We find that prediction-based evaluation methods, which measure bias as the average performance gap (δ) in prediction outcomes, do not reliably reflect disparities in allocation decision outcomes.

Bias scores per group, computed with respect to White Male. δ: average performance gap, measured as the average score difference. ∆DP (demographic parity gap): the selection rate difference over multiple selection rounds, with 2 out of 8 being selected in each round.

Measuring Allocational Harms

We introduce Rank-Allocational-Based Bias Index (RABBI), a model-agnostic bias metric that measures allocational bias using scores derived from model outputs. We implement with scoring methods for pointwise and pairwise ranking with LLMs. Given pairs of candidates from group A and group B, RABBI is computed as the difference between the proportion of pairs where A is preferred over B and those where B is prefered over A. Our approach is inspired by the rank-biserial correlation (Cureton, 1956), which measures if the group membership is correlated with being higher-ranked or lower-ranked.

Rank-Allocational-Based Bias Index (RABBI)

Testing Predictive Validity

We compare bias scores measured with RABBI and traditional bias metrics to allocation gaps (∆DP and ∆EO) measured in simulated candidate selection outcomes. RABBI shows a strong positive correlation with the allocation gaps, whereas other metrics show varied correlation performance. In some cases, the average performance gap δ and distribution-based metrics (JSD and EMD) have close to zero or even negative correlation with the allocation gaps. This shows that current bias metrics do not predict potential allocational harms well.

<div class="column"> <script type="text/javascript">window.PlotlyConfig = {MathJaxConfig: 'local'};</script> <script charset="utf-8" src="https://cdn.plot.ly/plotly-2.31.1.min.js"></script> <div id="60fd0414-1ea2-4631-a483-fa921f818d1d" class="plotly-graph-div" style="height:345px; width:500px;"></div> <script type="text/javascript"> window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById("60fd0414-1ea2-4631-a483-fa921f818d1d")) { Plotly.newPlot( "60fd0414-1ea2-4631-a483-fa921f818d1d", [{"hovertext":["[retail] Llama2-7B-Chat - White F","[retail] Llama2-7B-Chat - Black F","[retail] Llama2-7B-Chat - Black M","[retail] Llama2-7B-Chat - Hispanic F","[retail] Llama2-7B-Chat - Hispanic M","[retail] Llama2-7B-Chat - Asian F","[retail] Llama2-7B-Chat - Asian M","[software_engineer] Llama2-7B-Chat - White F","[software_engineer] Llama2-7B-Chat - Black F","[software_engineer] Llama2-7B-Chat - Black M","[software_engineer] Llama2-7B-Chat - Hispanic F","[software_engineer] Llama2-7B-Chat - Hispanic M","[software_engineer] Llama2-7B-Chat - Asian F","[software_engineer] Llama2-7B-Chat - Asian M","[HR_specialist] Llama2-7B-Chat - White F","[HR_specialist] Llama2-7B-Chat - Black F","[HR_specialist] Llama2-7B-Chat - Black M","[HR_specialist] Llama2-7B-Chat - Hispanic F","[HR_specialist] Llama2-7B-Chat - Hispanic M","[HR_specialist] Llama2-7B-Chat - Asian F","[HR_specialist] Llama2-7B-Chat - Asian M","[financial_analyst] Llama2-7B-Chat - White F","[financial_analyst] Llama2-7B-Chat - Black F","[financial_analyst] Llama2-7B-Chat - Black M","[financial_analyst] Llama2-7B-Chat - Hispanic F","[financial_analyst] Llama2-7B-Chat - Hispanic M","[financial_analyst] Llama2-7B-Chat - Asian F","[financial_analyst] Llama2-7B-Chat - Asian M","[retail] Llama3-8B-IT - White F","[retail] Llama3-8B-IT - Black F","[retail] Llama3-8B-IT - Black M","[retail] Llama3-8B-IT - Hispanic F","[retail] Llama3-8B-IT - Hispanic M","[retail] Llama3-8B-IT - Asian F","[retail] Llama3-8B-IT - Asian M","[software_engineer] Llama3-8B-IT - White F","[software_engineer] Llama3-8B-IT - Black F","[software_engineer] Llama3-8B-IT - Black M","[software_engineer] Llama3-8B-IT - Hispanic F","[software_engineer] Llama3-8B-IT - Hispanic M","[software_engineer] Llama3-8B-IT - Asian F","[software_engineer] Llama3-8B-IT - Asian M","[HR_specialist] Llama3-8B-IT - White F","[HR_specialist] Llama3-8B-IT - Black F","[HR_specialist] Llama3-8B-IT - Black M","[HR_specialist] Llama3-8B-IT - Hispanic F","[HR_specialist] Llama3-8B-IT - Hispanic M","[HR_specialist] Llama3-8B-IT - Asian F","[HR_specialist] Llama3-8B-IT - Asian M","[financial_analyst] Llama3-8B-IT - White F","[financial_analyst] Llama3-8B-IT - Black F","[financial_analyst] Llama3-8B-IT - Black M","[financial_analyst] Llama3-8B-IT - Hispanic F","[financial_analyst] Llama3-8B-IT - Hispanic M","[financial_analyst] Llama3-8B-IT - Asian F","[financial_analyst] Llama3-8B-IT - Asian M","[retail] TinyLlama-1.1B-Chat - White F","[retail] TinyLlama-1.1B-Chat - Black F","[retail] TinyLlama-1.1B-Chat - Black M","[retail] TinyLlama-1.1B-Chat - Hispanic F","[retail] TinyLlama-1.1B-Chat - Hispanic M","[retail] TinyLlama-1.1B-Chat - Asian F","[retail] TinyLlama-1.1B-Chat - Asian M","[software_engineer] TinyLlama-1.1B-Chat - White F","[software_engineer] TinyLlama-1.1B-Chat - Black F","[software_engineer] TinyLlama-1.1B-Chat - Black M","[software_engineer] TinyLlama-1.1B-Chat - Hispanic F","[software_engineer] TinyLlama-1.1B-Chat - Hispanic M","[software_engineer] TinyLlama-1.1B-Chat - Asian F","[software_engineer] TinyLlama-1.1B-Chat - Asian M","[HR_specialist] TinyLlama-1.1B-Chat - White F","[HR_specialist] TinyLlama-1.1B-Chat - Black F","[HR_specialist] TinyLlama-1.1B-Chat - Black M","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic F","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic M","[HR_specialist] TinyLlama-1.1B-Chat - Asian F","[HR_specialist] TinyLlama-1.1B-Chat - Asian M","[financial_analyst] TinyLlama-1.1B-Chat - White F","[financial_analyst] TinyLlama-1.1B-Chat - Black F","[financial_analyst] TinyLlama-1.1B-Chat - Black M","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic F","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic M","[financial_analyst] TinyLlama-1.1B-Chat - Asian F","[financial_analyst] TinyLlama-1.1B-Chat - Asian M","[retail] Llama3-70B-IT - White F","[retail] Llama3-70B-IT - Black F","[retail] Llama3-70B-IT - Black M","[retail] Llama3-70B-IT - Hispanic F","[retail] Llama3-70B-IT - Hispanic M","[retail] Llama3-70B-IT - Asian F","[retail] Llama3-70B-IT - Asian M","[software_engineer] Llama3-70B-IT - White F","[software_engineer] Llama3-70B-IT - Black F","[software_engineer] Llama3-70B-IT - Black M","[software_engineer] Llama3-70B-IT - Hispanic F","[software_engineer] Llama3-70B-IT - Hispanic M","[software_engineer] Llama3-70B-IT - Asian F","[software_engineer] Llama3-70B-IT - Asian M","[HR_specialist] Llama3-70B-IT - White F","[HR_specialist] Llama3-70B-IT - Black F","[HR_specialist] Llama3-70B-IT - Black M","[HR_specialist] Llama3-70B-IT - Hispanic F","[HR_specialist] Llama3-70B-IT - Hispanic M","[HR_specialist] Llama3-70B-IT - Asian F","[HR_specialist] Llama3-70B-IT - Asian M","[financial_analyst] Llama3-70B-IT - White F","[financial_analyst] Llama3-70B-IT - Black F","[financial_analyst] Llama3-70B-IT - Black M","[financial_analyst] Llama3-70B-IT - Hispanic F","[financial_analyst] Llama3-70B-IT - Hispanic M","[financial_analyst] Llama3-70B-IT - Asian F","[financial_analyst] Llama3-70B-IT - Asian M","[retail] StableLM2-Zephyr-1.6B - White F","[retail] StableLM2-Zephyr-1.6B - Black F","[retail] StableLM2-Zephyr-1.6B - Black M","[retail] StableLM2-Zephyr-1.6B - Hispanic F","[retail] StableLM2-Zephyr-1.6B - Hispanic M","[retail] StableLM2-Zephyr-1.6B - Asian F","[retail] StableLM2-Zephyr-1.6B - Asian M","[software_engineer] StableLM2-Zephyr-1.6B - White F","[software_engineer] StableLM2-Zephyr-1.6B - Black F","[software_engineer] StableLM2-Zephyr-1.6B - Black M","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic F","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic M","[software_engineer] StableLM2-Zephyr-1.6B - Asian F","[software_engineer] StableLM2-Zephyr-1.6B - Asian M","[HR_specialist] StableLM2-Zephyr-1.6B - White F","[HR_specialist] StableLM2-Zephyr-1.6B - Black F","[HR_specialist] StableLM2-Zephyr-1.6B - Black M","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic F","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic M","[HR_specialist] StableLM2-Zephyr-1.6B - Asian F","[HR_specialist] StableLM2-Zephyr-1.6B - Asian M","[financial_analyst] StableLM2-Zephyr-1.6B - White F","[financial_analyst] StableLM2-Zephyr-1.6B - Black F","[financial_analyst] StableLM2-Zephyr-1.6B - Black M","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic F","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic M","[financial_analyst] StableLM2-Zephyr-1.6B - Asian F","[financial_analyst] StableLM2-Zephyr-1.6B - Asian M","[retail] Llama2-13B-Chat - White F","[retail] Llama2-13B-Chat - Black F","[retail] Llama2-13B-Chat - Black M","[retail] Llama2-13B-Chat - Hispanic F","[retail] Llama2-13B-Chat - Hispanic M","[retail] Llama2-13B-Chat - Asian F","[retail] Llama2-13B-Chat - Asian M","[software_engineer] Llama2-13B-Chat - White F","[software_engineer] Llama2-13B-Chat - Black F","[software_engineer] Llama2-13B-Chat - Black M","[software_engineer] Llama2-13B-Chat - Hispanic F","[software_engineer] Llama2-13B-Chat - Hispanic M","[software_engineer] Llama2-13B-Chat - Asian F","[software_engineer] Llama2-13B-Chat - Asian M","[HR_specialist] Llama2-13B-Chat - White F","[HR_specialist] Llama2-13B-Chat - Black F","[HR_specialist] Llama2-13B-Chat - Black M","[HR_specialist] Llama2-13B-Chat - Hispanic F","[HR_specialist] Llama2-13B-Chat - Hispanic M","[HR_specialist] Llama2-13B-Chat - Asian F","[HR_specialist] Llama2-13B-Chat - Asian M","[financial_analyst] Llama2-13B-Chat - White F","[financial_analyst] Llama2-13B-Chat - Black F","[financial_analyst] Llama2-13B-Chat - Black M","[financial_analyst] Llama2-13B-Chat - Hispanic F","[financial_analyst] Llama2-13B-Chat - Hispanic M","[financial_analyst] Llama2-13B-Chat - Asian F","[financial_analyst] Llama2-13B-Chat - Asian M","[retail] StarlingLM-7B - White F","[retail] StarlingLM-7B - Black F","[retail] StarlingLM-7B - Black M","[retail] StarlingLM-7B - Hispanic F","[retail] StarlingLM-7B - Hispanic M","[retail] StarlingLM-7B - Asian F","[retail] StarlingLM-7B - Asian M","[software_engineer] StarlingLM-7B - White F","[software_engineer] StarlingLM-7B - Black F","[software_engineer] StarlingLM-7B - Black M","[software_engineer] StarlingLM-7B - Hispanic F","[software_engineer] StarlingLM-7B - Hispanic M","[software_engineer] StarlingLM-7B - Asian F","[software_engineer] StarlingLM-7B - Asian M","[HR_specialist] StarlingLM-7B - White F","[HR_specialist] StarlingLM-7B - Black F","[HR_specialist] StarlingLM-7B - Black M","[HR_specialist] StarlingLM-7B - Hispanic F","[HR_specialist] StarlingLM-7B - Hispanic M","[HR_specialist] StarlingLM-7B - Asian F","[HR_specialist] StarlingLM-7B - Asian M","[financial_analyst] StarlingLM-7B - White F","[financial_analyst] StarlingLM-7B - Black F","[financial_analyst] StarlingLM-7B - Black M","[financial_analyst] StarlingLM-7B - Hispanic F","[financial_analyst] StarlingLM-7B - Hispanic M","[financial_analyst] StarlingLM-7B - Asian F","[financial_analyst] StarlingLM-7B - Asian M","[retail] StableLM-Zephyr-3B - White F","[retail] StableLM-Zephyr-3B - Black F","[retail] StableLM-Zephyr-3B - Black M","[retail] StableLM-Zephyr-3B - Hispanic F","[retail] StableLM-Zephyr-3B - Hispanic M","[retail] StableLM-Zephyr-3B - Asian F","[retail] StableLM-Zephyr-3B - Asian M","[software_engineer] StableLM-Zephyr-3B - White F","[software_engineer] StableLM-Zephyr-3B - Black F","[software_engineer] StableLM-Zephyr-3B - Black M","[software_engineer] StableLM-Zephyr-3B - Hispanic F","[software_engineer] StableLM-Zephyr-3B - Hispanic M","[software_engineer] StableLM-Zephyr-3B - Asian F","[software_engineer] StableLM-Zephyr-3B - Asian M","[HR_specialist] StableLM-Zephyr-3B - White F","[HR_specialist] StableLM-Zephyr-3B - Black F","[HR_specialist] StableLM-Zephyr-3B - Black M","[HR_specialist] StableLM-Zephyr-3B - Hispanic F","[HR_specialist] StableLM-Zephyr-3B - Hispanic M","[HR_specialist] StableLM-Zephyr-3B - Asian F","[HR_specialist] StableLM-Zephyr-3B - Asian M","[financial_analyst] StableLM-Zephyr-3B - White F","[financial_analyst] StableLM-Zephyr-3B - Black F","[financial_analyst] StableLM-Zephyr-3B - Black M","[financial_analyst] StableLM-Zephyr-3B - Hispanic F","[financial_analyst] StableLM-Zephyr-3B - Hispanic M","[financial_analyst] StableLM-Zephyr-3B - Asian F","[financial_analyst] StableLM-Zephyr-3B - Asian M","[retail] Gemma-2B-IT - White F","[retail] Gemma-2B-IT - Black F","[retail] Gemma-2B-IT - Black M","[retail] Gemma-2B-IT - Hispanic F","[retail] Gemma-2B-IT - Hispanic M","[retail] Gemma-2B-IT - Asian F","[retail] Gemma-2B-IT - Asian M","[software_engineer] Gemma-2B-IT - White F","[software_engineer] Gemma-2B-IT - Black F","[software_engineer] Gemma-2B-IT - Black M","[software_engineer] Gemma-2B-IT - Hispanic F","[software_engineer] Gemma-2B-IT - Hispanic M","[software_engineer] Gemma-2B-IT - Asian F","[software_engineer] Gemma-2B-IT - Asian M","[HR_specialist] Gemma-2B-IT - White F","[HR_specialist] Gemma-2B-IT - Black F","[HR_specialist] Gemma-2B-IT - Black M","[HR_specialist] Gemma-2B-IT - Hispanic F","[HR_specialist] Gemma-2B-IT - Hispanic M","[HR_specialist] Gemma-2B-IT - Asian F","[HR_specialist] Gemma-2B-IT - Asian M","[financial_analyst] Gemma-2B-IT - White F","[financial_analyst] Gemma-2B-IT - Black F","[financial_analyst] Gemma-2B-IT - Black M","[financial_analyst] Gemma-2B-IT - Hispanic F","[financial_analyst] Gemma-2B-IT - Hispanic M","[financial_analyst] Gemma-2B-IT - Asian F","[financial_analyst] Gemma-2B-IT - Asian M","[retail] Gemma-7B-IT - White F","[retail] Gemma-7B-IT - Black F","[retail] Gemma-7B-IT - Black M","[retail] Gemma-7B-IT - Hispanic F","[retail] Gemma-7B-IT - Hispanic M","[retail] Gemma-7B-IT - Asian F","[retail] Gemma-7B-IT - Asian M","[software_engineer] Gemma-7B-IT - White F","[software_engineer] Gemma-7B-IT - Black F","[software_engineer] Gemma-7B-IT - Black M","[software_engineer] Gemma-7B-IT - Hispanic F","[software_engineer] Gemma-7B-IT - Hispanic M","[software_engineer] Gemma-7B-IT - Asian F","[software_engineer] Gemma-7B-IT - Asian M","[HR_specialist] Gemma-7B-IT - White F","[HR_specialist] Gemma-7B-IT - Black F","[HR_specialist] Gemma-7B-IT - Black M","[HR_specialist] Gemma-7B-IT - Hispanic F","[HR_specialist] Gemma-7B-IT - Hispanic M","[HR_specialist] Gemma-7B-IT - Asian F","[HR_specialist] Gemma-7B-IT - Asian M","[financial_analyst] Gemma-7B-IT - White F","[financial_analyst] Gemma-7B-IT - Black F","[financial_analyst] Gemma-7B-IT - Black M","[financial_analyst] Gemma-7B-IT - Hispanic F","[financial_analyst] Gemma-7B-IT - Hispanic M","[financial_analyst] Gemma-7B-IT - Asian F","[financial_analyst] Gemma-7B-IT - Asian M"],"marker":{"color":"#1F77B4"},"mode":"markers","showlegend":false,"x":[0.0119156491884264,0.0119288493091145,0.0104907888017578,0.0129083248538376,0.0086790559515139,0.0109580292366076,0.00506577884224,-0.0397782356229738,-0.0254961457358507,0.0169906522526738,-0.0113175854330127,0.0079358346859629,-0.0113298972910077,-0.00234217826002,1.948461574308169e-06,1.9122389779413496e-06,3.894998142905948e-07,0.0016678165816589,-2.060523322855446e-06,1.93376024293368e-06,-1.1234025648620971e-06,0.0021794349910125,0.0034888777083921,0.00610644854318,0.0112702275183544,0.0001635421524991,0.0134289360691225,0.0118983460243443,-0.0001070184682813,0.0026298271423225,0.0018015440876882,0.0027879919514567,0.0024925417637926,0.0036698511804347,0.0022595035552435,-1.4816569191777871e-05,-1.4986323693788606e-05,-1.1481802605683988e-05,-1.8826598629839708e-05,-1.6307327296849472e-05,-1.4416810808715042e-05,-1.4742751683560762e-05,0.0014295658164156,0.0182715949223932,0.0163773015785667,0.0121230038181705,0.0107767473867345,0.0060057852170116,0.0014862958608353,0.0008565579512074,0.0089284526641585,0.0058380634256435,0.0069611580386135,0.0034183405497894,0.0051468611971302,0.0028743489905737,0.0001429299021001,0.0005904095380775,0.0008566814829494,0.0007640606755761,0.0004652149334616,0.0004960446386835,0.0006189276764301,-0.0002035630546217,0.0002990823176619,0.0005804767249362,0.0002860868849063,0.0002486805679547,0.0002414952743011,0.000376190971428,3.792714120054441e-05,0.0002827171681821,0.0005984213073357,0.0004180211141042,0.0001946160872885,0.0002915132931611,0.0003395243143571,-5.3524502113933e-05,0.0003050933415745,0.0009326615234427,0.0006609493554825,0.0004403122213137,0.0003799439020638,0.0006088282415765,1.5643503603612885e-08,1.8712940530463132e-08,8.119840799736266e-09,3.188582331503653e-08,4.0405845336266574e-09,2.6002428432647665e-08,1.5166615408013232e-08,0.0001818535227503,-1.4065066929469516e-05,-9.573183421174304e-05,7.322621269700846e-05,-5.5989962926328296e-05,-0.0001370744989175,-0.000167242030457,-1.5515753759576256e-07,-4.035595020379646e-07,-2.7155895299113553e-07,-4.60594535178771e-07,-5.485877418998086e-07,-7.271750515069897e-07,-7.196498729156176e-07,0.0172299778908356,0.0395840098498102,0.0243470628270199,0.0348928516418882,0.0108529800151654,0.0321936740481596,0.0181903815864206,0.0003440843678089,0.0003443905279749,0.0003717369214824,0.0007087116983126,0.0006200539668979,0.0001903040578014,-0.0002430978004267,0.0067371154469484,0.0067322389564777,0.0068473186528732,0.0069197022733084,0.0070850360441357,0.0067277830257804,0.0066653203572348,0.0097421641806374,0.0099461214776443,0.0053820212363348,0.0143670217153475,0.0128372532544327,0.0048250986243256,-0.0033617930208245,0.004622378658193,0.0091850234931591,0.0092729202412523,0.0101467169568638,0.0088141720685702,0.0074239856697385,0.0025233261863414,0.0003117188483139,0.000183718518086,1.918870957906549e-06,0.0037265264142599,0.0001327930862571,-2.24370278646413e-05,-0.0002693647032698,-7.393923253040668e-05,6.0190570263518595e-06,7.076701425823284e-05,0.0033314487933542,4.69260804559779e-05,-3.659007374912093e-05,-3.205217305624064e-05,-0.0030629428638806,0.0015527733350058,0.0068125425115955,0.001917296207094,0.0022579327499738,-0.0012784907281004,-0.0018181262255946,-1.1376508114224748e-05,0.0001115655223797,7.160745716239258e-05,0.0034543691045555,0.0001178151390355,0.000205216775295,0.000126372639832,0.0060671418479143,0.0159898885009213,0.0148185800778942,0.0120539540903014,0.0074895098311728,0.0055421605548546,0.0001379458734321,-0.0065797918843765,0.0048290154856927,0.0112035029050209,-0.0061762772738493,-0.0017427428325839,-0.0096409949354777,-0.005287225696556,-0.0040623277105182,0.0031406794087777,0.0069578169843704,-0.0029780960170524,-0.0017395080234017,-0.0082513507748911,-0.0052787547454266,-0.0091541874748163,0.0103282130616075,0.0099767079353513,0.0004172866888875,-0.0007778049613551,-0.0037228082864041,-0.0028875385309162,1.3915172665246445e-06,1.467698381385496e-06,1.4570953164039224e-06,1.4325656021441091e-06,1.3754404231125503e-06,1.4413535245338949e-06,1.418059366820046e-06,-1.658914006164025e-09,1.5989871648969256e-08,1.2508315494486057e-08,3.180607843766836e-08,5.820321780092286e-09,6.592189372156555e-08,5.020938997901681e-08,0.0133698957556158,0.0012459198695305,0.0009659780264327,0.0007122421912177,0.0001807027493081,0.0003153989780709,0.0002617032113293,0.0417357137673065,0.037053681245708,0.0258239405192095,0.0355040511292883,0.0079305589504246,0.0431919315370455,0.0380592871501506,0.0002710001762441,-5.63915830606998e-05,-0.0001082958075588,-0.0090567542684258,-2.756469558728991e-05,-0.0001563185847993,-0.0002886654854554,9.925449050007806e-05,0.000107985364475,8.458403009559134e-05,-0.0022017008704424,0.0001137974013121,0.0001370875677253,0.0001129488012604,0.0224458902096885,0.0160509974882403,0.0139904876217838,0.0123355251479742,8.166134063747332e-05,0.0058053415136246,0.0014389584400239,0.001971802058891,0.0024093411277035,0.001686138135404,-0.0010796141504848,0.0003345335840068,0.0010768259859971,0.0009634132965303,-1.628983071766399e-07,-5.735301783493796e-07,-9.329080182807204e-07,-3.619660519094126e-07,-1.83925572883048e-07,-1.0285399265619333e-07,-3.092463383147504e-07,-0.0019252018323373,0.0092032366924867,0.0154717708921119,0.0066667726464894,0.0056638588451514,0.004053515034148,0.0048719008779666,-2.7203057332281233e-06,1.812912166032632e-05,1.8939455473598876e-05,1.8465193852734707e-05,1.6689837299188603e-05,1.598518855439046e-05,1.29799385881757e-05,-5.889078188436869e-07,-1.1371781433178183e-06,3.296718671386145e-07,5.313955315777719e-07,1.1114442323156837e-06,-7.848764985718404e-07,-7.849897005751671e-07],"y":[0.0555555555555555,0.0138888888888888,-0.0216666666666667,-0.0011111111111111,-0.0255555555555556,-0.0072222222222223,-0.0538888888888889,-0.0738888888888888,-0.1083333333333333,-0.0594444444444444,-0.0638888888888887,-0.0277777777777776,-0.0322222222222221,-0.0655555555555554,-0.0016666666666666,-0.0522222222222222,-0.0355555555555555,-0.0322222222222222,-0.0455555555555555,-0.0105555555555555,-0.0444444444444444,-0.0194444444444445,-0.0755555555555556,-0.045,-0.0416666666666667,-0.0294444444444444,-0.0611111111111111,-0.0966666666666667,0.0338888888888888,-0.0238888888888889,-0.0577777777777777,-0.0177777777777777,-0.0544444444444444,-0.0316666666666666,-0.0483333333333333,-0.0322222222222222,-0.0475,-0.0625,-0.0591666666666667,-0.0580555555555556,-0.0780555555555556,-0.0780555555555556,0.038611111111111,-0.0025,-0.0249999999999999,-0.0044444444444443,-0.036111111111111,-0.005,-0.0411111111111111,-0.0144444444444444,-0.0694444444444444,-0.0883333333333333,-0.0561111111111111,-0.0683333333333334,-0.0655555555555555,-0.0777777777777777,-0.0088888888888888,0.0561111111111111,0.0788888888888889,0.0894444444444444,0.0438888888888888,0.0155555555555556,0.0405555555555555,-0.0172222222222221,0.0394444444444445,0.0616666666666667,0.0383333333333334,0.0283333333333334,0.0138888888888888,0.0222222222222222,0.0055555555555554,0.0422222222222221,0.0433333333333333,0.0538888888888887,0.0238888888888887,0.03,0.0411111111111111,-0.0122222222222221,0.0305555555555556,0.0622222222222223,0.08,0.0727777777777778,-0.0033333333333332,0.0277777777777778,0.009074074074074,0.0203703703703703,0.0102777777777777,0.0229629629629628,0.0198148148148148,0.0306481481481481,0.0164814814814814,0.017962962962963,0.02,0.0166666666666666,0.0471296296296296,0.0263888888888889,0.0348148148148148,0.0303703703703704,0.016898148148148,0.0285648148148147,0.0133333333333332,0.0487499999999999,0.0175925925925925,0.0616203703703704,0.0450925925925926,-0.0004629629629629,0.0044444444444445,0.0026851851851851,0.0158333333333333,0.0082407407407407,0.0438888888888889,0.0609259259259259,-0.015,-0.0266666666666666,-0.0161111111111111,0.0672222222222222,0.0549999999999999,-0.0383333333333333,-0.0572222222222222,-0.0166666666666666,-0.0783333333333334,-0.0572222222222223,-0.0383333333333334,0.0555555555555555,-0.0622222222222223,-0.0827777777777778,0.02,-0.0494444444444445,-0.0133333333333333,0.08,0.0633333333333333,-0.0483333333333333,-0.0433333333333333,0.0566666666666665,-0.0444444444444445,-0.0361111111111112,0.006111111111111,0.0622222222222222,-0.0372222222222223,-0.0472222222222223,0.0633333333333333,-0.0505555555555556,-0.0605555555555556,-0.0005555555555556,-0.0088888888888889,-0.0544444444444444,-0.0838888888888889,0.0372222222222221,-0.1177777777777778,-0.1388888888888889,-0.0499999999999999,-0.0416666666666667,-0.0661111111111111,-0.0805555555555556,0.1616666666666666,-0.045,-0.0888888888888889,0.0077777777777778,-0.03,-0.0794444444444445,-0.1038888888888888,0.0222222222222222,-0.0777777777777777,-0.0783333333333334,-0.0416666666666666,-0.0449999999999999,-0.0983333333333334,-0.0988888888888889,0.0861111111111111,0.0405555555555556,0.0083333333333332,0.0299999999999999,-0.0388888888888889,0.0083333333333332,-0.0188888888888889,-0.0077777777777778,-0.0655555555555554,-0.0633333333333333,-0.0888888888888888,-0.0611111111111111,-0.0861111111111111,-0.0716666666666667,0.0961111111111111,0.0755555555555555,0.0266666666666666,0.0377777777777778,0.0088888888888889,-0.0138888888888888,-0.0488888888888889,0.09,0.0455555555555555,-0.0255555555555555,0.0161111111111111,-0.0016666666666666,-0.0049999999999999,-0.0172222222222221,-0.0183333333333333,0.0244444444444445,0.0327777777777778,-0.001111111111111,-0.0322222222222221,0.0405555555555556,0.0605555555555556,-0.0294444444444444,-0.0322222222222223,-0.0055555555555555,-0.0444444444444444,-0.0550000000000001,0.0183333333333333,-0.0027777777777777,-0.0444444444444445,-0.05,-0.0011111111111111,-0.0566666666666667,-0.0427777777777778,-0.0194444444444445,0.0055555555555554,-0.0311111111111111,-0.0122222222222222,0.0555555555555555,-0.0055555555555555,0.0083333333333334,-0.0077777777777778,0.0194444444444445,0.1572222222222223,0.0877777777777778,0.0144444444444445,0.1033333333333333,-0.0238888888888888,0.0027777777777778,-0.0261111111111111,0.0694444444444444,0.0127777777777778,-0.0466666666666666,0.0227777777777778,-0.0344444444444443,0.0094444444444444,0.0111111111111111,0.1822222222222221,0.0855555555555555,-0.0216666666666667,0.0727777777777777,-0.0438888888888889,0.0683333333333332,0.0166666666666665,0.0633333333333334,0.0261111111111111,-0.0316666666666665,0.0211111111111112,-0.0383333333333332,0.0050000000000001,0.0033333333333334,-0.0611574074074072,-0.1302962962962961,-0.1259166666666665,-0.1143703703703702,-0.1006944444444442,-0.0763796296296294,-0.1066666666666665,-0.0325462962962961,-0.099398148148148,-0.1099537037037036,-0.1136111111111111,-0.0917592592592592,-0.0986574074074073,-0.0970370370370369,-0.0499999999999997,-0.1429166666666665,-0.1319814814814813,-0.109509259259259,-0.1206944444444442,-0.0916481481481479,-0.1182870370370369,-0.0571296296296296,-0.1668703703703703,-0.1375185185185184,-0.1396759259259258,-0.1174537037037035,-0.1307407407407406,-0.1266851851851851],"type":"scatter","xaxis":"x","yaxis":"y"},{"line":{"color":"#1F77B4"},"mode":"lines","showlegend":false,"x":[0.0119156491884264,0.0119288493091145,0.0104907888017578,0.0129083248538376,0.0086790559515139,0.0109580292366076,0.00506577884224,-0.0397782356229738,-0.0254961457358507,0.0169906522526738,-0.0113175854330127,0.0079358346859629,-0.0113298972910077,-0.00234217826002,1.948461574308169e-06,1.9122389779413496e-06,3.894998142905948e-07,0.0016678165816589,-2.060523322855446e-06,1.93376024293368e-06,-1.1234025648620971e-06,0.0021794349910125,0.0034888777083921,0.00610644854318,0.0112702275183544,0.0001635421524991,0.0134289360691225,0.0118983460243443,-0.0001070184682813,0.0026298271423225,0.0018015440876882,0.0027879919514567,0.0024925417637926,0.0036698511804347,0.0022595035552435,-1.4816569191777871e-05,-1.4986323693788606e-05,-1.1481802605683988e-05,-1.8826598629839708e-05,-1.6307327296849472e-05,-1.4416810808715042e-05,-1.4742751683560762e-05,0.0014295658164156,0.0182715949223932,0.0163773015785667,0.0121230038181705,0.0107767473867345,0.0060057852170116,0.0014862958608353,0.0008565579512074,0.0089284526641585,0.0058380634256435,0.0069611580386135,0.0034183405497894,0.0051468611971302,0.0028743489905737,0.0001429299021001,0.0005904095380775,0.0008566814829494,0.0007640606755761,0.0004652149334616,0.0004960446386835,0.0006189276764301,-0.0002035630546217,0.0002990823176619,0.0005804767249362,0.0002860868849063,0.0002486805679547,0.0002414952743011,0.000376190971428,3.792714120054441e-05,0.0002827171681821,0.0005984213073357,0.0004180211141042,0.0001946160872885,0.0002915132931611,0.0003395243143571,-5.3524502113933e-05,0.0003050933415745,0.0009326615234427,0.0006609493554825,0.0004403122213137,0.0003799439020638,0.0006088282415765,1.5643503603612885e-08,1.8712940530463132e-08,8.119840799736266e-09,3.188582331503653e-08,4.0405845336266574e-09,2.6002428432647665e-08,1.5166615408013232e-08,0.0001818535227503,-1.4065066929469516e-05,-9.573183421174304e-05,7.322621269700846e-05,-5.5989962926328296e-05,-0.0001370744989175,-0.000167242030457,-1.5515753759576256e-07,-4.035595020379646e-07,-2.7155895299113553e-07,-4.60594535178771e-07,-5.485877418998086e-07,-7.271750515069897e-07,-7.196498729156176e-07,0.0172299778908356,0.0395840098498102,0.0243470628270199,0.0348928516418882,0.0108529800151654,0.0321936740481596,0.0181903815864206,0.0003440843678089,0.0003443905279749,0.0003717369214824,0.0007087116983126,0.0006200539668979,0.0001903040578014,-0.0002430978004267,0.0067371154469484,0.0067322389564777,0.0068473186528732,0.0069197022733084,0.0070850360441357,0.0067277830257804,0.0066653203572348,0.0097421641806374,0.0099461214776443,0.0053820212363348,0.0143670217153475,0.0128372532544327,0.0048250986243256,-0.0033617930208245,0.004622378658193,0.0091850234931591,0.0092729202412523,0.0101467169568638,0.0088141720685702,0.0074239856697385,0.0025233261863414,0.0003117188483139,0.000183718518086,1.918870957906549e-06,0.0037265264142599,0.0001327930862571,-2.24370278646413e-05,-0.0002693647032698,-7.393923253040668e-05,6.0190570263518595e-06,7.076701425823284e-05,0.0033314487933542,4.69260804559779e-05,-3.659007374912093e-05,-3.205217305624064e-05,-0.0030629428638806,0.0015527733350058,0.0068125425115955,0.001917296207094,0.0022579327499738,-0.0012784907281004,-0.0018181262255946,-1.1376508114224748e-05,0.0001115655223797,7.160745716239258e-05,0.0034543691045555,0.0001178151390355,0.000205216775295,0.000126372639832,0.0060671418479143,0.0159898885009213,0.0148185800778942,0.0120539540903014,0.0074895098311728,0.0055421605548546,0.0001379458734321,-0.0065797918843765,0.0048290154856927,0.0112035029050209,-0.0061762772738493,-0.0017427428325839,-0.0096409949354777,-0.005287225696556,-0.0040623277105182,0.0031406794087777,0.0069578169843704,-0.0029780960170524,-0.0017395080234017,-0.0082513507748911,-0.0052787547454266,-0.0091541874748163,0.0103282130616075,0.0099767079353513,0.0004172866888875,-0.0007778049613551,-0.0037228082864041,-0.0028875385309162,1.3915172665246445e-06,1.467698381385496e-06,1.4570953164039224e-06,1.4325656021441091e-06,1.3754404231125503e-06,1.4413535245338949e-06,1.418059366820046e-06,-1.658914006164025e-09,1.5989871648969256e-08,1.2508315494486057e-08,3.180607843766836e-08,5.820321780092286e-09,6.592189372156555e-08,5.020938997901681e-08,0.0133698957556158,0.0012459198695305,0.0009659780264327,0.0007122421912177,0.0001807027493081,0.0003153989780709,0.0002617032113293,0.0417357137673065,0.037053681245708,0.0258239405192095,0.0355040511292883,0.0079305589504246,0.0431919315370455,0.0380592871501506,0.0002710001762441,-5.63915830606998e-05,-0.0001082958075588,-0.0090567542684258,-2.756469558728991e-05,-0.0001563185847993,-0.0002886654854554,9.925449050007806e-05,0.000107985364475,8.458403009559134e-05,-0.0022017008704424,0.0001137974013121,0.0001370875677253,0.0001129488012604,0.0224458902096885,0.0160509974882403,0.0139904876217838,0.0123355251479742,8.166134063747332e-05,0.0058053415136246,0.0014389584400239,0.001971802058891,0.0024093411277035,0.001686138135404,-0.0010796141504848,0.0003345335840068,0.0010768259859971,0.0009634132965303,-1.628983071766399e-07,-5.735301783493796e-07,-9.329080182807204e-07,-3.619660519094126e-07,-1.83925572883048e-07,-1.0285399265619333e-07,-3.092463383147504e-07,-0.0019252018323373,0.0092032366924867,0.0154717708921119,0.0066667726464894,0.0056638588451514,0.004053515034148,0.0048719008779666,-2.7203057332281233e-06,1.812912166032632e-05,1.8939455473598876e-05,1.8465193852734707e-05,1.6689837299188603e-05,1.598518855439046e-05,1.29799385881757e-05,-5.889078188436869e-07,-1.1371781433178183e-06,3.296718671386145e-07,5.313955315777719e-07,1.1114442323156837e-06,-7.848764985718404e-07,-7.849897005751671e-07],"y":[-0.008771421947336542,-0.008759662850705343,-0.01004073390051507,-0.007887114193731386,-0.011654684421069227,-0.00962450093164868,-0.014873509133903662,-0.05482201505194039,-0.04209906508455394,-0.004250444234616164,-0.029468342636488114,-0.012316770085774966,-0.029479310439835798,-0.021472758145603066,-0.019384533856877093,-0.019384566125143495,-0.019385922630693147,-0.01790052437986002,-0.019388105190951428,-0.019384546953301007,-0.019387270373315384,-0.017444758068623695,-0.016278263927356592,-0.013946446733213108,-0.009346384553026119,-0.019240580943757905,-0.007423336798624661,-0.008786836168408805,-0.0194816051403944,-0.017043534098454792,-0.017781395570146522,-0.016902635744704058,-0.01716583237665457,-0.016117046875201067,-0.017373430388660696,-0.019399468691297293,-0.019399619914126226,-0.019396497972812596,-0.01940304095588262,-0.01940079670708029,-0.019399112573533932,-0.019399402932261244,-0.018112765906824153,-0.0031093388623117764,-0.004796836954505377,-0.00858670370227643,-0.009785992696800657,-0.014036120896624302,-0.01806222893902015,-0.018623219941043326,-0.011432513721816818,-0.01418553292083658,-0.013185043728961253,-0.016341100721329785,-0.014801278336264165,-0.01682570608688081,-0.019258943006496228,-0.01886031359966846,-0.018623109894951664,-0.018705619521166235,-0.01897184102340712,-0.018944376919753696,-0.01883490871492885,-0.019567610196470853,-0.019119837358360616,-0.01886916207252019,-0.019131414112327355,-0.019164736875508428,-0.0191711377686815,-0.019051146462863374,-0.019352482879436462,-0.019134415965531268,-0.01885317645515894,-0.01901388281191284,-0.0192128992724661,-0.01912658009144707,-0.019083810312977144,-0.019433950976299123,-0.019114482542847117,-0.01855542440484788,-0.018797474437147743,-0.018994025168949828,-0.01904780323024912,-0.018843905619818593,-0.019386255674048388,-0.01938625293969419,-0.0193862623763718,-0.01938624120486197,-0.019386266010305894,-0.019386246445981394,-0.019386256098875895,-0.019224268579854473,-0.01939879922865147,-0.019471550639848467,-0.019321037319011188,-0.01943614728894038,-0.01950838002957553,-0.019535254247386093,-0.019386407829168454,-0.01938662911371367,-0.019386511523333375,-0.01938667992237534,-0.019386758309584456,-0.019386917400965542,-0.01938691069729182,-0.004037245175913225,0.015876453199547804,0.002302885454293346,0.011697416963240474,-0.009718082193150684,0.009292901815281474,-0.003181686342157531,-0.01907974806911967,-0.019079475331690847,-0.019055114275351462,-0.018754926189450436,-0.018833905378765597,-0.01921674056851282,-0.01960282903326755,-0.013384628153008933,-0.013388972289249883,-0.013286455554579135,-0.013221973872378993,-0.013074689174496532,-0.013392941777172726,-0.013448585552909752,-0.01070763305001952,-0.010525941259405472,-0.014591790128531604,-0.006587659608775505,-0.007950427084945292,-0.015087914896286202,-0.022381064121146637,-0.015268504432333078,-0.011203952086491397,-0.01112565080585781,-0.010347244285365651,-0.011534318591510573,-0.01277274182910859,-0.017138408612278434,-0.019108580326055304,-0.019222607181380365,-0.019384560217160143,-0.01606655873445648,-0.019267973211586548,-0.019406257243616293,-0.019626228444229964,-0.01945213708181584,-0.019380907638117572,-0.019323228052926442,-0.01641850672272319,-0.019344466331801535,-0.01941886523699104,-0.01941482272753137,-0.0221148386860322,-0.018003008643915294,-0.013317435271765614,-0.017678279819198423,-0.017374829713060196,-0.020525190712790055,-0.02100591555694852,-0.01939640417305659,-0.019286883415574635,-0.01932247935906549,-0.016309005313493174,-0.019281316053889087,-0.019203455834972533,-0.019273692753984085,-0.01398146241517571,-0.005141957118469453,-0.0061853967397246315,-0.0086482154445973,-0.01271437077598035,-0.014449132817630925,-0.01926338294125929,-0.025247762122605988,-0.015084425628847285,-0.009405825007731612,-0.02488829818970666,-0.020938761579818624,-0.02797478131706484,-0.024096302142508613,-0.023005123196382364,-0.016588450292218875,-0.013188020048695216,-0.022039254356594606,-0.020935879906638828,-0.026736841122923162,-0.024088755943860705,-0.02754111740550175,-0.010185561655009742,-0.010498693848546042,-0.019014537061771277,-0.020079163554998086,-0.022702668255956997,-0.021958582804014477,-0.019385030000972147,-0.01938496213635846,-0.019384971581913442,-0.01938499343378034,-0.019385044322746903,-0.01938498560521339,-0.01938500635640635,-0.01938627108760448,-0.019386255365492475,-0.019386258466975878,-0.019386241275901297,-0.019386264424858097,-0.019386210884423973,-0.019386224881633104,-0.007475931829235819,-0.018276363686448763,-0.01852574498089941,-0.01875178111159791,-0.019225293726247237,-0.019105301946830563,-0.019153135881437695,0.017793260998917378,0.013622354220653625,0.00361853611425866,0.012241893336078238,-0.012321469882501178,0.01909050712833104,0.014518180651536617,-0.019144853842856902,-0.019436505065212332,-0.019482743035747773,-0.02745432073779655,-0.01941082513671879,-0.019525523286884318,-0.01964342220844932,-0.019297850482991884,-0.01929007273662336,-0.01931091940604166,-0.021347616320193025,-0.01928489518526558,-0.019264147547885534,-0.019285651145778744,0.0006092590816235293,-0.005087519245975858,-0.006923088420055111,-0.008397382792839166,-0.019313523032824558,-0.014214682663818456,-0.018104398652369423,-0.017629724234488914,-0.017239950208049172,-0.017884202944169165,-0.0203480249921787,-0.019088256217816662,-0.018426998014967184,-0.01852802972567318,-0.01938641472489764,-0.019386780529117697,-0.01938710067458051,-0.019386592060916134,-0.019386433456669506,-0.019386361235470287,-0.0193865450964814,-0.021101301988351896,-0.011187727176438142,-0.005603513127863242,-0.013447291806429335,-0.01434072002434927,-0.01577526664179909,-0.01504622192725005,-0.01938869294657143,-0.01937011959885598,-0.019369397727152005,-0.019369820214821625,-0.019371401760154526,-0.01937202948416379,-0.019374706658531256,-0.01938679422801976,-0.019387282645048503,-0.019385975927373414,-0.019385796225375306,-0.019385279499135905,-0.0193869688032904,-0.019386968904134425],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["[retail] Llama2-7B-Chat - White F","[retail] Llama2-7B-Chat - Black F","[retail] Llama2-7B-Chat - Black M","[retail] Llama2-7B-Chat - Hispanic F","[retail] Llama2-7B-Chat - Hispanic M","[retail] Llama2-7B-Chat - Asian F","[retail] Llama2-7B-Chat - Asian M","[software_engineer] Llama2-7B-Chat - White F","[software_engineer] Llama2-7B-Chat - Black F","[software_engineer] Llama2-7B-Chat - Black M","[software_engineer] Llama2-7B-Chat - Hispanic F","[software_engineer] Llama2-7B-Chat - Hispanic M","[software_engineer] Llama2-7B-Chat - Asian F","[software_engineer] Llama2-7B-Chat - Asian M","[HR_specialist] Llama2-7B-Chat - White F","[HR_specialist] Llama2-7B-Chat - Black F","[HR_specialist] Llama2-7B-Chat - Black M","[HR_specialist] Llama2-7B-Chat - Hispanic F","[HR_specialist] Llama2-7B-Chat - Hispanic M","[HR_specialist] Llama2-7B-Chat - Asian F","[HR_specialist] Llama2-7B-Chat - Asian M","[financial_analyst] Llama2-7B-Chat - White F","[financial_analyst] Llama2-7B-Chat - Black F","[financial_analyst] Llama2-7B-Chat - Black M","[financial_analyst] Llama2-7B-Chat - Hispanic F","[financial_analyst] Llama2-7B-Chat - Hispanic M","[financial_analyst] Llama2-7B-Chat - Asian F","[financial_analyst] Llama2-7B-Chat - Asian M","[retail] Llama3-8B-IT - White F","[retail] Llama3-8B-IT - Black F","[retail] Llama3-8B-IT - Black M","[retail] Llama3-8B-IT - Hispanic F","[retail] Llama3-8B-IT - Hispanic M","[retail] Llama3-8B-IT - Asian F","[retail] Llama3-8B-IT - Asian M","[software_engineer] Llama3-8B-IT - White F","[software_engineer] Llama3-8B-IT - Black F","[software_engineer] Llama3-8B-IT - Black M","[software_engineer] Llama3-8B-IT - Hispanic F","[software_engineer] Llama3-8B-IT - Hispanic M","[software_engineer] Llama3-8B-IT - Asian F","[software_engineer] Llama3-8B-IT - Asian M","[HR_specialist] Llama3-8B-IT - White F","[HR_specialist] Llama3-8B-IT - Black F","[HR_specialist] Llama3-8B-IT - Black M","[HR_specialist] Llama3-8B-IT - Hispanic F","[HR_specialist] Llama3-8B-IT - Hispanic M","[HR_specialist] Llama3-8B-IT - Asian F","[HR_specialist] Llama3-8B-IT - Asian M","[financial_analyst] Llama3-8B-IT - White F","[financial_analyst] Llama3-8B-IT - Black F","[financial_analyst] Llama3-8B-IT - Black M","[financial_analyst] Llama3-8B-IT - Hispanic F","[financial_analyst] Llama3-8B-IT - Hispanic M","[financial_analyst] Llama3-8B-IT - Asian F","[financial_analyst] Llama3-8B-IT - Asian M","[retail] TinyLlama-1.1B-Chat - White F","[retail] TinyLlama-1.1B-Chat - Black F","[retail] TinyLlama-1.1B-Chat - Black M","[retail] TinyLlama-1.1B-Chat - Hispanic F","[retail] TinyLlama-1.1B-Chat - Hispanic M","[retail] TinyLlama-1.1B-Chat - Asian F","[retail] TinyLlama-1.1B-Chat - Asian M","[software_engineer] TinyLlama-1.1B-Chat - White F","[software_engineer] TinyLlama-1.1B-Chat - Black F","[software_engineer] TinyLlama-1.1B-Chat - Black M","[software_engineer] TinyLlama-1.1B-Chat - Hispanic F","[software_engineer] TinyLlama-1.1B-Chat - Hispanic M","[software_engineer] TinyLlama-1.1B-Chat - Asian F","[software_engineer] TinyLlama-1.1B-Chat - Asian M","[HR_specialist] TinyLlama-1.1B-Chat - White F","[HR_specialist] TinyLlama-1.1B-Chat - Black F","[HR_specialist] TinyLlama-1.1B-Chat - Black M","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic F","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic M","[HR_specialist] TinyLlama-1.1B-Chat - Asian F","[HR_specialist] TinyLlama-1.1B-Chat - Asian M","[financial_analyst] TinyLlama-1.1B-Chat - White F","[financial_analyst] TinyLlama-1.1B-Chat - Black F","[financial_analyst] TinyLlama-1.1B-Chat - Black M","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic F","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic M","[financial_analyst] TinyLlama-1.1B-Chat - Asian F","[financial_analyst] TinyLlama-1.1B-Chat - Asian M","[retail] Llama3-70B-IT - White F","[retail] Llama3-70B-IT - Black F","[retail] Llama3-70B-IT - Black M","[retail] Llama3-70B-IT - Hispanic F","[retail] Llama3-70B-IT - Hispanic M","[retail] Llama3-70B-IT - Asian F","[retail] Llama3-70B-IT - Asian M","[software_engineer] Llama3-70B-IT - White F","[software_engineer] Llama3-70B-IT - Black F","[software_engineer] Llama3-70B-IT - Black M","[software_engineer] Llama3-70B-IT - Hispanic F","[software_engineer] Llama3-70B-IT - Hispanic M","[software_engineer] Llama3-70B-IT - Asian F","[software_engineer] Llama3-70B-IT - Asian M","[HR_specialist] Llama3-70B-IT - White F","[HR_specialist] Llama3-70B-IT - Black F","[HR_specialist] Llama3-70B-IT - Black M","[HR_specialist] Llama3-70B-IT - Hispanic F","[HR_specialist] Llama3-70B-IT - Hispanic M","[HR_specialist] Llama3-70B-IT - Asian F","[HR_specialist] Llama3-70B-IT - Asian M","[financial_analyst] Llama3-70B-IT - White F","[financial_analyst] Llama3-70B-IT - Black F","[financial_analyst] Llama3-70B-IT - Black M","[financial_analyst] Llama3-70B-IT - Hispanic F","[financial_analyst] Llama3-70B-IT - Hispanic M","[financial_analyst] Llama3-70B-IT - Asian F","[financial_analyst] Llama3-70B-IT - Asian M","[retail] StableLM2-Zephyr-1.6B - White F","[retail] StableLM2-Zephyr-1.6B - Black F","[retail] StableLM2-Zephyr-1.6B - Black M","[retail] StableLM2-Zephyr-1.6B - Hispanic F","[retail] StableLM2-Zephyr-1.6B - Hispanic M","[retail] StableLM2-Zephyr-1.6B - Asian F","[retail] StableLM2-Zephyr-1.6B - Asian M","[software_engineer] StableLM2-Zephyr-1.6B - White F","[software_engineer] StableLM2-Zephyr-1.6B - Black F","[software_engineer] StableLM2-Zephyr-1.6B - Black M","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic F","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic M","[software_engineer] StableLM2-Zephyr-1.6B - Asian F","[software_engineer] StableLM2-Zephyr-1.6B - Asian M","[HR_specialist] StableLM2-Zephyr-1.6B - White F","[HR_specialist] StableLM2-Zephyr-1.6B - Black F","[HR_specialist] StableLM2-Zephyr-1.6B - Black M","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic F","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic M","[HR_specialist] StableLM2-Zephyr-1.6B - Asian F","[HR_specialist] StableLM2-Zephyr-1.6B - Asian M","[financial_analyst] StableLM2-Zephyr-1.6B - White F","[financial_analyst] StableLM2-Zephyr-1.6B - Black F","[financial_analyst] StableLM2-Zephyr-1.6B - Black M","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic F","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic M","[financial_analyst] StableLM2-Zephyr-1.6B - Asian F","[financial_analyst] StableLM2-Zephyr-1.6B - Asian M","[retail] Llama2-13B-Chat - White F","[retail] Llama2-13B-Chat - Black F","[retail] Llama2-13B-Chat - Black M","[retail] Llama2-13B-Chat - Hispanic F","[retail] Llama2-13B-Chat - Hispanic M","[retail] Llama2-13B-Chat - Asian F","[retail] Llama2-13B-Chat - Asian M","[software_engineer] Llama2-13B-Chat - White F","[software_engineer] Llama2-13B-Chat - Black F","[software_engineer] Llama2-13B-Chat - Black M","[software_engineer] Llama2-13B-Chat - Hispanic F","[software_engineer] Llama2-13B-Chat - Hispanic M","[software_engineer] Llama2-13B-Chat - Asian F","[software_engineer] Llama2-13B-Chat - Asian M","[HR_specialist] Llama2-13B-Chat - White F","[HR_specialist] Llama2-13B-Chat - Black F","[HR_specialist] Llama2-13B-Chat - Black M","[HR_specialist] Llama2-13B-Chat - Hispanic F","[HR_specialist] Llama2-13B-Chat - Hispanic M","[HR_specialist] Llama2-13B-Chat - Asian F","[HR_specialist] Llama2-13B-Chat - Asian M","[financial_analyst] Llama2-13B-Chat - White F","[financial_analyst] Llama2-13B-Chat - Black F","[financial_analyst] Llama2-13B-Chat - Black M","[financial_analyst] Llama2-13B-Chat - Hispanic F","[financial_analyst] Llama2-13B-Chat - Hispanic M","[financial_analyst] Llama2-13B-Chat - Asian F","[financial_analyst] Llama2-13B-Chat - Asian M","[retail] StarlingLM-7B - White F","[retail] StarlingLM-7B - Black F","[retail] StarlingLM-7B - Black M","[retail] StarlingLM-7B - Hispanic F","[retail] StarlingLM-7B - Hispanic M","[retail] StarlingLM-7B - Asian F","[retail] StarlingLM-7B - Asian M","[software_engineer] StarlingLM-7B - White F","[software_engineer] StarlingLM-7B - Black F","[software_engineer] StarlingLM-7B - Black M","[software_engineer] StarlingLM-7B - Hispanic F","[software_engineer] StarlingLM-7B - Hispanic M","[software_engineer] StarlingLM-7B - Asian F","[software_engineer] StarlingLM-7B - Asian M","[HR_specialist] StarlingLM-7B - White F","[HR_specialist] StarlingLM-7B - Black F","[HR_specialist] StarlingLM-7B - Black M","[HR_specialist] StarlingLM-7B - Hispanic F","[HR_specialist] StarlingLM-7B - Hispanic M","[HR_specialist] StarlingLM-7B - Asian F","[HR_specialist] StarlingLM-7B - Asian M","[financial_analyst] StarlingLM-7B - White F","[financial_analyst] StarlingLM-7B - Black F","[financial_analyst] StarlingLM-7B - Black M","[financial_analyst] StarlingLM-7B - Hispanic F","[financial_analyst] StarlingLM-7B - Hispanic M","[financial_analyst] StarlingLM-7B - Asian F","[financial_analyst] StarlingLM-7B - Asian M","[retail] StableLM-Zephyr-3B - White F","[retail] StableLM-Zephyr-3B - Black F","[retail] StableLM-Zephyr-3B - Black M","[retail] StableLM-Zephyr-3B - Hispanic F","[retail] StableLM-Zephyr-3B - Hispanic M","[retail] StableLM-Zephyr-3B - Asian F","[retail] StableLM-Zephyr-3B - Asian M","[software_engineer] StableLM-Zephyr-3B - White F","[software_engineer] StableLM-Zephyr-3B - Black F","[software_engineer] StableLM-Zephyr-3B - Black M","[software_engineer] StableLM-Zephyr-3B - Hispanic F","[software_engineer] StableLM-Zephyr-3B - Hispanic M","[software_engineer] StableLM-Zephyr-3B - Asian F","[software_engineer] StableLM-Zephyr-3B - Asian M","[HR_specialist] StableLM-Zephyr-3B - White F","[HR_specialist] StableLM-Zephyr-3B - Black F","[HR_specialist] StableLM-Zephyr-3B - Black M","[HR_specialist] StableLM-Zephyr-3B - Hispanic F","[HR_specialist] StableLM-Zephyr-3B - Hispanic M","[HR_specialist] StableLM-Zephyr-3B - Asian F","[HR_specialist] StableLM-Zephyr-3B - Asian M","[financial_analyst] StableLM-Zephyr-3B - White F","[financial_analyst] StableLM-Zephyr-3B - Black F","[financial_analyst] StableLM-Zephyr-3B - Black M","[financial_analyst] StableLM-Zephyr-3B - Hispanic F","[financial_analyst] StableLM-Zephyr-3B - Hispanic M","[financial_analyst] StableLM-Zephyr-3B - Asian F","[financial_analyst] StableLM-Zephyr-3B - Asian M","[retail] Gemma-2B-IT - White F","[retail] Gemma-2B-IT - Black F","[retail] Gemma-2B-IT - Black M","[retail] Gemma-2B-IT - Hispanic F","[retail] Gemma-2B-IT - Hispanic M","[retail] Gemma-2B-IT - Asian F","[retail] Gemma-2B-IT - Asian M","[software_engineer] Gemma-2B-IT - White F","[software_engineer] Gemma-2B-IT - Black F","[software_engineer] Gemma-2B-IT - Black M","[software_engineer] Gemma-2B-IT - Hispanic F","[software_engineer] Gemma-2B-IT - Hispanic M","[software_engineer] Gemma-2B-IT - Asian F","[software_engineer] Gemma-2B-IT - Asian M","[HR_specialist] Gemma-2B-IT - White F","[HR_specialist] Gemma-2B-IT - Black F","[HR_specialist] Gemma-2B-IT - Black M","[HR_specialist] Gemma-2B-IT - Hispanic F","[HR_specialist] Gemma-2B-IT - Hispanic M","[HR_specialist] Gemma-2B-IT - Asian F","[HR_specialist] Gemma-2B-IT - Asian M","[financial_analyst] Gemma-2B-IT - White F","[financial_analyst] Gemma-2B-IT - Black F","[financial_analyst] Gemma-2B-IT - Black M","[financial_analyst] Gemma-2B-IT - Hispanic F","[financial_analyst] Gemma-2B-IT - Hispanic M","[financial_analyst] Gemma-2B-IT - Asian F","[financial_analyst] Gemma-2B-IT - Asian M","[retail] Gemma-7B-IT - White F","[retail] Gemma-7B-IT - Black F","[retail] Gemma-7B-IT - Black M","[retail] Gemma-7B-IT - Hispanic F","[retail] Gemma-7B-IT - Hispanic M","[retail] Gemma-7B-IT - Asian F","[retail] Gemma-7B-IT - Asian M","[software_engineer] Gemma-7B-IT - White F","[software_engineer] Gemma-7B-IT - Black F","[software_engineer] Gemma-7B-IT - Black M","[software_engineer] Gemma-7B-IT - Hispanic F","[software_engineer] Gemma-7B-IT - Hispanic M","[software_engineer] Gemma-7B-IT - Asian F","[software_engineer] Gemma-7B-IT - Asian M","[HR_specialist] Gemma-7B-IT - White F","[HR_specialist] Gemma-7B-IT - Black F","[HR_specialist] Gemma-7B-IT - Black M","[HR_specialist] Gemma-7B-IT - Hispanic F","[HR_specialist] Gemma-7B-IT - Hispanic M","[HR_specialist] Gemma-7B-IT - Asian F","[HR_specialist] Gemma-7B-IT - Asian M","[financial_analyst] Gemma-7B-IT - White F","[financial_analyst] Gemma-7B-IT - Black F","[financial_analyst] Gemma-7B-IT - Black M","[financial_analyst] Gemma-7B-IT - Hispanic F","[financial_analyst] Gemma-7B-IT - Hispanic M","[financial_analyst] Gemma-7B-IT - Asian F","[financial_analyst] Gemma-7B-IT - Asian M"],"marker":{"color":"#FF7F0E"},"mode":"markers","showlegend":false,"x":[0.1076749999999999,0.0629444444444444,0.0014416666666665,0.0655472222222222,-0.0207555555555555,-0.0081055555555555,-0.1056638888888888,-0.07445,-0.1156138888888889,-0.0510416666666666,-0.0388777777777777,-0.0146916666666666,-0.0182222222222222,-0.052511111111111,0.0176944444444444,-0.0708222222222222,-0.0560916666666666,-0.0385472222222221,-0.0565666666666666,-0.0299138888888889,-0.1127333333333333,-0.0083277777777778,-0.1000777777777778,-0.0667972222222221,-0.0242888888888889,-0.0491111111111111,-0.0494055555555555,-0.1182805555555556,0.0213638888888889,0.0701472222222221,0.0341388888888889,0.0974305555555554,0.0564111111111111,0.0678055555555554,0.0176944444444444,-0.1500222222222221,-0.0845777777777777,-0.0251722222222222,-0.1408527777777778,-0.1000805555555555,-0.1357138888888889,-0.1395388888888888,0.0336611111111111,0.0319166666666665,-0.0125027777777777,0.0138638888888888,-0.0178333333333333,-0.0152416666666667,-0.0667333333333333,-0.0006777777777777,-0.0160749999999999,-0.0464361111111111,-0.0177388888888888,-0.0439333333333333,-0.0369166666666667,-0.071825,0.0214777777777777,0.1788722222222223,0.2646944444444443,0.2310166666666666,0.1336555555555556,0.1591333333333333,0.184911111111111,-0.0583555555555556,0.0703833333333332,0.1296777777777777,0.0728277777777777,0.0493555555555556,0.0535333333333334,0.0790888888888889,0.0084888888888889,0.084961111111111,0.1845777777777777,0.1348777777777778,0.05285,0.0937777777777777,0.0977777777777777,-0.0573777777777777,0.0945222222222221,0.2299944444444444,0.1759388888888888,0.1042444444444443,0.0969055555555555,0.1457333333333332,-0.0015666666666667,0.0113194444444444,0.0208333333333332,0.031725,0.0186277777777776,0.0373916666666667,0.0276472222222221,0.08775,0.0688805555555556,0.0030444444444444,0.0958194444444444,-0.0025249999999999,0.0436972222222222,0.0085972222222221,0.0460305555555555,0.0420972222222222,0.0110916666666667,0.0564888888888888,0.0026111111111111,0.0638777777777777,0.0345694444444444,0.0238472222222221,0.0963472222222221,0.0871249999999999,0.0887361111111111,0.0326249999999999,0.080513888888889,0.0825444444444445,0.0523499999999999,0.0435388888888887,0.0660722222222223,0.2082055555555555,0.1928388888888887,0.001411111111111,-0.0651666666666667,0.0623444444444445,0.0119444444444445,0.074011111111111,0.125461111111111,0.2455333333333333,0.0232388888888888,-0.0246388888888888,0.0978055555555554,0.0242666666666666,0.0567944444444443,0.2216444444444445,0.190911111111111,0.0305722222222222,-0.0325499999999999,0.1019611111111111,0.0279944444444444,0.0572166666666666,0.1104444444444443,0.1560222222222222,0.0120222222222221,-0.0368111111111111,0.1079805555555555,-0.0180888888888889,-0.0514777777777777,0.056788888888889,0.0226444444444444,-0.0504666666666666,-0.0988,0.0050222222222222,-0.1019277777777777,-0.1000638888888888,-0.00495,0.0134277777777778,-0.0534666666666666,-0.0808222222222222,0.1446222222222222,-0.0959694444444444,-0.1258222222222221,-0.0097722222222221,-0.0283333333333333,-0.14265,-0.2200722222222222,-0.0025722222222221,-0.1095333333333333,-0.1120444444444443,-0.07735,-0.062461111111111,-0.1251722222222222,-0.1444555555555555,0.0779499999999999,0.0739,0.0267111111111111,0.0351611111111112,-0.0338388888888888,-0.0008333333333333,-0.04905,-0.0518111111111111,-0.0459888888888888,-0.0186833333333333,-0.1285388888888888,-0.0878944444444445,-0.13215,-0.1061611111111111,0.0611777777777777,0.1023222222222222,0.0608277777777777,0.0332888888888889,0.0110166666666666,-0.0674277777777777,-0.123,0.0806888888888888,0.1108777777777778,0.0406055555555555,0.0655444444444444,0.0106333333333332,0.0156944444444444,-0.0388833333333333,-0.0976944444444444,0.0667666666666666,0.1283222222222222,-0.02695,-0.0437333333333332,0.0716833333333333,0.1130444444444445,-0.0351055555555555,-0.0135277777777778,-0.0021833333333333,-0.0526666666666666,-0.0680777777777777,0.0470111111111111,0.039211111111111,-0.1091111111111111,-0.0507666666666666,0.0702333333333333,-0.1073499999999999,-0.0527944444444444,0.0035222222222222,0.0313444444444444,-0.0484277777777777,0.0030888888888889,0.0665055555555556,-0.0246555555555555,0.0015888888888888,0.0231833333333333,0.0604333333333333,0.2271277777777778,0.091261111111111,-0.0095499999999999,0.1209,-0.0377111111111111,-0.0218333333333333,-0.0752055555555555,0.1166055555555556,0.0619499999999999,0.0022666666666666,0.1014777777777777,0.0229888888888889,0.0799777777777777,0.075061111111111,0.2870888888888889,0.2163222222222223,0.0380444444444445,0.19455,-0.0604444444444444,0.1788499999999999,0.0696333333333334,0.1501888888888889,0.1160499999999999,0.02285,0.1157388888888888,-0.0285555555555555,0.04525,0.0261388888888889,-0.066625,-0.1619166666666667,-0.1577722222222222,-0.1199583333333332,-0.0908777777777777,-0.0822916666666666,-0.1160527777777777,-0.0418527777777777,-0.1163222222222222,-0.1001111111111111,-0.1114916666666666,-0.0888361111111111,-0.0937138888888888,-0.0762777777777777,-0.0396388888888888,-0.0999499999999999,-0.0876638888888888,-0.0608555555555555,-0.0959444444444445,-0.0591555555555555,-0.0756972222222222,-0.0711194444444444,-0.2158833333333333,-0.1777472222222221,-0.1816638888888888,-0.1595888888888889,-0.1530444444444444,-0.1669444444444444],"y":[0.0555555555555555,0.0138888888888888,-0.0216666666666667,-0.0011111111111111,-0.0255555555555556,-0.0072222222222223,-0.0538888888888889,-0.0738888888888888,-0.1083333333333333,-0.0594444444444444,-0.0638888888888887,-0.0277777777777776,-0.0322222222222221,-0.0655555555555554,-0.0016666666666666,-0.0522222222222222,-0.0355555555555555,-0.0322222222222222,-0.0455555555555555,-0.0105555555555555,-0.0444444444444444,-0.0194444444444445,-0.0755555555555556,-0.045,-0.0416666666666667,-0.0294444444444444,-0.0611111111111111,-0.0966666666666667,0.0338888888888888,-0.0238888888888889,-0.0577777777777777,-0.0177777777777777,-0.0544444444444444,-0.0316666666666666,-0.0483333333333333,-0.0322222222222222,-0.0475,-0.0625,-0.0591666666666667,-0.0580555555555556,-0.0780555555555556,-0.0780555555555556,0.038611111111111,-0.0025,-0.0249999999999999,-0.0044444444444443,-0.036111111111111,-0.005,-0.0411111111111111,-0.0144444444444444,-0.0694444444444444,-0.0883333333333333,-0.0561111111111111,-0.0683333333333334,-0.0655555555555555,-0.0777777777777777,-0.0088888888888888,0.0561111111111111,0.0788888888888889,0.0894444444444444,0.0438888888888888,0.0155555555555556,0.0405555555555555,-0.0172222222222221,0.0394444444444445,0.0616666666666667,0.0383333333333334,0.0283333333333334,0.0138888888888888,0.0222222222222222,0.0055555555555554,0.0422222222222221,0.0433333333333333,0.0538888888888887,0.0238888888888887,0.03,0.0411111111111111,-0.0122222222222221,0.0305555555555556,0.0622222222222223,0.08,0.0727777777777778,-0.0033333333333332,0.0277777777777778,0.009074074074074,0.0203703703703703,0.0102777777777777,0.0229629629629628,0.0198148148148148,0.0306481481481481,0.0164814814814814,0.017962962962963,0.02,0.0166666666666666,0.0471296296296296,0.0263888888888889,0.0348148148148148,0.0303703703703704,0.016898148148148,0.0285648148148147,0.0133333333333332,0.0487499999999999,0.0175925925925925,0.0616203703703704,0.0450925925925926,-0.0004629629629629,0.0044444444444445,0.0026851851851851,0.0158333333333333,0.0082407407407407,0.0438888888888889,0.0609259259259259,-0.015,-0.0266666666666666,-0.0161111111111111,0.0672222222222222,0.0549999999999999,-0.0383333333333333,-0.0572222222222222,-0.0166666666666666,-0.0783333333333334,-0.0572222222222223,-0.0383333333333334,0.0555555555555555,-0.0622222222222223,-0.0827777777777778,0.02,-0.0494444444444445,-0.0133333333333333,0.08,0.0633333333333333,-0.0483333333333333,-0.0433333333333333,0.0566666666666665,-0.0444444444444445,-0.0361111111111112,0.006111111111111,0.0622222222222222,-0.0372222222222223,-0.0472222222222223,0.0633333333333333,-0.0505555555555556,-0.0605555555555556,-0.0005555555555556,-0.0088888888888889,-0.0544444444444444,-0.0838888888888889,0.0372222222222221,-0.1177777777777778,-0.1388888888888889,-0.0499999999999999,-0.0416666666666667,-0.0661111111111111,-0.0805555555555556,0.1616666666666666,-0.045,-0.0888888888888889,0.0077777777777778,-0.03,-0.0794444444444445,-0.1038888888888888,0.0222222222222222,-0.0777777777777777,-0.0783333333333334,-0.0416666666666666,-0.0449999999999999,-0.0983333333333334,-0.0988888888888889,0.0861111111111111,0.0405555555555556,0.0083333333333332,0.0299999999999999,-0.0388888888888889,0.0083333333333332,-0.0188888888888889,-0.0077777777777778,-0.0655555555555554,-0.0633333333333333,-0.0888888888888888,-0.0611111111111111,-0.0861111111111111,-0.0716666666666667,0.0961111111111111,0.0755555555555555,0.0266666666666666,0.0377777777777778,0.0088888888888889,-0.0138888888888888,-0.0488888888888889,0.09,0.0455555555555555,-0.0255555555555555,0.0161111111111111,-0.0016666666666666,-0.0049999999999999,-0.0172222222222221,-0.0183333333333333,0.0244444444444445,0.0327777777777778,-0.001111111111111,-0.0322222222222221,0.0405555555555556,0.0605555555555556,-0.0294444444444444,-0.0322222222222223,-0.0055555555555555,-0.0444444444444444,-0.0550000000000001,0.0183333333333333,-0.0027777777777777,-0.0444444444444445,-0.05,-0.0011111111111111,-0.0566666666666667,-0.0427777777777778,-0.0194444444444445,0.0055555555555554,-0.0311111111111111,-0.0122222222222222,0.0555555555555555,-0.0055555555555555,0.0083333333333334,-0.0077777777777778,0.0194444444444445,0.1572222222222223,0.0877777777777778,0.0144444444444445,0.1033333333333333,-0.0238888888888888,0.0027777777777778,-0.0261111111111111,0.0694444444444444,0.0127777777777778,-0.0466666666666666,0.0227777777777778,-0.0344444444444443,0.0094444444444444,0.0111111111111111,0.1822222222222221,0.0855555555555555,-0.0216666666666667,0.0727777777777777,-0.0438888888888889,0.0683333333333332,0.0166666666666665,0.0633333333333334,0.0261111111111111,-0.0316666666666665,0.0211111111111112,-0.0383333333333332,0.0050000000000001,0.0033333333333334,-0.0611574074074072,-0.1302962962962961,-0.1259166666666665,-0.1143703703703702,-0.1006944444444442,-0.0763796296296294,-0.1066666666666665,-0.0325462962962961,-0.099398148148148,-0.1099537037037036,-0.1136111111111111,-0.0917592592592592,-0.0986574074074073,-0.0970370370370369,-0.0499999999999997,-0.1429166666666665,-0.1319814814814813,-0.109509259259259,-0.1206944444444442,-0.0916481481481479,-0.1182870370370369,-0.0571296296296296,-0.1668703703703703,-0.1375185185185184,-0.1396759259259258,-0.1174537037037035,-0.1307407407407406,-0.1266851851851851],"type":"scatter","xaxis":"x2","yaxis":"y2"},{"line":{"color":"#FF7F0E"},"mode":"lines","showlegend":false,"x":[0.1076749999999999,0.0629444444444444,0.0014416666666665,0.0655472222222222,-0.0207555555555555,-0.0081055555555555,-0.1056638888888888,-0.07445,-0.1156138888888889,-0.0510416666666666,-0.0388777777777777,-0.0146916666666666,-0.0182222222222222,-0.052511111111111,0.0176944444444444,-0.0708222222222222,-0.0560916666666666,-0.0385472222222221,-0.0565666666666666,-0.0299138888888889,-0.1127333333333333,-0.0083277777777778,-0.1000777777777778,-0.0667972222222221,-0.0242888888888889,-0.0491111111111111,-0.0494055555555555,-0.1182805555555556,0.0213638888888889,0.0701472222222221,0.0341388888888889,0.0974305555555554,0.0564111111111111,0.0678055555555554,0.0176944444444444,-0.1500222222222221,-0.0845777777777777,-0.0251722222222222,-0.1408527777777778,-0.1000805555555555,-0.1357138888888889,-0.1395388888888888,0.0336611111111111,0.0319166666666665,-0.0125027777777777,0.0138638888888888,-0.0178333333333333,-0.0152416666666667,-0.0667333333333333,-0.0006777777777777,-0.0160749999999999,-0.0464361111111111,-0.0177388888888888,-0.0439333333333333,-0.0369166666666667,-0.071825,0.0214777777777777,0.1788722222222223,0.2646944444444443,0.2310166666666666,0.1336555555555556,0.1591333333333333,0.184911111111111,-0.0583555555555556,0.0703833333333332,0.1296777777777777,0.0728277777777777,0.0493555555555556,0.0535333333333334,0.0790888888888889,0.0084888888888889,0.084961111111111,0.1845777777777777,0.1348777777777778,0.05285,0.0937777777777777,0.0977777777777777,-0.0573777777777777,0.0945222222222221,0.2299944444444444,0.1759388888888888,0.1042444444444443,0.0969055555555555,0.1457333333333332,-0.0015666666666667,0.0113194444444444,0.0208333333333332,0.031725,0.0186277777777776,0.0373916666666667,0.0276472222222221,0.08775,0.0688805555555556,0.0030444444444444,0.0958194444444444,-0.0025249999999999,0.0436972222222222,0.0085972222222221,0.0460305555555555,0.0420972222222222,0.0110916666666667,0.0564888888888888,0.0026111111111111,0.0638777777777777,0.0345694444444444,0.0238472222222221,0.0963472222222221,0.0871249999999999,0.0887361111111111,0.0326249999999999,0.080513888888889,0.0825444444444445,0.0523499999999999,0.0435388888888887,0.0660722222222223,0.2082055555555555,0.1928388888888887,0.001411111111111,-0.0651666666666667,0.0623444444444445,0.0119444444444445,0.074011111111111,0.125461111111111,0.2455333333333333,0.0232388888888888,-0.0246388888888888,0.0978055555555554,0.0242666666666666,0.0567944444444443,0.2216444444444445,0.190911111111111,0.0305722222222222,-0.0325499999999999,0.1019611111111111,0.0279944444444444,0.0572166666666666,0.1104444444444443,0.1560222222222222,0.0120222222222221,-0.0368111111111111,0.1079805555555555,-0.0180888888888889,-0.0514777777777777,0.056788888888889,0.0226444444444444,-0.0504666666666666,-0.0988,0.0050222222222222,-0.1019277777777777,-0.1000638888888888,-0.00495,0.0134277777777778,-0.0534666666666666,-0.0808222222222222,0.1446222222222222,-0.0959694444444444,-0.1258222222222221,-0.0097722222222221,-0.0283333333333333,-0.14265,-0.2200722222222222,-0.0025722222222221,-0.1095333333333333,-0.1120444444444443,-0.07735,-0.062461111111111,-0.1251722222222222,-0.1444555555555555,0.0779499999999999,0.0739,0.0267111111111111,0.0351611111111112,-0.0338388888888888,-0.0008333333333333,-0.04905,-0.0518111111111111,-0.0459888888888888,-0.0186833333333333,-0.1285388888888888,-0.0878944444444445,-0.13215,-0.1061611111111111,0.0611777777777777,0.1023222222222222,0.0608277777777777,0.0332888888888889,0.0110166666666666,-0.0674277777777777,-0.123,0.0806888888888888,0.1108777777777778,0.0406055555555555,0.0655444444444444,0.0106333333333332,0.0156944444444444,-0.0388833333333333,-0.0976944444444444,0.0667666666666666,0.1283222222222222,-0.02695,-0.0437333333333332,0.0716833333333333,0.1130444444444445,-0.0351055555555555,-0.0135277777777778,-0.0021833333333333,-0.0526666666666666,-0.0680777777777777,0.0470111111111111,0.039211111111111,-0.1091111111111111,-0.0507666666666666,0.0702333333333333,-0.1073499999999999,-0.0527944444444444,0.0035222222222222,0.0313444444444444,-0.0484277777777777,0.0030888888888889,0.0665055555555556,-0.0246555555555555,0.0015888888888888,0.0231833333333333,0.0604333333333333,0.2271277777777778,0.091261111111111,-0.0095499999999999,0.1209,-0.0377111111111111,-0.0218333333333333,-0.0752055555555555,0.1166055555555556,0.0619499999999999,0.0022666666666666,0.1014777777777777,0.0229888888888889,0.0799777777777777,0.075061111111111,0.2870888888888889,0.2163222222222223,0.0380444444444445,0.19455,-0.0604444444444444,0.1788499999999999,0.0696333333333334,0.1501888888888889,0.1160499999999999,0.02285,0.1157388888888888,-0.0285555555555555,0.04525,0.0261388888888889,-0.066625,-0.1619166666666667,-0.1577722222222222,-0.1199583333333332,-0.0908777777777777,-0.0822916666666666,-0.1160527777777777,-0.0418527777777777,-0.1163222222222222,-0.1001111111111111,-0.1114916666666666,-0.0888361111111111,-0.0937138888888888,-0.0762777777777777,-0.0396388888888888,-0.0999499999999999,-0.0876638888888888,-0.0608555555555555,-0.0959444444444445,-0.0591555555555555,-0.0756972222222222,-0.0711194444444444,-0.2158833333333333,-0.1777472222222221,-0.1816638888888888,-0.1595888888888889,-0.1530444444444444,-0.1669444444444444],"y":[0.03740080036731478,0.013408109369983313,-0.019580909531582723,0.014804194041442035,-0.031487112957011155,-0.02470187326242955,-0.07703046424033921,-0.060287877844201025,-0.08236747095663073,-0.04773205551081513,-0.04120755735039069,-0.028234548562353346,-0.030128277076146348,-0.04852023991978165,-0.010863202580990428,-0.0583420010235766,-0.05044078756280225,-0.04103025310716378,-0.050695569290464405,-0.0363994834605324,-0.08082239112279647,-0.024821069392330013,-0.07403417152496737,-0.05618306112075513,-0.03338233142242793,-0.046696539132305225,-0.04685447400442326,-0.08379782451543584,-0.008894976486009657,0.017271553930380747,-0.002042688968359059,0.03190585877890523,0.009903743150910877,0.016015524711555016,-0.010863202580990428,-0.1008235017200875,-0.06572024146441278,-0.03385613603878209,-0.09590517141007135,-0.0740356614765911,-0.09314876090612405,-0.09520042429203503,-0.002298960647644981,-0.0032346502673633874,-0.027060466682834166,-0.012917845870149004,-0.0299196838488206,-0.028529558983856947,-0.056148792233408795,-0.02071774262050788,-0.028976544470983464,-0.04526171571862888,-0.02986902549361289,-0.04391926930562535,-0.04015565150401951,-0.05887987355975227,-0.008833888469435737,0.07558975043578682,0.12162329580333027,0.10355912231692113,0.051336317904298136,0.06500215419738165,0.07882890526583074,-0.051655098136162876,0.01739819981839994,0.04920270717908048,0.01870935724730463,0.0061192660265724595,0.008360153268700434,0.022067708207249112,-0.015800902262115446,0.02521746593986774,0.07865011107098012,0.05199189661875044,0.007993625169256597,0.02994657239366706,0.03209210273187468,-0.051130635164600945,0.030345879428833458,0.10301082011937919,0.07401636152110115,0.03556071011197698,0.03162425792201553,0.057814627564386045,-0.021194527140109633,-0.014282641557508831,-0.009179557246146995,-0.0033374569294024135,-0.010362578835408722,-0.0002979556169415982,-0.005524705913075252,0.02671337737011811,0.016592135989948423,-0.018721207444675852,0.03104168683712722,-0.02170856045030514,0.0030842345689828907,-0.015742794148789062,0.0043357939329373195,0.0022260224336998428,-0.014404817590656723,0.009945461796375983,-0.01895363989798166,0.013908733115565073,-0.0018117464666770164,-0.007562959734372495,0.031324777645640685,0.026378138254773118,0.027242310196551236,-0.002854712603305755,0.02283205339023563,0.023921208027200724,0.007725433876980588,0.002999307326428748,0.015085794898331837,0.09132363958264267,0.08308122720002831,-0.019597298999444,-0.055308459517610854,0.013086279819252223,-0.013947402442163834,0.01934407663902437,0.04694096061421992,0.11134560950266631,-0.007889259139974887,-0.033570065327021045,0.03210700224811219,-0.007337977039185416,0.010109356474989038,0.09853202553837083,0.08204720077314218,-0.003955786853260875,-0.037813447551476115,0.03433596987725019,-0.005338461960105798,0.010335829121799886,0.03888628213619879,0.06333340837877573,-0.013905683796698784,-0.040099033342316785,0.03756469504592789,-0.030056759398206113,-0.0479659779157447,0.010106376571741663,-0.008208108787458495,-0.04742363552469778,-0.07334879377803993,-0.01766036188856207,-0.07502647930638835,-0.07402672176684855,-0.023009288217843565,-0.013151768275078525,-0.049032783278353496,-0.06370582686909565,0.057218646914884,-0.07183053307343326,-0.08784304317393138,-0.02559584423668269,-0.035551700986615614,-0.096869170110641,-0.13839710176794856,-0.021733889627908967,-0.07910596685223037,-0.0804528831201051,-0.061843387339401555,-0.053857246636073115,-0.08749439449397269,-0.09783763866608192,0.02145682804150938,0.019284478574074213,-0.006026819610280728,-0.0014943867708170694,-0.038504785104898576,-0.0208011799114382,-0.04666376019658262,-0.04814477211059537,-0.045021833507204234,-0.03037560904568972,-0.08930021586196407,-0.06749924370317667,-0.09123715297284599,-0.07729716558099145,0.012460500137274927,0.03452966358833837,0.012272766232681762,-0.002498614165228177,-0.01444504628449817,-0.056521280139347596,-0.08632925232419605,0.022925920342532106,0.0391187145895047,0.00142591841174323,0.01480270408981827,-0.014650659608576436,-0.011935967750094242,-0.04121053725363822,-0.07275579303178531,0.015458282804270584,0.048475610786687925,-0.034809705077985496,-0.043811992788714914,0.01809549717831747,0.040280876856033855,-0.03918420304533101,-0.027610258831999926,-0.021525296400583274,-0.048603677210711974,-0.05686992881930634,0.0048617468561229634,0.0006779626966180442,-0.07887949420541958,-0.04758455030006335,0.01731774243071721,-0.07793486487595867,-0.04867221498540473,-0.01846493576538993,-0.003541580301856916,-0.046330011032861385,-0.018697368218695738,0.015318227351637645,-0.033579005036763594,-0.01950194209552365,-0.007919058172449964,0.012061193102108531,0.10147319004366376,0.028596676222544744,-0.02547664810678228,0.044494460048013794,-0.0405817776684135,-0.03206521418702822,-0.060693144685862434,0.04219099483768814,0.012874706688678888,-0.019138393899327345,0.03407671829471673,-0.00802335478611281,0.02254449272685076,0.019907278352803866,0.13363528579404554,0.0956772782272557,5.21830146409082e-05,0.08399903740026167,-0.052775541757226804,0.07557783082279669,0.016995912879986117,0.060204509968889625,0.041893004512936996,-0.008097852367300581,0.041726129931076404,-0.035670897116516026,0.003917117526662112,-0.0063337496447743065,-0.05609068412008236,-0.10720347457300775,-0.10498046675036482,-0.08469775529618394,-0.06909945174708979,-0.06449401127806219,-0.08260288331318402,-0.0428032955394326,-0.08274740862068831,-0.07405205094445243,-0.08015638274697784,-0.06800433730362969,-0.07062069235494395,-0.06126826601263197,-0.04161580409529963,-0.07396563375027457,-0.06737557771840491,-0.052996054597542586,-0.07181712350881952,-0.05208420420380434,-0.06095686612326714,-0.058501425847318406,-0.13615025471932557,-0.11569470887678909,-0.11779554066628406,-0.10595489511230079,-0.1024445690867333,-0.10990028701200479],"type":"scatter","xaxis":"x2","yaxis":"y2"},{"hovertext":["[retail] Llama2-7B-Chat - White F","[retail] Llama2-7B-Chat - Black F","[retail] Llama2-7B-Chat - Black M","[retail] Llama2-7B-Chat - Hispanic F","[retail] Llama2-7B-Chat - Hispanic M","[retail] Llama2-7B-Chat - Asian F","[retail] Llama2-7B-Chat - Asian M","[software_engineer] Llama2-7B-Chat - White F","[software_engineer] Llama2-7B-Chat - Black F","[software_engineer] Llama2-7B-Chat - Black M","[software_engineer] Llama2-7B-Chat - Hispanic F","[software_engineer] Llama2-7B-Chat - Hispanic M","[software_engineer] Llama2-7B-Chat - Asian F","[software_engineer] Llama2-7B-Chat - Asian M","[HR_specialist] Llama2-7B-Chat - White F","[HR_specialist] Llama2-7B-Chat - Black F","[HR_specialist] Llama2-7B-Chat - Black M","[HR_specialist] Llama2-7B-Chat - Hispanic F","[HR_specialist] Llama2-7B-Chat - Hispanic M","[HR_specialist] Llama2-7B-Chat - Asian F","[HR_specialist] Llama2-7B-Chat - Asian M","[financial_analyst] Llama2-7B-Chat - White F","[financial_analyst] Llama2-7B-Chat - Black F","[financial_analyst] Llama2-7B-Chat - Black M","[financial_analyst] Llama2-7B-Chat - Hispanic F","[financial_analyst] Llama2-7B-Chat - Hispanic M","[financial_analyst] Llama2-7B-Chat - Asian F","[financial_analyst] Llama2-7B-Chat - Asian M","[retail] Llama3-8B-IT - White F","[retail] Llama3-8B-IT - Black F","[retail] Llama3-8B-IT - Black M","[retail] Llama3-8B-IT - Hispanic F","[retail] Llama3-8B-IT - Hispanic M","[retail] Llama3-8B-IT - Asian F","[retail] Llama3-8B-IT - Asian M","[software_engineer] Llama3-8B-IT - White F","[software_engineer] Llama3-8B-IT - Black F","[software_engineer] Llama3-8B-IT - Black M","[software_engineer] Llama3-8B-IT - Hispanic F","[software_engineer] Llama3-8B-IT - Hispanic M","[software_engineer] Llama3-8B-IT - Asian F","[software_engineer] Llama3-8B-IT - Asian M","[HR_specialist] Llama3-8B-IT - White F","[HR_specialist] Llama3-8B-IT - Black F","[HR_specialist] Llama3-8B-IT - Black M","[HR_specialist] Llama3-8B-IT - Hispanic F","[HR_specialist] Llama3-8B-IT - Hispanic M","[HR_specialist] Llama3-8B-IT - Asian F","[HR_specialist] Llama3-8B-IT - Asian M","[financial_analyst] Llama3-8B-IT - White F","[financial_analyst] Llama3-8B-IT - Black F","[financial_analyst] Llama3-8B-IT - Black M","[financial_analyst] Llama3-8B-IT - Hispanic F","[financial_analyst] Llama3-8B-IT - Hispanic M","[financial_analyst] Llama3-8B-IT - Asian F","[financial_analyst] Llama3-8B-IT - Asian M","[retail] TinyLlama-1.1B-Chat - White F","[retail] TinyLlama-1.1B-Chat - Black F","[retail] TinyLlama-1.1B-Chat - Black M","[retail] TinyLlama-1.1B-Chat - Hispanic F","[retail] TinyLlama-1.1B-Chat - Hispanic M","[retail] TinyLlama-1.1B-Chat - Asian F","[retail] TinyLlama-1.1B-Chat - Asian M","[software_engineer] TinyLlama-1.1B-Chat - White F","[software_engineer] TinyLlama-1.1B-Chat - Black F","[software_engineer] TinyLlama-1.1B-Chat - Black M","[software_engineer] TinyLlama-1.1B-Chat - Hispanic F","[software_engineer] TinyLlama-1.1B-Chat - Hispanic M","[software_engineer] TinyLlama-1.1B-Chat - Asian F","[software_engineer] TinyLlama-1.1B-Chat - Asian M","[HR_specialist] TinyLlama-1.1B-Chat - White F","[HR_specialist] TinyLlama-1.1B-Chat - Black F","[HR_specialist] TinyLlama-1.1B-Chat - Black M","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic F","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic M","[HR_specialist] TinyLlama-1.1B-Chat - Asian F","[HR_specialist] TinyLlama-1.1B-Chat - Asian M","[financial_analyst] TinyLlama-1.1B-Chat - White F","[financial_analyst] TinyLlama-1.1B-Chat - Black F","[financial_analyst] TinyLlama-1.1B-Chat - Black M","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic F","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic M","[financial_analyst] TinyLlama-1.1B-Chat - Asian F","[financial_analyst] TinyLlama-1.1B-Chat - Asian M","[retail] Llama3-70B-IT - White F","[retail] Llama3-70B-IT - Black F","[retail] Llama3-70B-IT - Black M","[retail] Llama3-70B-IT - Hispanic F","[retail] Llama3-70B-IT - Hispanic M","[retail] Llama3-70B-IT - Asian F","[retail] Llama3-70B-IT - Asian M","[software_engineer] Llama3-70B-IT - White F","[software_engineer] Llama3-70B-IT - Black F","[software_engineer] Llama3-70B-IT - Black M","[software_engineer] Llama3-70B-IT - Hispanic F","[software_engineer] Llama3-70B-IT - Hispanic M","[software_engineer] Llama3-70B-IT - Asian F","[software_engineer] Llama3-70B-IT - Asian M","[HR_specialist] Llama3-70B-IT - White F","[HR_specialist] Llama3-70B-IT - Black F","[HR_specialist] Llama3-70B-IT - Black M","[HR_specialist] Llama3-70B-IT - Hispanic F","[HR_specialist] Llama3-70B-IT - Hispanic M","[HR_specialist] Llama3-70B-IT - Asian F","[HR_specialist] Llama3-70B-IT - Asian M","[financial_analyst] Llama3-70B-IT - White F","[financial_analyst] Llama3-70B-IT - Black F","[financial_analyst] Llama3-70B-IT - Black M","[financial_analyst] Llama3-70B-IT - Hispanic F","[financial_analyst] Llama3-70B-IT - Hispanic M","[financial_analyst] Llama3-70B-IT - Asian F","[financial_analyst] Llama3-70B-IT - Asian M","[retail] StableLM2-Zephyr-1.6B - White F","[retail] StableLM2-Zephyr-1.6B - Black F","[retail] StableLM2-Zephyr-1.6B - Black M","[retail] StableLM2-Zephyr-1.6B - Hispanic F","[retail] StableLM2-Zephyr-1.6B - Hispanic M","[retail] StableLM2-Zephyr-1.6B - Asian F","[retail] StableLM2-Zephyr-1.6B - Asian M","[software_engineer] StableLM2-Zephyr-1.6B - White F","[software_engineer] StableLM2-Zephyr-1.6B - Black F","[software_engineer] StableLM2-Zephyr-1.6B - Black M","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic F","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic M","[software_engineer] StableLM2-Zephyr-1.6B - Asian F","[software_engineer] StableLM2-Zephyr-1.6B - Asian M","[HR_specialist] StableLM2-Zephyr-1.6B - White F","[HR_specialist] StableLM2-Zephyr-1.6B - Black F","[HR_specialist] StableLM2-Zephyr-1.6B - Black M","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic F","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic M","[HR_specialist] StableLM2-Zephyr-1.6B - Asian F","[HR_specialist] StableLM2-Zephyr-1.6B - Asian M","[financial_analyst] StableLM2-Zephyr-1.6B - White F","[financial_analyst] StableLM2-Zephyr-1.6B - Black F","[financial_analyst] StableLM2-Zephyr-1.6B - Black M","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic F","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic M","[financial_analyst] StableLM2-Zephyr-1.6B - Asian F","[financial_analyst] StableLM2-Zephyr-1.6B - Asian M","[retail] Llama2-13B-Chat - White F","[retail] Llama2-13B-Chat - Black F","[retail] Llama2-13B-Chat - Black M","[retail] Llama2-13B-Chat - Hispanic F","[retail] Llama2-13B-Chat - Hispanic M","[retail] Llama2-13B-Chat - Asian F","[retail] Llama2-13B-Chat - Asian M","[software_engineer] Llama2-13B-Chat - White F","[software_engineer] Llama2-13B-Chat - Black F","[software_engineer] Llama2-13B-Chat - Black M","[software_engineer] Llama2-13B-Chat - Hispanic F","[software_engineer] Llama2-13B-Chat - Hispanic M","[software_engineer] Llama2-13B-Chat - Asian F","[software_engineer] Llama2-13B-Chat - Asian M","[HR_specialist] Llama2-13B-Chat - White F","[HR_specialist] Llama2-13B-Chat - Black F","[HR_specialist] Llama2-13B-Chat - Black M","[HR_specialist] Llama2-13B-Chat - Hispanic F","[HR_specialist] Llama2-13B-Chat - Hispanic M","[HR_specialist] Llama2-13B-Chat - Asian F","[HR_specialist] Llama2-13B-Chat - Asian M","[financial_analyst] Llama2-13B-Chat - White F","[financial_analyst] Llama2-13B-Chat - Black F","[financial_analyst] Llama2-13B-Chat - Black M","[financial_analyst] Llama2-13B-Chat - Hispanic F","[financial_analyst] Llama2-13B-Chat - Hispanic M","[financial_analyst] Llama2-13B-Chat - Asian F","[financial_analyst] Llama2-13B-Chat - Asian M","[retail] StarlingLM-7B - White F","[retail] StarlingLM-7B - Black F","[retail] StarlingLM-7B - Black M","[retail] StarlingLM-7B - Hispanic F","[retail] StarlingLM-7B - Hispanic M","[retail] StarlingLM-7B - Asian F","[retail] StarlingLM-7B - Asian M","[software_engineer] StarlingLM-7B - White F","[software_engineer] StarlingLM-7B - Black F","[software_engineer] StarlingLM-7B - Black M","[software_engineer] StarlingLM-7B - Hispanic F","[software_engineer] StarlingLM-7B - Hispanic M","[software_engineer] StarlingLM-7B - Asian F","[software_engineer] StarlingLM-7B - Asian M","[HR_specialist] StarlingLM-7B - White F","[HR_specialist] StarlingLM-7B - Black F","[HR_specialist] StarlingLM-7B - Black M","[HR_specialist] StarlingLM-7B - Hispanic F","[HR_specialist] StarlingLM-7B - Hispanic M","[HR_specialist] StarlingLM-7B - Asian F","[HR_specialist] StarlingLM-7B - Asian M","[financial_analyst] StarlingLM-7B - White F","[financial_analyst] StarlingLM-7B - Black F","[financial_analyst] StarlingLM-7B - Black M","[financial_analyst] StarlingLM-7B - Hispanic F","[financial_analyst] StarlingLM-7B - Hispanic M","[financial_analyst] StarlingLM-7B - Asian F","[financial_analyst] StarlingLM-7B - Asian M","[retail] StableLM-Zephyr-3B - White F","[retail] StableLM-Zephyr-3B - Black F","[retail] StableLM-Zephyr-3B - Black M","[retail] StableLM-Zephyr-3B - Hispanic F","[retail] StableLM-Zephyr-3B - Hispanic M","[retail] StableLM-Zephyr-3B - Asian F","[retail] StableLM-Zephyr-3B - Asian M","[software_engineer] StableLM-Zephyr-3B - White F","[software_engineer] StableLM-Zephyr-3B - Black F","[software_engineer] StableLM-Zephyr-3B - Black M","[software_engineer] StableLM-Zephyr-3B - Hispanic F","[software_engineer] StableLM-Zephyr-3B - Hispanic M","[software_engineer] StableLM-Zephyr-3B - Asian F","[software_engineer] StableLM-Zephyr-3B - Asian M","[HR_specialist] StableLM-Zephyr-3B - White F","[HR_specialist] StableLM-Zephyr-3B - Black F","[HR_specialist] StableLM-Zephyr-3B - Black M","[HR_specialist] StableLM-Zephyr-3B - Hispanic F","[HR_specialist] StableLM-Zephyr-3B - Hispanic M","[HR_specialist] StableLM-Zephyr-3B - Asian F","[HR_specialist] StableLM-Zephyr-3B - Asian M","[financial_analyst] StableLM-Zephyr-3B - White F","[financial_analyst] StableLM-Zephyr-3B - Black F","[financial_analyst] StableLM-Zephyr-3B - Black M","[financial_analyst] StableLM-Zephyr-3B - Hispanic F","[financial_analyst] StableLM-Zephyr-3B - Hispanic M","[financial_analyst] StableLM-Zephyr-3B - Asian F","[financial_analyst] StableLM-Zephyr-3B - Asian M","[retail] Gemma-2B-IT - White F","[retail] Gemma-2B-IT - Black F","[retail] Gemma-2B-IT - Black M","[retail] Gemma-2B-IT - Hispanic F","[retail] Gemma-2B-IT - Hispanic M","[retail] Gemma-2B-IT - Asian F","[retail] Gemma-2B-IT - Asian M","[software_engineer] Gemma-2B-IT - White F","[software_engineer] Gemma-2B-IT - Black F","[software_engineer] Gemma-2B-IT - Black M","[software_engineer] Gemma-2B-IT - Hispanic F","[software_engineer] Gemma-2B-IT - Hispanic M","[software_engineer] Gemma-2B-IT - Asian F","[software_engineer] Gemma-2B-IT - Asian M","[HR_specialist] Gemma-2B-IT - White F","[HR_specialist] Gemma-2B-IT - Black F","[HR_specialist] Gemma-2B-IT - Black M","[HR_specialist] Gemma-2B-IT - Hispanic F","[HR_specialist] Gemma-2B-IT - Hispanic M","[HR_specialist] Gemma-2B-IT - Asian F","[HR_specialist] Gemma-2B-IT - Asian M","[financial_analyst] Gemma-2B-IT - White F","[financial_analyst] Gemma-2B-IT - Black F","[financial_analyst] Gemma-2B-IT - Black M","[financial_analyst] Gemma-2B-IT - Hispanic F","[financial_analyst] Gemma-2B-IT - Hispanic M","[financial_analyst] Gemma-2B-IT - Asian F","[financial_analyst] Gemma-2B-IT - Asian M","[retail] Gemma-7B-IT - White F","[retail] Gemma-7B-IT - Black F","[retail] Gemma-7B-IT - Black M","[retail] Gemma-7B-IT - Hispanic F","[retail] Gemma-7B-IT - Hispanic M","[retail] Gemma-7B-IT - Asian F","[retail] Gemma-7B-IT - Asian M","[software_engineer] Gemma-7B-IT - White F","[software_engineer] Gemma-7B-IT - Black F","[software_engineer] Gemma-7B-IT - Black M","[software_engineer] Gemma-7B-IT - Hispanic F","[software_engineer] Gemma-7B-IT - Hispanic M","[software_engineer] Gemma-7B-IT - Asian F","[software_engineer] Gemma-7B-IT - Asian M","[HR_specialist] Gemma-7B-IT - White F","[HR_specialist] Gemma-7B-IT - Black F","[HR_specialist] Gemma-7B-IT - Black M","[HR_specialist] Gemma-7B-IT - Hispanic F","[HR_specialist] Gemma-7B-IT - Hispanic M","[HR_specialist] Gemma-7B-IT - Asian F","[HR_specialist] Gemma-7B-IT - Asian M","[financial_analyst] Gemma-7B-IT - White F","[financial_analyst] Gemma-7B-IT - Black F","[financial_analyst] Gemma-7B-IT - Black M","[financial_analyst] Gemma-7B-IT - Hispanic F","[financial_analyst] Gemma-7B-IT - Hispanic M","[financial_analyst] Gemma-7B-IT - Asian F","[financial_analyst] Gemma-7B-IT - Asian M"],"marker":{"color":"#1F77B4"},"mode":"markers","showlegend":false,"x":[4.8254124029867285e-09,-1.3073188087631136e-09,-5.836677030579551e-09,-6.05032357547941e-10,-7.040383498413405e-09,-8.182496014086382e-09,-1.709199104471537e-08,-1.2426515039187793e-08,-2.7801879687316955e-08,-2.1382981607587226e-08,-7.653554456865663e-09,-1.0755392132466568e-08,-1.4139531767654032e-09,-1.8927728939743815e-08,-1.638242985713134e-09,-3.373810342210959e-09,-2.2717401293448347e-09,-1.9211444657329935e-09,-2.233743745527761e-09,-5.650144796476296e-10,-3.712407825595676e-09,-2.586601488552276e-09,-2.090614259486756e-08,-1.6929178725533234e-08,-7.557741543706697e-09,-5.291114213434866e-09,-5.6421928240624206e-09,-1.664305759874196e-08,5.02546077674193e-06,-1.2084048479632514e-06,-7.112109884799267e-06,2.1638362268650013e-07,-5.942279067916445e-06,-2.3646752619344018e-06,-7.522283448024858e-06,-1.889034454005678e-05,-4.984203814850652e-05,-5.016483890851742e-05,-5.1728660822480954e-05,-4.887230680772347e-05,-3.208674359256314e-05,-2.688906955850001e-05,7.729098646658272e-07,-1.856938110722517e-06,-3.820836629198077e-06,-1.1682452482064676e-06,-2.607657052067225e-06,-1.8956646238299513e-06,-4.443128056474954e-06,-7.669464596737896e-07,-3.34902789389524e-06,-5.850545285901454e-06,-2.4694088310850404e-06,-3.747453270697143e-06,-3.6269893393114927e-06,-5.848314810763533e-06,7.401281710506247e-05,0.0005983197641329,0.0008627969432736,0.0006681424210502,0.0005329936579699,0.0005733619915438,0.000546514871665,-0.0002234187295478,0.0003753480266974,0.0005626588846563,0.000329239764663,0.0001695576073674,0.0002009816283897,0.000236110109149,-0.0001112440052747,0.0002232984418534,0.0005556342663773,0.0003922200191081,0.0001715194178901,0.0003518779765715,0.0002250991623163,-0.0001799236348183,0.0002991057424348,0.0010119664201727,0.000774181424928,0.0005493953699253,0.0005133956502603,0.0005344374295318,1.0476064460362977e-12,1.7003065622134272e-12,2.1719293030741937e-12,3.251510172219696e-12,3.579359031391505e-13,2.918443264832149e-12,4.2932324362254803e-13,8.365974579760405e-12,1.3860468328630304e-11,1.030275864621899e-11,1.7690737763587094e-11,1.1046497050415384e-11,1.8695267556267936e-11,1.673994276529811e-11,3.527733660746435e-12,6.909806060662049e-12,5.557221349761221e-12,7.769673793234233e-12,4.8366866067794945e-12,9.015233004561196e-12,7.332912055346696e-12,1.623368106606904e-12,6.958544851443094e-12,6.246891892658368e-12,8.498313164295723e-12,5.187739127165969e-12,1.3344769733691919e-11,1.5891066240669716e-11,5.3771327536034086e-05,4.334335727163019e-05,4.990218750278163e-05,0.0001456687690477,0.0001302879046897,1.4614202258678157e-05,-1.8613233649711347e-05,0.0099756525886233,0.0100016594653993,0.0101044647004742,0.0101002067156629,0.0101480435042909,0.0099434603965543,0.0098837287439702,9.9464226744006e-05,0.0001195078771354,0.0001725024869984,0.0002521175279093,0.0002265630131945,0.0001160057097246,8.41551726018519e-05,0.0056735414013514,0.0059593285347369,0.0060116167227649,0.0062388344521576,0.0063955343888268,0.0057499831422627,0.0053705470484369,3.796826610003023e-06,-9.191756773496708e-06,-1.002775034053549e-05,-2.3488394956805436e-06,-1.8257617393491188e-06,-7.897969781622827e-06,-9.759075204840428e-06,2.6780565088868613e-06,-6.427808428077775e-06,-6.647362668532608e-06,-8.47944241377796e-07,-2.4472398663100137e-07,-2.2207549136288307e-06,-3.580897625865554e-06,5.006509696370287e-06,-9.279199596590182e-06,-1.2515627283327111e-05,-3.25711282656016e-06,-3.7405213327845743e-06,-6.9715897599298415e-06,-1.0505431759733064e-05,7.538357038594512e-07,-1.7151418623462256e-05,-1.4705144534055137e-05,-9.129889158909776e-06,-6.562028035284051e-06,-1.4376891107503733e-05,-1.828363340494743e-05,0.001794576109995,0.0006744144286163,-0.000641920796446,0.0002427911026886,-0.001752599427186,-0.0003126599946484,-0.0013464765026718,-7.164281771965264e-05,-0.0013355434068813,-0.0012528142521287,-0.0018975688451288,-0.0012130581509548,-0.0011612314124852,-0.0012249360183577,0.0006277815510427,7.636891192819295e-05,-0.0003616734524354,-0.0004933422876565,-0.0004319150249799,-0.0010094275664819,-0.001526997577267,0.0019283491515696,0.0002575428816135,-0.001467104770687,-0.0002956152369781,-0.000763653058037,-0.0004144593374401,-0.0010197368873849,-1.1442887637436172e-08,9.822763269440316e-09,1.6289027016114233e-08,5.450504603210504e-09,8.243819404896158e-09,1.0839519060112934e-08,1.3148299005116826e-08,-1.7599977031323986e-09,-3.6205760611807136e-10,1.0631246993852983e-09,-1.5079945070439747e-09,-1.1182480497140546e-09,1.3386045605301431e-09,1.3114273000880414e-09,-6.568557586739132e-09,-3.1812826817301243e-09,3.440781104480095e-09,-6.4798038046376405e-09,-2.94574808989978e-09,4.242740603288553e-10,-6.35365982049052e-10,-2.591795889017589e-09,-3.744945464845273e-10,3.0181678267737766e-09,-5.004335834613015e-10,1.9011853202854923e-09,9.098343189961611e-10,1.5268306619020675e-09,7.671289124711045e-06,2.046871809713302e-06,-3.530383720806718e-06,-0.009343319472281,-3.728780704093104e-06,-2.417656167041926e-06,-5.105265189264685e-06,1.4917218968957258e-05,1.344773757117057e-05,5.045890919652685e-06,-0.0003275246250137,7.010822228759039e-06,1.4471343958266658e-05,1.4433962335469452e-05,3.573029765924218e-05,2.902742694244065e-05,7.261426647975355e-06,-0.0035227822828012,-9.637719898369925e-06,2.4685460332074527e-05,1.1679672625941606e-05,3.014651194455098e-06,1.7270337326902307e-06,-6.004990850128067e-07,-9.733794453414824e-05,-5.84244864043626e-07,2.073667655366762e-07,-2.1500195512835777e-08,-1.860219756011361e-10,-6.412507191910777e-10,-5.359558352679983e-10,-4.407996190280983e-10,-3.2197911004061547e-10,-2.3036050844638112e-10,-3.8032221816308715e-10,-6.720343170840691e-10,-1.9321687583229163e-09,-2.048456404502019e-09,-1.3682814881121883e-09,-1.0242329206988643e-09,-1.0870893074610422e-09,-7.447974459395822e-10,-7.293965431642846e-11,-3.231754863719516e-10,-2.9885671715135226e-10,-1.6994250451318746e-10,-3.9123793094120174e-10,-5.909905897993895e-11,-3.331744879986331e-10,-2.301481227817703e-10,-9.292572267227683e-10,-6.778202443769031e-10,-8.03414224037624e-10,-6.677234321017521e-10,-6.208693559273114e-10,-6.779430350434268e-10],"y":[0.0833333333333333,-0.0016666666666667,-0.0916666666666667,-0.025,-0.0666666666666667,-0.0283333333333333,-0.1216666666666667,-0.135,-0.1783333333333334,-0.0733333333333334,-0.085,-0.025,-0.025,-0.1166666666666667,-0.0549999999999999,-0.14,-0.1049999999999999,-0.0933333333333333,-0.12,-0.0333333333333333,-0.095,-0.0266666666666665,-0.1599999999999999,-0.1366666666666666,-0.0883333333333332,-0.04,-0.0916666666666665,-0.1516666666666666,0.0883333333333334,-0.0799999999999999,-0.1833333333333333,-0.0716666666666666,-0.1683333333333332,-0.1049999999999999,-0.1499999999999999,-0.0566666666666667,-0.1575,-0.2233333333333334,-0.1541666666666667,-0.18,-0.2033333333333334,-0.1916666666666667,0.0658333333333333,-0.0291666666666666,-0.0733333333333333,-0.0283333333333333,-0.1049999999999999,-0.0283333333333333,-0.1233333333333333,-0.035,-0.2066666666666667,-0.2683333333333334,-0.1783333333333333,-0.21,-0.2,-0.2383333333333333,-0.0116666666666667,0.015,0.0366666666666666,0.0399999999999999,0.0316666666666665,0.005,0.0099999999999999,-0.0466666666666667,0.0916666666666666,0.1283333333333333,0.0733333333333333,0.0449999999999999,0.0183333333333333,0.0416666666666666,-0.0233333333333333,0.0516666666666666,0.0499999999999999,0.0716666666666667,0.0333333333333334,0.03,0.0366666666666667,-0.0266666666666667,0.0166666666666667,0.03,0.09,0.0699999999999999,-0.0199999999999999,0.015,0.0397222222222221,0.0769444444444444,0.0416666666666665,0.0905555555555555,0.0677777777777777,0.1119444444444444,0.0619444444444443,0.0488888888888889,0.0791666666666666,0.0983333333333334,0.1697222222222222,0.1133333333333334,0.1336111111111111,0.1136111111111111,0.0473611111111111,0.0765277777777778,0.0441666666666668,0.1415277777777778,0.0494444444444445,0.1579166666666668,0.1225,0.0052777777777778,0.0091666666666667,0.0030555555555555,0.0391666666666666,0.0197222222222221,0.1241666666666667,0.1744444444444444,-0.025,-0.03,-0.0116666666666667,0.2083333333333333,0.1683333333333332,-0.0616666666666667,-0.1116666666666666,-0.0049999999999999,-0.0833333333333332,-0.0466666666666665,-0.0333333333333333,0.0966666666666667,-0.0366666666666666,-0.0883333333333332,0.0566666666666667,-0.0216666666666665,0.035,0.2000000000000001,0.1116666666666667,-0.0033333333333332,-0.0083333333333333,0.0083333333333333,-0.1166666666666666,-0.12,-0.07,0.0716666666666667,-0.12,-0.1116666666666666,0.1866666666666667,-0.135,-0.1633333333333332,-0.0149999999999999,-0.0166666666666666,-0.1483333333333332,-0.2299999999999999,0.0816666666666666,-0.29,-0.345,-0.12,-0.0949999999999999,-0.1616666666666666,-0.1966666666666666,0.265,-0.0116666666666666,-0.1016666666666666,0.0566666666666667,-0.0183333333333332,-0.0716666666666666,-0.1283333333333333,0.065,-0.185,-0.1816666666666667,-0.0883333333333333,-0.0816666666666666,-0.2466666666666666,-0.2449999999999999,0.2233333333333334,0.1083333333333333,0.0083333333333334,0.075,-0.12,0.0116666666666667,-0.07,0.01,-0.1516666666666666,-0.1633333333333332,-0.1983333333333332,-0.1033333333333332,-0.145,-0.1416666666666667,0.1233333333333333,0.0316666666666666,-0.0383333333333333,-0.0033333333333333,-0.03,-0.0633333333333334,-0.1099999999999999,0.2383333333333333,0.0799999999999999,-0.0966666666666667,0.0166666666666666,-0.0133333333333334,-0.0266666666666667,-0.0566666666666667,-0.0216666666666667,0.0199999999999999,0.0233333333333332,0.0033333333333332,0.0199999999999999,0.0133333333333333,0.04,-0.0616666666666667,-0.05,-0.015,-0.0716666666666667,-0.0616666666666667,0.0583333333333332,0.0,-0.0049999999999999,0.0016666666666666,0.02,0.0,0.015,0.0183333333333333,0.01,-0.0016666666666665,0.0083333333333334,0.1116666666666666,0.0433333333333334,0.0833333333333334,0.045,0.0883333333333334,0.2983333333333334,0.0733333333333333,-0.0733333333333333,0.1049999999999999,-0.0783333333333333,-0.025,-0.0633333333333333,0.0399999999999999,0.035,0.03,0.0266666666666667,0.0033333333333334,0.02,0.0183333333333334,0.2083333333333333,0.09,0.0133333333333332,0.0849999999999999,-0.0083333333333333,0.0933333333333333,0.03,0.1599999999999999,0.0366666666666666,-0.0966666666666666,0.0083333333333334,-0.115,-0.01,-0.0016666666666665,-0.1342222222222223,-0.3081111111111113,-0.2851944444444446,-0.2811111111111113,-0.2304166666666668,-0.1765833333333334,-0.2713333333333335,-0.0768055555555556,-0.1099999999999999,-0.1251388888888888,-0.1245833333333332,-0.0880555555555555,-0.1413888888888889,-0.0976388888888888,-0.0115277777777777,-0.1075833333333332,-0.1021944444444444,-0.063138888888889,-0.0854166666666667,-0.0285555555555555,-0.0961388888888888,-0.079222222222222,-0.3031111111111111,-0.2283888888888889,-0.25825,-0.1868611111111109,-0.2219444444444444,-0.1929722222222222],"type":"scatter","xaxis":"x3","yaxis":"y3"},{"line":{"color":"#1F77B4"},"mode":"lines","showlegend":false,"x":[4.8254124029867285e-09,-1.3073188087631136e-09,-5.836677030579551e-09,-6.05032357547941e-10,-7.040383498413405e-09,-8.182496014086382e-09,-1.709199104471537e-08,-1.2426515039187793e-08,-2.7801879687316955e-08,-2.1382981607587226e-08,-7.653554456865663e-09,-1.0755392132466568e-08,-1.4139531767654032e-09,-1.8927728939743815e-08,-1.638242985713134e-09,-3.373810342210959e-09,-2.2717401293448347e-09,-1.9211444657329935e-09,-2.233743745527761e-09,-5.650144796476296e-10,-3.712407825595676e-09,-2.586601488552276e-09,-2.090614259486756e-08,-1.6929178725533234e-08,-7.557741543706697e-09,-5.291114213434866e-09,-5.6421928240624206e-09,-1.664305759874196e-08,5.02546077674193e-06,-1.2084048479632514e-06,-7.112109884799267e-06,2.1638362268650013e-07,-5.942279067916445e-06,-2.3646752619344018e-06,-7.522283448024858e-06,-1.889034454005678e-05,-4.984203814850652e-05,-5.016483890851742e-05,-5.1728660822480954e-05,-4.887230680772347e-05,-3.208674359256314e-05,-2.688906955850001e-05,7.729098646658272e-07,-1.856938110722517e-06,-3.820836629198077e-06,-1.1682452482064676e-06,-2.607657052067225e-06,-1.8956646238299513e-06,-4.443128056474954e-06,-7.669464596737896e-07,-3.34902789389524e-06,-5.850545285901454e-06,-2.4694088310850404e-06,-3.747453270697143e-06,-3.6269893393114927e-06,-5.848314810763533e-06,7.401281710506247e-05,0.0005983197641329,0.0008627969432736,0.0006681424210502,0.0005329936579699,0.0005733619915438,0.000546514871665,-0.0002234187295478,0.0003753480266974,0.0005626588846563,0.000329239764663,0.0001695576073674,0.0002009816283897,0.000236110109149,-0.0001112440052747,0.0002232984418534,0.0005556342663773,0.0003922200191081,0.0001715194178901,0.0003518779765715,0.0002250991623163,-0.0001799236348183,0.0002991057424348,0.0010119664201727,0.000774181424928,0.0005493953699253,0.0005133956502603,0.0005344374295318,1.0476064460362977e-12,1.7003065622134272e-12,2.1719293030741937e-12,3.251510172219696e-12,3.579359031391505e-13,2.918443264832149e-12,4.2932324362254803e-13,8.365974579760405e-12,1.3860468328630304e-11,1.030275864621899e-11,1.7690737763587094e-11,1.1046497050415384e-11,1.8695267556267936e-11,1.673994276529811e-11,3.527733660746435e-12,6.909806060662049e-12,5.557221349761221e-12,7.769673793234233e-12,4.8366866067794945e-12,9.015233004561196e-12,7.332912055346696e-12,1.623368106606904e-12,6.958544851443094e-12,6.246891892658368e-12,8.498313164295723e-12,5.187739127165969e-12,1.3344769733691919e-11,1.5891066240669716e-11,5.3771327536034086e-05,4.334335727163019e-05,4.990218750278163e-05,0.0001456687690477,0.0001302879046897,1.4614202258678157e-05,-1.8613233649711347e-05,0.0099756525886233,0.0100016594653993,0.0101044647004742,0.0101002067156629,0.0101480435042909,0.0099434603965543,0.0098837287439702,9.9464226744006e-05,0.0001195078771354,0.0001725024869984,0.0002521175279093,0.0002265630131945,0.0001160057097246,8.41551726018519e-05,0.0056735414013514,0.0059593285347369,0.0060116167227649,0.0062388344521576,0.0063955343888268,0.0057499831422627,0.0053705470484369,3.796826610003023e-06,-9.191756773496708e-06,-1.002775034053549e-05,-2.3488394956805436e-06,-1.8257617393491188e-06,-7.897969781622827e-06,-9.759075204840428e-06,2.6780565088868613e-06,-6.427808428077775e-06,-6.647362668532608e-06,-8.47944241377796e-07,-2.4472398663100137e-07,-2.2207549136288307e-06,-3.580897625865554e-06,5.006509696370287e-06,-9.279199596590182e-06,-1.2515627283327111e-05,-3.25711282656016e-06,-3.7405213327845743e-06,-6.9715897599298415e-06,-1.0505431759733064e-05,7.538357038594512e-07,-1.7151418623462256e-05,-1.4705144534055137e-05,-9.129889158909776e-06,-6.562028035284051e-06,-1.4376891107503733e-05,-1.828363340494743e-05,0.001794576109995,0.0006744144286163,-0.000641920796446,0.0002427911026886,-0.001752599427186,-0.0003126599946484,-0.0013464765026718,-7.164281771965264e-05,-0.0013355434068813,-0.0012528142521287,-0.0018975688451288,-0.0012130581509548,-0.0011612314124852,-0.0012249360183577,0.0006277815510427,7.636891192819295e-05,-0.0003616734524354,-0.0004933422876565,-0.0004319150249799,-0.0010094275664819,-0.001526997577267,0.0019283491515696,0.0002575428816135,-0.001467104770687,-0.0002956152369781,-0.000763653058037,-0.0004144593374401,-0.0010197368873849,-1.1442887637436172e-08,9.822763269440316e-09,1.6289027016114233e-08,5.450504603210504e-09,8.243819404896158e-09,1.0839519060112934e-08,1.3148299005116826e-08,-1.7599977031323986e-09,-3.6205760611807136e-10,1.0631246993852983e-09,-1.5079945070439747e-09,-1.1182480497140546e-09,1.3386045605301431e-09,1.3114273000880414e-09,-6.568557586739132e-09,-3.1812826817301243e-09,3.440781104480095e-09,-6.4798038046376405e-09,-2.94574808989978e-09,4.242740603288553e-10,-6.35365982049052e-10,-2.591795889017589e-09,-3.744945464845273e-10,3.0181678267737766e-09,-5.004335834613015e-10,1.9011853202854923e-09,9.098343189961611e-10,1.5268306619020675e-09,7.671289124711045e-06,2.046871809713302e-06,-3.530383720806718e-06,-0.009343319472281,-3.728780704093104e-06,-2.417656167041926e-06,-5.105265189264685e-06,1.4917218968957258e-05,1.344773757117057e-05,5.045890919652685e-06,-0.0003275246250137,7.010822228759039e-06,1.4471343958266658e-05,1.4433962335469452e-05,3.573029765924218e-05,2.902742694244065e-05,7.261426647975355e-06,-0.0035227822828012,-9.637719898369925e-06,2.4685460332074527e-05,1.1679672625941606e-05,3.014651194455098e-06,1.7270337326902307e-06,-6.004990850128067e-07,-9.733794453414824e-05,-5.84244864043626e-07,2.073667655366762e-07,-2.1500195512835777e-08,-1.860219756011361e-10,-6.412507191910777e-10,-5.359558352679983e-10,-4.407996190280983e-10,-3.2197911004061547e-10,-2.3036050844638112e-10,-3.8032221816308715e-10,-6.720343170840691e-10,-1.9321687583229163e-09,-2.048456404502019e-09,-1.3682814881121883e-09,-1.0242329206988643e-09,-1.0870893074610422e-09,-7.447974459395822e-10,-7.293965431642846e-11,-3.231754863719516e-10,-2.9885671715135226e-10,-1.6994250451318746e-10,-3.9123793094120174e-10,-5.909905897993895e-11,-3.331744879986331e-10,-2.301481227817703e-10,-9.292572267227683e-10,-6.778202443769031e-10,-8.03414224037624e-10,-6.677234321017521e-10,-6.208693559273114e-10,-6.779430350434268e-10],"y":[-0.03287527591334806,-0.032875282047564125,-0.032875286578019,-0.032875281345107636,-0.032875287782016906,-0.03287528892440595,-0.032875297836058144,-0.032875293169452535,-0.032875308548539865,-0.03287530212808764,-0.03287528839533632,-0.032875291497925015,-0.03287528215422431,-0.03287529967224051,-0.032875282378568425,-0.032875284114556,-0.03287528301221895,-0.032875282661538406,-0.03287528297421337,-0.03287528130508007,-0.03287528445323547,-0.03287528332715655,-0.03287530165113318,-0.032875297673206405,-0.03287528829950021,-0.03287528603232409,-0.032875286383487703,-0.032875297387016,-0.032870254062388866,-0.032876489437355404,-0.03288239457179568,-0.03287506430391536,-0.03288122445773968,-0.03287764598772525,-0.032882804844670016,-0.03289417565819388,-0.032925134845817876,-0.03292545772473432,-0.032927021925280416,-0.03292416487968601,-0.032907375252354897,-0.03290217631986143,-0.0328745076429274,-0.032877138127640856,-0.0328791025016579,-0.032876449268032217,-0.03287788902834607,-0.03287717686353042,-0.03287972494375421,-0.03287604787208133,-0.0328786305786884,-0.03288113270174711,-0.032877750746652466,-0.032879029100531844,-0.03287890860743377,-0.03288113047073193,-0.03280125000286079,-0.032276816110779004,-0.032012274896496364,-0.0322069765484192,-0.03234215803368088,-0.03230177992613715,-0.032328633546233235,-0.033098753563558,-0.03249984183407031,-0.032312485624457946,-0.03254596125982444,-0.032705682079320085,-0.03267425044992245,-0.03263911346386504,-0.03298655167957148,-0.03265192823311801,-0.03231951194353559,-0.03248296575661744,-0.03270371979380436,-0.03252331756675829,-0.03265012707666516,-0.03305524793780811,-0.03257610257809382,-0.031863069302724506,-0.032100911870406916,-0.032325752350547486,-0.03236176078645472,-0.03234071391255341,-0.03287528073888093,-0.032875280738228076,-0.032875280737756335,-0.0328752807366765,-0.03287528073957077,-0.03287528073700964,-0.032875280739499364,-0.03287528073156079,-0.032875280726064965,-0.03287528072962354,-0.03287528072223377,-0.03287528072887962,-0.032875280721229,-0.0328752807231848,-0.032875280736400204,-0.03287528073301731,-0.032875280734370224,-0.03287528073215724,-0.03287528073509093,-0.03287528073091137,-0.0328752807325941,-0.03287528073830503,-0.03287528073296856,-0.03287528073368039,-0.03287528073142842,-0.0328752807347398,-0.03287528072658079,-0.03287528072403388,-0.03282149639329371,-0.032831926888375405,-0.03282536647012208,-0.032729576701598755,-0.03274496128996741,-0.03286066299928348,-0.03289389848020952,-0.022897212849041827,-0.022871199675487966,-0.022768369549237798,-0.022772628564991213,-0.022724780194133095,-0.022929412835475525,-0.022989158950270934,-0.03277579243093354,-0.03275574392757902,-0.03270273648667564,-0.03262310216939291,-0.03264866287135979,-0.032759246942933626,-0.03279110519169967,-0.027200365662292263,-0.026914509334204556,-0.02686220848617484,-0.02663493574288793,-0.02647819786607312,-0.027123905413327657,-0.027503433376116233,-0.032871482994032176,-0.032884474722207915,-0.03288531091818549,-0.032877630148124844,-0.03287710694372107,-0.032883180621964686,-0.03288504217799824,-0.0328726020350096,-0.03288171010465608,-0.03288192971205495,-0.03287612888947419,-0.03287552552316793,-0.03287750203253099,-0.0328788625045606,-0.03287027301805767,-0.032884562186202636,-0.03288779939749236,-0.03287853864136661,-0.03287902216691557,-0.03288225401764812,-0.03288578871526077,-0.03287452672170644,-0.03289243631124902,-0.0328899894448684,-0.032884412839613957,-0.0328818443567605,-0.03288966111196522,-0.03289356880016203,-0.03108027012765915,-0.03220070302227635,-0.03351735695806164,-0.032632430852725124,-0.03462830450600653,-0.03318801643572918,-0.034222083251121437,-0.03294694090378778,-0.03421114750821279,-0.03412839832309997,-0.034773309023904964,-0.03408863259618978,-0.0340367933094445,-0.03410051333945867,-0.03224734719058946,-0.032798893337580626,-0.033237041760641114,-0.03336874247548442,-0.033307300340055856,-0.03388495270873572,-0.034402648033429614,-0.03094646469699248,-0.032617675502103566,-0.03434274072561974,-0.03317096755118684,-0.03363911869343437,-0.03328984042614979,-0.03389526452572866,-0.03287529218558698,-0.03287527091478724,-0.03287526444695788,-0.032875275288104515,-0.03287527249411339,-0.03287526989778527,-0.032875267588446326,-0.032875282500352626,-0.03287528110207406,-0.03287527967654669,-0.032875282248288416,-0.03287528185844759,-0.03287527940100013,-0.03287527942818397,-0.03287528731007676,-0.032875283921981725,-0.032875277298314604,-0.03287528722130149,-0.0328752836863901,-0.03287528031555201,-0.03287528137544861,-0.032875283332352206,-0.03287528111451401,-0.03287527772103021,-0.03287528124048354,-0.03287527883828316,-0.032875279829874184,-0.03287527921272845,-0.03286760759343366,-0.032873233372531036,-0.03287881197842513,-0.04222086241415308,-0.032879010423444245,-0.03287769898145808,-0.032880387241203464,-0.032860359909206875,-0.032861829746395094,-0.03287023362729942,-0.0332028846651147,-0.03286826822024168,-0.032860805892172704,-0.03286084328284633,-0.032839541791259697,-0.03284624628487372,-0.03286801755514619,-0.03639891595780832,-0.03288492079330926,-0.032850589302759844,-0.032863598239423725,-0.03287226535882782,-0.03287355328804717,-0.032875881384406475,-0.032972642251899324,-0.03287586512625004,-0.032875073322955674,-0.032875302245329925,-0.03287528092599581,-0.03287528138133477,-0.03287528127601439,-0.03287528118083514,-0.03287528106198586,-0.032875280970345075,-0.032875281120343096,-0.03287528141212582,-0.03287528267256536,-0.03287528278888117,-0.03287528210854157,-0.0328752817644097,-0.032875281827281305,-0.032875281484906566,-0.032875280812886105,-0.03287528106318253,-0.03287528103885787,-0.032875280909912444,-0.03287528113126145,-0.03287528079904216,-0.03287528107318395,-0.03287528097013264,-0.03287528166941101,-0.03287528141791315,-0.03287528154353754,-0.03287528140781389,-0.03287528136094847,-0.03287528141803597],"type":"scatter","xaxis":"x3","yaxis":"y3"},{"hovertext":["[retail] Llama2-7B-Chat - White F","[retail] Llama2-7B-Chat - Black F","[retail] Llama2-7B-Chat - Black M","[retail] Llama2-7B-Chat - Hispanic F","[retail] Llama2-7B-Chat - Hispanic M","[retail] Llama2-7B-Chat - Asian F","[retail] Llama2-7B-Chat - Asian M","[software_engineer] Llama2-7B-Chat - White F","[software_engineer] Llama2-7B-Chat - Black F","[software_engineer] Llama2-7B-Chat - Black M","[software_engineer] Llama2-7B-Chat - Hispanic F","[software_engineer] Llama2-7B-Chat - Hispanic M","[software_engineer] Llama2-7B-Chat - Asian F","[software_engineer] Llama2-7B-Chat - Asian M","[HR_specialist] Llama2-7B-Chat - White F","[HR_specialist] Llama2-7B-Chat - Black F","[HR_specialist] Llama2-7B-Chat - Black M","[HR_specialist] Llama2-7B-Chat - Hispanic F","[HR_specialist] Llama2-7B-Chat - Hispanic M","[HR_specialist] Llama2-7B-Chat - Asian F","[HR_specialist] Llama2-7B-Chat - Asian M","[financial_analyst] Llama2-7B-Chat - White F","[financial_analyst] Llama2-7B-Chat - Black F","[financial_analyst] Llama2-7B-Chat - Black M","[financial_analyst] Llama2-7B-Chat - Hispanic F","[financial_analyst] Llama2-7B-Chat - Hispanic M","[financial_analyst] Llama2-7B-Chat - Asian F","[financial_analyst] Llama2-7B-Chat - Asian M","[retail] Llama3-8B-IT - White F","[retail] Llama3-8B-IT - Black F","[retail] Llama3-8B-IT - Black M","[retail] Llama3-8B-IT - Hispanic F","[retail] Llama3-8B-IT - Hispanic M","[retail] Llama3-8B-IT - Asian F","[retail] Llama3-8B-IT - Asian M","[software_engineer] Llama3-8B-IT - White F","[software_engineer] Llama3-8B-IT - Black F","[software_engineer] Llama3-8B-IT - Black M","[software_engineer] Llama3-8B-IT - Hispanic F","[software_engineer] Llama3-8B-IT - Hispanic M","[software_engineer] Llama3-8B-IT - Asian F","[software_engineer] Llama3-8B-IT - Asian M","[HR_specialist] Llama3-8B-IT - White F","[HR_specialist] Llama3-8B-IT - Black F","[HR_specialist] Llama3-8B-IT - Black M","[HR_specialist] Llama3-8B-IT - Hispanic F","[HR_specialist] Llama3-8B-IT - Hispanic M","[HR_specialist] Llama3-8B-IT - Asian F","[HR_specialist] Llama3-8B-IT - Asian M","[financial_analyst] Llama3-8B-IT - White F","[financial_analyst] Llama3-8B-IT - Black F","[financial_analyst] Llama3-8B-IT - Black M","[financial_analyst] Llama3-8B-IT - Hispanic F","[financial_analyst] Llama3-8B-IT - Hispanic M","[financial_analyst] Llama3-8B-IT - Asian F","[financial_analyst] Llama3-8B-IT - Asian M","[retail] TinyLlama-1.1B-Chat - White F","[retail] TinyLlama-1.1B-Chat - Black F","[retail] TinyLlama-1.1B-Chat - Black M","[retail] TinyLlama-1.1B-Chat - Hispanic F","[retail] TinyLlama-1.1B-Chat - Hispanic M","[retail] TinyLlama-1.1B-Chat - Asian F","[retail] TinyLlama-1.1B-Chat - Asian M","[software_engineer] TinyLlama-1.1B-Chat - White F","[software_engineer] TinyLlama-1.1B-Chat - Black F","[software_engineer] TinyLlama-1.1B-Chat - Black M","[software_engineer] TinyLlama-1.1B-Chat - Hispanic F","[software_engineer] TinyLlama-1.1B-Chat - Hispanic M","[software_engineer] TinyLlama-1.1B-Chat - Asian F","[software_engineer] TinyLlama-1.1B-Chat - Asian M","[HR_specialist] TinyLlama-1.1B-Chat - White F","[HR_specialist] TinyLlama-1.1B-Chat - Black F","[HR_specialist] TinyLlama-1.1B-Chat - Black M","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic F","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic M","[HR_specialist] TinyLlama-1.1B-Chat - Asian F","[HR_specialist] TinyLlama-1.1B-Chat - Asian M","[financial_analyst] TinyLlama-1.1B-Chat - White F","[financial_analyst] TinyLlama-1.1B-Chat - Black F","[financial_analyst] TinyLlama-1.1B-Chat - Black M","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic F","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic M","[financial_analyst] TinyLlama-1.1B-Chat - Asian F","[financial_analyst] TinyLlama-1.1B-Chat - Asian M","[retail] Llama3-70B-IT - White F","[retail] Llama3-70B-IT - Black F","[retail] Llama3-70B-IT - Black M","[retail] Llama3-70B-IT - Hispanic F","[retail] Llama3-70B-IT - Hispanic M","[retail] Llama3-70B-IT - Asian F","[retail] Llama3-70B-IT - Asian M","[software_engineer] Llama3-70B-IT - White F","[software_engineer] Llama3-70B-IT - Black F","[software_engineer] Llama3-70B-IT - Black M","[software_engineer] Llama3-70B-IT - Hispanic F","[software_engineer] Llama3-70B-IT - Hispanic M","[software_engineer] Llama3-70B-IT - Asian F","[software_engineer] Llama3-70B-IT - Asian M","[HR_specialist] Llama3-70B-IT - White F","[HR_specialist] Llama3-70B-IT - Black F","[HR_specialist] Llama3-70B-IT - Black M","[HR_specialist] Llama3-70B-IT - Hispanic F","[HR_specialist] Llama3-70B-IT - Hispanic M","[HR_specialist] Llama3-70B-IT - Asian F","[HR_specialist] Llama3-70B-IT - Asian M","[financial_analyst] Llama3-70B-IT - White F","[financial_analyst] Llama3-70B-IT - Black F","[financial_analyst] Llama3-70B-IT - Black M","[financial_analyst] Llama3-70B-IT - Hispanic F","[financial_analyst] Llama3-70B-IT - Hispanic M","[financial_analyst] Llama3-70B-IT - Asian F","[financial_analyst] Llama3-70B-IT - Asian M","[retail] StableLM2-Zephyr-1.6B - White F","[retail] StableLM2-Zephyr-1.6B - Black F","[retail] StableLM2-Zephyr-1.6B - Black M","[retail] StableLM2-Zephyr-1.6B - Hispanic F","[retail] StableLM2-Zephyr-1.6B - Hispanic M","[retail] StableLM2-Zephyr-1.6B - Asian F","[retail] StableLM2-Zephyr-1.6B - Asian M","[software_engineer] StableLM2-Zephyr-1.6B - White F","[software_engineer] StableLM2-Zephyr-1.6B - Black F","[software_engineer] StableLM2-Zephyr-1.6B - Black M","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic F","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic M","[software_engineer] StableLM2-Zephyr-1.6B - Asian F","[software_engineer] StableLM2-Zephyr-1.6B - Asian M","[HR_specialist] StableLM2-Zephyr-1.6B - White F","[HR_specialist] StableLM2-Zephyr-1.6B - Black F","[HR_specialist] StableLM2-Zephyr-1.6B - Black M","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic F","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic M","[HR_specialist] StableLM2-Zephyr-1.6B - Asian F","[HR_specialist] StableLM2-Zephyr-1.6B - Asian M","[financial_analyst] StableLM2-Zephyr-1.6B - White F","[financial_analyst] StableLM2-Zephyr-1.6B - Black F","[financial_analyst] StableLM2-Zephyr-1.6B - Black M","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic F","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic M","[financial_analyst] StableLM2-Zephyr-1.6B - Asian F","[financial_analyst] StableLM2-Zephyr-1.6B - Asian M","[retail] Llama2-13B-Chat - White F","[retail] Llama2-13B-Chat - Black F","[retail] Llama2-13B-Chat - Black M","[retail] Llama2-13B-Chat - Hispanic F","[retail] Llama2-13B-Chat - Hispanic M","[retail] Llama2-13B-Chat - Asian F","[retail] Llama2-13B-Chat - Asian M","[software_engineer] Llama2-13B-Chat - White F","[software_engineer] Llama2-13B-Chat - Black F","[software_engineer] Llama2-13B-Chat - Black M","[software_engineer] Llama2-13B-Chat - Hispanic F","[software_engineer] Llama2-13B-Chat - Hispanic M","[software_engineer] Llama2-13B-Chat - Asian F","[software_engineer] Llama2-13B-Chat - Asian M","[HR_specialist] Llama2-13B-Chat - White F","[HR_specialist] Llama2-13B-Chat - Black F","[HR_specialist] Llama2-13B-Chat - Black M","[HR_specialist] Llama2-13B-Chat - Hispanic F","[HR_specialist] Llama2-13B-Chat - Hispanic M","[HR_specialist] Llama2-13B-Chat - Asian F","[HR_specialist] Llama2-13B-Chat - Asian M","[financial_analyst] Llama2-13B-Chat - White F","[financial_analyst] Llama2-13B-Chat - Black F","[financial_analyst] Llama2-13B-Chat - Black M","[financial_analyst] Llama2-13B-Chat - Hispanic F","[financial_analyst] Llama2-13B-Chat - Hispanic M","[financial_analyst] Llama2-13B-Chat - Asian F","[financial_analyst] Llama2-13B-Chat - Asian M","[retail] StarlingLM-7B - White F","[retail] StarlingLM-7B - Black F","[retail] StarlingLM-7B - Black M","[retail] StarlingLM-7B - Hispanic F","[retail] StarlingLM-7B - Hispanic M","[retail] StarlingLM-7B - Asian F","[retail] StarlingLM-7B - Asian M","[software_engineer] StarlingLM-7B - White F","[software_engineer] StarlingLM-7B - Black F","[software_engineer] StarlingLM-7B - Black M","[software_engineer] StarlingLM-7B - Hispanic F","[software_engineer] StarlingLM-7B - Hispanic M","[software_engineer] StarlingLM-7B - Asian F","[software_engineer] StarlingLM-7B - Asian M","[HR_specialist] StarlingLM-7B - White F","[HR_specialist] StarlingLM-7B - Black F","[HR_specialist] StarlingLM-7B - Black M","[HR_specialist] StarlingLM-7B - Hispanic F","[HR_specialist] StarlingLM-7B - Hispanic M","[HR_specialist] StarlingLM-7B - Asian F","[HR_specialist] StarlingLM-7B - Asian M","[financial_analyst] StarlingLM-7B - White F","[financial_analyst] StarlingLM-7B - Black F","[financial_analyst] StarlingLM-7B - Black M","[financial_analyst] StarlingLM-7B - Hispanic F","[financial_analyst] StarlingLM-7B - Hispanic M","[financial_analyst] StarlingLM-7B - Asian F","[financial_analyst] StarlingLM-7B - Asian M","[retail] StableLM-Zephyr-3B - White F","[retail] StableLM-Zephyr-3B - Black F","[retail] StableLM-Zephyr-3B - Black M","[retail] StableLM-Zephyr-3B - Hispanic F","[retail] StableLM-Zephyr-3B - Hispanic M","[retail] StableLM-Zephyr-3B - Asian F","[retail] StableLM-Zephyr-3B - Asian M","[software_engineer] StableLM-Zephyr-3B - White F","[software_engineer] StableLM-Zephyr-3B - Black F","[software_engineer] StableLM-Zephyr-3B - Black M","[software_engineer] StableLM-Zephyr-3B - Hispanic F","[software_engineer] StableLM-Zephyr-3B - Hispanic M","[software_engineer] StableLM-Zephyr-3B - Asian F","[software_engineer] StableLM-Zephyr-3B - Asian M","[HR_specialist] StableLM-Zephyr-3B - White F","[HR_specialist] StableLM-Zephyr-3B - Black F","[HR_specialist] StableLM-Zephyr-3B - Black M","[HR_specialist] StableLM-Zephyr-3B - Hispanic F","[HR_specialist] StableLM-Zephyr-3B - Hispanic M","[HR_specialist] StableLM-Zephyr-3B - Asian F","[HR_specialist] StableLM-Zephyr-3B - Asian M","[financial_analyst] StableLM-Zephyr-3B - White F","[financial_analyst] StableLM-Zephyr-3B - Black F","[financial_analyst] StableLM-Zephyr-3B - Black M","[financial_analyst] StableLM-Zephyr-3B - Hispanic F","[financial_analyst] StableLM-Zephyr-3B - Hispanic M","[financial_analyst] StableLM-Zephyr-3B - Asian F","[financial_analyst] StableLM-Zephyr-3B - Asian M","[retail] Gemma-2B-IT - White F","[retail] Gemma-2B-IT - Black F","[retail] Gemma-2B-IT - Black M","[retail] Gemma-2B-IT - Hispanic F","[retail] Gemma-2B-IT - Hispanic M","[retail] Gemma-2B-IT - Asian F","[retail] Gemma-2B-IT - Asian M","[software_engineer] Gemma-2B-IT - White F","[software_engineer] Gemma-2B-IT - Black F","[software_engineer] Gemma-2B-IT - Black M","[software_engineer] Gemma-2B-IT - Hispanic F","[software_engineer] Gemma-2B-IT - Hispanic M","[software_engineer] Gemma-2B-IT - Asian F","[software_engineer] Gemma-2B-IT - Asian M","[HR_specialist] Gemma-2B-IT - White F","[HR_specialist] Gemma-2B-IT - Black F","[HR_specialist] Gemma-2B-IT - Black M","[HR_specialist] Gemma-2B-IT - Hispanic F","[HR_specialist] Gemma-2B-IT - Hispanic M","[HR_specialist] Gemma-2B-IT - Asian F","[HR_specialist] Gemma-2B-IT - Asian M","[financial_analyst] Gemma-2B-IT - White F","[financial_analyst] Gemma-2B-IT - Black F","[financial_analyst] Gemma-2B-IT - Black M","[financial_analyst] Gemma-2B-IT - Hispanic F","[financial_analyst] Gemma-2B-IT - Hispanic M","[financial_analyst] Gemma-2B-IT - Asian F","[financial_analyst] Gemma-2B-IT - Asian M","[retail] Gemma-7B-IT - White F","[retail] Gemma-7B-IT - Black F","[retail] Gemma-7B-IT - Black M","[retail] Gemma-7B-IT - Hispanic F","[retail] Gemma-7B-IT - Hispanic M","[retail] Gemma-7B-IT - Asian F","[retail] Gemma-7B-IT - Asian M","[software_engineer] Gemma-7B-IT - White F","[software_engineer] Gemma-7B-IT - Black F","[software_engineer] Gemma-7B-IT - Black M","[software_engineer] Gemma-7B-IT - Hispanic F","[software_engineer] Gemma-7B-IT - Hispanic M","[software_engineer] Gemma-7B-IT - Asian F","[software_engineer] Gemma-7B-IT - Asian M","[HR_specialist] Gemma-7B-IT - White F","[HR_specialist] Gemma-7B-IT - Black F","[HR_specialist] Gemma-7B-IT - Black M","[HR_specialist] Gemma-7B-IT - Hispanic F","[HR_specialist] Gemma-7B-IT - Hispanic M","[HR_specialist] Gemma-7B-IT - Asian F","[HR_specialist] Gemma-7B-IT - Asian M","[financial_analyst] Gemma-7B-IT - White F","[financial_analyst] Gemma-7B-IT - Black F","[financial_analyst] Gemma-7B-IT - Black M","[financial_analyst] Gemma-7B-IT - Hispanic F","[financial_analyst] Gemma-7B-IT - Hispanic M","[financial_analyst] Gemma-7B-IT - Asian F","[financial_analyst] Gemma-7B-IT - Asian M"],"marker":{"color":"#FF7F0E"},"mode":"markers","showlegend":false,"x":[0.1165499999999999,-0.031325,-0.14805,-0.0157749999999999,-0.11385,-0.1259249999999999,-0.284275,-0.167525,-0.3105,-0.17895,-0.0834,-0.06555,-0.00595,-0.191725,-0.0713249999999999,-0.200925,-0.140175,-0.122075,-0.105375,-0.023675,-0.1987,-0.061925,-0.3984499999999999,-0.323775,-0.1616499999999999,-0.1128749999999999,-0.1918999999999999,-0.337825,0.1691499999999999,-0.070925,-0.2275249999999999,-0.035,-0.188875,-0.1110499999999999,-0.2309,-0.177,-0.352375,-0.3945499999999999,-0.3507249999999999,-0.3577749999999999,-0.3369,-0.323775,0.0626249999999999,-0.0894249999999999,-0.18425,-0.0553749999999999,-0.145375,-0.0916749999999999,-0.2426749999999999,-0.0383,-0.30915,-0.4425,-0.2306249999999999,-0.294875,-0.2895999999999999,-0.407,0.0177,0.2619,0.36185,0.2808999999999999,0.1932499999999999,0.24865,0.2334499999999999,-0.11265,0.1576999999999999,0.2237499999999999,0.1467,0.0458,0.0763499999999999,0.0681499999999999,-0.0516999999999999,0.13415,0.2842,0.21005,0.0884,0.1898999999999999,0.1249,-0.0921499999999999,0.09365,0.2613000000000001,0.2219999999999999,0.1304499999999999,0.1407,0.1368,0.0768999999999999,0.1001749999999999,0.1129999999999999,0.19005,0.052775,0.178525,0.0648999999999999,0.1947749999999999,0.269025,0.21055,0.3664499999999999,0.263225,0.313075,0.3000499999999999,0.132025,0.1972249999999999,0.1554999999999999,0.2718499999999999,0.176425,0.32915,0.2537,0.0528999999999999,0.1180000000000001,0.1212999999999999,0.1749750000000001,0.1182499999999999,0.2813000000000001,0.3410999999999999,0.03675,0.0443999999999999,0.0378,0.3209999999999999,0.2916499999999999,-0.0375999999999999,-0.1334499999999999,0.04705,0.0475000000000001,0.1407499999999999,0.12335,0.2010499999999999,0.0032499999999999,-0.0496499999999999,0.1685000000000001,0.2035499999999999,0.28485,0.4792499999999999,0.4126499999999999,0.1775,0.11745,0.1311999999999999,0.0825,0.0935999999999999,0.1787,0.282,0.0436,-0.0358,0.35175,-0.34655,-0.418,-0.1047,-0.0857,-0.4307499999999999,-0.5895,0.2216,-0.4686749999999999,-0.5174000000000001,-0.1024,-0.06045,-0.19615,-0.26565,0.3027500000000001,-0.2594999999999999,-0.36585,-0.06135,-0.1514999999999999,-0.2929,-0.46235,0.0491999999999999,-0.39485,-0.39995,-0.3038499999999999,-0.2270499999999999,-0.4358999999999999,-0.4684,0.4173,0.1876500000000001,-0.0883,0.1275999999999999,-0.29735,0.0071000000000001,-0.1896999999999999,-0.0305999999999999,-0.34685,-0.3833499999999999,-0.46435,-0.3148499999999999,-0.30715,-0.35185,0.18175,0.08315,-0.1059,-0.0317499999999999,-0.0799499999999999,-0.21955,-0.4066499999999999,0.38745,0.0898000000000001,-0.2896999999999999,-0.0212999999999999,-0.1112999999999999,-0.0323999999999999,-0.1485999999999999,-0.2230499999999999,0.2799,0.4426000000000001,0.1236999999999999,0.2017,0.26335,0.3459000000000001,-0.08925,0.00075,0.0631999999999999,-0.0597499999999999,-0.0368,0.1028,0.0990999999999999,-0.21655,-0.0814,0.2048000000000001,-0.2295,-0.0911499999999999,0.0223999999999999,-0.00575,-0.1904,0.02695,0.2818,0.01295,0.18585,0.07915,0.2155499999999999,0.54,0.1568499999999999,-0.1072499999999999,0.2193,-0.1471,-0.0062499999999999,-0.11195,0.3063,0.2771999999999999,0.141,0.3863000000000001,0.1364499999999999,0.28265,0.2757,0.7255,0.5659000000000001,0.0983,0.4970000000000001,-0.138,0.4550499999999999,0.18005,0.2284999999999999,0.0905,-0.1293999999999999,0.0786999999999999,-0.1639,-0.02885,-0.04105,-0.170625,-0.484925,-0.4238499999999999,-0.39935,-0.320675,-0.244075,-0.37485,-0.1776499999999999,-0.3728249999999999,-0.4611499999999999,-0.436825,-0.34475,-0.396775,-0.31405,-0.009075,-0.04515,-0.0505499999999999,-0.0059249999999999,-0.0742,-0.0141999999999999,-0.0154499999999999,-0.1613,-0.601225,-0.431525,-0.49075,-0.370375,-0.3859,-0.3823],"y":[0.0833333333333333,-0.0016666666666667,-0.0916666666666667,-0.025,-0.0666666666666667,-0.0283333333333333,-0.1216666666666667,-0.135,-0.1783333333333334,-0.0733333333333334,-0.085,-0.025,-0.025,-0.1166666666666667,-0.0549999999999999,-0.14,-0.1049999999999999,-0.0933333333333333,-0.12,-0.0333333333333333,-0.095,-0.0266666666666665,-0.1599999999999999,-0.1366666666666666,-0.0883333333333332,-0.04,-0.0916666666666665,-0.1516666666666666,0.0883333333333334,-0.0799999999999999,-0.1833333333333333,-0.0716666666666666,-0.1683333333333332,-0.1049999999999999,-0.1499999999999999,-0.0566666666666667,-0.1575,-0.2233333333333334,-0.1541666666666667,-0.18,-0.2033333333333334,-0.1916666666666667,0.0658333333333333,-0.0291666666666666,-0.0733333333333333,-0.0283333333333333,-0.1049999999999999,-0.0283333333333333,-0.1233333333333333,-0.035,-0.2066666666666667,-0.2683333333333334,-0.1783333333333333,-0.21,-0.2,-0.2383333333333333,-0.0116666666666667,0.015,0.0366666666666666,0.0399999999999999,0.0316666666666665,0.005,0.0099999999999999,-0.0466666666666667,0.0916666666666666,0.1283333333333333,0.0733333333333333,0.0449999999999999,0.0183333333333333,0.0416666666666666,-0.0233333333333333,0.0516666666666666,0.0499999999999999,0.0716666666666667,0.0333333333333334,0.03,0.0366666666666667,-0.0266666666666667,0.0166666666666667,0.03,0.09,0.0699999999999999,-0.0199999999999999,0.015,0.0397222222222221,0.0769444444444444,0.0416666666666665,0.0905555555555555,0.0677777777777777,0.1119444444444444,0.0619444444444443,0.0488888888888889,0.0791666666666666,0.0983333333333334,0.1697222222222222,0.1133333333333334,0.1336111111111111,0.1136111111111111,0.0473611111111111,0.0765277777777778,0.0441666666666668,0.1415277777777778,0.0494444444444445,0.1579166666666668,0.1225,0.0052777777777778,0.0091666666666667,0.0030555555555555,0.0391666666666666,0.0197222222222221,0.1241666666666667,0.1744444444444444,-0.025,-0.03,-0.0116666666666667,0.2083333333333333,0.1683333333333332,-0.0616666666666667,-0.1116666666666666,-0.0049999999999999,-0.0833333333333332,-0.0466666666666665,-0.0333333333333333,0.0966666666666667,-0.0366666666666666,-0.0883333333333332,0.0566666666666667,-0.0216666666666665,0.035,0.2000000000000001,0.1116666666666667,-0.0033333333333332,-0.0083333333333333,0.0083333333333333,-0.1166666666666666,-0.12,-0.07,0.0716666666666667,-0.12,-0.1116666666666666,0.1866666666666667,-0.135,-0.1633333333333332,-0.0149999999999999,-0.0166666666666666,-0.1483333333333332,-0.2299999999999999,0.0816666666666666,-0.29,-0.345,-0.12,-0.0949999999999999,-0.1616666666666666,-0.1966666666666666,0.265,-0.0116666666666666,-0.1016666666666666,0.0566666666666667,-0.0183333333333332,-0.0716666666666666,-0.1283333333333333,0.065,-0.185,-0.1816666666666667,-0.0883333333333333,-0.0816666666666666,-0.2466666666666666,-0.2449999999999999,0.2233333333333334,0.1083333333333333,0.0083333333333334,0.075,-0.12,0.0116666666666667,-0.07,0.01,-0.1516666666666666,-0.1633333333333332,-0.1983333333333332,-0.1033333333333332,-0.145,-0.1416666666666667,0.1233333333333333,0.0316666666666666,-0.0383333333333333,-0.0033333333333333,-0.03,-0.0633333333333334,-0.1099999999999999,0.2383333333333333,0.0799999999999999,-0.0966666666666667,0.0166666666666666,-0.0133333333333334,-0.0266666666666667,-0.0566666666666667,-0.0216666666666667,0.0199999999999999,0.0233333333333332,0.0033333333333332,0.0199999999999999,0.0133333333333333,0.04,-0.0616666666666667,-0.05,-0.015,-0.0716666666666667,-0.0616666666666667,0.0583333333333332,0.0,-0.0049999999999999,0.0016666666666666,0.02,0.0,0.015,0.0183333333333333,0.01,-0.0016666666666665,0.0083333333333334,0.1116666666666666,0.0433333333333334,0.0833333333333334,0.045,0.0883333333333334,0.2983333333333334,0.0733333333333333,-0.0733333333333333,0.1049999999999999,-0.0783333333333333,-0.025,-0.0633333333333333,0.0399999999999999,0.035,0.03,0.0266666666666667,0.0033333333333334,0.02,0.0183333333333334,0.2083333333333333,0.09,0.0133333333333332,0.0849999999999999,-0.0083333333333333,0.0933333333333333,0.03,0.1599999999999999,0.0366666666666666,-0.0966666666666666,0.0083333333333334,-0.115,-0.01,-0.0016666666666665,-0.1342222222222223,-0.3081111111111113,-0.2851944444444446,-0.2811111111111113,-0.2304166666666668,-0.1765833333333334,-0.2713333333333335,-0.0768055555555556,-0.1099999999999999,-0.1251388888888888,-0.1245833333333332,-0.0880555555555555,-0.1413888888888889,-0.0976388888888888,-0.0115277777777777,-0.1075833333333332,-0.1021944444444444,-0.063138888888889,-0.0854166666666667,-0.0285555555555555,-0.0961388888888888,-0.079222222222222,-0.3031111111111111,-0.2283888888888889,-0.25825,-0.1868611111111109,-0.2219444444444444,-0.1929722222222222],"type":"scatter","xaxis":"x4","yaxis":"y4"},{"line":{"color":"#FF7F0E"},"mode":"lines","showlegend":false,"x":[0.1165499999999999,-0.031325,-0.14805,-0.0157749999999999,-0.11385,-0.1259249999999999,-0.284275,-0.167525,-0.3105,-0.17895,-0.0834,-0.06555,-0.00595,-0.191725,-0.0713249999999999,-0.200925,-0.140175,-0.122075,-0.105375,-0.023675,-0.1987,-0.061925,-0.3984499999999999,-0.323775,-0.1616499999999999,-0.1128749999999999,-0.1918999999999999,-0.337825,0.1691499999999999,-0.070925,-0.2275249999999999,-0.035,-0.188875,-0.1110499999999999,-0.2309,-0.177,-0.352375,-0.3945499999999999,-0.3507249999999999,-0.3577749999999999,-0.3369,-0.323775,0.0626249999999999,-0.0894249999999999,-0.18425,-0.0553749999999999,-0.145375,-0.0916749999999999,-0.2426749999999999,-0.0383,-0.30915,-0.4425,-0.2306249999999999,-0.294875,-0.2895999999999999,-0.407,0.0177,0.2619,0.36185,0.2808999999999999,0.1932499999999999,0.24865,0.2334499999999999,-0.11265,0.1576999999999999,0.2237499999999999,0.1467,0.0458,0.0763499999999999,0.0681499999999999,-0.0516999999999999,0.13415,0.2842,0.21005,0.0884,0.1898999999999999,0.1249,-0.0921499999999999,0.09365,0.2613000000000001,0.2219999999999999,0.1304499999999999,0.1407,0.1368,0.0768999999999999,0.1001749999999999,0.1129999999999999,0.19005,0.052775,0.178525,0.0648999999999999,0.1947749999999999,0.269025,0.21055,0.3664499999999999,0.263225,0.313075,0.3000499999999999,0.132025,0.1972249999999999,0.1554999999999999,0.2718499999999999,0.176425,0.32915,0.2537,0.0528999999999999,0.1180000000000001,0.1212999999999999,0.1749750000000001,0.1182499999999999,0.2813000000000001,0.3410999999999999,0.03675,0.0443999999999999,0.0378,0.3209999999999999,0.2916499999999999,-0.0375999999999999,-0.1334499999999999,0.04705,0.0475000000000001,0.1407499999999999,0.12335,0.2010499999999999,0.0032499999999999,-0.0496499999999999,0.1685000000000001,0.2035499999999999,0.28485,0.4792499999999999,0.4126499999999999,0.1775,0.11745,0.1311999999999999,0.0825,0.0935999999999999,0.1787,0.282,0.0436,-0.0358,0.35175,-0.34655,-0.418,-0.1047,-0.0857,-0.4307499999999999,-0.5895,0.2216,-0.4686749999999999,-0.5174000000000001,-0.1024,-0.06045,-0.19615,-0.26565,0.3027500000000001,-0.2594999999999999,-0.36585,-0.06135,-0.1514999999999999,-0.2929,-0.46235,0.0491999999999999,-0.39485,-0.39995,-0.3038499999999999,-0.2270499999999999,-0.4358999999999999,-0.4684,0.4173,0.1876500000000001,-0.0883,0.1275999999999999,-0.29735,0.0071000000000001,-0.1896999999999999,-0.0305999999999999,-0.34685,-0.3833499999999999,-0.46435,-0.3148499999999999,-0.30715,-0.35185,0.18175,0.08315,-0.1059,-0.0317499999999999,-0.0799499999999999,-0.21955,-0.4066499999999999,0.38745,0.0898000000000001,-0.2896999999999999,-0.0212999999999999,-0.1112999999999999,-0.0323999999999999,-0.1485999999999999,-0.2230499999999999,0.2799,0.4426000000000001,0.1236999999999999,0.2017,0.26335,0.3459000000000001,-0.08925,0.00075,0.0631999999999999,-0.0597499999999999,-0.0368,0.1028,0.0990999999999999,-0.21655,-0.0814,0.2048000000000001,-0.2295,-0.0911499999999999,0.0223999999999999,-0.00575,-0.1904,0.02695,0.2818,0.01295,0.18585,0.07915,0.2155499999999999,0.54,0.1568499999999999,-0.1072499999999999,0.2193,-0.1471,-0.0062499999999999,-0.11195,0.3063,0.2771999999999999,0.141,0.3863000000000001,0.1364499999999999,0.28265,0.2757,0.7255,0.5659000000000001,0.0983,0.4970000000000001,-0.138,0.4550499999999999,0.18005,0.2284999999999999,0.0905,-0.1293999999999999,0.0786999999999999,-0.1639,-0.02885,-0.04105,-0.170625,-0.484925,-0.4238499999999999,-0.39935,-0.320675,-0.244075,-0.37485,-0.1776499999999999,-0.3728249999999999,-0.4611499999999999,-0.436825,-0.34475,-0.396775,-0.31405,-0.009075,-0.04515,-0.0505499999999999,-0.0059249999999999,-0.0742,-0.0141999999999999,-0.0154499999999999,-0.1613,-0.601225,-0.431525,-0.49075,-0.370375,-0.3859,-0.3823],"y":[0.024422663776198575,-0.03462461930662392,-0.08123353979921875,-0.028415420646012622,-0.06757729579967502,-0.07239890826442616,-0.13562891520383413,-0.08901001207673671,-0.1461006987970515,-0.09357207604442055,-0.05541844697551984,-0.048290845940670256,-0.024492245286494612,-0.09867320227524427,-0.05059683451076861,-0.10234681177219757,-0.07808900993090276,-0.07086158255102727,-0.06419318270329685,-0.03156993314883125,-0.101458357301467,-0.04684336393779464,-0.18121960697716472,-0.15140147771792706,-0.08666409296862793,-0.06718797305407395,-0.09874308071676237,-0.15701171830838287,0.04542612676964889,-0.0504371123587272,-0.11296833488295377,-0.03609206657850472,-0.09753518194194896,-0.06645924073538484,-0.11431599054080352,-0.0927934305532185,-0.16282161158889052,-0.1796623159947606,-0.16216275771171954,-0.16497786064145004,-0.15664236083178704,-0.15140147771792706,0.002890121154110964,-0.057824261890644095,-0.09568839455896973,-0.0442279136981159,-0.08016539790744158,-0.05872269899587724,-0.11901781139152358,-0.03740977433284666,-0.14556163653391163,-0.19880900897072912,-0.11420618156127499,-0.13986155223293248,-0.13775521635288587,-0.18463366797705066,-0.015048673047044043,0.08246170077425952,0.12237227351561615,0.09004850299622823,0.055049386430146084,0.07717090448788658,0.07110146271031154,-0.06709812934355067,0.040854080167462455,0.06722820052330644,0.0364617209863227,-0.0038281918661323727,0.008370587496033123,0.005096283379183455,-0.0427604664262351,0.03145043846602229,0.09136621075057019,0.061757716815886904,0.013182217326281763,0.053711713406798964,0.027756863700063823,-0.05891236905142646,0.015278570571825755,0.08222211754619738,0.0665294161081251,0.029973008559638865,0.034065888705700986,0.03250859772329688,0.008590205455090111,0.017884038177001824,0.02300512967683073,0.05377160921381455,-0.0010430368399096353,0.04916961470812034,0.0037985408938466946,0.0556583271348041,0.0853067516074978,0.06195736950593871,0.12420907826409275,0.0829907804028968,0.10289615360106216,0.0976952010252125,0.030601914533302105,0.05663662531605797,0.039975608331234494,0.08643478930629048,0.048331073409902746,0.10931498758622783,0.07918739665740983,-0.0009931236673967245,0.0250016565773489,0.026319364331690756,0.047752080608752544,0.02510148292237472,0.09020822514826975,0.11408668687846603,-0.007441905556070118,-0.004387219398277479,-0.007022634906961318,0.1060606487383833,0.09434103583234212,-0.037130260566774084,-0.0754036812497059,-0.0033290601410028496,-0.0031493727199561833,0.034085853974706135,0.027137940360903216,0.0581639683949543,-0.020818635789541365,-0.04194189039702269,0.045166578272581616,0.05916223184521335,0.09162575924763755,0.16925072513978087,0.1426569868248799,0.048760326693514135,0.02478203861829187,0.03027248759471658,0.010826315583670415,0.015258605302820537,0.04923949314963848,0.09048773891434223,-0.004706663702360333,-0.036411510882587615,0.1183392891765696,-0.16049565774978697,-0.18902602715819047,-0.0639236515717269,-0.05633684934975816,-0.19411717075451157,-0.257506899845961,0.06636969395608369,-0.20926082729494128,-0.22871698194049014,-0.06300524919748858,-0.0462543885021418,-0.10044012858220278,-0.12819185249940424,0.09877332555149235,-0.12573612441176696,-0.16820225158578678,-0.04661376334423506,-0.0826111433605762,-0.13907292410722785,-0.20673522076578593,-0.0024705535737801127,-0.1797821076087917,-0.1818185650473202,-0.14344531801936242,-0.11277866482740455,-0.1961735934620452,-0.20915101831541283,0.14451375684236178,0.052813276301565903,-0.05737504333802757,0.028834988226343554,-0.14084983304868895,-0.019281310076142356,-0.0978646088805344,-0.03433512290604876,-0.16061544936381805,-0.17519009573760008,-0.20753383152599317,-0.14783767720050223,-0.1447630257737044,-0.16261197626433613,0.050457374558954514,0.011085864080737766,-0.06440281802785125,-0.03479432409316792,-0.054040843414162314,-0.10978387447662745,-0.18449391109401436,0.13259449124626876,0.013741244858426867,-0.13779514689089623,-0.03062158287108511,-0.06655906708041075,-0.03505387259023527,-0.0814531577582757,-0.11118144330699006,0.08964919761612464,0.15461618295898336,0.027277697243939438,0.058423516892021694,0.08304069357540975,0.11600335270296347,-0.05775438344912601,-0.02181689923980037,0.003119721747670541,-0.04597487473606923,-0.03681081626269123,0.018932214799773864,0.017454784893390432,-0.1085859583363166,-0.054619836215312606,0.05966136357034295,-0.11375696300865845,-0.05851306367132284,-0.013171937760557079,-0.02441238421047389,-0.09814412264660699,-0.011355098281085574,0.09040787783832151,-0.01694537360253623,0.052094526617379344,0.009488642560323291,0.06395389640645677,0.19350852698107573,0.040514670594374386,-0.06494188029099109,0.06545129158184537,-0.08085419968812031,-0.024612036900525658,-0.06681861557747813,0.10019085965086016,0.08857107308984483,0.03418568031973207,0.13213529005914965,0.03236884084026057,0.0907472874114096,0.08797211501968945,0.2675796749902969,0.20385053632575945,0.01713534058930758,0.17633839563662018,-0.0772205207291774,0.1595875349412733,0.04977855541277836,0.06912490107879862,0.014020758624499358,-0.07378649446028623,0.009308955139276622,-0.0875625300738611,-0.033636338490867466,-0.03850786412813161,-0.09024785875505793,-0.2157495397216251,-0.1913619636317966,-0.181578981819258,-0.15016363103960584,-0.11957683892366867,-0.17179600000671935,-0.09305297905028581,-0.17098740661200948,-0.20625605430966157,-0.1965429509386411,-0.15977690806560044,-0.18055077046549117,-0.14751823289641935,-0.02574007459931842,-0.04014501618655644,-0.04230126523911594,-0.024482262651991982,-0.05174483747856655,-0.02778651467234942,-0.028285646397478947,-0.0865243360855917,-0.2621887554276759,-0.19442663242409192,-0.2180754935607287,-0.17000910843075567,-0.17620832445686435,-0.1747708250884913],"type":"scatter","xaxis":"x4","yaxis":"y4"}], {"template":{"data":{"histogram2dcontour":[{"type":"histogram2dcontour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"choropleth":[{"type":"choropleth","colorbar":{"outlinewidth":0,"ticks":""}}],"histogram2d":[{"type":"histogram2d","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmap":[{"type":"heatmap","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmapgl":[{"type":"heatmapgl","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"contourcarpet":[{"type":"contourcarpet","colorbar":{"outlinewidth":0,"ticks":""}}],"contour":[{"type":"contour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"surface":[{"type":"surface","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"mesh3d":[{"type":"mesh3d","colorbar":{"outlinewidth":0,"ticks":""}}],"scatter":[{"fillpattern":{"fillmode":"overlay","size":10,"solidity":0.2},"type":"scatter"}],"parcoords":[{"type":"parcoords","line":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolargl":[{"type":"scatterpolargl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"bar":[{"error_x":{"color":"#2a3f5f"},"error_y":{"color":"#2a3f5f"},"marker":{"line":{"color":"#E5ECF6","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"bar"}],"scattergeo":[{"type":"scattergeo","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolar":[{"type":"scatterpolar","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"histogram":[{"marker":{"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"histogram"}],"scattergl":[{"type":"scattergl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatter3d":[{"type":"scatter3d","line":{"colorbar":{"outlinewidth":0,"ticks":""}},"marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattermapbox":[{"type":"scattermapbox","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterternary":[{"type":"scatterternary","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattercarpet":[{"type":"scattercarpet","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"carpet":[{"aaxis":{"endlinecolor":"#2a3f5f","gridcolor":"white","linecolor":"white","minorgridcolor":"white","startlinecolor":"#2a3f5f"},"baxis":{"endlinecolor":"#2a3f5f","gridcolor":"white","linecolor":"white","minorgridcolor":"white","startlinecolor":"#2a3f5f"},"type":"carpet"}],"table":[{"cells":{"fill":{"color":"#EBF0F8"},"line":{"color":"white"}},"header":{"fill":{"color":"#C8D4E3"},"line":{"color":"white"}},"type":"table"}],"barpolar":[{"marker":{"line":{"color":"#E5ECF6","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"barpolar"}],"pie":[{"automargin":true,"type":"pie"}]},"layout":{"autotypenumbers":"strict","colorway":["#636efa","#EF553B","#00cc96","#ab63fa","#FFA15A","#19d3f3","#FF6692","#B6E880","#FF97FF","#FECB52"],"font":{"color":"#2a3f5f"},"hovermode":"closest","hoverlabel":{"align":"left"},"paper_bgcolor":"white","plot_bgcolor":"#E5ECF6","polar":{"bgcolor":"#E5ECF6","angularaxis":{"gridcolor":"white","linecolor":"white","ticks":""},"radialaxis":{"gridcolor":"white","linecolor":"white","ticks":""}},"ternary":{"bgcolor":"#E5ECF6","aaxis":{"gridcolor":"white","linecolor":"white","ticks":""},"baxis":{"gridcolor":"white","linecolor":"white","ticks":""},"caxis":{"gridcolor":"white","linecolor":"white","ticks":""}},"coloraxis":{"colorbar":{"outlinewidth":0,"ticks":""}},"colorscale":{"sequential":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"sequentialminus":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"diverging":[[0,"#8e0152"],[0.1,"#c51b7d"],[0.2,"#de77ae"],[0.3,"#f1b6da"],[0.4,"#fde0ef"],[0.5,"#f7f7f7"],[0.6,"#e6f5d0"],[0.7,"#b8e186"],[0.8,"#7fbc41"],[0.9,"#4d9221"],[1,"#276419"]]},"xaxis":{"gridcolor":"white","linecolor":"white","ticks":"","title":{"standoff":15},"zerolinecolor":"white","automargin":true,"zerolinewidth":2},"yaxis":{"gridcolor":"white","linecolor":"white","ticks":"","title":{"standoff":15},"zerolinecolor":"white","automargin":true,"zerolinewidth":2},"scene":{"xaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2},"yaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2},"zaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2}},"shapedefaults":{"line":{"color":"#2a3f5f"}},"annotationdefaults":{"arrowcolor":"#2a3f5f","arrowhead":0,"arrowwidth":1},"geo":{"bgcolor":"white","landcolor":"#E5ECF6","subunitcolor":"white","showland":true,"showlakes":true,"lakecolor":"white"},"title":{"x":0.05},"mapbox":{"style":"light"}}},"xaxis":{"anchor":"y","domain":[0.0,0.445],"tickfont":{"size":11.5},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey"},"yaxis":{"anchor":"x","domain":[0.56,1.0],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":2,"linecolor":"darkgrey","title":{"font":{"size":16},"text":"\u0394\u003cspan style=\"font-size: 20px;\"\u003e\u003csub\u003eDP\u003c\u002fsub\u003e\u003c\u002fspan\u003e","standoff":2},"range":[-0.2,0.2]},"xaxis2":{"anchor":"y2","domain":[0.555,1.0],"tickfont":{"size":11.5},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey"},"yaxis2":{"anchor":"x2","domain":[0.56,1.0],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":2,"linecolor":"darkgrey","range":[-0.2,0.2]},"xaxis3":{"anchor":"y3","domain":[0.0,0.445],"tickfont":{"size":11.5},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey","title":{"font":{"size":15},"text":"\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","standoff":6}},"yaxis3":{"anchor":"x3","domain":[0.0,0.44],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":2,"linecolor":"darkgrey","title":{"font":{"size":16},"text":"\u0394\u003cspan style=\"font-size: 20px;\"\u003e\u003csub\u003eEO\u003c\u002fsub\u003e\u003c\u002fspan\u003e","standoff":2},"range":[-0.4,0.4]},"xaxis4":{"anchor":"y4","domain":[0.555,1.0],"tickfont":{"size":11.5},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey","title":{"font":{"size":15},"text":"RABBI","standoff":6}},"yaxis4":{"anchor":"x4","domain":[0.0,0.44],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":2,"linecolor":"darkgrey","range":[-0.4,0.4]},"font":{"size":14},"margin":{"l":23,"r":20,"t":20,"b":30},"autosize":false,"width":500,"height":345,"plot_bgcolor":"white"}, {"responsive": true} ) }; </script> </div>
<div class="column"> <script type="text/javascript">window.PlotlyConfig = {MathJaxConfig: 'local'};</script> <script charset="utf-8" src="https://cdn.plot.ly/plotly-2.31.1.min.js"></script> <div id="d9a28da0-9d56-450f-a3fe-536891450496" class="plotly-graph-div" style="height:345px; width:500px;"></div> <script type="text/javascript"> window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById("d9a28da0-9d56-450f-a3fe-536891450496")) { Plotly.newPlot( "d9a28da0-9d56-450f-a3fe-536891450496", [{"hovertext":["[retail] Llama2-7B-Chat - White F","[retail] Llama2-7B-Chat - Black F","[retail] Llama2-7B-Chat - Black M","[retail] Llama2-7B-Chat - Hispanic F","[retail] Llama2-7B-Chat - Hispanic M","[retail] Llama2-7B-Chat - Asian F","[retail] Llama2-7B-Chat - Asian M","[software_engineer] Llama2-7B-Chat - White F","[software_engineer] Llama2-7B-Chat - Black F","[software_engineer] Llama2-7B-Chat - Black M","[software_engineer] Llama2-7B-Chat - Hispanic F","[software_engineer] Llama2-7B-Chat - Hispanic M","[software_engineer] Llama2-7B-Chat - Asian F","[software_engineer] Llama2-7B-Chat - Asian M","[HR_specialist] Llama2-7B-Chat - White F","[HR_specialist] Llama2-7B-Chat - Black F","[HR_specialist] Llama2-7B-Chat - Black M","[HR_specialist] Llama2-7B-Chat - Hispanic F","[HR_specialist] Llama2-7B-Chat - Hispanic M","[HR_specialist] Llama2-7B-Chat - Asian F","[HR_specialist] Llama2-7B-Chat - Asian M","[financial_analyst] Llama2-7B-Chat - White F","[financial_analyst] Llama2-7B-Chat - Black F","[financial_analyst] Llama2-7B-Chat - Black M","[financial_analyst] Llama2-7B-Chat - Hispanic F","[financial_analyst] Llama2-7B-Chat - Hispanic M","[financial_analyst] Llama2-7B-Chat - Asian F","[financial_analyst] Llama2-7B-Chat - Asian M","[retail] Llama3-8B-IT - White F","[retail] Llama3-8B-IT - Black F","[retail] Llama3-8B-IT - Black M","[retail] Llama3-8B-IT - Hispanic F","[retail] Llama3-8B-IT - Hispanic M","[retail] Llama3-8B-IT - Asian F","[retail] Llama3-8B-IT - Asian M","[software_engineer] Llama3-8B-IT - White F","[software_engineer] Llama3-8B-IT - Black F","[software_engineer] Llama3-8B-IT - Black M","[software_engineer] Llama3-8B-IT - Hispanic F","[software_engineer] Llama3-8B-IT - Hispanic M","[software_engineer] Llama3-8B-IT - Asian F","[software_engineer] Llama3-8B-IT - Asian M","[HR_specialist] Llama3-8B-IT - White F","[HR_specialist] Llama3-8B-IT - Black F","[HR_specialist] Llama3-8B-IT - Black M","[HR_specialist] Llama3-8B-IT - Hispanic F","[HR_specialist] Llama3-8B-IT - Hispanic M","[HR_specialist] Llama3-8B-IT - Asian F","[HR_specialist] Llama3-8B-IT - Asian M","[financial_analyst] Llama3-8B-IT - White F","[financial_analyst] Llama3-8B-IT - Black F","[financial_analyst] Llama3-8B-IT - Black M","[financial_analyst] Llama3-8B-IT - Hispanic F","[financial_analyst] Llama3-8B-IT - Hispanic M","[financial_analyst] Llama3-8B-IT - Asian F","[financial_analyst] Llama3-8B-IT - Asian M","[retail] TinyLlama-1.1B-Chat - White F","[retail] TinyLlama-1.1B-Chat - Black F","[retail] TinyLlama-1.1B-Chat - Black M","[retail] TinyLlama-1.1B-Chat - Hispanic F","[retail] TinyLlama-1.1B-Chat - Hispanic M","[retail] TinyLlama-1.1B-Chat - Asian F","[retail] TinyLlama-1.1B-Chat - Asian M","[software_engineer] TinyLlama-1.1B-Chat - White F","[software_engineer] TinyLlama-1.1B-Chat - Black F","[software_engineer] TinyLlama-1.1B-Chat - Black M","[software_engineer] TinyLlama-1.1B-Chat - Hispanic F","[software_engineer] TinyLlama-1.1B-Chat - Hispanic M","[software_engineer] TinyLlama-1.1B-Chat - Asian F","[software_engineer] TinyLlama-1.1B-Chat - Asian M","[HR_specialist] TinyLlama-1.1B-Chat - White F","[HR_specialist] TinyLlama-1.1B-Chat - Black F","[HR_specialist] TinyLlama-1.1B-Chat - Black M","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic F","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic M","[HR_specialist] TinyLlama-1.1B-Chat - Asian F","[HR_specialist] TinyLlama-1.1B-Chat - Asian M","[financial_analyst] TinyLlama-1.1B-Chat - White F","[financial_analyst] TinyLlama-1.1B-Chat - Black F","[financial_analyst] TinyLlama-1.1B-Chat - Black M","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic F","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic M","[financial_analyst] TinyLlama-1.1B-Chat - Asian F","[financial_analyst] TinyLlama-1.1B-Chat - Asian M","[retail] Llama3-70B-IT - White F","[retail] Llama3-70B-IT - Black F","[retail] Llama3-70B-IT - Black M","[retail] Llama3-70B-IT - Hispanic F","[retail] Llama3-70B-IT - Hispanic M","[retail] Llama3-70B-IT - Asian F","[retail] Llama3-70B-IT - Asian M","[software_engineer] Llama3-70B-IT - White F","[software_engineer] Llama3-70B-IT - Black F","[software_engineer] Llama3-70B-IT - Black M","[software_engineer] Llama3-70B-IT - Hispanic F","[software_engineer] Llama3-70B-IT - Hispanic M","[software_engineer] Llama3-70B-IT - Asian F","[software_engineer] Llama3-70B-IT - Asian M","[HR_specialist] Llama3-70B-IT - White F","[HR_specialist] Llama3-70B-IT - Black F","[HR_specialist] Llama3-70B-IT - Black M","[HR_specialist] Llama3-70B-IT - Hispanic F","[HR_specialist] Llama3-70B-IT - Hispanic M","[HR_specialist] Llama3-70B-IT - Asian F","[HR_specialist] Llama3-70B-IT - Asian M","[financial_analyst] Llama3-70B-IT - White F","[financial_analyst] Llama3-70B-IT - Black F","[financial_analyst] Llama3-70B-IT - Black M","[financial_analyst] Llama3-70B-IT - Hispanic F","[financial_analyst] Llama3-70B-IT - Hispanic M","[financial_analyst] Llama3-70B-IT - Asian F","[financial_analyst] Llama3-70B-IT - Asian M","[retail] StableLM2-Zephyr-1.6B - White F","[retail] StableLM2-Zephyr-1.6B - Black F","[retail] StableLM2-Zephyr-1.6B - Black M","[retail] StableLM2-Zephyr-1.6B - Hispanic F","[retail] StableLM2-Zephyr-1.6B - Hispanic M","[retail] StableLM2-Zephyr-1.6B - Asian F","[retail] StableLM2-Zephyr-1.6B - Asian M","[software_engineer] StableLM2-Zephyr-1.6B - White F","[software_engineer] StableLM2-Zephyr-1.6B - Black F","[software_engineer] StableLM2-Zephyr-1.6B - Black M","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic F","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic M","[software_engineer] StableLM2-Zephyr-1.6B - Asian F","[software_engineer] StableLM2-Zephyr-1.6B - Asian M","[HR_specialist] StableLM2-Zephyr-1.6B - White F","[HR_specialist] StableLM2-Zephyr-1.6B - Black F","[HR_specialist] StableLM2-Zephyr-1.6B - Black M","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic F","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic M","[HR_specialist] StableLM2-Zephyr-1.6B - Asian F","[HR_specialist] StableLM2-Zephyr-1.6B - Asian M","[financial_analyst] StableLM2-Zephyr-1.6B - White F","[financial_analyst] StableLM2-Zephyr-1.6B - Black F","[financial_analyst] StableLM2-Zephyr-1.6B - Black M","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic F","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic M","[financial_analyst] StableLM2-Zephyr-1.6B - Asian F","[financial_analyst] StableLM2-Zephyr-1.6B - Asian M","[retail] Llama2-13B-Chat - White F","[retail] Llama2-13B-Chat - Black F","[retail] Llama2-13B-Chat - Black M","[retail] Llama2-13B-Chat - Hispanic F","[retail] Llama2-13B-Chat - Hispanic M","[retail] Llama2-13B-Chat - Asian F","[retail] Llama2-13B-Chat - Asian M","[software_engineer] Llama2-13B-Chat - White F","[software_engineer] Llama2-13B-Chat - Black F","[software_engineer] Llama2-13B-Chat - Black M","[software_engineer] Llama2-13B-Chat - Hispanic F","[software_engineer] Llama2-13B-Chat - Hispanic M","[software_engineer] Llama2-13B-Chat - Asian F","[software_engineer] Llama2-13B-Chat - Asian M","[HR_specialist] Llama2-13B-Chat - White F","[HR_specialist] Llama2-13B-Chat - Black F","[HR_specialist] Llama2-13B-Chat - Black M","[HR_specialist] Llama2-13B-Chat - Hispanic F","[HR_specialist] Llama2-13B-Chat - Hispanic M","[HR_specialist] Llama2-13B-Chat - Asian F","[HR_specialist] Llama2-13B-Chat - Asian M","[financial_analyst] Llama2-13B-Chat - White F","[financial_analyst] Llama2-13B-Chat - Black F","[financial_analyst] Llama2-13B-Chat - Black M","[financial_analyst] Llama2-13B-Chat - Hispanic F","[financial_analyst] Llama2-13B-Chat - Hispanic M","[financial_analyst] Llama2-13B-Chat - Asian F","[financial_analyst] Llama2-13B-Chat - Asian M","[retail] StarlingLM-7B - White F","[retail] StarlingLM-7B - Black F","[retail] StarlingLM-7B - Black M","[retail] StarlingLM-7B - Hispanic F","[retail] StarlingLM-7B - Hispanic M","[retail] StarlingLM-7B - Asian F","[retail] StarlingLM-7B - Asian M","[software_engineer] StarlingLM-7B - White F","[software_engineer] StarlingLM-7B - Black F","[software_engineer] StarlingLM-7B - Black M","[software_engineer] StarlingLM-7B - Hispanic F","[software_engineer] StarlingLM-7B - Hispanic M","[software_engineer] StarlingLM-7B - Asian F","[software_engineer] StarlingLM-7B - Asian M","[HR_specialist] StarlingLM-7B - White F","[HR_specialist] StarlingLM-7B - Black F","[HR_specialist] StarlingLM-7B - Black M","[HR_specialist] StarlingLM-7B - Hispanic F","[HR_specialist] StarlingLM-7B - Hispanic M","[HR_specialist] StarlingLM-7B - Asian F","[HR_specialist] StarlingLM-7B - Asian M","[financial_analyst] StarlingLM-7B - White F","[financial_analyst] StarlingLM-7B - Black F","[financial_analyst] StarlingLM-7B - Black M","[financial_analyst] StarlingLM-7B - Hispanic F","[financial_analyst] StarlingLM-7B - Hispanic M","[financial_analyst] StarlingLM-7B - Asian F","[financial_analyst] StarlingLM-7B - Asian M","[retail] StableLM-Zephyr-3B - White F","[retail] StableLM-Zephyr-3B - Black F","[retail] StableLM-Zephyr-3B - Black M","[retail] StableLM-Zephyr-3B - Hispanic F","[retail] StableLM-Zephyr-3B - Hispanic M","[retail] StableLM-Zephyr-3B - Asian F","[retail] StableLM-Zephyr-3B - Asian M","[software_engineer] StableLM-Zephyr-3B - White F","[software_engineer] StableLM-Zephyr-3B - Black F","[software_engineer] StableLM-Zephyr-3B - Black M","[software_engineer] StableLM-Zephyr-3B - Hispanic F","[software_engineer] StableLM-Zephyr-3B - Hispanic M","[software_engineer] StableLM-Zephyr-3B - Asian F","[software_engineer] StableLM-Zephyr-3B - Asian M","[HR_specialist] StableLM-Zephyr-3B - White F","[HR_specialist] StableLM-Zephyr-3B - Black F","[HR_specialist] StableLM-Zephyr-3B - Black M","[HR_specialist] StableLM-Zephyr-3B - Hispanic F","[HR_specialist] StableLM-Zephyr-3B - Hispanic M","[HR_specialist] StableLM-Zephyr-3B - Asian F","[HR_specialist] StableLM-Zephyr-3B - Asian M","[financial_analyst] StableLM-Zephyr-3B - White F","[financial_analyst] StableLM-Zephyr-3B - Black F","[financial_analyst] StableLM-Zephyr-3B - Black M","[financial_analyst] StableLM-Zephyr-3B - Hispanic F","[financial_analyst] StableLM-Zephyr-3B - Hispanic M","[financial_analyst] StableLM-Zephyr-3B - Asian F","[financial_analyst] StableLM-Zephyr-3B - Asian M","[retail] Gemma-2B-IT - White F","[retail] Gemma-2B-IT - Black F","[retail] Gemma-2B-IT - Black M","[retail] Gemma-2B-IT - Hispanic F","[retail] Gemma-2B-IT - Hispanic M","[retail] Gemma-2B-IT - Asian F","[retail] Gemma-2B-IT - Asian M","[software_engineer] Gemma-2B-IT - White F","[software_engineer] Gemma-2B-IT - Black F","[software_engineer] Gemma-2B-IT - Black M","[software_engineer] Gemma-2B-IT - Hispanic F","[software_engineer] Gemma-2B-IT - Hispanic M","[software_engineer] Gemma-2B-IT - Asian F","[software_engineer] Gemma-2B-IT - Asian M","[HR_specialist] Gemma-2B-IT - White F","[HR_specialist] Gemma-2B-IT - Black F","[HR_specialist] Gemma-2B-IT - Black M","[HR_specialist] Gemma-2B-IT - Hispanic F","[HR_specialist] Gemma-2B-IT - Hispanic M","[HR_specialist] Gemma-2B-IT - Asian F","[HR_specialist] Gemma-2B-IT - Asian M","[financial_analyst] Gemma-2B-IT - White F","[financial_analyst] Gemma-2B-IT - Black F","[financial_analyst] Gemma-2B-IT - Black M","[financial_analyst] Gemma-2B-IT - Hispanic F","[financial_analyst] Gemma-2B-IT - Hispanic M","[financial_analyst] Gemma-2B-IT - Asian F","[financial_analyst] Gemma-2B-IT - Asian M","[retail] Gemma-7B-IT - White F","[retail] Gemma-7B-IT - Black F","[retail] Gemma-7B-IT - Black M","[retail] Gemma-7B-IT - Hispanic F","[retail] Gemma-7B-IT - Hispanic M","[retail] Gemma-7B-IT - Asian F","[retail] Gemma-7B-IT - Asian M","[software_engineer] Gemma-7B-IT - White F","[software_engineer] Gemma-7B-IT - Black F","[software_engineer] Gemma-7B-IT - Black M","[software_engineer] Gemma-7B-IT - Hispanic F","[software_engineer] Gemma-7B-IT - Hispanic M","[software_engineer] Gemma-7B-IT - Asian F","[software_engineer] Gemma-7B-IT - Asian M","[HR_specialist] Gemma-7B-IT - White F","[HR_specialist] Gemma-7B-IT - Black F","[HR_specialist] Gemma-7B-IT - Black M","[HR_specialist] Gemma-7B-IT - Hispanic F","[HR_specialist] Gemma-7B-IT - Hispanic M","[HR_specialist] Gemma-7B-IT - Asian F","[HR_specialist] Gemma-7B-IT - Asian M","[financial_analyst] Gemma-7B-IT - White F","[financial_analyst] Gemma-7B-IT - Black F","[financial_analyst] Gemma-7B-IT - Black M","[financial_analyst] Gemma-7B-IT - Hispanic F","[financial_analyst] Gemma-7B-IT - Hispanic M","[financial_analyst] Gemma-7B-IT - Asian F","[financial_analyst] Gemma-7B-IT - Asian M"],"marker":{"color":"#2CA02C"},"mode":"markers","showlegend":false,"x":[0.0086257130084145,0.0116358393497846,0.0080235338511671,0.007048795694532,0.0098195203554336,0.0107553106614401,0.0031520166720257,0.0112754502269521,0.0178589918986142,0.0079757501886133,0.0228715965824785,0.0104352032579725,0.0156744068183736,0.0117671140031703,2.5108949773409907e-06,0.0001395760522121,7.344001460455555e-05,7.44978373567809e-05,2.093811157224501e-06,0.000176767018238,0.0001104996724191,0.001803294312843,0.0025107324108834,0.0018622770033234,0.00137851459507,0.0021902357470189,0.0005223951929175,0.0041701215397984,0.0,1.8891867457941896e-05,0.0006290142964316,0.0005390898262066,0.0004913238954469,0.0005820884306319,0.0001379983497312,1.3102811748827523e-05,1.3102811748827523e-05,0.0001039071061484,2.0885569065987692e-06,4.266843014437416e-05,0.0003093276751107,1.3102811748827523e-05,0.0006206828965584,0.0191474183843271,0.0173763049126693,0.0008561001111007,0.0144146032685351,0.0053098116611479,0.0023142353583621,9.445933728970948e-06,0.0089953055578173,0.0037603353560749,0.0025313628632661,1.8891867457941896e-05,0.0003512967189109,0.0002620660902727,0.0041065740916995,0.0121220924413275,0.0280658040808197,0.0223355245823892,0.0079603716557794,0.0147857079903185,0.0122797080126511,0.0037680938866398,0.0083609899384588,0.0134187132216151,0.0089107000008363,0.004830363441321,0.0055637630932032,0.0067366468097731,0.0030656854731417,0.0098514484559303,0.0175355465507861,0.0096768494262794,0.0016240283865414,0.0041280296741909,0.0060567985163289,0.0058013868863698,0.0099967097686793,0.0277053717584848,0.0165602444098237,0.0137317508620359,0.0124114567387475,0.0092618930278201,0.0001068493168654,0.0009454835266195,0.0009454835266195,0.0052884547708164,1.6835303127335716e-05,0.0,1.6835303127335716e-05,0.0019552848469602,0.0008789672501753,0.0,0.0032497047500335,0.0,0.0,0.0,5.214853260381643e-07,0.0,0.0,0.0,0.0,0.0,0.0,0.0229080429169589,0.0217686734054772,0.0299890689238549,0.0375678929243125,0.0115615627214104,0.0363371313474843,0.0214323806811791,0.0053403189330015,0.00679874911074,0.0069677538496876,0.0264579514078909,0.0190687636569575,0.0051851360933265,0.0018834934713336,0.0052942590607311,0.0085425080809388,0.0099213346759125,0.0125493990899588,0.024985073203132,0.0073118780564389,0.0054894193172468,0.0100256446943181,0.0126337594895571,0.0074477201968613,0.0173543667744812,0.0116271229134342,0.0104951251977634,0.0042715380401787,0.006474157833888,0.0213738335742066,0.0181392307917657,0.0225326893118323,0.0109007943445518,0.0149431174366286,0.0054052153909104,9.445933728970948e-06,0.0006387320102176,6.032879770311895e-05,0.001878697633306,0.0003165957051224,5.6964405062524814e-05,0.0001414324213234,1.0442784532993846e-06,0.0001546638375553,0.0025630651894974,0.0004923345686099,0.000363002156863,4.187622314449002e-06,9.08165622265809e-05,0.0020989838342547,0.000203438824735,0.0053798762057546,0.0008804988763964,0.0003969150864882,0.0007757115713761,0.0021755157788565,0.0,0.0008912008914087,0.0005504150584798,8.929530511199348e-05,0.0006949597644147,0.0006076699713952,0.00041621765519,0.0100704362145133,0.0369764768271851,0.0323939523067539,0.0251345472417217,0.0156503378970797,0.011094033452901,0.0147763624859981,0.000382463311383,0.0002555928768406,0.0006758705222679,0.0004082097575618,8.597095017048167e-05,0.0054545241641427,0.0048615998117225,0.0088760366903986,0.0029049683294294,0.0090883775898219,0.002157483267433,0.0026080434870573,0.0186983011884667,0.0062342307284377,0.0151941252142436,0.0140656992340782,0.0137839013019379,0.0069053112035265,0.0048600507951262,0.0110457184512874,0.0138088412935072,0.0070408502265101,0.0246323138173026,0.0185530143694182,0.0188218373852882,0.0052383156744892,0.0150633856407893,0.0075341912355045,0.0021208211065785,0.0050839206181274,0.0058454386400286,0.0112428015880314,0.0029465269445898,0.0154179080237688,0.007570666422093,0.0001604668064942,0.0012639109474716,0.0005140069289094,1.5090634900483036e-05,1.0469055786168585e-05,0.0003835570706379,0.0003772806960367,0.0154764281640962,0.0071521593610303,0.0105714015318258,0.0124468712646608,0.0183755882653645,0.0069749769382215,0.0114369937120161,0.0104375522084224,0.0020315853647488,0.003196846618657,1.2562866943292145e-05,0.0007452813689565,0.0027940367069807,0.003135960832149,0.0046004221733995,0.0123760178134113,0.0139923955339582,1.3912082144551185e-06,0.0137757066704546,0.0191547136982805,0.0205880664560868,0.0104616465936244,0.0157163458336133,0.0177738000943953,0.0222697234871604,0.0094110563299964,0.0101527890638587,0.0011261721401845,0.0098384772626596,0.0358033434383256,0.0154394338548482,3.1328353598983165e-06,0.0053423801945711,0.0116724655616419,0.0135973661820896,0.0006175833851419,3.025489449465409e-05,6.931950139409115e-05,0.0006532378097673,0.0002389593266943,0.0011649061075904,0.0006339605512544,0.0002943265631468,0.0014510813721063,0.0013795533768984,0.0044280417375423,0.0027064728481638,0.0001810173623985,0.000361454262927,0.0,0.0002193996036918,0.0002193996036918,0.0002193996036918,3.4015966907774853e-05,0.0002193996036918,0.0003193660051088,0.000176767018238,0.0004109205889609,0.0037488228455581,5.342465843270576e-05,0.0,5.342465843270576e-05,0.0002669056537723],"y":[0.0555555555555555,0.0138888888888888,0.0216666666666667,0.0011111111111111,0.0255555555555556,0.0072222222222223,0.0538888888888889,0.0738888888888888,0.1083333333333333,0.0594444444444444,0.0638888888888887,0.0277777777777776,0.0322222222222221,0.0655555555555554,0.0016666666666666,0.0522222222222222,0.0355555555555555,0.0322222222222222,0.0455555555555555,0.0105555555555555,0.0444444444444444,0.0194444444444445,0.0755555555555556,0.045,0.0416666666666667,0.0294444444444444,0.0611111111111111,0.0966666666666667,0.0338888888888888,0.0238888888888889,0.0577777777777777,0.0177777777777777,0.0544444444444444,0.0316666666666666,0.0483333333333333,0.0322222222222222,0.0475,0.0625,0.0591666666666667,0.0580555555555556,0.0780555555555556,0.0780555555555556,0.038611111111111,0.0025,0.0249999999999999,0.0044444444444443,0.036111111111111,0.005,0.0411111111111111,0.0144444444444444,0.0694444444444444,0.0883333333333333,0.0561111111111111,0.0683333333333334,0.0655555555555555,0.0777777777777777,0.0088888888888888,0.0561111111111111,0.0788888888888889,0.0894444444444444,0.0438888888888888,0.0155555555555556,0.0405555555555555,0.0172222222222221,0.0394444444444445,0.0616666666666667,0.0383333333333334,0.0283333333333334,0.0138888888888888,0.0222222222222222,0.0055555555555554,0.0422222222222221,0.0433333333333333,0.0538888888888887,0.0238888888888887,0.03,0.0411111111111111,0.0122222222222221,0.0305555555555556,0.0622222222222223,0.08,0.0727777777777778,0.0033333333333332,0.0277777777777778,0.009074074074074,0.0203703703703703,0.0102777777777777,0.0229629629629628,0.0198148148148148,0.0306481481481481,0.0164814814814814,0.017962962962963,0.02,0.0166666666666666,0.0471296296296296,0.0263888888888889,0.0348148148148148,0.0303703703703704,0.016898148148148,0.0285648148148147,0.0133333333333332,0.0487499999999999,0.0175925925925925,0.0616203703703704,0.0450925925925926,0.0004629629629629,0.0044444444444445,0.0026851851851851,0.0158333333333333,0.0082407407407407,0.0438888888888889,0.0609259259259259,0.015,0.0266666666666666,0.0161111111111111,0.0672222222222222,0.0549999999999999,0.0383333333333333,0.0572222222222222,0.0166666666666666,0.0783333333333334,0.0572222222222223,0.0383333333333334,0.0555555555555555,0.0622222222222223,0.0827777777777778,0.02,0.0494444444444445,0.0133333333333333,0.08,0.0633333333333333,0.0483333333333333,0.0433333333333333,0.0566666666666665,0.0444444444444445,0.0361111111111112,0.006111111111111,0.0622222222222222,0.0372222222222223,0.0472222222222223,0.0633333333333333,0.0505555555555556,0.0605555555555556,0.0005555555555556,0.0088888888888889,0.0544444444444444,0.0838888888888889,0.0372222222222221,0.1177777777777778,0.1388888888888889,0.0499999999999999,0.0416666666666667,0.0661111111111111,0.0805555555555556,0.1616666666666666,0.045,0.0888888888888889,0.0077777777777778,0.03,0.0794444444444445,0.1038888888888888,0.0222222222222222,0.0777777777777777,0.0783333333333334,0.0416666666666666,0.0449999999999999,0.0983333333333334,0.0988888888888889,0.0861111111111111,0.0405555555555556,0.0083333333333332,0.0299999999999999,0.0388888888888889,0.0083333333333332,0.0188888888888889,0.0077777777777778,0.0655555555555554,0.0633333333333333,0.0888888888888888,0.0611111111111111,0.0861111111111111,0.0716666666666667,0.0961111111111111,0.0755555555555555,0.0266666666666666,0.0377777777777778,0.0088888888888889,0.0138888888888888,0.0488888888888889,0.09,0.0455555555555555,0.0255555555555555,0.0161111111111111,0.0016666666666666,0.0049999999999999,0.0172222222222221,0.0183333333333333,0.0244444444444445,0.0327777777777778,0.001111111111111,0.0322222222222221,0.0405555555555556,0.0605555555555556,0.0294444444444444,0.0322222222222223,0.0055555555555555,0.0444444444444444,0.0550000000000001,0.0183333333333333,0.0027777777777777,0.0444444444444445,0.05,0.0011111111111111,0.0566666666666667,0.0427777777777778,0.0194444444444445,0.0055555555555554,0.0311111111111111,0.0122222222222222,0.0555555555555555,0.0055555555555555,0.0083333333333334,0.0077777777777778,0.0194444444444445,0.1572222222222223,0.0877777777777778,0.0144444444444445,0.1033333333333333,0.0238888888888888,0.0027777777777778,0.0261111111111111,0.0694444444444444,0.0127777777777778,0.0466666666666666,0.0227777777777778,0.0344444444444443,0.0094444444444444,0.0111111111111111,0.1822222222222221,0.0855555555555555,0.0216666666666667,0.0727777777777777,0.0438888888888889,0.0683333333333332,0.0166666666666665,0.0633333333333334,0.0261111111111111,0.0316666666666665,0.0211111111111112,0.0383333333333332,0.0050000000000001,0.0033333333333334,0.0611574074074072,0.1302962962962961,0.1259166666666665,0.1143703703703702,0.1006944444444442,0.0763796296296294,0.1066666666666665,0.0325462962962961,0.099398148148148,0.1099537037037036,0.1136111111111111,0.0917592592592592,0.0986574074074073,0.0970370370370369,0.0499999999999997,0.1429166666666665,0.1319814814814813,0.109509259259259,0.1206944444444442,0.0916481481481479,0.1182870370370369,0.0571296296296296,0.1668703703703703,0.1375185185185184,0.1396759259259258,0.1174537037037035,0.1307407407407406,0.1266851851851851],"type":"scatter","xaxis":"x","yaxis":"y"},{"line":{"color":"#2CA02C"},"mode":"lines","showlegend":false,"x":[0.0086257130084145,0.0116358393497846,0.0080235338511671,0.007048795694532,0.0098195203554336,0.0107553106614401,0.0031520166720257,0.0112754502269521,0.0178589918986142,0.0079757501886133,0.0228715965824785,0.0104352032579725,0.0156744068183736,0.0117671140031703,2.5108949773409907e-06,0.0001395760522121,7.344001460455555e-05,7.44978373567809e-05,2.093811157224501e-06,0.000176767018238,0.0001104996724191,0.001803294312843,0.0025107324108834,0.0018622770033234,0.00137851459507,0.0021902357470189,0.0005223951929175,0.0041701215397984,0.0,1.8891867457941896e-05,0.0006290142964316,0.0005390898262066,0.0004913238954469,0.0005820884306319,0.0001379983497312,1.3102811748827523e-05,1.3102811748827523e-05,0.0001039071061484,2.0885569065987692e-06,4.266843014437416e-05,0.0003093276751107,1.3102811748827523e-05,0.0006206828965584,0.0191474183843271,0.0173763049126693,0.0008561001111007,0.0144146032685351,0.0053098116611479,0.0023142353583621,9.445933728970948e-06,0.0089953055578173,0.0037603353560749,0.0025313628632661,1.8891867457941896e-05,0.0003512967189109,0.0002620660902727,0.0041065740916995,0.0121220924413275,0.0280658040808197,0.0223355245823892,0.0079603716557794,0.0147857079903185,0.0122797080126511,0.0037680938866398,0.0083609899384588,0.0134187132216151,0.0089107000008363,0.004830363441321,0.0055637630932032,0.0067366468097731,0.0030656854731417,0.0098514484559303,0.0175355465507861,0.0096768494262794,0.0016240283865414,0.0041280296741909,0.0060567985163289,0.0058013868863698,0.0099967097686793,0.0277053717584848,0.0165602444098237,0.0137317508620359,0.0124114567387475,0.0092618930278201,0.0001068493168654,0.0009454835266195,0.0009454835266195,0.0052884547708164,1.6835303127335716e-05,0.0,1.6835303127335716e-05,0.0019552848469602,0.0008789672501753,0.0,0.0032497047500335,0.0,0.0,0.0,5.214853260381643e-07,0.0,0.0,0.0,0.0,0.0,0.0,0.0229080429169589,0.0217686734054772,0.0299890689238549,0.0375678929243125,0.0115615627214104,0.0363371313474843,0.0214323806811791,0.0053403189330015,0.00679874911074,0.0069677538496876,0.0264579514078909,0.0190687636569575,0.0051851360933265,0.0018834934713336,0.0052942590607311,0.0085425080809388,0.0099213346759125,0.0125493990899588,0.024985073203132,0.0073118780564389,0.0054894193172468,0.0100256446943181,0.0126337594895571,0.0074477201968613,0.0173543667744812,0.0116271229134342,0.0104951251977634,0.0042715380401787,0.006474157833888,0.0213738335742066,0.0181392307917657,0.0225326893118323,0.0109007943445518,0.0149431174366286,0.0054052153909104,9.445933728970948e-06,0.0006387320102176,6.032879770311895e-05,0.001878697633306,0.0003165957051224,5.6964405062524814e-05,0.0001414324213234,1.0442784532993846e-06,0.0001546638375553,0.0025630651894974,0.0004923345686099,0.000363002156863,4.187622314449002e-06,9.08165622265809e-05,0.0020989838342547,0.000203438824735,0.0053798762057546,0.0008804988763964,0.0003969150864882,0.0007757115713761,0.0021755157788565,0.0,0.0008912008914087,0.0005504150584798,8.929530511199348e-05,0.0006949597644147,0.0006076699713952,0.00041621765519,0.0100704362145133,0.0369764768271851,0.0323939523067539,0.0251345472417217,0.0156503378970797,0.011094033452901,0.0147763624859981,0.000382463311383,0.0002555928768406,0.0006758705222679,0.0004082097575618,8.597095017048167e-05,0.0054545241641427,0.0048615998117225,0.0088760366903986,0.0029049683294294,0.0090883775898219,0.002157483267433,0.0026080434870573,0.0186983011884667,0.0062342307284377,0.0151941252142436,0.0140656992340782,0.0137839013019379,0.0069053112035265,0.0048600507951262,0.0110457184512874,0.0138088412935072,0.0070408502265101,0.0246323138173026,0.0185530143694182,0.0188218373852882,0.0052383156744892,0.0150633856407893,0.0075341912355045,0.0021208211065785,0.0050839206181274,0.0058454386400286,0.0112428015880314,0.0029465269445898,0.0154179080237688,0.007570666422093,0.0001604668064942,0.0012639109474716,0.0005140069289094,1.5090634900483036e-05,1.0469055786168585e-05,0.0003835570706379,0.0003772806960367,0.0154764281640962,0.0071521593610303,0.0105714015318258,0.0124468712646608,0.0183755882653645,0.0069749769382215,0.0114369937120161,0.0104375522084224,0.0020315853647488,0.003196846618657,1.2562866943292145e-05,0.0007452813689565,0.0027940367069807,0.003135960832149,0.0046004221733995,0.0123760178134113,0.0139923955339582,1.3912082144551185e-06,0.0137757066704546,0.0191547136982805,0.0205880664560868,0.0104616465936244,0.0157163458336133,0.0177738000943953,0.0222697234871604,0.0094110563299964,0.0101527890638587,0.0011261721401845,0.0098384772626596,0.0358033434383256,0.0154394338548482,3.1328353598983165e-06,0.0053423801945711,0.0116724655616419,0.0135973661820896,0.0006175833851419,3.025489449465409e-05,6.931950139409115e-05,0.0006532378097673,0.0002389593266943,0.0011649061075904,0.0006339605512544,0.0002943265631468,0.0014510813721063,0.0013795533768984,0.0044280417375423,0.0027064728481638,0.0001810173623985,0.000361454262927,0.0,0.0002193996036918,0.0002193996036918,0.0002193996036918,3.4015966907774853e-05,0.0002193996036918,0.0003193660051088,0.000176767018238,0.0004109205889609,0.0037488228455581,5.342465843270576e-05,0.0,5.342465843270576e-05,0.0002669056537723],"y":[0.047027749419218584,0.04440953042765243,0.04755152707072833,0.048399357913716995,0.045989371386616164,0.04517541752772447,0.05178879067686764,0.04472299821562722,0.038996609392802195,0.0475930894766199,0.034636627354794655,0.04545384812765681,0.040896769551254084,0.0442953472500622,0.05452824241554849,0.05440902263635786,0.054466548005745574,0.054465627907614965,0.05452860519659322,0.054376673796966826,0.054434313378720976,0.05296191435829915,0.05234658209194526,0.052910610996620595,0.053331389323193534,0.05262535127200622,0.05407604513612652,0.05090323930861672,0.05453042640125871,0.05451399418528002,0.05398330744673196,0.05406152408253019,0.05410307106524188,0.05402412373784369,0.05441039492779352,0.05451902952728295,0.05451902952728295,0.05444004761717332,0.05452860976675979,0.05449331324337927,0.05426137204880146,0.05451902952728295,0.05399055412906371,0.03787593128445578,0.03941645231308558,0.05378578736775372,0.041992551324429854,0.049911932638459014,0.05251749595281127,0.05452221029326936,0.04670627645687531,0.05125967284230618,0.05232863764838798,0.05451399418528002,0.05422486721974317,0.05430248034957067,0.05095851311330439,0.04398658569556989,0.03011868651909464,0.03510290475723811,0.04760646578118718,0.0416697630689738,0.04384949109042512,0.05125292444381125,0.04725800652163251,0.042858780159585934,0.046779866682320426,0.05032895846803001,0.04969104474641128,0.04867086616472946,0.05186388187200328,0.04596160020706925,0.03927794334904797,0.04611346708689361,0.05311784052203948,0.0509398509685359,0.04926220071730816,0.049484358694877106,0.045835251381589,0.03043219188215591,0.04012626474768421,0.042586498865621464,0.04373489556264298,0.046474397692425444,0.05443748847144227,0.053708041343334074,0.053708041343334074,0.04993050894042289,0.05451578299251836,0.05453042640125871,0.05451578299251836,0.052829712431258835,0.05376589744586404,0.05453042640125871,0.05170382122639162,0.05453042640125871,0.05453042640125871,0.05453042640125871,0.05452997281139914,0.05453042640125871,0.05453042640125871,0.05453042640125871,0.05453042640125871,0.05453042640125871,0.05453042640125871,0.03460492619866773,0.03559595400118017,0.02844582366658252,0.02185373460406707,0.044474136512907415,0.02292425556202619,0.03588846265285426,0.04988539730090517,0.04861684935434619,0.0484698484092045,0.03151720270296568,0.0379443454563612,0.05002037590709128,0.05289215683450959,0.049925460347651766,0.04710012137195516,0.04590081291522326,0.043614912796896894,0.03279831759670411,0.048170527905214026,0.049755709236880864,0.04581008367657082,0.04354153581024728,0.04805237191055666,0.03943553418657848,0.04441711201613187,0.0454017278034645,0.050815026862612536,0.04889918004388256,0.03593938714239143,0.03875285657015796,0.03493141014852346,0.04504887528368276,0.04153284775212586,0.049828950122510283,0.05452221029326936,0.053974854943446816,0.05447795219055406,0.05289632827211065,0.05425505028949642,0.054480878551679046,0.05440740795965949,0.05452951808400925,0.054395899225030124,0.05230106284812965,0.054102191977997836,0.05421468578664863,0.05452678399192774,0.05445143382054791,0.05270472252221999,0.05435347456132343,0.04985099023919706,0.05376456523172905,0.054185188195406686,0.05385570961603895,0.05263815475459376,0.05453042640125871,0.05375525657960767,0.054051673353737166,0.054452757015595814,0.05392594783550631,0.054001872819355826,0.054168398749971626,0.04577112384713628,0.022368150506195648,0.02635404723212825,0.0326683045267532,0.04091770478774968,0.04488079519467131,0.041677891823093234,0.054197758402684114,0.054308110774483886,0.05394255172871719,0.05417536404885776,0.0544556485517825,0.049786061169726704,0.05030178895787065,0.04681001695756011,0.0520036742362488,0.04662532206023454,0.05265383949952482,0.05226194055905456,0.03826657507753505,0.04910786952493455,0.04131452026156502,0.042296029340184275,0.04254113822068993,0.04852416125309272,0.050303136298218115,0.04492281976123642,0.04251944532405672,0.04840626891110136,0.03310514901129894,0.03839294608848866,0.038159122837999916,0.04997412011129623,0.04142823802465782,0.047977159082282804,0.0526857283822278,0.05010841350065158,0.04944604231710382,0.044751396122152315,0.051967526399534864,0.041119873148640775,0.047945432830485864,0.05439085178124862,0.05343107199847563,0.05408334127909249,0.054517300511375544,0.05452132037793125,0.05419680704685097,0.05420226626062322,0.04106897211479096,0.0483094518154432,0.045335382366828,0.043704091877412504,0.038547271968053416,0.04846356574016257,0.04458248709662686,0.045451805001893726,0.05276334595952811,0.051749797423977284,0.05451949917326585,0.05388217791831491,0.05210016297051509,0.05180275610559831,0.05052896223077667,0.04376572047058146,0.042359789168856084,0.05452921632322369,0.04254826594137181,0.03786958579347764,0.036622850279248685,0.04543084761679697,0.04086029084114846,0.039070709538256615,0.03516013879250969,0.04634465490215275,0.04569949303509947,0.05355087772096588,0.045972882598807385,0.02338854625375562,0.0411011499013914,0.05452770144951034,0.04988360440799103,0.04437767281351977,0.042703387155782334,0.05399325009552323,0.054504110582462316,0.05447013204333043,0.053962237745508346,0.054322578697737364,0.0535171867732847,0.05397900517604777,0.054274420071304265,0.053268270472937335,0.053330485786928686,0.05067889936953821,0.052176326337805806,0.05437297683194287,0.05421603215050202,0.05453042640125871,0.054339591816931425,0.054339591816931425,0.054339591816931425,0.05450083918780843,0.054339591816931425,0.05425264067235276,0.054376673796966826,0.05417300615771063,0.05126968646640609,0.05448395743635048,0.05453042640125871,0.05448395743635048,0.054298270879392825],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["[retail] Llama2-7B-Chat - White F","[retail] Llama2-7B-Chat - Black F","[retail] Llama2-7B-Chat - Black M","[retail] Llama2-7B-Chat - Hispanic F","[retail] Llama2-7B-Chat - Hispanic M","[retail] Llama2-7B-Chat - Asian F","[retail] Llama2-7B-Chat - Asian M","[software_engineer] Llama2-7B-Chat - White F","[software_engineer] Llama2-7B-Chat - Black F","[software_engineer] Llama2-7B-Chat - Black M","[software_engineer] Llama2-7B-Chat - Hispanic F","[software_engineer] Llama2-7B-Chat - Hispanic M","[software_engineer] Llama2-7B-Chat - Asian F","[software_engineer] Llama2-7B-Chat - Asian M","[HR_specialist] Llama2-7B-Chat - White F","[HR_specialist] Llama2-7B-Chat - Black F","[HR_specialist] Llama2-7B-Chat - Black M","[HR_specialist] Llama2-7B-Chat - Hispanic F","[HR_specialist] Llama2-7B-Chat - Hispanic M","[HR_specialist] Llama2-7B-Chat - Asian F","[HR_specialist] Llama2-7B-Chat - Asian M","[financial_analyst] Llama2-7B-Chat - White F","[financial_analyst] Llama2-7B-Chat - Black F","[financial_analyst] Llama2-7B-Chat - Black M","[financial_analyst] Llama2-7B-Chat - Hispanic F","[financial_analyst] Llama2-7B-Chat - Hispanic M","[financial_analyst] Llama2-7B-Chat - Asian F","[financial_analyst] Llama2-7B-Chat - Asian M","[retail] Llama3-8B-IT - White F","[retail] Llama3-8B-IT - Black F","[retail] Llama3-8B-IT - Black M","[retail] Llama3-8B-IT - Hispanic F","[retail] Llama3-8B-IT - Hispanic M","[retail] Llama3-8B-IT - Asian F","[retail] Llama3-8B-IT - Asian M","[software_engineer] Llama3-8B-IT - White F","[software_engineer] Llama3-8B-IT - Black F","[software_engineer] Llama3-8B-IT - Black M","[software_engineer] Llama3-8B-IT - Hispanic F","[software_engineer] Llama3-8B-IT - Hispanic M","[software_engineer] Llama3-8B-IT - Asian F","[software_engineer] Llama3-8B-IT - Asian M","[HR_specialist] Llama3-8B-IT - White F","[HR_specialist] Llama3-8B-IT - Black F","[HR_specialist] Llama3-8B-IT - Black M","[HR_specialist] Llama3-8B-IT - Hispanic F","[HR_specialist] Llama3-8B-IT - Hispanic M","[HR_specialist] Llama3-8B-IT - Asian F","[HR_specialist] Llama3-8B-IT - Asian M","[financial_analyst] Llama3-8B-IT - White F","[financial_analyst] Llama3-8B-IT - Black F","[financial_analyst] Llama3-8B-IT - Black M","[financial_analyst] Llama3-8B-IT - Hispanic F","[financial_analyst] Llama3-8B-IT - Hispanic M","[financial_analyst] Llama3-8B-IT - Asian F","[financial_analyst] Llama3-8B-IT - Asian M","[retail] TinyLlama-1.1B-Chat - White F","[retail] TinyLlama-1.1B-Chat - Black F","[retail] TinyLlama-1.1B-Chat - Black M","[retail] TinyLlama-1.1B-Chat - Hispanic F","[retail] TinyLlama-1.1B-Chat - Hispanic M","[retail] TinyLlama-1.1B-Chat - Asian F","[retail] TinyLlama-1.1B-Chat - Asian M","[software_engineer] TinyLlama-1.1B-Chat - White F","[software_engineer] TinyLlama-1.1B-Chat - Black F","[software_engineer] TinyLlama-1.1B-Chat - Black M","[software_engineer] TinyLlama-1.1B-Chat - Hispanic F","[software_engineer] TinyLlama-1.1B-Chat - Hispanic M","[software_engineer] TinyLlama-1.1B-Chat - Asian F","[software_engineer] TinyLlama-1.1B-Chat - Asian M","[HR_specialist] TinyLlama-1.1B-Chat - White F","[HR_specialist] TinyLlama-1.1B-Chat - Black F","[HR_specialist] TinyLlama-1.1B-Chat - Black M","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic F","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic M","[HR_specialist] TinyLlama-1.1B-Chat - Asian F","[HR_specialist] TinyLlama-1.1B-Chat - Asian M","[financial_analyst] TinyLlama-1.1B-Chat - White F","[financial_analyst] TinyLlama-1.1B-Chat - Black F","[financial_analyst] TinyLlama-1.1B-Chat - Black M","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic F","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic M","[financial_analyst] TinyLlama-1.1B-Chat - Asian F","[financial_analyst] TinyLlama-1.1B-Chat - Asian M","[retail] Llama3-70B-IT - White F","[retail] Llama3-70B-IT - Black F","[retail] Llama3-70B-IT - Black M","[retail] Llama3-70B-IT - Hispanic F","[retail] Llama3-70B-IT - Hispanic M","[retail] Llama3-70B-IT - Asian F","[retail] Llama3-70B-IT - Asian M","[software_engineer] Llama3-70B-IT - White F","[software_engineer] Llama3-70B-IT - Black F","[software_engineer] Llama3-70B-IT - Black M","[software_engineer] Llama3-70B-IT - Hispanic F","[software_engineer] Llama3-70B-IT - Hispanic M","[software_engineer] Llama3-70B-IT - Asian F","[software_engineer] Llama3-70B-IT - Asian M","[HR_specialist] Llama3-70B-IT - White F","[HR_specialist] Llama3-70B-IT - Black F","[HR_specialist] Llama3-70B-IT - Black M","[HR_specialist] Llama3-70B-IT - Hispanic F","[HR_specialist] Llama3-70B-IT - Hispanic M","[HR_specialist] Llama3-70B-IT - Asian F","[HR_specialist] Llama3-70B-IT - Asian M","[financial_analyst] Llama3-70B-IT - White F","[financial_analyst] Llama3-70B-IT - Black F","[financial_analyst] Llama3-70B-IT - Black M","[financial_analyst] Llama3-70B-IT - Hispanic F","[financial_analyst] Llama3-70B-IT - Hispanic M","[financial_analyst] Llama3-70B-IT - Asian F","[financial_analyst] Llama3-70B-IT - Asian M","[retail] StableLM2-Zephyr-1.6B - White F","[retail] StableLM2-Zephyr-1.6B - Black F","[retail] StableLM2-Zephyr-1.6B - Black M","[retail] StableLM2-Zephyr-1.6B - Hispanic F","[retail] StableLM2-Zephyr-1.6B - Hispanic M","[retail] StableLM2-Zephyr-1.6B - Asian F","[retail] StableLM2-Zephyr-1.6B - Asian M","[software_engineer] StableLM2-Zephyr-1.6B - White F","[software_engineer] StableLM2-Zephyr-1.6B - Black F","[software_engineer] StableLM2-Zephyr-1.6B - Black M","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic F","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic M","[software_engineer] StableLM2-Zephyr-1.6B - Asian F","[software_engineer] StableLM2-Zephyr-1.6B - Asian M","[HR_specialist] StableLM2-Zephyr-1.6B - White F","[HR_specialist] StableLM2-Zephyr-1.6B - Black F","[HR_specialist] StableLM2-Zephyr-1.6B - Black M","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic F","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic M","[HR_specialist] StableLM2-Zephyr-1.6B - Asian F","[HR_specialist] StableLM2-Zephyr-1.6B - Asian M","[financial_analyst] StableLM2-Zephyr-1.6B - White F","[financial_analyst] StableLM2-Zephyr-1.6B - Black F","[financial_analyst] StableLM2-Zephyr-1.6B - Black M","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic F","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic M","[financial_analyst] StableLM2-Zephyr-1.6B - Asian F","[financial_analyst] StableLM2-Zephyr-1.6B - Asian M","[retail] Llama2-13B-Chat - White F","[retail] Llama2-13B-Chat - Black F","[retail] Llama2-13B-Chat - Black M","[retail] Llama2-13B-Chat - Hispanic F","[retail] Llama2-13B-Chat - Hispanic M","[retail] Llama2-13B-Chat - Asian F","[retail] Llama2-13B-Chat - Asian M","[software_engineer] Llama2-13B-Chat - White F","[software_engineer] Llama2-13B-Chat - Black F","[software_engineer] Llama2-13B-Chat - Black M","[software_engineer] Llama2-13B-Chat - Hispanic F","[software_engineer] Llama2-13B-Chat - Hispanic M","[software_engineer] Llama2-13B-Chat - Asian F","[software_engineer] Llama2-13B-Chat - Asian M","[HR_specialist] Llama2-13B-Chat - White F","[HR_specialist] Llama2-13B-Chat - Black F","[HR_specialist] Llama2-13B-Chat - Black M","[HR_specialist] Llama2-13B-Chat - Hispanic F","[HR_specialist] Llama2-13B-Chat - Hispanic M","[HR_specialist] Llama2-13B-Chat - Asian F","[HR_specialist] Llama2-13B-Chat - Asian M","[financial_analyst] Llama2-13B-Chat - White F","[financial_analyst] Llama2-13B-Chat - Black F","[financial_analyst] Llama2-13B-Chat - Black M","[financial_analyst] Llama2-13B-Chat - Hispanic F","[financial_analyst] Llama2-13B-Chat - Hispanic M","[financial_analyst] Llama2-13B-Chat - Asian F","[financial_analyst] Llama2-13B-Chat - Asian M","[retail] StarlingLM-7B - White F","[retail] StarlingLM-7B - Black F","[retail] StarlingLM-7B - Black M","[retail] StarlingLM-7B - Hispanic F","[retail] StarlingLM-7B - Hispanic M","[retail] StarlingLM-7B - Asian F","[retail] StarlingLM-7B - Asian M","[software_engineer] StarlingLM-7B - White F","[software_engineer] StarlingLM-7B - Black F","[software_engineer] StarlingLM-7B - Black M","[software_engineer] StarlingLM-7B - Hispanic F","[software_engineer] StarlingLM-7B - Hispanic M","[software_engineer] StarlingLM-7B - Asian F","[software_engineer] StarlingLM-7B - Asian M","[HR_specialist] StarlingLM-7B - White F","[HR_specialist] StarlingLM-7B - Black F","[HR_specialist] StarlingLM-7B - Black M","[HR_specialist] StarlingLM-7B - Hispanic F","[HR_specialist] StarlingLM-7B - Hispanic M","[HR_specialist] StarlingLM-7B - Asian F","[HR_specialist] StarlingLM-7B - Asian M","[financial_analyst] StarlingLM-7B - White F","[financial_analyst] StarlingLM-7B - Black F","[financial_analyst] StarlingLM-7B - Black M","[financial_analyst] StarlingLM-7B - Hispanic F","[financial_analyst] StarlingLM-7B - Hispanic M","[financial_analyst] StarlingLM-7B - Asian F","[financial_analyst] StarlingLM-7B - Asian M","[retail] StableLM-Zephyr-3B - White F","[retail] StableLM-Zephyr-3B - Black F","[retail] StableLM-Zephyr-3B - Black M","[retail] StableLM-Zephyr-3B - Hispanic F","[retail] StableLM-Zephyr-3B - Hispanic M","[retail] StableLM-Zephyr-3B - Asian F","[retail] StableLM-Zephyr-3B - Asian M","[software_engineer] StableLM-Zephyr-3B - White F","[software_engineer] StableLM-Zephyr-3B - Black F","[software_engineer] StableLM-Zephyr-3B - Black M","[software_engineer] StableLM-Zephyr-3B - Hispanic F","[software_engineer] StableLM-Zephyr-3B - Hispanic M","[software_engineer] StableLM-Zephyr-3B - Asian F","[software_engineer] StableLM-Zephyr-3B - Asian M","[HR_specialist] StableLM-Zephyr-3B - White F","[HR_specialist] StableLM-Zephyr-3B - Black F","[HR_specialist] StableLM-Zephyr-3B - Black M","[HR_specialist] StableLM-Zephyr-3B - Hispanic F","[HR_specialist] StableLM-Zephyr-3B - Hispanic M","[HR_specialist] StableLM-Zephyr-3B - Asian F","[HR_specialist] StableLM-Zephyr-3B - Asian M","[financial_analyst] StableLM-Zephyr-3B - White F","[financial_analyst] StableLM-Zephyr-3B - Black F","[financial_analyst] StableLM-Zephyr-3B - Black M","[financial_analyst] StableLM-Zephyr-3B - Hispanic F","[financial_analyst] StableLM-Zephyr-3B - Hispanic M","[financial_analyst] StableLM-Zephyr-3B - Asian F","[financial_analyst] StableLM-Zephyr-3B - Asian M","[retail] Gemma-2B-IT - White F","[retail] Gemma-2B-IT - Black F","[retail] Gemma-2B-IT - Black M","[retail] Gemma-2B-IT - Hispanic F","[retail] Gemma-2B-IT - Hispanic M","[retail] Gemma-2B-IT - Asian F","[retail] Gemma-2B-IT - Asian M","[software_engineer] Gemma-2B-IT - White F","[software_engineer] Gemma-2B-IT - Black F","[software_engineer] Gemma-2B-IT - Black M","[software_engineer] Gemma-2B-IT - Hispanic F","[software_engineer] Gemma-2B-IT - Hispanic M","[software_engineer] Gemma-2B-IT - Asian F","[software_engineer] Gemma-2B-IT - Asian M","[HR_specialist] Gemma-2B-IT - White F","[HR_specialist] Gemma-2B-IT - Black F","[HR_specialist] Gemma-2B-IT - Black M","[HR_specialist] Gemma-2B-IT - Hispanic F","[HR_specialist] Gemma-2B-IT - Hispanic M","[HR_specialist] Gemma-2B-IT - Asian F","[HR_specialist] Gemma-2B-IT - Asian M","[financial_analyst] Gemma-2B-IT - White F","[financial_analyst] Gemma-2B-IT - Black F","[financial_analyst] Gemma-2B-IT - Black M","[financial_analyst] Gemma-2B-IT - Hispanic F","[financial_analyst] Gemma-2B-IT - Hispanic M","[financial_analyst] Gemma-2B-IT - Asian F","[financial_analyst] Gemma-2B-IT - Asian M","[retail] Gemma-7B-IT - White F","[retail] Gemma-7B-IT - Black F","[retail] Gemma-7B-IT - Black M","[retail] Gemma-7B-IT - Hispanic F","[retail] Gemma-7B-IT - Hispanic M","[retail] Gemma-7B-IT - Asian F","[retail] Gemma-7B-IT - Asian M","[software_engineer] Gemma-7B-IT - White F","[software_engineer] Gemma-7B-IT - Black F","[software_engineer] Gemma-7B-IT - Black M","[software_engineer] Gemma-7B-IT - Hispanic F","[software_engineer] Gemma-7B-IT - Hispanic M","[software_engineer] Gemma-7B-IT - Asian F","[software_engineer] Gemma-7B-IT - Asian M","[HR_specialist] Gemma-7B-IT - White F","[HR_specialist] Gemma-7B-IT - Black F","[HR_specialist] Gemma-7B-IT - Black M","[HR_specialist] Gemma-7B-IT - Hispanic F","[HR_specialist] Gemma-7B-IT - Hispanic M","[HR_specialist] Gemma-7B-IT - Asian F","[HR_specialist] Gemma-7B-IT - Asian M","[financial_analyst] Gemma-7B-IT - White F","[financial_analyst] Gemma-7B-IT - Black F","[financial_analyst] Gemma-7B-IT - Black M","[financial_analyst] Gemma-7B-IT - Hispanic F","[financial_analyst] Gemma-7B-IT - Hispanic M","[financial_analyst] Gemma-7B-IT - Asian F","[financial_analyst] Gemma-7B-IT - Asian M"],"marker":{"color":"#D84260"},"mode":"markers","showlegend":false,"x":[0.0119156491914768,0.0122392340177117,0.010490792825194,0.0129083258237495,0.0086852151088603,0.0109580361989083,0.0052809201742622,0.0397782375639502,0.0303347248002506,0.0170962103653399,0.0324662782447782,0.0153727495705443,0.0252206032134435,0.0186092488147597,2.0036430197882726e-06,2.094238137657673e-06,1.3195542666125735e-06,0.0016678704468157,2.118815422478701e-06,1.948711260765087e-06,1.1639669499038962e-06,0.0036123558415214,0.0045394235179716,0.0065142116527959,0.0112702332013898,0.0029820314097114,0.0134289441188906,0.0118983638541242,0.0007864488674203,0.0026391658314751,0.0018167054936622,0.0027901053890048,0.0024963518750446,0.0036719381175611,0.0027020768744003,1.4816569296180955e-05,1.607178517584344e-05,1.752549685283837e-05,1.8885225956081394e-05,1.6307327296849472e-05,1.4634690586818576e-05,1.4742751683620308e-05,0.0018262025731601,0.0182722120632264,0.016382028617508,0.0123246827670824,0.0107810225749711,0.0061060313932745,0.0018902347757401,0.0010661190526813,0.0089441994718968,0.005858809229022,0.0069737910562937,0.003432356675512,0.0051638663944902,0.0029329963233508,0.0001807455263561,0.0005904095380774,0.0008569792189697,0.000764060675576,0.0004652149334617,0.0005074812538954,0.0006189276764302,0.0002498909094625,0.0003210128343148,0.0005808397309469,0.0003250110129788,0.0002488719332539,0.0002662060519483,0.0003768181057393,7.99471081220497e-05,0.0003010602819488,0.0005987481286164,0.0004333773114916,0.0001946457957613,0.0002956442219777,0.0003395243143572,0.0003603823764232,0.000378711157058,0.0009326634324629,0.0006673709246613,0.0004403122213137,0.0004225912810657,0.0006103304713323,1.5837781454906283e-08,1.8834613008754888e-08,8.134970544230552e-09,3.1999011041418417e-08,6.8936622648918685e-09,2.6082696623568793e-08,1.5182154987699966e-08,0.0001818535227738,6.0606374566850446e-05,9.65076284449534e-05,7.322622268492144e-05,5.598997434490536e-05,0.0001537088212875,0.0001672420525873,1.551693058860289e-07,4.035744377600583e-07,2.71566020897027e-07,4.606071106534457e-07,5.485936640032788e-07,7.271905995885927e-07,7.196613207339445e-07,0.0172300417286608,0.0395840098512371,0.024347062828357,0.0348929368238095,0.0108535875336696,0.0321940673047085,0.0183815690502874,0.0003495294941094,0.0003656225478485,0.0003874459282802,0.0007088049292685,0.0006203137319204,0.0002311232727911,0.0002680634360104,0.0067410169598001,0.0067662247998928,0.0068668344246232,0.0069320513178594,0.0070855838392218,0.006756801777998,0.0067103772509909,0.0099157574715501,0.0105915229428593,0.0069465337938078,0.0155536623738041,0.0128617393293202,0.0073540270529359,0.0052157111538793,0.0046432627333609,0.0093470416130699,0.0093594423527998,0.0102602117128787,0.008817789954626,0.0076406622676432,0.0038403697295259,0.0003279002113765,0.0003075969079477,0.0001735115372068,0.0037289114615431,0.000167265974863,0.0002793730222506,0.0002819373334364,8.506399936024082e-05,7.046684267808546e-05,0.0001246298995692,0.0033498890641409,4.966837006513526e-05,5.1706799125757133e-05,4.263191130857832e-05,0.0031025668931478,0.0015767386520416,0.0068249066229765,0.0023308670502143,0.0026278149490198,0.0013499618992187,0.001833406125903,1.3581321184355338e-05,0.000161776868032,0.0001148699314769,0.0034873762001717,0.0001426312684625,0.0002607817180491,0.0001911281877537,0.0060807261632571,0.0161604457297949,0.0156284911513009,0.0138550308241782,0.0103822878710124,0.0076399042507199,0.0057055562318961,0.0066015655897892,0.0062691576630657,0.0121585537267673,0.006180303802392,0.001816880902097,0.009655518051487,0.0067826295567644,0.0055427964295975,0.0040189910113856,0.0071231411399712,0.0035778279962223,0.0020816357512258,0.0083174925008561,0.0053667298504313,0.01270511638033,0.0106688655179423,0.0107216495301661,0.0062788163689191,0.0031163460872817,0.0072335755012455,0.007048272025724,1.4052369047767863e-06,1.4679192788556263e-06,1.4571771406475995e-06,1.436593258541582e-06,1.3800462506208256e-06,1.4413535245139112e-06,1.4180593666986614e-06,1.4014645208596893e-08,2.2782405586137716e-08,2.3599269912873607e-08,3.6235842919563045e-08,2.6911050419742288e-08,6.594584424997794e-08,5.0262767817092305e-08,0.0133699036197964,0.0012459249445691,0.0009659782695782,0.0007126910602282,0.0001811046730998,0.0003153998780683,0.0002617043844959,0.041735717389169,0.0370536829697084,0.0287731849123758,0.0355067707172149,0.023127942514884,0.0431919319786721,0.0382238133396339,0.0002710001762442,0.000137022324528,0.0001107297730357,0.0092072841667887,4.652108361876628e-05,0.0001570158718806,0.0002886669802406,9.925449049996e-05,0.0001080918968483,9.170803712036028e-05,0.0024581282050748,0.000117223423499,0.0001390901883435,0.0001148809265743,0.0224458902096885,0.0160509990487723,0.0140140607563952,0.0146103969906261,0.0072059486294438,0.0086685349618101,0.0036690321048658,0.0019718794782137,0.0024116955744752,0.00184267921249,0.0050643553809391,0.0006216363765322,0.0011800293171019,0.0010588964781673,1.6289831396047269e-07,6.334462919203402e-07,1.0167905337958122e-06,4.0989894473301524e-07,2.1987526267734186e-07,1.1004395531718137e-07,3.140396646515257e-07,0.0025999799184111,0.0092090379483024,0.0154717726129486,0.0066687070642081,0.005665792921692,0.0040573818728559,0.004871901536757,9.844554531120586e-06,1.812994423656437e-05,1.8940347135778125e-05,1.846580965253353e-05,1.669062261999524e-05,1.5985638478390153e-05,1.2980741653470304e-05,5.892780889372204e-07,1.1399632866564382e-06,3.326365855258179e-07,5.33415188821225e-07,1.113144166800642e-06,7.866159466183063e-07,7.868852834110345e-07],"y":[0.0555555555555555,0.0138888888888888,0.0216666666666667,0.0011111111111111,0.0255555555555556,0.0072222222222223,0.0538888888888889,0.0738888888888888,0.1083333333333333,0.0594444444444444,0.0638888888888887,0.0277777777777776,0.0322222222222221,0.0655555555555554,0.0016666666666666,0.0522222222222222,0.0355555555555555,0.0322222222222222,0.0455555555555555,0.0105555555555555,0.0444444444444444,0.0194444444444445,0.0755555555555556,0.045,0.0416666666666667,0.0294444444444444,0.0611111111111111,0.0966666666666667,0.0338888888888888,0.0238888888888889,0.0577777777777777,0.0177777777777777,0.0544444444444444,0.0316666666666666,0.0483333333333333,0.0322222222222222,0.0475,0.0625,0.0591666666666667,0.0580555555555556,0.0780555555555556,0.0780555555555556,0.038611111111111,0.0025,0.0249999999999999,0.0044444444444443,0.036111111111111,0.005,0.0411111111111111,0.0144444444444444,0.0694444444444444,0.0883333333333333,0.0561111111111111,0.0683333333333334,0.0655555555555555,0.0777777777777777,0.0088888888888888,0.0561111111111111,0.0788888888888889,0.0894444444444444,0.0438888888888888,0.0155555555555556,0.0405555555555555,0.0172222222222221,0.0394444444444445,0.0616666666666667,0.0383333333333334,0.0283333333333334,0.0138888888888888,0.0222222222222222,0.0055555555555554,0.0422222222222221,0.0433333333333333,0.0538888888888887,0.0238888888888887,0.03,0.0411111111111111,0.0122222222222221,0.0305555555555556,0.0622222222222223,0.08,0.0727777777777778,0.0033333333333332,0.0277777777777778,0.009074074074074,0.0203703703703703,0.0102777777777777,0.0229629629629628,0.0198148148148148,0.0306481481481481,0.0164814814814814,0.017962962962963,0.02,0.0166666666666666,0.0471296296296296,0.0263888888888889,0.0348148148148148,0.0303703703703704,0.016898148148148,0.0285648148148147,0.0133333333333332,0.0487499999999999,0.0175925925925925,0.0616203703703704,0.0450925925925926,0.0004629629629629,0.0044444444444445,0.0026851851851851,0.0158333333333333,0.0082407407407407,0.0438888888888889,0.0609259259259259,0.015,0.0266666666666666,0.0161111111111111,0.0672222222222222,0.0549999999999999,0.0383333333333333,0.0572222222222222,0.0166666666666666,0.0783333333333334,0.0572222222222223,0.0383333333333334,0.0555555555555555,0.0622222222222223,0.0827777777777778,0.02,0.0494444444444445,0.0133333333333333,0.08,0.0633333333333333,0.0483333333333333,0.0433333333333333,0.0566666666666665,0.0444444444444445,0.0361111111111112,0.006111111111111,0.0622222222222222,0.0372222222222223,0.0472222222222223,0.0633333333333333,0.0505555555555556,0.0605555555555556,0.0005555555555556,0.0088888888888889,0.0544444444444444,0.0838888888888889,0.0372222222222221,0.1177777777777778,0.1388888888888889,0.0499999999999999,0.0416666666666667,0.0661111111111111,0.0805555555555556,0.1616666666666666,0.045,0.0888888888888889,0.0077777777777778,0.03,0.0794444444444445,0.1038888888888888,0.0222222222222222,0.0777777777777777,0.0783333333333334,0.0416666666666666,0.0449999999999999,0.0983333333333334,0.0988888888888889,0.0861111111111111,0.0405555555555556,0.0083333333333332,0.0299999999999999,0.0388888888888889,0.0083333333333332,0.0188888888888889,0.0077777777777778,0.0655555555555554,0.0633333333333333,0.0888888888888888,0.0611111111111111,0.0861111111111111,0.0716666666666667,0.0961111111111111,0.0755555555555555,0.0266666666666666,0.0377777777777778,0.0088888888888889,0.0138888888888888,0.0488888888888889,0.09,0.0455555555555555,0.0255555555555555,0.0161111111111111,0.0016666666666666,0.0049999999999999,0.0172222222222221,0.0183333333333333,0.0244444444444445,0.0327777777777778,0.001111111111111,0.0322222222222221,0.0405555555555556,0.0605555555555556,0.0294444444444444,0.0322222222222223,0.0055555555555555,0.0444444444444444,0.0550000000000001,0.0183333333333333,0.0027777777777777,0.0444444444444445,0.05,0.0011111111111111,0.0566666666666667,0.0427777777777778,0.0194444444444445,0.0055555555555554,0.0311111111111111,0.0122222222222222,0.0555555555555555,0.0055555555555555,0.0083333333333334,0.0077777777777778,0.0194444444444445,0.1572222222222223,0.0877777777777778,0.0144444444444445,0.1033333333333333,0.0238888888888888,0.0027777777777778,0.0261111111111111,0.0694444444444444,0.0127777777777778,0.0466666666666666,0.0227777777777778,0.0344444444444443,0.0094444444444444,0.0111111111111111,0.1822222222222221,0.0855555555555555,0.0216666666666667,0.0727777777777777,0.0438888888888889,0.0683333333333332,0.0166666666666665,0.0633333333333334,0.0261111111111111,0.0316666666666665,0.0211111111111112,0.0383333333333332,0.0050000000000001,0.0033333333333334,0.0611574074074072,0.1302962962962961,0.1259166666666665,0.1143703703703702,0.1006944444444442,0.0763796296296294,0.1066666666666665,0.0325462962962961,0.099398148148148,0.1099537037037036,0.1136111111111111,0.0917592592592592,0.0986574074074073,0.0970370370370369,0.0499999999999997,0.1429166666666665,0.1319814814814813,0.109509259259259,0.1206944444444442,0.0916481481481479,0.1182870370370369,0.0571296296296296,0.1668703703703703,0.1375185185185184,0.1396759259259258,0.1174537037037035,0.1307407407407406,0.1266851851851851],"type":"scatter","xaxis":"x2","yaxis":"y2"},{"line":{"color":"#D84260"},"mode":"lines","showlegend":false,"x":[0.0119156491914768,0.0122392340177117,0.010490792825194,0.0129083258237495,0.0086852151088603,0.0109580361989083,0.0052809201742622,0.0397782375639502,0.0303347248002506,0.0170962103653399,0.0324662782447782,0.0153727495705443,0.0252206032134435,0.0186092488147597,2.0036430197882726e-06,2.094238137657673e-06,1.3195542666125735e-06,0.0016678704468157,2.118815422478701e-06,1.948711260765087e-06,1.1639669499038962e-06,0.0036123558415214,0.0045394235179716,0.0065142116527959,0.0112702332013898,0.0029820314097114,0.0134289441188906,0.0118983638541242,0.0007864488674203,0.0026391658314751,0.0018167054936622,0.0027901053890048,0.0024963518750446,0.0036719381175611,0.0027020768744003,1.4816569296180955e-05,1.607178517584344e-05,1.752549685283837e-05,1.8885225956081394e-05,1.6307327296849472e-05,1.4634690586818576e-05,1.4742751683620308e-05,0.0018262025731601,0.0182722120632264,0.016382028617508,0.0123246827670824,0.0107810225749711,0.0061060313932745,0.0018902347757401,0.0010661190526813,0.0089441994718968,0.005858809229022,0.0069737910562937,0.003432356675512,0.0051638663944902,0.0029329963233508,0.0001807455263561,0.0005904095380774,0.0008569792189697,0.000764060675576,0.0004652149334617,0.0005074812538954,0.0006189276764302,0.0002498909094625,0.0003210128343148,0.0005808397309469,0.0003250110129788,0.0002488719332539,0.0002662060519483,0.0003768181057393,7.99471081220497e-05,0.0003010602819488,0.0005987481286164,0.0004333773114916,0.0001946457957613,0.0002956442219777,0.0003395243143572,0.0003603823764232,0.000378711157058,0.0009326634324629,0.0006673709246613,0.0004403122213137,0.0004225912810657,0.0006103304713323,1.5837781454906283e-08,1.8834613008754888e-08,8.134970544230552e-09,3.1999011041418417e-08,6.8936622648918685e-09,2.6082696623568793e-08,1.5182154987699966e-08,0.0001818535227738,6.0606374566850446e-05,9.65076284449534e-05,7.322622268492144e-05,5.598997434490536e-05,0.0001537088212875,0.0001672420525873,1.551693058860289e-07,4.035744377600583e-07,2.71566020897027e-07,4.606071106534457e-07,5.485936640032788e-07,7.271905995885927e-07,7.196613207339445e-07,0.0172300417286608,0.0395840098512371,0.024347062828357,0.0348929368238095,0.0108535875336696,0.0321940673047085,0.0183815690502874,0.0003495294941094,0.0003656225478485,0.0003874459282802,0.0007088049292685,0.0006203137319204,0.0002311232727911,0.0002680634360104,0.0067410169598001,0.0067662247998928,0.0068668344246232,0.0069320513178594,0.0070855838392218,0.006756801777998,0.0067103772509909,0.0099157574715501,0.0105915229428593,0.0069465337938078,0.0155536623738041,0.0128617393293202,0.0073540270529359,0.0052157111538793,0.0046432627333609,0.0093470416130699,0.0093594423527998,0.0102602117128787,0.008817789954626,0.0076406622676432,0.0038403697295259,0.0003279002113765,0.0003075969079477,0.0001735115372068,0.0037289114615431,0.000167265974863,0.0002793730222506,0.0002819373334364,8.506399936024082e-05,7.046684267808546e-05,0.0001246298995692,0.0033498890641409,4.966837006513526e-05,5.1706799125757133e-05,4.263191130857832e-05,0.0031025668931478,0.0015767386520416,0.0068249066229765,0.0023308670502143,0.0026278149490198,0.0013499618992187,0.001833406125903,1.3581321184355338e-05,0.000161776868032,0.0001148699314769,0.0034873762001717,0.0001426312684625,0.0002607817180491,0.0001911281877537,0.0060807261632571,0.0161604457297949,0.0156284911513009,0.0138550308241782,0.0103822878710124,0.0076399042507199,0.0057055562318961,0.0066015655897892,0.0062691576630657,0.0121585537267673,0.006180303802392,0.001816880902097,0.009655518051487,0.0067826295567644,0.0055427964295975,0.0040189910113856,0.0071231411399712,0.0035778279962223,0.0020816357512258,0.0083174925008561,0.0053667298504313,0.01270511638033,0.0106688655179423,0.0107216495301661,0.0062788163689191,0.0031163460872817,0.0072335755012455,0.007048272025724,1.4052369047767863e-06,1.4679192788556263e-06,1.4571771406475995e-06,1.436593258541582e-06,1.3800462506208256e-06,1.4413535245139112e-06,1.4180593666986614e-06,1.4014645208596893e-08,2.2782405586137716e-08,2.3599269912873607e-08,3.6235842919563045e-08,2.6911050419742288e-08,6.594584424997794e-08,5.0262767817092305e-08,0.0133699036197964,0.0012459249445691,0.0009659782695782,0.0007126910602282,0.0001811046730998,0.0003153998780683,0.0002617043844959,0.041735717389169,0.0370536829697084,0.0287731849123758,0.0355067707172149,0.023127942514884,0.0431919319786721,0.0382238133396339,0.0002710001762442,0.000137022324528,0.0001107297730357,0.0092072841667887,4.652108361876628e-05,0.0001570158718806,0.0002886669802406,9.925449049996e-05,0.0001080918968483,9.170803712036028e-05,0.0024581282050748,0.000117223423499,0.0001390901883435,0.0001148809265743,0.0224458902096885,0.0160509990487723,0.0140140607563952,0.0146103969906261,0.0072059486294438,0.0086685349618101,0.0036690321048658,0.0019718794782137,0.0024116955744752,0.00184267921249,0.0050643553809391,0.0006216363765322,0.0011800293171019,0.0010588964781673,1.6289831396047269e-07,6.334462919203402e-07,1.0167905337958122e-06,4.0989894473301524e-07,2.1987526267734186e-07,1.1004395531718137e-07,3.140396646515257e-07,0.0025999799184111,0.0092090379483024,0.0154717726129486,0.0066687070642081,0.005665792921692,0.0040573818728559,0.004871901536757,9.844554531120586e-06,1.812994423656437e-05,1.8940347135778125e-05,1.846580965253353e-05,1.669062261999524e-05,1.5985638478390153e-05,1.2980741653470304e-05,5.892780889372204e-07,1.1399632866564382e-06,3.326365855258179e-07,5.33415188821225e-07,1.113144166800642e-06,7.866159466183063e-07,7.868852834110345e-07],"y":[0.046160094770045755,0.04604244784300993,0.046678135046875395,0.04579918367082637,0.04733459558713823,0.04650825765263864,0.048572307634514464,0.03602999089766591,0.03946340361358329,0.04427657906407861,0.03868842687725372,0.044903184052741546,0.041322763634187756,0.04372647810250859,0.050491582760006384,0.050491549822005724,0.050491831476673875,0.049885917430769644,0.050491540886351764,0.050491602731748325,0.05049188804412764,0.04917895371428469,0.048841896304771204,0.048123915309456464,0.046394751038626156,0.04940812308944017,0.04560990055982685,0.046166379263808864,0.050206379120662524,0.04953277999049207,0.04983180492462879,0.04947790233965122,0.04958470338661473,0.04915729116674365,0.049509907190914644,0.05048692431721012,0.0504864679537498,0.05048593942244138,0.05048544506072344,0.05048638231683336,0.050486990443522346,0.050486951155351394,0.04982835203645803,0.04384901579556854,0.044536236752466325,0.04601138092649383,0.04657261514783395,0.0482723189097369,0.04980507161273568,0.05010469840138303,0.04724043568843069,0.048362202382512404,0.0479568243330977,0.04924439667400692,0.04861486530833476,0.049425950956384315,0.050426596915176175,0.05027765386164377,0.050180736140986705,0.05021451887802697,0.05032317132513512,0.05030780440334835,0.05026728541705066,0.050401457473578014,0.0503755994134177,0.05028113319166777,0.05037414578087556,0.05040182794651106,0.05039552571713585,0.05035531008535531,0.05046324456733369,0.05038285363636658,0.050274622169570515,0.050334746646612624,0.05042154314303389,0.0503848227732376,0.050368869126440986,0.05036128568399549,0.050354621821715274,0.050153219352742334,0.05024967272687499,0.050332225295907355,0.050338668163419475,0.05027041113457157,0.050492305473677966,0.05049230438410888,0.0504923082742173,0.0504922995978802,0.05049230872552432,0.05049230174889643,0.05049230571204649,0.05042619407683784,0.0504702763490642,0.05045722359796757,0.05046568810440506,0.050471954750695075,0.05043642674961404,0.050431506422867534,0.050492254816402474,0.0504921645028338,0.050492212497620106,0.05049214376725487,0.05049211177765961,0.05049204684451397,0.050492049581961615,0.04422792150241566,0.03610060698251689,0.04164035992923934,0.03780615768030163,0.046546232438543486,0.03878739561128664,0.04380925647302143,0.05036523150638944,0.050359380495570864,0.05035144608877189,0.05023460841321868,0.05026678148375125,0.050408280892363766,0.05039485042117165,0.04804145486866592,0.048032289961403046,0.047995710949594976,0.04797199980352754,0.04791617941927616,0.04803571592417829,0.04805259466044361,0.046887202768252575,0.04664151222700721,0.04796673435640808,0.04483740891855926,0.0458161212941839,0.04781858053139086,0.04859601591821963,0.04880414309879271,0.04709397288749842,0.04708946430488294,0.04676196827110917,0.04728639486219057,0.0477143675107034,0.04909605386524867,0.0503730953443732,0.050380477091177794,0.05042922700325394,0.049136577158239526,0.050431497725357655,0.050390738553249145,0.050389806237186974,0.050461384200340735,0.050466691342356935,0.05044699908028071,0.04927437972720099,0.05047425311964551,0.050473512000484416,0.05047681139087089,0.0493642995597955,0.049919050553033695,0.04801095479485959,0.04964486931385822,0.0495369068726316,0.050001500612275374,0.04982573301425664,0.050487373420915554,0.05043349342014456,0.05045054754782596,0.04922439302278971,0.050440454256293205,0.05039749786218938,0.05042282205273255,0.04828151922541338,0.044616798459041054,0.044810203144330665,0.04545498664710984,0.04671758459269051,0.04771464310570797,0.04841792113910763,0.04809215571685962,0.04821301049103552,0.046071781073533775,0.048245315416409064,0.04983174115073812,0.046981818972665644,0.048026325623528585,0.04847709631987302,0.049031111867941485,0.04790252457311932,0.049191507130166,0.04973548325514933,0.047468289850051186,0.04854110949451297,0.04587306527658995,0.046613392502131895,0.046594201624404384,0.048209498839775426,0.04935928980743552,0.047862373545661516,0.047929745012728814,0.05049180032472155,0.05049177753505995,0.0504917814406187,0.05049178892437652,0.05049180948338046,0.05049178719366909,0.050491795662811846,0.05049230613652233,0.05049230294879539,0.05049230265180502,0.05049229805747964,0.05049230144772879,0.05049228725570503,0.05049229295765889,0.045631366131528454,0.05003932571104501,0.05014110695471392,0.05023319551827306,0.05042646633887183,0.05037764013659274,0.050397162404951144,0.03531830274822087,0.03702056724601789,0.040031138421762986,0.03758298383092849,0.04208359999162388,0.03478886144668282,0.036595138637838684,0.05039378269970885,0.05044249352069719,0.050452052800478604,0.04714478501696898,0.05047539739017026,0.05043522439305005,0.05038735951471311,0.05045622491121354,0.05045301186283935,0.05045896860306232,0.04959860050708327,0.050449691880063575,0.050441741699833856,0.0504505435502979,0.042331576260219675,0.04465659039195212,0.04539716754894711,0.045180355387963854,0.047872417949192114,0.047340660049634185,0.049158347716482115,0.04977538774756025,0.04961548218960156,0.04982236156401346,0.048651044894030195,0.05026630060497844,0.050063283627016585,0.050107324339399795,0.05049225200633854,0.050492080927477166,0.05049194155359929,0.050492162203409505,0.05049223129101945,0.05049227122279237,0.050492197055321014,0.049547026957226306,0.04714414738816487,0.04486718188051315,0.04806774484372336,0.04843237803224665,0.04901715396104334,0.04872101604696621,0.05048873201093017,0.050485719661279904,0.05048542502011313,0.05048559754945363,0.05048624296074106,0.05048649927442187,0.05048759177582753,0.0504920969858734,0.05049189677122789,0.05049219029397,0.050492117296153737,0.05049190652195407,0.05049202523902169,0.050492025141097914],"type":"scatter","xaxis":"x2","yaxis":"y2"},{"hovertext":["[retail] Llama2-7B-Chat - White F","[retail] Llama2-7B-Chat - Black F","[retail] Llama2-7B-Chat - Black M","[retail] Llama2-7B-Chat - Hispanic F","[retail] Llama2-7B-Chat - Hispanic M","[retail] Llama2-7B-Chat - Asian F","[retail] Llama2-7B-Chat - Asian M","[software_engineer] Llama2-7B-Chat - White F","[software_engineer] Llama2-7B-Chat - Black F","[software_engineer] Llama2-7B-Chat - Black M","[software_engineer] Llama2-7B-Chat - Hispanic F","[software_engineer] Llama2-7B-Chat - Hispanic M","[software_engineer] Llama2-7B-Chat - Asian F","[software_engineer] Llama2-7B-Chat - Asian M","[HR_specialist] Llama2-7B-Chat - White F","[HR_specialist] Llama2-7B-Chat - Black F","[HR_specialist] Llama2-7B-Chat - Black M","[HR_specialist] Llama2-7B-Chat - Hispanic F","[HR_specialist] Llama2-7B-Chat - Hispanic M","[HR_specialist] Llama2-7B-Chat - Asian F","[HR_specialist] Llama2-7B-Chat - Asian M","[financial_analyst] Llama2-7B-Chat - White F","[financial_analyst] Llama2-7B-Chat - Black F","[financial_analyst] Llama2-7B-Chat - Black M","[financial_analyst] Llama2-7B-Chat - Hispanic F","[financial_analyst] Llama2-7B-Chat - Hispanic M","[financial_analyst] Llama2-7B-Chat - Asian F","[financial_analyst] Llama2-7B-Chat - Asian M","[retail] Llama3-8B-IT - White F","[retail] Llama3-8B-IT - Black F","[retail] Llama3-8B-IT - Black M","[retail] Llama3-8B-IT - Hispanic F","[retail] Llama3-8B-IT - Hispanic M","[retail] Llama3-8B-IT - Asian F","[retail] Llama3-8B-IT - Asian M","[software_engineer] Llama3-8B-IT - White F","[software_engineer] Llama3-8B-IT - Black F","[software_engineer] Llama3-8B-IT - Black M","[software_engineer] Llama3-8B-IT - Hispanic F","[software_engineer] Llama3-8B-IT - Hispanic M","[software_engineer] Llama3-8B-IT - Asian F","[software_engineer] Llama3-8B-IT - Asian M","[HR_specialist] Llama3-8B-IT - White F","[HR_specialist] Llama3-8B-IT - Black F","[HR_specialist] Llama3-8B-IT - Black M","[HR_specialist] Llama3-8B-IT - Hispanic F","[HR_specialist] Llama3-8B-IT - Hispanic M","[HR_specialist] Llama3-8B-IT - Asian F","[HR_specialist] Llama3-8B-IT - Asian M","[financial_analyst] Llama3-8B-IT - White F","[financial_analyst] Llama3-8B-IT - Black F","[financial_analyst] Llama3-8B-IT - Black M","[financial_analyst] Llama3-8B-IT - Hispanic F","[financial_analyst] Llama3-8B-IT - Hispanic M","[financial_analyst] Llama3-8B-IT - Asian F","[financial_analyst] Llama3-8B-IT - Asian M","[retail] TinyLlama-1.1B-Chat - White F","[retail] TinyLlama-1.1B-Chat - Black F","[retail] TinyLlama-1.1B-Chat - Black M","[retail] TinyLlama-1.1B-Chat - Hispanic F","[retail] TinyLlama-1.1B-Chat - Hispanic M","[retail] TinyLlama-1.1B-Chat - Asian F","[retail] TinyLlama-1.1B-Chat - Asian M","[software_engineer] TinyLlama-1.1B-Chat - White F","[software_engineer] TinyLlama-1.1B-Chat - Black F","[software_engineer] TinyLlama-1.1B-Chat - Black M","[software_engineer] TinyLlama-1.1B-Chat - Hispanic F","[software_engineer] TinyLlama-1.1B-Chat - Hispanic M","[software_engineer] TinyLlama-1.1B-Chat - Asian F","[software_engineer] TinyLlama-1.1B-Chat - Asian M","[HR_specialist] TinyLlama-1.1B-Chat - White F","[HR_specialist] TinyLlama-1.1B-Chat - Black F","[HR_specialist] TinyLlama-1.1B-Chat - Black M","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic F","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic M","[HR_specialist] TinyLlama-1.1B-Chat - Asian F","[HR_specialist] TinyLlama-1.1B-Chat - Asian M","[financial_analyst] TinyLlama-1.1B-Chat - White F","[financial_analyst] TinyLlama-1.1B-Chat - Black F","[financial_analyst] TinyLlama-1.1B-Chat - Black M","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic F","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic M","[financial_analyst] TinyLlama-1.1B-Chat - Asian F","[financial_analyst] TinyLlama-1.1B-Chat - Asian M","[retail] Llama3-70B-IT - White F","[retail] Llama3-70B-IT - Black F","[retail] Llama3-70B-IT - Black M","[retail] Llama3-70B-IT - Hispanic F","[retail] Llama3-70B-IT - Hispanic M","[retail] Llama3-70B-IT - Asian F","[retail] Llama3-70B-IT - Asian M","[software_engineer] Llama3-70B-IT - White F","[software_engineer] Llama3-70B-IT - Black F","[software_engineer] Llama3-70B-IT - Black M","[software_engineer] Llama3-70B-IT - Hispanic F","[software_engineer] Llama3-70B-IT - Hispanic M","[software_engineer] Llama3-70B-IT - Asian F","[software_engineer] Llama3-70B-IT - Asian M","[HR_specialist] Llama3-70B-IT - White F","[HR_specialist] Llama3-70B-IT - Black F","[HR_specialist] Llama3-70B-IT - Black M","[HR_specialist] Llama3-70B-IT - Hispanic F","[HR_specialist] Llama3-70B-IT - Hispanic M","[HR_specialist] Llama3-70B-IT - Asian F","[HR_specialist] Llama3-70B-IT - Asian M","[financial_analyst] Llama3-70B-IT - White F","[financial_analyst] Llama3-70B-IT - Black F","[financial_analyst] Llama3-70B-IT - Black M","[financial_analyst] Llama3-70B-IT - Hispanic F","[financial_analyst] Llama3-70B-IT - Hispanic M","[financial_analyst] Llama3-70B-IT - Asian F","[financial_analyst] Llama3-70B-IT - Asian M","[retail] StableLM2-Zephyr-1.6B - White F","[retail] StableLM2-Zephyr-1.6B - Black F","[retail] StableLM2-Zephyr-1.6B - Black M","[retail] StableLM2-Zephyr-1.6B - Hispanic F","[retail] StableLM2-Zephyr-1.6B - Hispanic M","[retail] StableLM2-Zephyr-1.6B - Asian F","[retail] StableLM2-Zephyr-1.6B - Asian M","[software_engineer] StableLM2-Zephyr-1.6B - White F","[software_engineer] StableLM2-Zephyr-1.6B - Black F","[software_engineer] StableLM2-Zephyr-1.6B - Black M","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic F","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic M","[software_engineer] StableLM2-Zephyr-1.6B - Asian F","[software_engineer] StableLM2-Zephyr-1.6B - Asian M","[HR_specialist] StableLM2-Zephyr-1.6B - White F","[HR_specialist] StableLM2-Zephyr-1.6B - Black F","[HR_specialist] StableLM2-Zephyr-1.6B - Black M","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic F","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic M","[HR_specialist] StableLM2-Zephyr-1.6B - Asian F","[HR_specialist] StableLM2-Zephyr-1.6B - Asian M","[financial_analyst] StableLM2-Zephyr-1.6B - White F","[financial_analyst] StableLM2-Zephyr-1.6B - Black F","[financial_analyst] StableLM2-Zephyr-1.6B - Black M","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic F","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic M","[financial_analyst] StableLM2-Zephyr-1.6B - Asian F","[financial_analyst] StableLM2-Zephyr-1.6B - Asian M","[retail] Llama2-13B-Chat - White F","[retail] Llama2-13B-Chat - Black F","[retail] Llama2-13B-Chat - Black M","[retail] Llama2-13B-Chat - Hispanic F","[retail] Llama2-13B-Chat - Hispanic M","[retail] Llama2-13B-Chat - Asian F","[retail] Llama2-13B-Chat - Asian M","[software_engineer] Llama2-13B-Chat - White F","[software_engineer] Llama2-13B-Chat - Black F","[software_engineer] Llama2-13B-Chat - Black M","[software_engineer] Llama2-13B-Chat - Hispanic F","[software_engineer] Llama2-13B-Chat - Hispanic M","[software_engineer] Llama2-13B-Chat - Asian F","[software_engineer] Llama2-13B-Chat - Asian M","[HR_specialist] Llama2-13B-Chat - White F","[HR_specialist] Llama2-13B-Chat - Black F","[HR_specialist] Llama2-13B-Chat - Black M","[HR_specialist] Llama2-13B-Chat - Hispanic F","[HR_specialist] Llama2-13B-Chat - Hispanic M","[HR_specialist] Llama2-13B-Chat - Asian F","[HR_specialist] Llama2-13B-Chat - Asian M","[financial_analyst] Llama2-13B-Chat - White F","[financial_analyst] Llama2-13B-Chat - Black F","[financial_analyst] Llama2-13B-Chat - Black M","[financial_analyst] Llama2-13B-Chat - Hispanic F","[financial_analyst] Llama2-13B-Chat - Hispanic M","[financial_analyst] Llama2-13B-Chat - Asian F","[financial_analyst] Llama2-13B-Chat - Asian M","[retail] StarlingLM-7B - White F","[retail] StarlingLM-7B - Black F","[retail] StarlingLM-7B - Black M","[retail] StarlingLM-7B - Hispanic F","[retail] StarlingLM-7B - Hispanic M","[retail] StarlingLM-7B - Asian F","[retail] StarlingLM-7B - Asian M","[software_engineer] StarlingLM-7B - White F","[software_engineer] StarlingLM-7B - Black F","[software_engineer] StarlingLM-7B - Black M","[software_engineer] StarlingLM-7B - Hispanic F","[software_engineer] StarlingLM-7B - Hispanic M","[software_engineer] StarlingLM-7B - Asian F","[software_engineer] StarlingLM-7B - Asian M","[HR_specialist] StarlingLM-7B - White F","[HR_specialist] StarlingLM-7B - Black F","[HR_specialist] StarlingLM-7B - Black M","[HR_specialist] StarlingLM-7B - Hispanic F","[HR_specialist] StarlingLM-7B - Hispanic M","[HR_specialist] StarlingLM-7B - Asian F","[HR_specialist] StarlingLM-7B - Asian M","[financial_analyst] StarlingLM-7B - White F","[financial_analyst] StarlingLM-7B - Black F","[financial_analyst] StarlingLM-7B - Black M","[financial_analyst] StarlingLM-7B - Hispanic F","[financial_analyst] StarlingLM-7B - Hispanic M","[financial_analyst] StarlingLM-7B - Asian F","[financial_analyst] StarlingLM-7B - Asian M","[retail] StableLM-Zephyr-3B - White F","[retail] StableLM-Zephyr-3B - Black F","[retail] StableLM-Zephyr-3B - Black M","[retail] StableLM-Zephyr-3B - Hispanic F","[retail] StableLM-Zephyr-3B - Hispanic M","[retail] StableLM-Zephyr-3B - Asian F","[retail] StableLM-Zephyr-3B - Asian M","[software_engineer] StableLM-Zephyr-3B - White F","[software_engineer] StableLM-Zephyr-3B - Black F","[software_engineer] StableLM-Zephyr-3B - Black M","[software_engineer] StableLM-Zephyr-3B - Hispanic F","[software_engineer] StableLM-Zephyr-3B - Hispanic M","[software_engineer] StableLM-Zephyr-3B - Asian F","[software_engineer] StableLM-Zephyr-3B - Asian M","[HR_specialist] StableLM-Zephyr-3B - White F","[HR_specialist] StableLM-Zephyr-3B - Black F","[HR_specialist] StableLM-Zephyr-3B - Black M","[HR_specialist] StableLM-Zephyr-3B - Hispanic F","[HR_specialist] StableLM-Zephyr-3B - Hispanic M","[HR_specialist] StableLM-Zephyr-3B - Asian F","[HR_specialist] StableLM-Zephyr-3B - Asian M","[financial_analyst] StableLM-Zephyr-3B - White F","[financial_analyst] StableLM-Zephyr-3B - Black F","[financial_analyst] StableLM-Zephyr-3B - Black M","[financial_analyst] StableLM-Zephyr-3B - Hispanic F","[financial_analyst] StableLM-Zephyr-3B - Hispanic M","[financial_analyst] StableLM-Zephyr-3B - Asian F","[financial_analyst] StableLM-Zephyr-3B - Asian M","[retail] Gemma-2B-IT - White F","[retail] Gemma-2B-IT - Black F","[retail] Gemma-2B-IT - Black M","[retail] Gemma-2B-IT - Hispanic F","[retail] Gemma-2B-IT - Hispanic M","[retail] Gemma-2B-IT - Asian F","[retail] Gemma-2B-IT - Asian M","[software_engineer] Gemma-2B-IT - White F","[software_engineer] Gemma-2B-IT - Black F","[software_engineer] Gemma-2B-IT - Black M","[software_engineer] Gemma-2B-IT - Hispanic F","[software_engineer] Gemma-2B-IT - Hispanic M","[software_engineer] Gemma-2B-IT - Asian F","[software_engineer] Gemma-2B-IT - Asian M","[HR_specialist] Gemma-2B-IT - White F","[HR_specialist] Gemma-2B-IT - Black F","[HR_specialist] Gemma-2B-IT - Black M","[HR_specialist] Gemma-2B-IT - Hispanic F","[HR_specialist] Gemma-2B-IT - Hispanic M","[HR_specialist] Gemma-2B-IT - Asian F","[HR_specialist] Gemma-2B-IT - Asian M","[financial_analyst] Gemma-2B-IT - White F","[financial_analyst] Gemma-2B-IT - Black F","[financial_analyst] Gemma-2B-IT - Black M","[financial_analyst] Gemma-2B-IT - Hispanic F","[financial_analyst] Gemma-2B-IT - Hispanic M","[financial_analyst] Gemma-2B-IT - Asian F","[financial_analyst] Gemma-2B-IT - Asian M","[retail] Gemma-7B-IT - White F","[retail] Gemma-7B-IT - Black F","[retail] Gemma-7B-IT - Black M","[retail] Gemma-7B-IT - Hispanic F","[retail] Gemma-7B-IT - Hispanic M","[retail] Gemma-7B-IT - Asian F","[retail] Gemma-7B-IT - Asian M","[software_engineer] Gemma-7B-IT - White F","[software_engineer] Gemma-7B-IT - Black F","[software_engineer] Gemma-7B-IT - Black M","[software_engineer] Gemma-7B-IT - Hispanic F","[software_engineer] Gemma-7B-IT - Hispanic M","[software_engineer] Gemma-7B-IT - Asian F","[software_engineer] Gemma-7B-IT - Asian M","[HR_specialist] Gemma-7B-IT - White F","[HR_specialist] Gemma-7B-IT - Black F","[HR_specialist] Gemma-7B-IT - Black M","[HR_specialist] Gemma-7B-IT - Hispanic F","[HR_specialist] Gemma-7B-IT - Hispanic M","[HR_specialist] Gemma-7B-IT - Asian F","[HR_specialist] Gemma-7B-IT - Asian M","[financial_analyst] Gemma-7B-IT - White F","[financial_analyst] Gemma-7B-IT - Black F","[financial_analyst] Gemma-7B-IT - Black M","[financial_analyst] Gemma-7B-IT - Hispanic F","[financial_analyst] Gemma-7B-IT - Hispanic M","[financial_analyst] Gemma-7B-IT - Asian F","[financial_analyst] Gemma-7B-IT - Asian M"],"marker":{"color":"#2CA02C"},"mode":"markers","showlegend":false,"x":[0.0451811918298688,0.0151396369860364,0.0224135265865778,0.0073032882496705,0.006385147235912,0.0182711270753612,0.0274348571987657,0.018870512519706,0.0228913787919284,0.0085960455501716,0.0156926283265362,0.0063862706679047,0.0041508862106652,0.0164669100041406,0.0138603647543758,0.0078338263239402,0.0071718393999682,0.0139766674460183,0.0205333724765008,0.0060763288169428,0.0218550994969178,0.0124018804215597,0.0976665086601252,0.022275639153096,0.0322666738615962,0.0152848075455835,0.0488548510424442,0.052067091917547,0.0526204137270591,0.0404297347850218,0.0462304226965661,0.0466746462638515,0.0568942335242391,0.0207754550481387,0.0630865560090019,0.0709479700342899,0.154824897871226,0.1484937909564409,0.1227726083252245,0.1048069034727542,0.1103551980997832,0.0979502461109987,0.0151462605026286,0.0247989908116915,0.0665028736093033,0.0072164059860415,0.0378657315449979,0.0261948993506726,0.0808684957709458,0.0178644141458405,0.0243326392720134,0.0447611367680697,0.0439868807479194,0.0229441150939125,0.0403217368265545,0.0730674675251392,0.0044491202801348,0.041677863254079,0.0539258176516787,0.031889240092423,0.009251974438358,0.017982398033447,0.035819214362938,0.0141531650056861,0.0207006190657026,0.019317958781112,0.011208373781658,0.0107899541138972,0.006772086735028,0.0049625450743058,0.004785633579488,0.0235977167010526,0.0330493276374875,0.0217317522383228,0.0054185046585022,0.0197199810206092,0.0162166909748888,0.0231754876013549,0.0272386133616837,0.024112391343532,0.0295184746609843,0.0085440815762137,0.0208393316173452,0.0233529429816671,0.0143334222353402,0.0829786391742922,0.0748442215499887,0.1003998225118602,0.0518904593666187,0.0817222632113264,0.0422127621793309,0.030856278676334,0.0499039825642617,0.0453992796313162,0.1779790255995051,0.0560224657988305,0.1223080717754343,0.0767070365442671,0.0419613257187138,0.1766771977116808,0.1354758426858506,0.1952608412521483,0.095558720197066,0.2016331995843436,0.1364884339738998,0.0211079682015184,0.1360374943329008,0.121071729161436,0.0939769284212325,0.0808947383558911,0.1390501440645121,0.1690704438281141,0.022119360431267,0.0218985369383103,0.0117819840817412,0.0666059811646728,0.0354926925687595,0.0077505903888533,0.0172687391340098,0.0281037945808359,0.0481505336808743,0.0610828191901295,0.0274339184287265,0.0587636780500183,0.0145216630198245,0.0356971676699922,0.0173485085203845,0.0243560107553823,0.0451719307842467,0.0719142931711258,0.0528179842611057,0.0303052109395026,0.0170811649948745,0.0266221714659349,0.0585808790425497,0.0493188349645679,0.0524328120601155,0.0396899203044518,0.0398877899907632,0.0302857328017839,0.0694923488208325,0.042622651175808,0.0623480860637572,0.0319521915974353,0.0234397878111782,0.0388112949247709,0.0765942798203162,0.0137858027801892,0.0815498852248613,0.0494884840801268,0.0362492205060386,0.0525348476704213,0.0375549074522225,0.0374798227308904,0.0904334166388428,0.05666442780829,0.0780098083090369,0.076240292542455,0.0313009844743834,0.0385495476685303,0.0576181182397163,0.0170730021955883,0.0070825345693864,0.071623311139088,0.0871791555909084,0.0416043771475343,0.0941935464943041,0.0809674009733857,0.0686071149700878,0.0203436538913173,0.0584040286164601,0.0216519499196798,0.0420520401675078,0.0108836800461206,0.0298854188702977,0.008471041295578,0.0381812642388173,0.0594272819740458,0.0680026456189992,0.0350646818563491,0.0279330353049793,0.0456729586845414,0.0182981152874261,0.0053392000461256,0.0151767309057147,0.0020262190043168,0.00554870178121,0.0158797233176247,0.0605115173062012,0.0488055988254204,0.0086477617825873,0.0390352415105198,0.0055803057488909,0.0160968459475412,0.0132855301358571,0.0154817844490055,0.025580962883553,0.03068959959287,0.0736190877954375,0.0098569661086694,0.0210341148343287,0.0366930532143468,0.0434615018311968,0.0116159998032539,0.0024645647020433,0.0137508412390916,0.003716546911696,0.0048387201996948,0.0095009108109528,0.0180659767584964,0.0276797968784662,0.0024590957438747,0.0197980373227998,0.0201306355820254,0.0100452939976063,0.0135885695035969,0.0184888177617768,0.0410233308688023,0.0031406679693421,0.0342184535798235,0.0071246433844414,0.026290160747461,0.013139225917239,0.0255804937306705,0.0891132670003974,0.012429273673845,0.0051779969518495,1.2562866943292145e-05,0.0031232467871063,0.0007132057275324,0.0055907184112556,0.0461886463984033,0.034952880223247,0.0289059712981573,1.2562866943292145e-05,0.0128263329304625,0.0391904904174518,0.0388122736728835,0.1506057582598353,0.1075414101034504,0.0071539962960479,3.1328353598983165e-06,0.00877225217997,0.0702392203222743,0.0134619186240074,0.0191300323188454,0.0199246884225573,0.0124962581617046,1.2562866943292145e-05,0.0090015216761964,0.0126960713690578,0.0079248000145053,0.0131534114569625,0.0701398388684076,0.0607722951750297,0.0354886572387121,0.025249179949216,0.0135382394075641,0.0262670672322051,0.0143117910077342,0.0951937152667367,0.1481525522689906,0.1360069405568059,0.09018562637387,0.085488473359911,0.0841520950670462,0.0050557129809723,0.0100739780571788,0.0173084925406389,0.0054413661504841,0.0105801461960092,0.0005304401674917,0.0116530075435935,0.0240731774356983,0.1942731319176344,0.1201112950531989,0.158630699203789,0.1369943888532623,0.1043965264157412,0.1307415922581147],"y":[0.0833333333333333,0.0016666666666667,0.0916666666666667,0.025,0.0666666666666667,0.0283333333333333,0.1216666666666667,0.135,0.1783333333333334,0.0733333333333334,0.085,0.025,0.025,0.1166666666666667,0.0549999999999999,0.14,0.1049999999999999,0.0933333333333333,0.12,0.0333333333333333,0.095,0.0266666666666665,0.1599999999999999,0.1366666666666666,0.0883333333333332,0.04,0.0916666666666665,0.1516666666666666,0.0883333333333334,0.0799999999999999,0.1833333333333333,0.0716666666666666,0.1683333333333332,0.1049999999999999,0.1499999999999999,0.0566666666666667,0.1575,0.2233333333333334,0.1541666666666667,0.18,0.2033333333333334,0.1916666666666667,0.0658333333333333,0.0291666666666666,0.0733333333333333,0.0283333333333333,0.1049999999999999,0.0283333333333333,0.1233333333333333,0.035,0.2066666666666667,0.2683333333333334,0.1783333333333333,0.21,0.2,0.2383333333333333,0.0116666666666667,0.015,0.0366666666666666,0.0399999999999999,0.0316666666666665,0.005,0.0099999999999999,0.0466666666666667,0.0916666666666666,0.1283333333333333,0.0733333333333333,0.0449999999999999,0.0183333333333333,0.0416666666666666,0.0233333333333333,0.0516666666666666,0.0499999999999999,0.0716666666666667,0.0333333333333334,0.03,0.0366666666666667,0.0266666666666667,0.0166666666666667,0.03,0.09,0.0699999999999999,0.0199999999999999,0.015,0.0397222222222221,0.0769444444444444,0.0416666666666665,0.0905555555555555,0.0677777777777777,0.1119444444444444,0.0619444444444443,0.0488888888888889,0.0791666666666666,0.0983333333333334,0.1697222222222222,0.1133333333333334,0.1336111111111111,0.1136111111111111,0.0473611111111111,0.0765277777777778,0.0441666666666668,0.1415277777777778,0.0494444444444445,0.1579166666666668,0.1225,0.0052777777777778,0.0091666666666667,0.0030555555555555,0.0391666666666666,0.0197222222222221,0.1241666666666667,0.1744444444444444,0.025,0.03,0.0116666666666667,0.2083333333333333,0.1683333333333332,0.0616666666666667,0.1116666666666666,0.0049999999999999,0.0833333333333332,0.0466666666666665,0.0333333333333333,0.0966666666666667,0.0366666666666666,0.0883333333333332,0.0566666666666667,0.0216666666666665,0.035,0.2000000000000001,0.1116666666666667,0.0033333333333332,0.0083333333333333,0.0083333333333333,0.1166666666666666,0.12,0.07,0.0716666666666667,0.12,0.1116666666666666,0.1866666666666667,0.135,0.1633333333333332,0.0149999999999999,0.0166666666666666,0.1483333333333332,0.2299999999999999,0.0816666666666666,0.29,0.345,0.12,0.0949999999999999,0.1616666666666666,0.1966666666666666,0.265,0.0116666666666666,0.1016666666666666,0.0566666666666667,0.0183333333333332,0.0716666666666666,0.1283333333333333,0.065,0.185,0.1816666666666667,0.0883333333333333,0.0816666666666666,0.2466666666666666,0.2449999999999999,0.2233333333333334,0.1083333333333333,0.0083333333333334,0.075,0.12,0.0116666666666667,0.07,0.01,0.1516666666666666,0.1633333333333332,0.1983333333333332,0.1033333333333332,0.145,0.1416666666666667,0.1233333333333333,0.0316666666666666,0.0383333333333333,0.0033333333333333,0.03,0.0633333333333334,0.1099999999999999,0.2383333333333333,0.0799999999999999,0.0966666666666667,0.0166666666666666,0.0133333333333334,0.0266666666666667,0.0566666666666667,0.0216666666666667,0.0199999999999999,0.0233333333333332,0.0033333333333332,0.0199999999999999,0.0133333333333333,0.04,0.0616666666666667,0.05,0.015,0.0716666666666667,0.0616666666666667,0.0583333333333332,0.0,0.0049999999999999,0.0016666666666666,0.02,0.0,0.015,0.0183333333333333,0.01,0.0016666666666665,0.0083333333333334,0.1116666666666666,0.0433333333333334,0.0833333333333334,0.045,0.0883333333333334,0.2983333333333334,0.0733333333333333,0.0733333333333333,0.1049999999999999,0.0783333333333333,0.025,0.0633333333333333,0.0399999999999999,0.035,0.03,0.0266666666666667,0.0033333333333334,0.02,0.0183333333333334,0.2083333333333333,0.09,0.0133333333333332,0.0849999999999999,0.0083333333333333,0.0933333333333333,0.03,0.1599999999999999,0.0366666666666666,0.0966666666666666,0.0083333333333334,0.115,0.01,0.0016666666666665,0.1342222222222223,0.3081111111111113,0.2851944444444446,0.2811111111111113,0.2304166666666668,0.1765833333333334,0.2713333333333335,0.0768055555555556,0.1099999999999999,0.1251388888888888,0.1245833333333332,0.0880555555555555,0.1413888888888889,0.0976388888888888,0.0115277777777777,0.1075833333333332,0.1021944444444444,0.063138888888889,0.0854166666666667,0.0285555555555555,0.0961388888888888,0.079222222222222,0.3031111111111111,0.2283888888888889,0.25825,0.1868611111111109,0.2219444444444444,0.1929722222222222],"type":"scatter","xaxis":"x3","yaxis":"y3"},{"line":{"color":"#2CA02C"},"mode":"lines","showlegend":false,"x":[0.0451811918298688,0.0151396369860364,0.0224135265865778,0.0073032882496705,0.006385147235912,0.0182711270753612,0.0274348571987657,0.018870512519706,0.0228913787919284,0.0085960455501716,0.0156926283265362,0.0063862706679047,0.0041508862106652,0.0164669100041406,0.0138603647543758,0.0078338263239402,0.0071718393999682,0.0139766674460183,0.0205333724765008,0.0060763288169428,0.0218550994969178,0.0124018804215597,0.0976665086601252,0.022275639153096,0.0322666738615962,0.0152848075455835,0.0488548510424442,0.052067091917547,0.0526204137270591,0.0404297347850218,0.0462304226965661,0.0466746462638515,0.0568942335242391,0.0207754550481387,0.0630865560090019,0.0709479700342899,0.154824897871226,0.1484937909564409,0.1227726083252245,0.1048069034727542,0.1103551980997832,0.0979502461109987,0.0151462605026286,0.0247989908116915,0.0665028736093033,0.0072164059860415,0.0378657315449979,0.0261948993506726,0.0808684957709458,0.0178644141458405,0.0243326392720134,0.0447611367680697,0.0439868807479194,0.0229441150939125,0.0403217368265545,0.0730674675251392,0.0044491202801348,0.041677863254079,0.0539258176516787,0.031889240092423,0.009251974438358,0.017982398033447,0.035819214362938,0.0141531650056861,0.0207006190657026,0.019317958781112,0.011208373781658,0.0107899541138972,0.006772086735028,0.0049625450743058,0.004785633579488,0.0235977167010526,0.0330493276374875,0.0217317522383228,0.0054185046585022,0.0197199810206092,0.0162166909748888,0.0231754876013549,0.0272386133616837,0.024112391343532,0.0295184746609843,0.0085440815762137,0.0208393316173452,0.0233529429816671,0.0143334222353402,0.0829786391742922,0.0748442215499887,0.1003998225118602,0.0518904593666187,0.0817222632113264,0.0422127621793309,0.030856278676334,0.0499039825642617,0.0453992796313162,0.1779790255995051,0.0560224657988305,0.1223080717754343,0.0767070365442671,0.0419613257187138,0.1766771977116808,0.1354758426858506,0.1952608412521483,0.095558720197066,0.2016331995843436,0.1364884339738998,0.0211079682015184,0.1360374943329008,0.121071729161436,0.0939769284212325,0.0808947383558911,0.1390501440645121,0.1690704438281141,0.022119360431267,0.0218985369383103,0.0117819840817412,0.0666059811646728,0.0354926925687595,0.0077505903888533,0.0172687391340098,0.0281037945808359,0.0481505336808743,0.0610828191901295,0.0274339184287265,0.0587636780500183,0.0145216630198245,0.0356971676699922,0.0173485085203845,0.0243560107553823,0.0451719307842467,0.0719142931711258,0.0528179842611057,0.0303052109395026,0.0170811649948745,0.0266221714659349,0.0585808790425497,0.0493188349645679,0.0524328120601155,0.0396899203044518,0.0398877899907632,0.0302857328017839,0.0694923488208325,0.042622651175808,0.0623480860637572,0.0319521915974353,0.0234397878111782,0.0388112949247709,0.0765942798203162,0.0137858027801892,0.0815498852248613,0.0494884840801268,0.0362492205060386,0.0525348476704213,0.0375549074522225,0.0374798227308904,0.0904334166388428,0.05666442780829,0.0780098083090369,0.076240292542455,0.0313009844743834,0.0385495476685303,0.0576181182397163,0.0170730021955883,0.0070825345693864,0.071623311139088,0.0871791555909084,0.0416043771475343,0.0941935464943041,0.0809674009733857,0.0686071149700878,0.0203436538913173,0.0584040286164601,0.0216519499196798,0.0420520401675078,0.0108836800461206,0.0298854188702977,0.008471041295578,0.0381812642388173,0.0594272819740458,0.0680026456189992,0.0350646818563491,0.0279330353049793,0.0456729586845414,0.0182981152874261,0.0053392000461256,0.0151767309057147,0.0020262190043168,0.00554870178121,0.0158797233176247,0.0605115173062012,0.0488055988254204,0.0086477617825873,0.0390352415105198,0.0055803057488909,0.0160968459475412,0.0132855301358571,0.0154817844490055,0.025580962883553,0.03068959959287,0.0736190877954375,0.0098569661086694,0.0210341148343287,0.0366930532143468,0.0434615018311968,0.0116159998032539,0.0024645647020433,0.0137508412390916,0.003716546911696,0.0048387201996948,0.0095009108109528,0.0180659767584964,0.0276797968784662,0.0024590957438747,0.0197980373227998,0.0201306355820254,0.0100452939976063,0.0135885695035969,0.0184888177617768,0.0410233308688023,0.0031406679693421,0.0342184535798235,0.0071246433844414,0.026290160747461,0.013139225917239,0.0255804937306705,0.0891132670003974,0.012429273673845,0.0051779969518495,1.2562866943292145e-05,0.0031232467871063,0.0007132057275324,0.0055907184112556,0.0461886463984033,0.034952880223247,0.0289059712981573,1.2562866943292145e-05,0.0128263329304625,0.0391904904174518,0.0388122736728835,0.1506057582598353,0.1075414101034504,0.0071539962960479,3.1328353598983165e-06,0.00877225217997,0.0702392203222743,0.0134619186240074,0.0191300323188454,0.0199246884225573,0.0124962581617046,1.2562866943292145e-05,0.0090015216761964,0.0126960713690578,0.0079248000145053,0.0131534114569625,0.0701398388684076,0.0607722951750297,0.0354886572387121,0.025249179949216,0.0135382394075641,0.0262670672322051,0.0143117910077342,0.0951937152667367,0.1481525522689906,0.1360069405568059,0.09018562637387,0.085488473359911,0.0841520950670462,0.0050557129809723,0.0100739780571788,0.0173084925406389,0.0054413661504841,0.0105801461960092,0.0005304401674917,0.0116530075435935,0.0240731774356983,0.1942731319176344,0.1201112950531989,0.158630699203789,0.1369943888532623,0.1043965264157412,0.1307415922581147],"y":[0.09204349465805263,0.06620642363284412,0.07246229165351342,0.05946681578190908,0.05867717374417329,0.06889964414933254,0.07678085892949406,0.06941514224447165,0.07287326576698314,0.060578644459387175,0.06668202073875597,0.058678139945567934,0.05675561006019479,0.06734793735997538,0.06510619271331242,0.0599231020819272,0.05935376393477283,0.06520621819202053,0.07084527563909862,0.05841157619217315,0.07198201956197392,0.06385183142968333,0.13718319750543403,0.07234370233845057,0.08093643579451666,0.06633127675969744,0.09520300469310691,0.09796567447073821,0.09844155579467362,0.0879570306325016,0.09294587978976843,0.09332793178137434,0.10211723057990704,0.07105347739929006,0.10744290285890556,0.11420406797122452,0.18634195008700735,0.1808969170360941,0.15877555794034365,0.14332425408126573,0.14809603380746592,0.13742722431126478,0.06621212015120075,0.07451389680287239,0.11038108768131262,0.05939209317757377,0.08575187400310155,0.07571444012540798,0.1227361605808722,0.06854985297169466,0.07411281377251612,0.09168222865425822,0.09101633409958855,0.07291862132820669,0.08786414759305833,0.11602692992006494,0.05701210460167506,0.08903047653339632,0.09956426113040982,0.08061182599478646,0.061142772426786215,0.06865132435357772,0.0839917783601809,0.06535801392991154,0.07098911513164133,0.06979996589611046,0.06282536272709788,0.0624655032347887,0.059009958893713285,0.057453672720970406,0.05730152098047147,0.0734807477305735,0.081609552791988,0.07187593544290449,0.057845818208204586,0.07014572287205922,0.06713273788497336,0.07311761195765798,0.0766120805162826,0.07392339077490795,0.07857286246062152,0.060533953134557894,0.0711084140849581,0.07327023146383088,0.06551304315092193,0.12455097759913411,0.11755501727017047,0.13953396877837837,0.09781376263436949,0.12347043848728531,0.08949051335888301,0.07972343331296525,0.09610530438381512,0.09223105985050088,0.2062555279877569,0.10136747162914853,0.15837603588187738,0.11915712087513336,0.08927426683885228,0.2051358982024424,0.1697009035202096,0.22111865676997344,0.13537040584037957,0.2265991678714423,0.17057177698747308,0.07133945347494086,0.17018394887427657,0.15731272633963098,0.13400999468084562,0.12275873036910857,0.17277496140656223,0.19859375211903676,0.07220929569882707,0.0720193776902148,0.06331869305374319,0.11046976475695552,0.08371095511946237,0.059851515482036835,0.06803754601326267,0.07735617477921657,0.09459726049012653,0.1057196002277949,0.0767800515455785,0.10372503587631501,0.06567493858355998,0.08388681278531553,0.06810615122734412,0.07413291428591849,0.09203552974762273,0.11503514877411636,0.09861147522618062,0.07924949059161716,0.06787622392522415,0.07608191311562139,0.103567820613528,0.09560205146724304,0.0982802100314977,0.08732075733109193,0.08749093404682917,0.07923273852834037,0.11295216909736779,0.08984303609512229,0.10680778591757367,0.0806659670841742,0.0733449218731627,0.08656510049317608,0.1190601450860827,0.06504206610492436,0.12332218576525965,0.09574795723912619,0.0843616027357274,0.09836796518679096,0.0854845514825752,0.08541997528843177,0.13096241721435967,0.10191958746070628,0.12027756243652957,0.11875570030991633,0.08010590004443947,0.08633998623110484,0.10273980357604766,0.0678692035554058,0.05927695781529497,0.1147848913068214,0.12816360822237724,0.08896727521894933,0.13419629584163403,0.12282122344640915,0.11219082868091777,0.0706821092322442,0.1034157213948468,0.0718073019056101,0.08935228529258037,0.06254611169797739,0.07888845077313077,0.06047113525018753,0.0860232461295899,0.1042957647153127,0.11167095820025108,0.08334284690290754,0.07720931422018576,0.0924664359877564,0.06892285520999798,0.0577776127203977,0.06623832605075537,0.05492830192648729,0.057957793514548286,0.06684293073819984,0.1052282552415376,0.09516064559964427,0.060623122715490314,0.08675770450025647,0.057984974329985256,0.06702966584027745,0.06461180941845225,0.0665006856425098,0.07518642750461012,0.07958008190055457,0.11650134784472731,0.06166309212517574,0.07127593630003262,0.0847433185712586,0.09056448490413002,0.06317593920446216,0.055305298689292307,0.06501199762727115,0.05638205897820709,0.05734717783092084,0.061356868760112655,0.06872320576805588,0.07699151792947631,0.05530059514244293,0.07021285475768058,0.07049890402813759,0.0618250624715105,0.06487243672980245,0.06908686780522134,0.08846754962050501,0.05588677751848017,0.08261505301215222,0.05931317326589395,0.07579636915629794,0.06448598129446287,0.07518602401230055,0.12982702991001646,0.06387539084292229,0.05763897090182518,0.053196468241043154,0.055871794528248496,0.05379905221003045,0.057993929681946124,0.09290995031846065,0.08324669253439335,0.07804608237314581,0.053196468241043154,0.06421687943323569,0.08689122545334427,0.0865659422600098,0.18271330268937933,0.14567605119707666,0.059338418073158955,0.05318835799518349,0.060730189984673076,0.11359451175006234,0.06476351134999539,0.0696383407945357,0.07032178032684189,0.06393300047662509,0.053196468241043154,0.0609273719311039,0.06410484870675154,0.060001343495088885,0.06449818148846989,0.11350903928715253,0.10545253578739316,0.08370748455645101,0.07490107944975813,0.06482915061253372,0.07577650770781465,0.06549443933474385,0.13505648539390155,0.18060343661372463,0.17015767127023257,0.13074930658447587,0.12670954643661367,0.1255602017689097,0.05753380125740355,0.06184973203632892,0.06807173570803411,0.05786548010637028,0.062285059109832355,0.05364186571351651,0.06320776750431573,0.07388966507305457,0.22026918288752104,0.1564867103628098,0.18961510821242478,0.1710069206483653,0.14297131159129545,0.16562923794935624],"type":"scatter","xaxis":"x3","yaxis":"y3"},{"hovertext":["[retail] Llama2-7B-Chat - White F","[retail] Llama2-7B-Chat - Black F","[retail] Llama2-7B-Chat - Black M","[retail] Llama2-7B-Chat - Hispanic F","[retail] Llama2-7B-Chat - Hispanic M","[retail] Llama2-7B-Chat - Asian F","[retail] Llama2-7B-Chat - Asian M","[software_engineer] Llama2-7B-Chat - White F","[software_engineer] Llama2-7B-Chat - Black F","[software_engineer] Llama2-7B-Chat - Black M","[software_engineer] Llama2-7B-Chat - Hispanic F","[software_engineer] Llama2-7B-Chat - Hispanic M","[software_engineer] Llama2-7B-Chat - Asian F","[software_engineer] Llama2-7B-Chat - Asian M","[HR_specialist] Llama2-7B-Chat - White F","[HR_specialist] Llama2-7B-Chat - Black F","[HR_specialist] Llama2-7B-Chat - Black M","[HR_specialist] Llama2-7B-Chat - Hispanic F","[HR_specialist] Llama2-7B-Chat - Hispanic M","[HR_specialist] Llama2-7B-Chat - Asian F","[HR_specialist] Llama2-7B-Chat - Asian M","[financial_analyst] Llama2-7B-Chat - White F","[financial_analyst] Llama2-7B-Chat - Black F","[financial_analyst] Llama2-7B-Chat - Black M","[financial_analyst] Llama2-7B-Chat - Hispanic F","[financial_analyst] Llama2-7B-Chat - Hispanic M","[financial_analyst] Llama2-7B-Chat - Asian F","[financial_analyst] Llama2-7B-Chat - Asian M","[retail] Llama3-8B-IT - White F","[retail] Llama3-8B-IT - Black F","[retail] Llama3-8B-IT - Black M","[retail] Llama3-8B-IT - Hispanic F","[retail] Llama3-8B-IT - Hispanic M","[retail] Llama3-8B-IT - Asian F","[retail] Llama3-8B-IT - Asian M","[software_engineer] Llama3-8B-IT - White F","[software_engineer] Llama3-8B-IT - Black F","[software_engineer] Llama3-8B-IT - Black M","[software_engineer] Llama3-8B-IT - Hispanic F","[software_engineer] Llama3-8B-IT - Hispanic M","[software_engineer] Llama3-8B-IT - Asian F","[software_engineer] Llama3-8B-IT - Asian M","[HR_specialist] Llama3-8B-IT - White F","[HR_specialist] Llama3-8B-IT - Black F","[HR_specialist] Llama3-8B-IT - Black M","[HR_specialist] Llama3-8B-IT - Hispanic F","[HR_specialist] Llama3-8B-IT - Hispanic M","[HR_specialist] Llama3-8B-IT - Asian F","[HR_specialist] Llama3-8B-IT - Asian M","[financial_analyst] Llama3-8B-IT - White F","[financial_analyst] Llama3-8B-IT - Black F","[financial_analyst] Llama3-8B-IT - Black M","[financial_analyst] Llama3-8B-IT - Hispanic F","[financial_analyst] Llama3-8B-IT - Hispanic M","[financial_analyst] Llama3-8B-IT - Asian F","[financial_analyst] Llama3-8B-IT - Asian M","[retail] TinyLlama-1.1B-Chat - White F","[retail] TinyLlama-1.1B-Chat - Black F","[retail] TinyLlama-1.1B-Chat - Black M","[retail] TinyLlama-1.1B-Chat - Hispanic F","[retail] TinyLlama-1.1B-Chat - Hispanic M","[retail] TinyLlama-1.1B-Chat - Asian F","[retail] TinyLlama-1.1B-Chat - Asian M","[software_engineer] TinyLlama-1.1B-Chat - White F","[software_engineer] TinyLlama-1.1B-Chat - Black F","[software_engineer] TinyLlama-1.1B-Chat - Black M","[software_engineer] TinyLlama-1.1B-Chat - Hispanic F","[software_engineer] TinyLlama-1.1B-Chat - Hispanic M","[software_engineer] TinyLlama-1.1B-Chat - Asian F","[software_engineer] TinyLlama-1.1B-Chat - Asian M","[HR_specialist] TinyLlama-1.1B-Chat - White F","[HR_specialist] TinyLlama-1.1B-Chat - Black F","[HR_specialist] TinyLlama-1.1B-Chat - Black M","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic F","[HR_specialist] TinyLlama-1.1B-Chat - Hispanic M","[HR_specialist] TinyLlama-1.1B-Chat - Asian F","[HR_specialist] TinyLlama-1.1B-Chat - Asian M","[financial_analyst] TinyLlama-1.1B-Chat - White F","[financial_analyst] TinyLlama-1.1B-Chat - Black F","[financial_analyst] TinyLlama-1.1B-Chat - Black M","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic F","[financial_analyst] TinyLlama-1.1B-Chat - Hispanic M","[financial_analyst] TinyLlama-1.1B-Chat - Asian F","[financial_analyst] TinyLlama-1.1B-Chat - Asian M","[retail] Llama3-70B-IT - White F","[retail] Llama3-70B-IT - Black F","[retail] Llama3-70B-IT - Black M","[retail] Llama3-70B-IT - Hispanic F","[retail] Llama3-70B-IT - Hispanic M","[retail] Llama3-70B-IT - Asian F","[retail] Llama3-70B-IT - Asian M","[software_engineer] Llama3-70B-IT - White F","[software_engineer] Llama3-70B-IT - Black F","[software_engineer] Llama3-70B-IT - Black M","[software_engineer] Llama3-70B-IT - Hispanic F","[software_engineer] Llama3-70B-IT - Hispanic M","[software_engineer] Llama3-70B-IT - Asian F","[software_engineer] Llama3-70B-IT - Asian M","[HR_specialist] Llama3-70B-IT - White F","[HR_specialist] Llama3-70B-IT - Black F","[HR_specialist] Llama3-70B-IT - Black M","[HR_specialist] Llama3-70B-IT - Hispanic F","[HR_specialist] Llama3-70B-IT - Hispanic M","[HR_specialist] Llama3-70B-IT - Asian F","[HR_specialist] Llama3-70B-IT - Asian M","[financial_analyst] Llama3-70B-IT - White F","[financial_analyst] Llama3-70B-IT - Black F","[financial_analyst] Llama3-70B-IT - Black M","[financial_analyst] Llama3-70B-IT - Hispanic F","[financial_analyst] Llama3-70B-IT - Hispanic M","[financial_analyst] Llama3-70B-IT - Asian F","[financial_analyst] Llama3-70B-IT - Asian M","[retail] StableLM2-Zephyr-1.6B - White F","[retail] StableLM2-Zephyr-1.6B - Black F","[retail] StableLM2-Zephyr-1.6B - Black M","[retail] StableLM2-Zephyr-1.6B - Hispanic F","[retail] StableLM2-Zephyr-1.6B - Hispanic M","[retail] StableLM2-Zephyr-1.6B - Asian F","[retail] StableLM2-Zephyr-1.6B - Asian M","[software_engineer] StableLM2-Zephyr-1.6B - White F","[software_engineer] StableLM2-Zephyr-1.6B - Black F","[software_engineer] StableLM2-Zephyr-1.6B - Black M","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic F","[software_engineer] StableLM2-Zephyr-1.6B - Hispanic M","[software_engineer] StableLM2-Zephyr-1.6B - Asian F","[software_engineer] StableLM2-Zephyr-1.6B - Asian M","[HR_specialist] StableLM2-Zephyr-1.6B - White F","[HR_specialist] StableLM2-Zephyr-1.6B - Black F","[HR_specialist] StableLM2-Zephyr-1.6B - Black M","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic F","[HR_specialist] StableLM2-Zephyr-1.6B - Hispanic M","[HR_specialist] StableLM2-Zephyr-1.6B - Asian F","[HR_specialist] StableLM2-Zephyr-1.6B - Asian M","[financial_analyst] StableLM2-Zephyr-1.6B - White F","[financial_analyst] StableLM2-Zephyr-1.6B - Black F","[financial_analyst] StableLM2-Zephyr-1.6B - Black M","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic F","[financial_analyst] StableLM2-Zephyr-1.6B - Hispanic M","[financial_analyst] StableLM2-Zephyr-1.6B - Asian F","[financial_analyst] StableLM2-Zephyr-1.6B - Asian M","[retail] Llama2-13B-Chat - White F","[retail] Llama2-13B-Chat - Black F","[retail] Llama2-13B-Chat - Black M","[retail] Llama2-13B-Chat - Hispanic F","[retail] Llama2-13B-Chat - Hispanic M","[retail] Llama2-13B-Chat - Asian F","[retail] Llama2-13B-Chat - Asian M","[software_engineer] Llama2-13B-Chat - White F","[software_engineer] Llama2-13B-Chat - Black F","[software_engineer] Llama2-13B-Chat - Black M","[software_engineer] Llama2-13B-Chat - Hispanic F","[software_engineer] Llama2-13B-Chat - Hispanic M","[software_engineer] Llama2-13B-Chat - Asian F","[software_engineer] Llama2-13B-Chat - Asian M","[HR_specialist] Llama2-13B-Chat - White F","[HR_specialist] Llama2-13B-Chat - Black F","[HR_specialist] Llama2-13B-Chat - Black M","[HR_specialist] Llama2-13B-Chat - Hispanic F","[HR_specialist] Llama2-13B-Chat - Hispanic M","[HR_specialist] Llama2-13B-Chat - Asian F","[HR_specialist] Llama2-13B-Chat - Asian M","[financial_analyst] Llama2-13B-Chat - White F","[financial_analyst] Llama2-13B-Chat - Black F","[financial_analyst] Llama2-13B-Chat - Black M","[financial_analyst] Llama2-13B-Chat - Hispanic F","[financial_analyst] Llama2-13B-Chat - Hispanic M","[financial_analyst] Llama2-13B-Chat - Asian F","[financial_analyst] Llama2-13B-Chat - Asian M","[retail] StarlingLM-7B - White F","[retail] StarlingLM-7B - Black F","[retail] StarlingLM-7B - Black M","[retail] StarlingLM-7B - Hispanic F","[retail] StarlingLM-7B - Hispanic M","[retail] StarlingLM-7B - Asian F","[retail] StarlingLM-7B - Asian M","[software_engineer] StarlingLM-7B - White F","[software_engineer] StarlingLM-7B - Black F","[software_engineer] StarlingLM-7B - Black M","[software_engineer] StarlingLM-7B - Hispanic F","[software_engineer] StarlingLM-7B - Hispanic M","[software_engineer] StarlingLM-7B - Asian F","[software_engineer] StarlingLM-7B - Asian M","[HR_specialist] StarlingLM-7B - White F","[HR_specialist] StarlingLM-7B - Black F","[HR_specialist] StarlingLM-7B - Black M","[HR_specialist] StarlingLM-7B - Hispanic F","[HR_specialist] StarlingLM-7B - Hispanic M","[HR_specialist] StarlingLM-7B - Asian F","[HR_specialist] StarlingLM-7B - Asian M","[financial_analyst] StarlingLM-7B - White F","[financial_analyst] StarlingLM-7B - Black F","[financial_analyst] StarlingLM-7B - Black M","[financial_analyst] StarlingLM-7B - Hispanic F","[financial_analyst] StarlingLM-7B - Hispanic M","[financial_analyst] StarlingLM-7B - Asian F","[financial_analyst] StarlingLM-7B - Asian M","[retail] StableLM-Zephyr-3B - White F","[retail] StableLM-Zephyr-3B - Black F","[retail] StableLM-Zephyr-3B - Black M","[retail] StableLM-Zephyr-3B - Hispanic F","[retail] StableLM-Zephyr-3B - Hispanic M","[retail] StableLM-Zephyr-3B - Asian F","[retail] StableLM-Zephyr-3B - Asian M","[software_engineer] StableLM-Zephyr-3B - White F","[software_engineer] StableLM-Zephyr-3B - Black F","[software_engineer] StableLM-Zephyr-3B - Black M","[software_engineer] StableLM-Zephyr-3B - Hispanic F","[software_engineer] StableLM-Zephyr-3B - Hispanic M","[software_engineer] StableLM-Zephyr-3B - Asian F","[software_engineer] StableLM-Zephyr-3B - Asian M","[HR_specialist] StableLM-Zephyr-3B - White F","[HR_specialist] StableLM-Zephyr-3B - Black F","[HR_specialist] StableLM-Zephyr-3B - Black M","[HR_specialist] StableLM-Zephyr-3B - Hispanic F","[HR_specialist] StableLM-Zephyr-3B - Hispanic M","[HR_specialist] StableLM-Zephyr-3B - Asian F","[HR_specialist] StableLM-Zephyr-3B - Asian M","[financial_analyst] StableLM-Zephyr-3B - White F","[financial_analyst] StableLM-Zephyr-3B - Black F","[financial_analyst] StableLM-Zephyr-3B - Black M","[financial_analyst] StableLM-Zephyr-3B - Hispanic F","[financial_analyst] StableLM-Zephyr-3B - Hispanic M","[financial_analyst] StableLM-Zephyr-3B - Asian F","[financial_analyst] StableLM-Zephyr-3B - Asian M","[retail] Gemma-2B-IT - White F","[retail] Gemma-2B-IT - Black F","[retail] Gemma-2B-IT - Black M","[retail] Gemma-2B-IT - Hispanic F","[retail] Gemma-2B-IT - Hispanic M","[retail] Gemma-2B-IT - Asian F","[retail] Gemma-2B-IT - Asian M","[software_engineer] Gemma-2B-IT - White F","[software_engineer] Gemma-2B-IT - Black F","[software_engineer] Gemma-2B-IT - Black M","[software_engineer] Gemma-2B-IT - Hispanic F","[software_engineer] Gemma-2B-IT - Hispanic M","[software_engineer] Gemma-2B-IT - Asian F","[software_engineer] Gemma-2B-IT - Asian M","[HR_specialist] Gemma-2B-IT - White F","[HR_specialist] Gemma-2B-IT - Black F","[HR_specialist] Gemma-2B-IT - Black M","[HR_specialist] Gemma-2B-IT - Hispanic F","[HR_specialist] Gemma-2B-IT - Hispanic M","[HR_specialist] Gemma-2B-IT - Asian F","[HR_specialist] Gemma-2B-IT - Asian M","[financial_analyst] Gemma-2B-IT - White F","[financial_analyst] Gemma-2B-IT - Black F","[financial_analyst] Gemma-2B-IT - Black M","[financial_analyst] Gemma-2B-IT - Hispanic F","[financial_analyst] Gemma-2B-IT - Hispanic M","[financial_analyst] Gemma-2B-IT - Asian F","[financial_analyst] Gemma-2B-IT - Asian M","[retail] Gemma-7B-IT - White F","[retail] Gemma-7B-IT - Black F","[retail] Gemma-7B-IT - Black M","[retail] Gemma-7B-IT - Hispanic F","[retail] Gemma-7B-IT - Hispanic M","[retail] Gemma-7B-IT - Asian F","[retail] Gemma-7B-IT - Asian M","[software_engineer] Gemma-7B-IT - White F","[software_engineer] Gemma-7B-IT - Black F","[software_engineer] Gemma-7B-IT - Black M","[software_engineer] Gemma-7B-IT - Hispanic F","[software_engineer] Gemma-7B-IT - Hispanic M","[software_engineer] Gemma-7B-IT - Asian F","[software_engineer] Gemma-7B-IT - Asian M","[HR_specialist] Gemma-7B-IT - White F","[HR_specialist] Gemma-7B-IT - Black F","[HR_specialist] Gemma-7B-IT - Black M","[HR_specialist] Gemma-7B-IT - Hispanic F","[HR_specialist] Gemma-7B-IT - Hispanic M","[HR_specialist] Gemma-7B-IT - Asian F","[HR_specialist] Gemma-7B-IT - Asian M","[financial_analyst] Gemma-7B-IT - White F","[financial_analyst] Gemma-7B-IT - Black F","[financial_analyst] Gemma-7B-IT - Black M","[financial_analyst] Gemma-7B-IT - Hispanic F","[financial_analyst] Gemma-7B-IT - Hispanic M","[financial_analyst] Gemma-7B-IT - Asian F","[financial_analyst] Gemma-7B-IT - Asian M"],"marker":{"color":"#D84260"},"mode":"markers","showlegend":false,"x":[5.824463184533891e-09,2.4274086662945395e-09,6.587034950267245e-09,3.859218733470726e-09,7.040383590006804e-09,8.613169772409002e-09,1.7091991131312767e-08,1.24265150058811e-08,2.7801879717292978e-08,2.1382981595929882e-08,8.000106972438914e-09,1.2048362519889724e-08,4.1952703422332164e-09,1.892772898970385e-08,1.6572921879287604e-09,3.373810322226944e-09,2.271740087711471e-09,1.932231421530872e-09,2.248062633269932e-09,8.33844979175602e-10,3.712407838363241e-09,2.931840992759227e-09,2.0906142467747023e-08,1.692917873941102e-08,7.765496232159386e-09,5.291114098526784e-09,8.711325297783289e-09,1.6643057556553487e-08,5.025460776804657e-06,4.861784208214925e-06,7.112109911491803e-06,6.556696419967034e-06,5.942281609241373e-06,3.896135742459949e-06,7.621931017066653e-06,1.8890344571288467e-05,4.984203814867083e-05,5.016483890864621e-05,5.1728660822509814e-05,4.887230680780729e-05,3.208674359256591e-05,2.6889069558562736e-05,1.2385615377241696e-06,1.8569383435029784e-06,3.820836666704186e-06,1.4756423295086975e-06,2.6076570521238465e-06,1.937208301447391e-06,4.443128056532686e-06,1.3596169355234443e-06,3.349027893931878e-06,5.850545285960851e-06,2.46940886124869e-06,3.747453270842583e-06,3.6269893394674793e-06,5.848314810722454e-06,0.00015972878265,0.0005999810157582,0.0008627969432735,0.0006735173982843,0.00053299365797,0.0005766971396212,0.0005518369212164,0.0002933882724603,0.0003838121183914,0.0005637479026886,0.0003659407988522,0.000208992278683,0.0002158291377927,0.0002378546970773,0.0001367213263299,0.0002750364262899,0.0005578575687334,0.0004260095585198,0.0002028643601845,0.0003789003057388,0.0002360389927594,0.0004847189307664,0.0003927337871274,0.0010119664201726,0.0007758313503497,0.0005494396512266,0.0005370189551912,0.0005388621949922,1.1993334103621584e-12,3.773837908838119e-12,3.1879238138188274e-12,3.676630111471013e-12,2.1203949707171428e-12,2.9517754907004704e-12,2.205662874565917e-12,8.436377707532473e-12,1.4064315267958704e-11,1.0839625308456392e-11,1.8168835325127476e-11,1.153785900154247e-11,1.869524868247652e-11,1.6930962742911503e-11,3.6649205892302914e-12,8.017806418791907e-12,7.069204110976557e-12,8.083878566544909e-12,5.516567203045497e-12,9.015295732162088e-12,7.812583358024482e-12,2.9993940664496668e-12,1.1239544295271739e-11,1.0258113802841251e-11,1.1612225625512452e-11,8.527324957263716e-12,1.3344611526910911e-11,1.5890996296619164e-11,6.218020630870458e-05,4.913660565169231e-05,5.660164339878592e-05,0.0001459484619157,0.0001310671997573,4.846672658351314e-05,3.269909387748904e-05,0.009998036058788,0.010068912094178,0.0101302277049098,0.0101115284271071,0.0101494887474148,0.0099750780384985,0.010038416710904,9.946422674401156e-05,0.0001331463644011,0.0001750580364617,0.0002523118971528,0.0002268816545925,0.0001208582988717,8.68331215243745e-05,0.0056896332821652,0.0061500737227915,0.006220748673284,0.0063520500292092,0.0064197443542425,0.0059844692952653,0.0056715014773621,3.7968266098370457e-06,9.222112961534968e-06,1.0027750340577126e-05,3.0952800892358744e-06,2.3022434035835373e-06,7.89796978173829e-06,9.7590752049187e-06,2.678056508967908e-06,6.444077656784231e-06,6.682677792720914e-06,1.5206599115608062e-06,2.1927350417833006e-06,2.349689001386323e-06,3.649388001479293e-06,5.006509696292016e-06,9.608050315086936e-06,1.2515627290276554e-05,5.60948624727331e-06,4.080025702480894e-06,7.026283585643278e-06,1.050543234060175e-05,9.014283417957402e-07,1.7151418623476133e-05,1.4705144533989634e-05,9.137292272786144e-06,6.562028072882308e-06,1.4376891107457656e-05,1.8283633404961864e-05,0.0018076301640905,0.0009825701386443,0.0010644171422826,0.001056189807647,0.0017762801130628,0.0007403504875226,0.0013702135531947,0.0001712071281393,0.0013355434068814,0.001274067794846,0.0018975688451288,0.0012257877430872,0.0011874479360684,0.0012296044320418,0.000628588519081,0.0004468436515704,0.0003844443470923,0.0005357978465733,0.0004459155263044,0.0010304756883808,0.0015332671693825,0.0019283491515697,0.0006932160896784,0.0014725512825142,0.0005003003790178,0.0010585055696088,0.000447191775642,0.001027902049851,1.14428875663819e-08,1.2554745662529677e-08,1.6581007186711182e-08,5.462760999108696e-09,8.243819388242812e-09,1.0839519209437933e-08,1.3148299089493776e-08,1.7602759633250643e-09,9.811587559083176e-10,1.467766808649351e-09,1.5255085572540847e-09,1.512467591724409e-09,1.608551547516157e-09,1.760473607448354e-09,6.572117532410715e-09,3.534220039402847e-09,3.917676274500792e-09,6.6248346158870335e-09,3.1301126135474533e-09,1.000563559783174e-09,1.7415896580441624e-09,2.718701053727734e-09,1.1947717420968118e-09,3.027024623736274e-09,1.7719231354407227e-09,2.193762854152403e-09,1.103721697925941e-09,2.987706538837287e-09,7.671289124715487e-06,2.245788007477767e-06,3.5303837208006117e-06,0.0093496542308779,3.728780704100321e-06,3.1278213101437745e-06,5.105265189201957e-06,1.4917218969003333e-05,1.347392727156227e-05,7.210589796607936e-06,0.0003641709409226,7.126914374754323e-06,1.4651185914984489e-05,1.4459686621015046e-05,3.5730297659335445e-05,2.9027426942379032e-05,7.35118315562e-06,0.0035742786913628,9.660600323964095e-06,2.4685460332161124e-05,1.1679672625936056e-05,3.014847757932815e-06,1.7892357333404438e-06,1.2256364632212691e-06,0.0001006332028145,1.5683805850658097e-06,8.356378857599101e-07,7.548044950977939e-07,1.8602188678329414e-10,6.412506181607823e-10,5.359557664341707e-10,4.4079963512633214e-10,3.2197911559173063e-10,2.303603835462908e-10,3.803221232390186e-10,6.720343548316521e-10,1.9321688515816512e-09,2.0484565760314768e-09,1.3682815241944367e-09,1.0259963950653983e-09,1.0870893801806504e-09,7.447975580721078e-10,8.880917556908215e-11,3.2670268768075773e-10,2.9885733165979625e-10,1.7346955982766584e-10,3.9123817185959813e-10,6.086235126989677e-11,3.33175143585329e-10,3.6183614660068026e-10,1.060945210573649e-09,8.095082898451621e-10,9.351023771975163e-10,7.994115291953818e-10,7.525574113875777e-10,8.09631097165031e-10],"y":[0.0833333333333333,0.0016666666666667,0.0916666666666667,0.025,0.0666666666666667,0.0283333333333333,0.1216666666666667,0.135,0.1783333333333334,0.0733333333333334,0.085,0.025,0.025,0.1166666666666667,0.0549999999999999,0.14,0.1049999999999999,0.0933333333333333,0.12,0.0333333333333333,0.095,0.0266666666666665,0.1599999999999999,0.1366666666666666,0.0883333333333332,0.04,0.0916666666666665,0.1516666666666666,0.0883333333333334,0.0799999999999999,0.1833333333333333,0.0716666666666666,0.1683333333333332,0.1049999999999999,0.1499999999999999,0.0566666666666667,0.1575,0.2233333333333334,0.1541666666666667,0.18,0.2033333333333334,0.1916666666666667,0.0658333333333333,0.0291666666666666,0.0733333333333333,0.0283333333333333,0.1049999999999999,0.0283333333333333,0.1233333333333333,0.035,0.2066666666666667,0.2683333333333334,0.1783333333333333,0.21,0.2,0.2383333333333333,0.0116666666666667,0.015,0.0366666666666666,0.0399999999999999,0.0316666666666665,0.005,0.0099999999999999,0.0466666666666667,0.0916666666666666,0.1283333333333333,0.0733333333333333,0.0449999999999999,0.0183333333333333,0.0416666666666666,0.0233333333333333,0.0516666666666666,0.0499999999999999,0.0716666666666667,0.0333333333333334,0.03,0.0366666666666667,0.0266666666666667,0.0166666666666667,0.03,0.09,0.0699999999999999,0.0199999999999999,0.015,0.0397222222222221,0.0769444444444444,0.0416666666666665,0.0905555555555555,0.0677777777777777,0.1119444444444444,0.0619444444444443,0.0488888888888889,0.0791666666666666,0.0983333333333334,0.1697222222222222,0.1133333333333334,0.1336111111111111,0.1136111111111111,0.0473611111111111,0.0765277777777778,0.0441666666666668,0.1415277777777778,0.0494444444444445,0.1579166666666668,0.1225,0.0052777777777778,0.0091666666666667,0.0030555555555555,0.0391666666666666,0.0197222222222221,0.1241666666666667,0.1744444444444444,0.025,0.03,0.0116666666666667,0.2083333333333333,0.1683333333333332,0.0616666666666667,0.1116666666666666,0.0049999999999999,0.0833333333333332,0.0466666666666665,0.0333333333333333,0.0966666666666667,0.0366666666666666,0.0883333333333332,0.0566666666666667,0.0216666666666665,0.035,0.2000000000000001,0.1116666666666667,0.0033333333333332,0.0083333333333333,0.0083333333333333,0.1166666666666666,0.12,0.07,0.0716666666666667,0.12,0.1116666666666666,0.1866666666666667,0.135,0.1633333333333332,0.0149999999999999,0.0166666666666666,0.1483333333333332,0.2299999999999999,0.0816666666666666,0.29,0.345,0.12,0.0949999999999999,0.1616666666666666,0.1966666666666666,0.265,0.0116666666666666,0.1016666666666666,0.0566666666666667,0.0183333333333332,0.0716666666666666,0.1283333333333333,0.065,0.185,0.1816666666666667,0.0883333333333333,0.0816666666666666,0.2466666666666666,0.2449999999999999,0.2233333333333334,0.1083333333333333,0.0083333333333334,0.075,0.12,0.0116666666666667,0.07,0.01,0.1516666666666666,0.1633333333333332,0.1983333333333332,0.1033333333333332,0.145,0.1416666666666667,0.1233333333333333,0.0316666666666666,0.0383333333333333,0.0033333333333333,0.03,0.0633333333333334,0.1099999999999999,0.2383333333333333,0.0799999999999999,0.0966666666666667,0.0166666666666666,0.0133333333333334,0.0266666666666667,0.0566666666666667,0.0216666666666667,0.0199999999999999,0.0233333333333332,0.0033333333333332,0.0199999999999999,0.0133333333333333,0.04,0.0616666666666667,0.05,0.015,0.0716666666666667,0.0616666666666667,0.0583333333333332,0.0,0.0049999999999999,0.0016666666666666,0.02,0.0,0.015,0.0183333333333333,0.01,0.0016666666666665,0.0083333333333334,0.1116666666666666,0.0433333333333334,0.0833333333333334,0.045,0.0883333333333334,0.2983333333333334,0.0733333333333333,0.0733333333333333,0.1049999999999999,0.0783333333333333,0.025,0.0633333333333333,0.0399999999999999,0.035,0.03,0.0266666666666667,0.0033333333333334,0.02,0.0183333333333334,0.2083333333333333,0.09,0.0133333333333332,0.0849999999999999,0.0083333333333333,0.0933333333333333,0.03,0.1599999999999999,0.0366666666666666,0.0966666666666666,0.0083333333333334,0.115,0.01,0.0016666666666665,0.1342222222222223,0.3081111111111113,0.2851944444444446,0.2811111111111113,0.2304166666666668,0.1765833333333334,0.2713333333333335,0.0768055555555556,0.1099999999999999,0.1251388888888888,0.1245833333333332,0.0880555555555555,0.1413888888888889,0.0976388888888888,0.0115277777777777,0.1075833333333332,0.1021944444444444,0.063138888888889,0.0854166666666667,0.0285555555555555,0.0961388888888888,0.079222222222222,0.3031111111111111,0.2283888888888889,0.25825,0.1868611111111109,0.2219444444444444,0.1929722222222222],"type":"scatter","xaxis":"x4","yaxis":"y4"},{"line":{"color":"#D84260"},"mode":"lines","showlegend":false,"x":[5.824463184533891e-09,2.4274086662945395e-09,6.587034950267245e-09,3.859218733470726e-09,7.040383590006804e-09,8.613169772409002e-09,1.7091991131312767e-08,1.24265150058811e-08,2.7801879717292978e-08,2.1382981595929882e-08,8.000106972438914e-09,1.2048362519889724e-08,4.1952703422332164e-09,1.892772898970385e-08,1.6572921879287604e-09,3.373810322226944e-09,2.271740087711471e-09,1.932231421530872e-09,2.248062633269932e-09,8.33844979175602e-10,3.712407838363241e-09,2.931840992759227e-09,2.0906142467747023e-08,1.692917873941102e-08,7.765496232159386e-09,5.291114098526784e-09,8.711325297783289e-09,1.6643057556553487e-08,5.025460776804657e-06,4.861784208214925e-06,7.112109911491803e-06,6.556696419967034e-06,5.942281609241373e-06,3.896135742459949e-06,7.621931017066653e-06,1.8890344571288467e-05,4.984203814867083e-05,5.016483890864621e-05,5.1728660822509814e-05,4.887230680780729e-05,3.208674359256591e-05,2.6889069558562736e-05,1.2385615377241696e-06,1.8569383435029784e-06,3.820836666704186e-06,1.4756423295086975e-06,2.6076570521238465e-06,1.937208301447391e-06,4.443128056532686e-06,1.3596169355234443e-06,3.349027893931878e-06,5.850545285960851e-06,2.46940886124869e-06,3.747453270842583e-06,3.6269893394674793e-06,5.848314810722454e-06,0.00015972878265,0.0005999810157582,0.0008627969432735,0.0006735173982843,0.00053299365797,0.0005766971396212,0.0005518369212164,0.0002933882724603,0.0003838121183914,0.0005637479026886,0.0003659407988522,0.000208992278683,0.0002158291377927,0.0002378546970773,0.0001367213263299,0.0002750364262899,0.0005578575687334,0.0004260095585198,0.0002028643601845,0.0003789003057388,0.0002360389927594,0.0004847189307664,0.0003927337871274,0.0010119664201726,0.0007758313503497,0.0005494396512266,0.0005370189551912,0.0005388621949922,1.1993334103621584e-12,3.773837908838119e-12,3.1879238138188274e-12,3.676630111471013e-12,2.1203949707171428e-12,2.9517754907004704e-12,2.205662874565917e-12,8.436377707532473e-12,1.4064315267958704e-11,1.0839625308456392e-11,1.8168835325127476e-11,1.153785900154247e-11,1.869524868247652e-11,1.6930962742911503e-11,3.6649205892302914e-12,8.017806418791907e-12,7.069204110976557e-12,8.083878566544909e-12,5.516567203045497e-12,9.015295732162088e-12,7.812583358024482e-12,2.9993940664496668e-12,1.1239544295271739e-11,1.0258113802841251e-11,1.1612225625512452e-11,8.527324957263716e-12,1.3344611526910911e-11,1.5890996296619164e-11,6.218020630870458e-05,4.913660565169231e-05,5.660164339878592e-05,0.0001459484619157,0.0001310671997573,4.846672658351314e-05,3.269909387748904e-05,0.009998036058788,0.010068912094178,0.0101302277049098,0.0101115284271071,0.0101494887474148,0.0099750780384985,0.010038416710904,9.946422674401156e-05,0.0001331463644011,0.0001750580364617,0.0002523118971528,0.0002268816545925,0.0001208582988717,8.68331215243745e-05,0.0056896332821652,0.0061500737227915,0.006220748673284,0.0063520500292092,0.0064197443542425,0.0059844692952653,0.0056715014773621,3.7968266098370457e-06,9.222112961534968e-06,1.0027750340577126e-05,3.0952800892358744e-06,2.3022434035835373e-06,7.89796978173829e-06,9.7590752049187e-06,2.678056508967908e-06,6.444077656784231e-06,6.682677792720914e-06,1.5206599115608062e-06,2.1927350417833006e-06,2.349689001386323e-06,3.649388001479293e-06,5.006509696292016e-06,9.608050315086936e-06,1.2515627290276554e-05,5.60948624727331e-06,4.080025702480894e-06,7.026283585643278e-06,1.050543234060175e-05,9.014283417957402e-07,1.7151418623476133e-05,1.4705144533989634e-05,9.137292272786144e-06,6.562028072882308e-06,1.4376891107457656e-05,1.8283633404961864e-05,0.0018076301640905,0.0009825701386443,0.0010644171422826,0.001056189807647,0.0017762801130628,0.0007403504875226,0.0013702135531947,0.0001712071281393,0.0013355434068814,0.001274067794846,0.0018975688451288,0.0012257877430872,0.0011874479360684,0.0012296044320418,0.000628588519081,0.0004468436515704,0.0003844443470923,0.0005357978465733,0.0004459155263044,0.0010304756883808,0.0015332671693825,0.0019283491515697,0.0006932160896784,0.0014725512825142,0.0005003003790178,0.0010585055696088,0.000447191775642,0.001027902049851,1.14428875663819e-08,1.2554745662529677e-08,1.6581007186711182e-08,5.462760999108696e-09,8.243819388242812e-09,1.0839519209437933e-08,1.3148299089493776e-08,1.7602759633250643e-09,9.811587559083176e-10,1.467766808649351e-09,1.5255085572540847e-09,1.512467591724409e-09,1.608551547516157e-09,1.760473607448354e-09,6.572117532410715e-09,3.534220039402847e-09,3.917676274500792e-09,6.6248346158870335e-09,3.1301126135474533e-09,1.000563559783174e-09,1.7415896580441624e-09,2.718701053727734e-09,1.1947717420968118e-09,3.027024623736274e-09,1.7719231354407227e-09,2.193762854152403e-09,1.103721697925941e-09,2.987706538837287e-09,7.671289124715487e-06,2.245788007477767e-06,3.5303837208006117e-06,0.0093496542308779,3.728780704100321e-06,3.1278213101437745e-06,5.105265189201957e-06,1.4917218969003333e-05,1.347392727156227e-05,7.210589796607936e-06,0.0003641709409226,7.126914374754323e-06,1.4651185914984489e-05,1.4459686621015046e-05,3.5730297659335445e-05,2.9027426942379032e-05,7.35118315562e-06,0.0035742786913628,9.660600323964095e-06,2.4685460332161124e-05,1.1679672625936056e-05,3.014847757932815e-06,1.7892357333404438e-06,1.2256364632212691e-06,0.0001006332028145,1.5683805850658097e-06,8.356378857599101e-07,7.548044950977939e-07,1.8602188678329414e-10,6.412506181607823e-10,5.359557664341707e-10,4.4079963512633214e-10,3.2197911559173063e-10,2.303603835462908e-10,3.803221232390186e-10,6.720343548316521e-10,1.9321688515816512e-09,2.0484565760314768e-09,1.3682815241944367e-09,1.0259963950653983e-09,1.0870893801806504e-09,7.447975580721078e-10,8.880917556908215e-11,3.2670268768075773e-10,2.9885733165979625e-10,1.7346955982766584e-10,3.9123817185959813e-10,6.086235126989677e-11,3.33175143585329e-10,3.6183614660068026e-10,1.060945210573649e-09,8.095082898451621e-10,9.351023771975163e-10,7.994115291953818e-10,7.525574113875777e-10,8.09631097165031e-10],"y":[0.0915497061916583,0.09154971394478506,0.09154970445123418,0.09154971067695261,0.09154970341655269,0.09154969982696924,0.09154968047568228,0.0915496911237386,0.09154965603241139,0.09154967068231781,0.09154970122616775,0.09154969198679927,0.09154970990997914,0.09154967628596197,0.09154971570242852,0.09154971178480441,0.0915497143000688,0.09154971507493234,0.09154971435410805,0.09154971758178918,0.09154971101202039,0.09154971279351481,0.09154967177061187,0.09154968084727041,0.09154970176162186,0.0915497074089255,0.09154969960294805,0.09154968150028725,0.09153824983249785,0.09153862339293903,0.09153348745521885,0.09153475508021076,0.09153615736442129,0.09154082730074335,0.09153232388612179,0.09150660588888454,0.09143596457224484,0.09143522784129214,0.09143165871707898,0.09143817779843015,0.09147648763382249,0.09148835033000446,0.09154689270522343,0.0915454813785175,0.09154099915647201,0.09154635161369189,0.0915437680067477,0.09154529817770163,0.09153957889547722,0.09154661641944715,0.09154207596969477,0.09153636673502145,0.09154408353178357,0.09154116664002797,0.09154144157589533,0.09153637182565429,0.09118516910952103,0.09018037764883467,0.08958055059552171,0.09001254493009901,0.09033326347204634,0.09023351863973655,0.09029025733016315,0.09088011690557667,0.09067374178376858,0.0902630727946364,0.09071452965016373,0.09107273460853497,0.09105713078614698,0.09100686166262713,0.09123767922509578,0.0909220014820379,0.09027651635451794,0.09057743420298812,0.09108672040966449,0.09068495205605949,0.09101100566021886,0.09044344129742314,0.09065337978242739,0.08924009981455672,0.08977903291672754,0.09029572864009314,0.09032407650155438,0.09031986965949258,0.0915497194821435,0.09154971947626768,0.09154971947760492,0.09154971947648954,0.09154971948004136,0.09154971947814389,0.09154971947984675,0.09154971946562633,0.09154971945278165,0.09154971946014138,0.09154971944341386,0.0915497194585478,0.09154971944221242,0.09154971944623906,0.09154971947651627,0.09154971946658164,0.09154971946874664,0.09154971946643084,0.09154971947229024,0.09154971946430505,0.09154971946705003,0.09154971947803521,0.09154971945922864,0.09154971946146857,0.09154971945837806,0.09154971946541876,0.09154971945442422,0.0915497194486126,0.09140780506486383,0.09143757458690405,0.09142053706700545,0.09121662005413428,0.09125058368683509,0.09143910345766672,0.09147509006149698,0.06873111573906952,0.06856935475349907,0.06842941360740853,0.06847209113007435,0.06838545396432777,0.06878351302636616,0.0686389546292061,0.09132271142413664,0.09124583839147406,0.09115018302161423,0.09097386587046784,0.09103190553193048,0.09127388354918994,0.09135153950428997,0.078564220476744,0.07751335329628777,0.07735205124850954,0.07705238103382658,0.07689788169318684,0.07789131370651761,0.07860560285089883,0.09154105395483145,0.09152867177709784,0.09152683306397387,0.09154265510049332,0.09154446505494632,0.09153169388047343,0.09152744626354836,0.09154360733346144,0.09153501211098324,0.09153446755183946,0.09154624886967692,0.09154471498682296,0.09154435676945011,0.09154139045523624,0.09153829308471201,0.09152779094895423,0.09152115496099948,0.09153691690614013,0.09154040760710493,0.091533683337381,0.091525742846234,0.09154766214721806,0.09151057465454143,0.09151615780694991,0.09152886536408579,0.09153474291173343,0.09151690698257042,0.09150799059100116,0.08742414960387383,0.08930719120089003,0.08912039108006403,0.08913916839671203,0.0874957000951509,0.0898600111953265,0.08842246929957985,0.09115897198282157,0.08850159727290188,0.08864190359134469,0.08721888177807618,0.08875209356899964,0.08883959684053305,0.08874338270694995,0.09011508649778845,0.09052988437310858,0.09067229884276319,0.09032686344826257,0.09053200264139115,0.08919785595242376,0.08805033062802138,0.08714863161977313,0.08996758643719201,0.08818890301917669,0.09040787962397608,0.08913388311325585,0.0905290898465438,0.08920372978979053,0.09154969336867998,0.09154969083107667,0.09154968164190534,0.0915497070171743,0.09154970066994081,0.09154969474575277,0.09154968947640457,0.09154971546738777,0.09154971724557368,0.09154971613498393,0.09154971600319944,0.09154971603296294,0.0915497158136697,0.09154971546693669,0.09154970448528034,0.09154971141869994,0.09154971054353447,0.0915497043649637,0.09154971234099779,0.09154971720128592,0.09154971551003568,0.09154971327996593,0.09154971675804292,0.09154971257627639,0.09154971544080533,0.0915497144780369,0.09154971696584721,0.0915497126660124,0.09153221123568789,0.09154459390358274,0.09154166205973026,0.07021092316525507,0.09154120925658775,0.09154258083138478,0.09153806769420059,0.09151567378764164,0.0915189678247045,0.09153326269372947,0.09071856901214886,0.09153345366686493,0.09151628095717046,0.09151671801765723,0.09146817191901739,0.09148346993854345,0.09153294181629618,0.0833921124652886,0.0915276710136167,0.09149337964630741,0.09152306286752461,0.0915428386718953,0.09154563589676736,0.0915469222042322,0.09132004345999009,0.09154613995637306,0.0915478123013421,0.09154799678808531,0.09154971906032139,0.09154971802134894,0.09154971826166429,0.09154971847883994,0.09154971875002504,0.09154971895912727,0.0915497186168683,0.09154971795109096,0.09154971507507514,0.09154971480967067,0.09154971636204005,0.09154971714324034,0.0915497170038073,0.09154971778502287,0.0915497192821908,0.09154971873924439,0.09154971880279608,0.09154971908896968,0.0915497185919545,0.09154971934597408,0.09154971872447225,0.09154971865905899,0.09154971706347637,0.09154971763733301,0.09154971735068855,0.09154971766037694,0.0915497177673125,0.09154971763705273],"type":"scatter","xaxis":"x4","yaxis":"y4"}], {"template":{"data":{"histogram2dcontour":[{"type":"histogram2dcontour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"choropleth":[{"type":"choropleth","colorbar":{"outlinewidth":0,"ticks":""}}],"histogram2d":[{"type":"histogram2d","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmap":[{"type":"heatmap","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmapgl":[{"type":"heatmapgl","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"contourcarpet":[{"type":"contourcarpet","colorbar":{"outlinewidth":0,"ticks":""}}],"contour":[{"type":"contour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"surface":[{"type":"surface","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"mesh3d":[{"type":"mesh3d","colorbar":{"outlinewidth":0,"ticks":""}}],"scatter":[{"fillpattern":{"fillmode":"overlay","size":10,"solidity":0.2},"type":"scatter"}],"parcoords":[{"type":"parcoords","line":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolargl":[{"type":"scatterpolargl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"bar":[{"error_x":{"color":"#2a3f5f"},"error_y":{"color":"#2a3f5f"},"marker":{"line":{"color":"#E5ECF6","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"bar"}],"scattergeo":[{"type":"scattergeo","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolar":[{"type":"scatterpolar","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"histogram":[{"marker":{"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"histogram"}],"scattergl":[{"type":"scattergl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatter3d":[{"type":"scatter3d","line":{"colorbar":{"outlinewidth":0,"ticks":""}},"marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattermapbox":[{"type":"scattermapbox","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterternary":[{"type":"scatterternary","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattercarpet":[{"type":"scattercarpet","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"carpet":[{"aaxis":{"endlinecolor":"#2a3f5f","gridcolor":"white","linecolor":"white","minorgridcolor":"white","startlinecolor":"#2a3f5f"},"baxis":{"endlinecolor":"#2a3f5f","gridcolor":"white","linecolor":"white","minorgridcolor":"white","startlinecolor":"#2a3f5f"},"type":"carpet"}],"table":[{"cells":{"fill":{"color":"#EBF0F8"},"line":{"color":"white"}},"header":{"fill":{"color":"#C8D4E3"},"line":{"color":"white"}},"type":"table"}],"barpolar":[{"marker":{"line":{"color":"#E5ECF6","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"barpolar"}],"pie":[{"automargin":true,"type":"pie"}]},"layout":{"autotypenumbers":"strict","colorway":["#636efa","#EF553B","#00cc96","#ab63fa","#FFA15A","#19d3f3","#FF6692","#B6E880","#FF97FF","#FECB52"],"font":{"color":"#2a3f5f"},"hovermode":"closest","hoverlabel":{"align":"left"},"paper_bgcolor":"white","plot_bgcolor":"#E5ECF6","polar":{"bgcolor":"#E5ECF6","angularaxis":{"gridcolor":"white","linecolor":"white","ticks":""},"radialaxis":{"gridcolor":"white","linecolor":"white","ticks":""}},"ternary":{"bgcolor":"#E5ECF6","aaxis":{"gridcolor":"white","linecolor":"white","ticks":""},"baxis":{"gridcolor":"white","linecolor":"white","ticks":""},"caxis":{"gridcolor":"white","linecolor":"white","ticks":""}},"coloraxis":{"colorbar":{"outlinewidth":0,"ticks":""}},"colorscale":{"sequential":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"sequentialminus":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"diverging":[[0,"#8e0152"],[0.1,"#c51b7d"],[0.2,"#de77ae"],[0.3,"#f1b6da"],[0.4,"#fde0ef"],[0.5,"#f7f7f7"],[0.6,"#e6f5d0"],[0.7,"#b8e186"],[0.8,"#7fbc41"],[0.9,"#4d9221"],[1,"#276419"]]},"xaxis":{"gridcolor":"white","linecolor":"white","ticks":"","title":{"standoff":15},"zerolinecolor":"white","automargin":true,"zerolinewidth":2},"yaxis":{"gridcolor":"white","linecolor":"white","ticks":"","title":{"standoff":15},"zerolinecolor":"white","automargin":true,"zerolinewidth":2},"scene":{"xaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2},"yaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2},"zaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2}},"shapedefaults":{"line":{"color":"#2a3f5f"}},"annotationdefaults":{"arrowcolor":"#2a3f5f","arrowhead":0,"arrowwidth":1},"geo":{"bgcolor":"white","landcolor":"#E5ECF6","subunitcolor":"white","showland":true,"showlakes":true,"lakecolor":"white"},"title":{"x":0.05},"mapbox":{"style":"light"}}},"xaxis":{"anchor":"y","domain":[0.0,0.445],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey","range":[-0.003,0.04]},"yaxis":{"anchor":"x","domain":[0.56,1.0],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey","title":{"font":{"size":16.5},"text":"\u0394\u003cspan style=\"font-size: 20px;\"\u003e\u003csub\u003eDP\u003c\u002fsub\u003e\u003c\u002fspan\u003e","standoff":0}},"xaxis2":{"anchor":"y2","domain":[0.555,1.0],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey"},"yaxis2":{"anchor":"x2","domain":[0.56,1.0],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey"},"xaxis3":{"anchor":"y3","domain":[0.0,0.445],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey","title":{"font":{"size":15},"text":"JSD","standoff":3}},"yaxis3":{"anchor":"x3","domain":[0.0,0.44],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey","title":{"font":{"size":16.5},"text":"\u0394\u003cspan style=\"font-size: 20px;\"\u003e\u003csub\u003eEO\u003c\u002fsub\u003e\u003c\u002fspan\u003e","standoff":0}},"xaxis4":{"anchor":"y4","domain":[0.555,1.0],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey","title":{"font":{"size":15},"text":"EMD","standoff":3}},"yaxis4":{"anchor":"x4","domain":[0.0,0.44],"tickfont":{"size":12},"mirror":true,"showgrid":true,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","showline":true,"linewidth":1,"linecolor":"darkgrey"},"font":{"size":14},"margin":{"l":30,"r":10,"t":20,"b":30},"autosize":false,"width":500,"height":345,"plot_bgcolor":"white"}, {"responsive": true} ) }; </script> </div>

Measurement between bias metrics and allocation gaps on the resume screening task. Each point represents a score measured between White Male and each of the other groups for a job position. ∆DP: demographic parity gap, ∆EO: equal opportunity gap.</div>

Metric Utility for Model Selection

We evaluate the utility of a metric for model selection by comparing the model fairness ranking derived from bias metrics to an ideal ranking. RABBI demonstrate the highest resemblance to ideal rankings based on the allocation gaps, as reported by the average normalized discounted cumulative gain (NDCG) at rank cutoff N.

Average NDCG@N in ranking model fairness, comparing to ideal rankings based on ∆DP.

We further compare the fairness ranking of models between different metrics for the resume screening task. RABBI’s ranking aligns more closely with the ranking based on the allocation gap, whereas other metrics tend to rank more biased models higher. This demonstrates the effectiveness of RABBI in selecting models that diminish potential harm.

<div class="column"> <script type="text/javascript">window.PlotlyConfig = {MathJaxConfig: 'local'};</script> <script charset="utf-8" src="https://cdn.plot.ly/plotly-2.31.1.min.js"></script> <div id="b73418fc-e0e2-49bb-a41b-ce05164e51b1" class="plotly-graph-div" style="height:265px; width:485px;"></div> <script type="text/javascript"> window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById("b73418fc-e0e2-49bb-a41b-ce05164e51b1")) { Plotly.newPlot( "b73418fc-e0e2-49bb-a41b-ce05164e51b1", [{"hovertext":["True rank: 1","True rank: 1","True rank: 1","True rank: 1"],"legendgroup":"1:Llama3-70B-IT","marker":{"color":"#025ea4","size":10.5},"mode":"markers","name":"1:Llama3-70B-IT","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[9.0,9.0,8.0,1.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 2","True rank: 2","True rank: 2","True rank: 2"],"legendgroup":"2:StableLM-Zephyr-3B","marker":{"color":"#427f8d","size":10.5},"mode":"markers","name":"2:StableLM-Zephyr-3B","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[10.0,5.0,10.0,2.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 3","True rank: 3","True rank: 3","True rank: 3"],"legendgroup":"3:Llama3-8B-IT","marker":{"color":"#55b26f","size":10.5},"mode":"markers","name":"3:Llama3-8B-IT","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[4.0,3.0,4.0,5.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 4","True rank: 4","True rank: 4","True rank: 4"],"legendgroup":"4:Llama2-7B-Chat","marker":{"color":"#00deb3","size":10.5},"mode":"markers","name":"4:Llama2-7B-Chat","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[8.0,4.0,9.0,3.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 5","True rank: 5","True rank: 5","True rank: 5"],"legendgroup":"5:StarlingLM-7B","marker":{"color":"#a6eca6","size":10.5},"mode":"markers","name":"5:StarlingLM-7B","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[7.0,10.0,7.0,4.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 6","True rank: 6","True rank: 6","True rank: 6"],"legendgroup":"6:TinyLlama-1.1B-Chat","marker":{"color":"#ffe642","size":10.5},"mode":"markers","name":"6:TinyLlama-1.1B-Chat","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[1.0,6.0,1.0,10.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 7","True rank: 7","True rank: 7","True rank: 7"],"legendgroup":"7:StableLM2-Zephyr-1.6B","marker":{"color":"#feb24a","size":10.5},"mode":"markers","name":"7:StableLM2-Zephyr-1.6B","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[6.0,8.0,6.0,7.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 8","True rank: 8","True rank: 8","True rank: 8"],"legendgroup":"8:Gemma-2B-IT","marker":{"color":"#f87c7a","size":10.5},"mode":"markers","name":"8:Gemma-2B-IT","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[5.0,7.0,5.0,8.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 9","True rank: 9","True rank: 9","True rank: 9"],"legendgroup":"9:Llama2-13B-Chat","marker":{"color":"#ce1c90","size":10.5},"mode":"markers","name":"9:Llama2-13B-Chat","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[2.0,2.0,2.0,6.0],"type":"scatter","xaxis":"x","yaxis":"y"},{"hovertext":["True rank: 10","True rank: 10","True rank: 10","True rank: 10"],"legendgroup":"10:Gemma-7B-IT","marker":{"color":"#b62e2e","size":10.5},"mode":"markers","name":"10:Gemma-7B-IT","showlegend":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[3.0,1.0,3.0,9.0],"type":"scatter","xaxis":"x","yaxis":"y"}], {"template":{"data":{"histogram2dcontour":[{"type":"histogram2dcontour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"choropleth":[{"type":"choropleth","colorbar":{"outlinewidth":0,"ticks":""}}],"histogram2d":[{"type":"histogram2d","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmap":[{"type":"heatmap","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmapgl":[{"type":"heatmapgl","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"contourcarpet":[{"type":"contourcarpet","colorbar":{"outlinewidth":0,"ticks":""}}],"contour":[{"type":"contour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"surface":[{"type":"surface","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"mesh3d":[{"type":"mesh3d","colorbar":{"outlinewidth":0,"ticks":""}}],"scatter":[{"fillpattern":{"fillmode":"overlay","size":10,"solidity":0.2},"type":"scatter"}],"parcoords":[{"type":"parcoords","line":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolargl":[{"type":"scatterpolargl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"bar":[{"error_x":{"color":"#2a3f5f"},"error_y":{"color":"#2a3f5f"},"marker":{"line":{"color":"#E5ECF6","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"bar"}],"scattergeo":[{"type":"scattergeo","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolar":[{"type":"scatterpolar","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"histogram":[{"marker":{"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"histogram"}],"scattergl":[{"type":"scattergl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatter3d":[{"type":"scatter3d","line":{"colorbar":{"outlinewidth":0,"ticks":""}},"marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattermapbox":[{"type":"scattermapbox","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterternary":[{"type":"scatterternary","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattercarpet":[{"type":"scattercarpet","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"carpet":[{"aaxis":{"endlinecolor":"#2a3f5f","gridcolor":"white","linecolor":"white","minorgridcolor":"white","startlinecolor":"#2a3f5f"},"baxis":{"endlinecolor":"#2a3f5f","gridcolor":"white","linecolor":"white","minorgridcolor":"white","startlinecolor":"#2a3f5f"},"type":"carpet"}],"table":[{"cells":{"fill":{"color":"#EBF0F8"},"line":{"color":"white"}},"header":{"fill":{"color":"#C8D4E3"},"line":{"color":"white"}},"type":"table"}],"barpolar":[{"marker":{"line":{"color":"#E5ECF6","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"barpolar"}],"pie":[{"automargin":true,"type":"pie"}]},"layout":{"autotypenumbers":"strict","colorway":["#636efa","#EF553B","#00cc96","#ab63fa","#FFA15A","#19d3f3","#FF6692","#B6E880","#FF97FF","#FECB52"],"font":{"color":"#2a3f5f"},"hovermode":"closest","hoverlabel":{"align":"left"},"paper_bgcolor":"white","plot_bgcolor":"#E5ECF6","polar":{"bgcolor":"#E5ECF6","angularaxis":{"gridcolor":"white","linecolor":"white","ticks":""},"radialaxis":{"gridcolor":"white","linecolor":"white","ticks":""}},"ternary":{"bgcolor":"#E5ECF6","aaxis":{"gridcolor":"white","linecolor":"white","ticks":""},"baxis":{"gridcolor":"white","linecolor":"white","ticks":""},"caxis":{"gridcolor":"white","linecolor":"white","ticks":""}},"coloraxis":{"colorbar":{"outlinewidth":0,"ticks":""}},"colorscale":{"sequential":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"sequentialminus":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"diverging":[[0,"#8e0152"],[0.1,"#c51b7d"],[0.2,"#de77ae"],[0.3,"#f1b6da"],[0.4,"#fde0ef"],[0.5,"#f7f7f7"],[0.6,"#e6f5d0"],[0.7,"#b8e186"],[0.8,"#7fbc41"],[0.9,"#4d9221"],[1,"#276419"]]},"xaxis":{"gridcolor":"white","linecolor":"white","ticks":"","title":{"standoff":15},"zerolinecolor":"white","automargin":true,"zerolinewidth":2},"yaxis":{"gridcolor":"white","linecolor":"white","ticks":"","title":{"standoff":15},"zerolinecolor":"white","automargin":true,"zerolinewidth":2},"scene":{"xaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2},"yaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2},"zaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2}},"shapedefaults":{"line":{"color":"#2a3f5f"}},"annotationdefaults":{"arrowcolor":"#2a3f5f","arrowhead":0,"arrowwidth":1},"geo":{"bgcolor":"white","landcolor":"#E5ECF6","subunitcolor":"white","showland":true,"showlakes":true,"lakecolor":"white"},"title":{"x":0.05},"mapbox":{"style":"light"}}},"xaxis":{"anchor":"y","domain":[0.0,1.0],"tickfont":{"size":14},"mirror":true,"showgrid":false,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey"},"yaxis":{"anchor":"x","domain":[0.0,1.0],"tickfont":{"size":14},"title":{"text":"Fairness Rank","standoff":2},"mirror":true,"showgrid":false,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","tickvals":[1,2,3,4,5,6,7,8,9,10],"autorange":"reversed"},"font":{"size":14},"margin":{"l":10,"r":12,"t":15,"b":3},"legend":{"y":0.99,"tracegroupgap":0.05},"barmode":"group","autosize":false,"width":485,"height":265,"plot_bgcolor":"rgb(242, 242, 242)","annotations":[{"ax":0,"ay":0,"font":{"size":15},"text":"True rank","x":1.3,"xref":"paper","y":1.02,"yref":"paper"}]}, {"responsive": true} ) }; </script> </div>
<div class="column"> <script type="text/javascript">window.PlotlyConfig = {MathJaxConfig: 'local'};</script> <script charset="utf-8" src="https://cdn.plot.ly/plotly-2.31.1.min.js"></script> <div id="3757f616-1ca2-43bc-959e-ee67d2bfeafb" class="plotly-graph-div" style="height:295px; width:485px;"></div> <script type="text/javascript"> window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById("3757f616-1ca2-43bc-959e-ee67d2bfeafb")) { Plotly.newPlot( "3757f616-1ca2-43bc-959e-ee67d2bfeafb", [{"hovertext":"True rank: 1","legendgroup":"1:Llama3-8B-IT","marker":{"color":"#025ea4","size":10.5},"mode":"markers","name":"1:Llama3-8B-IT","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[9.0,9.0,9.0,1.0],"type":"scatter"},{"hovertext":"True rank: 2","legendgroup":"2:TinyLlama-1.1B-Chat","marker":{"color":"#427f8d","size":10.5},"mode":"markers","name":"2:TinyLlama-1.1B-Chat","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[3.0,6.0,3.0,7.0],"type":"scatter"},{"hovertext":"True rank: 3","legendgroup":"3:Llama3-70B-IT","marker":{"color":"#55b26f","size":10.5},"mode":"markers","name":"3:Llama3-70B-IT","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[1.0,1.0,1.0,2.0],"type":"scatter"},{"hovertext":"True rank: 4","legendgroup":"4:Llama2-7B-Chat","marker":{"color":"#00deb3","size":10.5},"mode":"markers","name":"4:Llama2-7B-Chat","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[4.0,2.0,4.0,3.0],"type":"scatter"},{"hovertext":"True rank: 5","legendgroup":"5:StableLM-Zephyr-3B","marker":{"color":"#a6eca6","size":10.5},"mode":"markers","name":"5:StableLM-Zephyr-3B","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[6.0,4.0,6.0,4.0],"type":"scatter"},{"hovertext":"True rank: 6","legendgroup":"6:StarlingLM-7B","marker":{"color":"#ffe642","size":10.5},"mode":"markers","name":"6:StarlingLM-7B","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[7.0,7.0,7.0,5.0],"type":"scatter"},{"hovertext":"True rank: 7","legendgroup":"7:StableLM2-Zephyr-1.6B","marker":{"color":"#feb24a","size":10.5},"mode":"markers","name":"7:StableLM2-Zephyr-1.6B","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[8.0,8.0,8.0,8.0],"type":"scatter"},{"hovertext":"True rank: 8","legendgroup":"8:Llama2-13B-Chat","marker":{"color":"#f87c7a","size":10.5},"mode":"markers","name":"8:Llama2-13B-Chat","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[5.0,5.0,5.0,9.0],"type":"scatter"},{"hovertext":"True rank: 9","legendgroup":"9:Gemma-7B-IT","marker":{"color":"#ce1c90","size":10.5},"mode":"markers","name":"9:Gemma-7B-IT","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[2.0,3.0,2.0,6.0],"type":"scatter"},{"hovertext":"True rank: 10","legendgroup":"10:Gemma-2B-IT","marker":{"color":"#b62e2e","size":10.5},"mode":"markers","name":"10:Gemma-2B-IT","visible":true,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[10.0,10.0,10.0,10.0],"type":"scatter"},{"hovertext":"True rank: 1","legendgroup":"1:Llama3-70B-IT","marker":{"color":"#025ea4","size":10.5},"mode":"markers","name":"1:Llama3-70B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[9.0,10.0,9.0,5.0],"type":"scatter"},{"hovertext":"True rank: 2","legendgroup":"2:StableLM-Zephyr-3B","marker":{"color":"#427f8d","size":10.5},"mode":"markers","name":"2:StableLM-Zephyr-3B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[10.0,6.0,10.0,2.0],"type":"scatter"},{"hovertext":"True rank: 3","legendgroup":"3:Gemma-2B-IT","marker":{"color":"#55b26f","size":10.5},"mode":"markers","name":"3:Gemma-2B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[4.0,9.0,4.0,7.0],"type":"scatter"},{"hovertext":"True rank: 4","legendgroup":"4:StarlingLM-7B","marker":{"color":"#00deb3","size":10.5},"mode":"markers","name":"4:StarlingLM-7B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[6.0,5.0,8.0,3.0],"type":"scatter"},{"hovertext":"True rank: 5","legendgroup":"5:Llama3-8B-IT","marker":{"color":"#a6eca6","size":10.5},"mode":"markers","name":"5:Llama3-8B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[5.0,4.0,5.0,1.0],"type":"scatter"},{"hovertext":"True rank: 6","legendgroup":"6:StableLM2-Zephyr-1.6B","marker":{"color":"#ffe642","size":10.5},"mode":"markers","name":"6:StableLM2-Zephyr-1.6B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[7.0,8.0,6.0,6.0],"type":"scatter"},{"hovertext":"True rank: 7","legendgroup":"7:Llama2-7B-Chat","marker":{"color":"#feb24a","size":10.5},"mode":"markers","name":"7:Llama2-7B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[8.0,3.0,7.0,4.0],"type":"scatter"},{"hovertext":"True rank: 8","legendgroup":"8:TinyLlama-1.1B-Chat","marker":{"color":"#f87c7a","size":10.5},"mode":"markers","name":"8:TinyLlama-1.1B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[2.0,7.0,2.0,9.0],"type":"scatter"},{"hovertext":"True rank: 9","legendgroup":"9:Llama2-13B-Chat","marker":{"color":"#ce1c90","size":10.5},"mode":"markers","name":"9:Llama2-13B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[3.0,1.0,3.0,8.0],"type":"scatter"},{"hovertext":"True rank: 10","legendgroup":"10:Gemma-7B-IT","marker":{"color":"#b62e2e","size":10.5},"mode":"markers","name":"10:Gemma-7B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[1.0,2.0,1.0,10.0],"type":"scatter"},{"hovertext":"True rank: 1","legendgroup":"1:Llama3-70B-IT","marker":{"color":"#025ea4","size":10.5},"mode":"markers","name":"1:Llama3-70B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[1.0,4.0,1.0,1.0],"type":"scatter"},{"hovertext":"True rank: 2","legendgroup":"2:Llama3-8B-IT","marker":{"color":"#427f8d","size":10.5},"mode":"markers","name":"2:Llama3-8B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[7.0,1.0,7.0,3.0],"type":"scatter"},{"hovertext":"True rank: 3","legendgroup":"3:Llama2-7B-Chat","marker":{"color":"#55b26f","size":10.5},"mode":"markers","name":"3:Llama2-7B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[10.0,6.0,9.0,5.0],"type":"scatter"},{"hovertext":"True rank: 4","legendgroup":"4:StarlingLM-7B","marker":{"color":"#00deb3","size":10.5},"mode":"markers","name":"4:StarlingLM-7B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[9.0,10.0,10.0,2.0],"type":"scatter"},{"hovertext":"True rank: 5","legendgroup":"5:StableLM-Zephyr-3B","marker":{"color":"#a6eca6","size":10.5},"mode":"markers","name":"5:StableLM-Zephyr-3B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[3.0,8.0,3.0,6.0],"type":"scatter"},{"hovertext":"True rank: 6","legendgroup":"6:StableLM2-Zephyr-1.6B","marker":{"color":"#ffe642","size":10.5},"mode":"markers","name":"6:StableLM2-Zephyr-1.6B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[4.0,7.0,4.0,8.0],"type":"scatter"},{"hovertext":"True rank: 7","legendgroup":"7:Llama2-13B-Chat","marker":{"color":"#feb24a","size":10.5},"mode":"markers","name":"7:Llama2-13B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[6.0,3.0,6.0,4.0],"type":"scatter"},{"hovertext":"True rank: 8","legendgroup":"8:TinyLlama-1.1B-Chat","marker":{"color":"#f87c7a","size":10.5},"mode":"markers","name":"8:TinyLlama-1.1B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[5.0,9.0,5.0,10.0],"type":"scatter"},{"hovertext":"True rank: 9","legendgroup":"9:Gemma-2B-IT","marker":{"color":"#ce1c90","size":10.5},"mode":"markers","name":"9:Gemma-2B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[8.0,5.0,8.0,7.0],"type":"scatter"},{"hovertext":"True rank: 10","legendgroup":"10:Gemma-7B-IT","marker":{"color":"#b62e2e","size":10.5},"mode":"markers","name":"10:Gemma-7B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[2.0,2.0,2.0,9.0],"type":"scatter"},{"hovertext":"True rank: 1","legendgroup":"1:Llama3-70B-IT","marker":{"color":"#025ea4","size":10.5},"mode":"markers","name":"1:Llama3-70B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[3.0,3.0,3.0,2.0],"type":"scatter"},{"hovertext":"True rank: 2","legendgroup":"2:StableLM-Zephyr-3B","marker":{"color":"#427f8d","size":10.5},"mode":"markers","name":"2:StableLM-Zephyr-3B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[1.0,7.0,1.0,1.0],"type":"scatter"},{"hovertext":"True rank: 3","legendgroup":"3:Gemma-2B-IT","marker":{"color":"#55b26f","size":10.5},"mode":"markers","name":"3:Gemma-2B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[5.0,9.0,5.0,5.0],"type":"scatter"},{"hovertext":"True rank: 4","legendgroup":"4:TinyLlama-1.1B-Chat","marker":{"color":"#00deb3","size":10.5},"mode":"markers","name":"4:TinyLlama-1.1B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[4.0,6.0,4.0,6.0],"type":"scatter"},{"hovertext":"True rank: 5","legendgroup":"5:Llama2-7B-Chat","marker":{"color":"#a6eca6","size":10.5},"mode":"markers","name":"5:Llama2-7B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[10.0,10.0,10.0,3.0],"type":"scatter"},{"hovertext":"True rank: 6","legendgroup":"6:StableLM2-Zephyr-1.6B","marker":{"color":"#ffe642","size":10.5},"mode":"markers","name":"6:StableLM2-Zephyr-1.6B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[7.0,8.0,7.0,9.0],"type":"scatter"},{"hovertext":"True rank: 7","legendgroup":"7:Llama3-8B-IT","marker":{"color":"#feb24a","size":10.5},"mode":"markers","name":"7:Llama3-8B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[2.0,1.0,2.0,10.0],"type":"scatter"},{"hovertext":"True rank: 8","legendgroup":"8:Llama2-13B-Chat","marker":{"color":"#f87c7a","size":10.5},"mode":"markers","name":"8:Llama2-13B-Chat","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[6.0,2.0,6.0,4.0],"type":"scatter"},{"hovertext":"True rank: 9","legendgroup":"9:StarlingLM-7B","marker":{"color":"#ce1c90","size":10.5},"mode":"markers","name":"9:StarlingLM-7B","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[8.0,5.0,8.0,7.0],"type":"scatter"},{"hovertext":"True rank: 10","legendgroup":"10:Gemma-7B-IT","marker":{"color":"#b62e2e","size":10.5},"mode":"markers","name":"10:Gemma-7B-IT","visible":false,"x":["\u003cspan style=\"font-size: 17px;\"\u003e\u03b4\u003c\u002fspan\u003e","JSD","EMD","RABBI"],"y":[9.0,4.0,9.0,8.0],"type":"scatter"}], {"template":{"data":{"histogram2dcontour":[{"type":"histogram2dcontour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"choropleth":[{"type":"choropleth","colorbar":{"outlinewidth":0,"ticks":""}}],"histogram2d":[{"type":"histogram2d","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmap":[{"type":"heatmap","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"heatmapgl":[{"type":"heatmapgl","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"contourcarpet":[{"type":"contourcarpet","colorbar":{"outlinewidth":0,"ticks":""}}],"contour":[{"type":"contour","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"surface":[{"type":"surface","colorbar":{"outlinewidth":0,"ticks":""},"colorscale":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]]}],"mesh3d":[{"type":"mesh3d","colorbar":{"outlinewidth":0,"ticks":""}}],"scatter":[{"fillpattern":{"fillmode":"overlay","size":10,"solidity":0.2},"type":"scatter"}],"parcoords":[{"type":"parcoords","line":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolargl":[{"type":"scatterpolargl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"bar":[{"error_x":{"color":"#2a3f5f"},"error_y":{"color":"#2a3f5f"},"marker":{"line":{"color":"#E5ECF6","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"bar"}],"scattergeo":[{"type":"scattergeo","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterpolar":[{"type":"scatterpolar","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"histogram":[{"marker":{"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"histogram"}],"scattergl":[{"type":"scattergl","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatter3d":[{"type":"scatter3d","line":{"colorbar":{"outlinewidth":0,"ticks":""}},"marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattermapbox":[{"type":"scattermapbox","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scatterternary":[{"type":"scatterternary","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"scattercarpet":[{"type":"scattercarpet","marker":{"colorbar":{"outlinewidth":0,"ticks":""}}}],"carpet":[{"aaxis":{"endlinecolor":"#2a3f5f","gridcolor":"white","linecolor":"white","minorgridcolor":"white","startlinecolor":"#2a3f5f"},"baxis":{"endlinecolor":"#2a3f5f","gridcolor":"white","linecolor":"white","minorgridcolor":"white","startlinecolor":"#2a3f5f"},"type":"carpet"}],"table":[{"cells":{"fill":{"color":"#EBF0F8"},"line":{"color":"white"}},"header":{"fill":{"color":"#C8D4E3"},"line":{"color":"white"}},"type":"table"}],"barpolar":[{"marker":{"line":{"color":"#E5ECF6","width":0.5},"pattern":{"fillmode":"overlay","size":10,"solidity":0.2}},"type":"barpolar"}],"pie":[{"automargin":true,"type":"pie"}]},"layout":{"autotypenumbers":"strict","colorway":["#636efa","#EF553B","#00cc96","#ab63fa","#FFA15A","#19d3f3","#FF6692","#B6E880","#FF97FF","#FECB52"],"font":{"color":"#2a3f5f"},"hovermode":"closest","hoverlabel":{"align":"left"},"paper_bgcolor":"white","plot_bgcolor":"#E5ECF6","polar":{"bgcolor":"#E5ECF6","angularaxis":{"gridcolor":"white","linecolor":"white","ticks":""},"radialaxis":{"gridcolor":"white","linecolor":"white","ticks":""}},"ternary":{"bgcolor":"#E5ECF6","aaxis":{"gridcolor":"white","linecolor":"white","ticks":""},"baxis":{"gridcolor":"white","linecolor":"white","ticks":""},"caxis":{"gridcolor":"white","linecolor":"white","ticks":""}},"coloraxis":{"colorbar":{"outlinewidth":0,"ticks":""}},"colorscale":{"sequential":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"sequentialminus":[[0.0,"#0d0887"],[0.1111111111111111,"#46039f"],[0.2222222222222222,"#7201a8"],[0.3333333333333333,"#9c179e"],[0.4444444444444444,"#bd3786"],[0.5555555555555556,"#d8576b"],[0.6666666666666666,"#ed7953"],[0.7777777777777778,"#fb9f3a"],[0.8888888888888888,"#fdca26"],[1.0,"#f0f921"]],"diverging":[[0,"#8e0152"],[0.1,"#c51b7d"],[0.2,"#de77ae"],[0.3,"#f1b6da"],[0.4,"#fde0ef"],[0.5,"#f7f7f7"],[0.6,"#e6f5d0"],[0.7,"#b8e186"],[0.8,"#7fbc41"],[0.9,"#4d9221"],[1,"#276419"]]},"xaxis":{"gridcolor":"white","linecolor":"white","ticks":"","title":{"standoff":15},"zerolinecolor":"white","automargin":true,"zerolinewidth":2},"yaxis":{"gridcolor":"white","linecolor":"white","ticks":"","title":{"standoff":15},"zerolinecolor":"white","automargin":true,"zerolinewidth":2},"scene":{"xaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2},"yaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2},"zaxis":{"backgroundcolor":"#E5ECF6","gridcolor":"white","linecolor":"white","showbackground":true,"ticks":"","zerolinecolor":"white","gridwidth":2}},"shapedefaults":{"line":{"color":"#2a3f5f"}},"annotationdefaults":{"arrowcolor":"#2a3f5f","arrowhead":0,"arrowwidth":1},"geo":{"bgcolor":"white","landcolor":"#E5ECF6","subunitcolor":"white","showland":true,"showlakes":true,"lakecolor":"white"},"title":{"x":0.05},"mapbox":{"style":"light"}}},"font":{"size":14},"margin":{"l":10,"r":12,"t":40,"b":3},"legend":{"font":{"size":14},"title":{"font":{"size":14}},"y":0.99,"tracegroupgap":0.25},"barmode":"group","autosize":false,"width":485,"height":295,"plot_bgcolor":"rgb(242, 242, 242)","updatemenus":[{"active":0,"buttons":[{"args":[{"visible":[true,true,true,true,true,true,true,true,true,true,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false]}],"label":"HR_specialist","method":"update"},{"args":[{"visible":[false,false,false,false,false,false,false,false,false,false,true,true,true,true,true,true,true,true,true,true,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false]}],"label":"financial_analyst","method":"update"},{"args":[{"visible":[false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,true,true,true,true,true,true,true,true,true,true,false,false,false,false,false,false,false,false,false,false]}],"label":"retail","method":"update"},{"args":[{"visible":[false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,false,true,true,true,true,true,true,true,true,true,true]}],"label":"software_engineer","method":"update"}],"x":0.05,"xanchor":"left","y":1.18,"yanchor":"top"}],"xaxis":{"tickfont":{"size":14},"mirror":true,"showgrid":false,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey"},"yaxis":{"tickfont":{"size":14},"title":{"text":"Fairness Rank","standoff":1},"mirror":true,"showgrid":false,"gridcolor":"darkgrey","zeroline":true,"zerolinecolor":"darkgrey","tickvals":[1,2,3,4,5,6,7,8,9,10],"autorange":"reversed"},"annotations":[{"ax":0,"ay":0,"font":{"size":14},"text":"True rank","x":1.2,"xref":"paper","y":1.02,"yref":"paper"}]}, {"responsive": true} ) }; </script> </div>

Fairness ranking of models on the resume screening task. The true rank is based on ∆DP. (Left: overall ranking, Right: ranking per job position)</div>

Conclusion

Our analysis reveal that commonly-used bias metrics based on average performance gap and distribution distance are insufficient to assess allocational harms. We propose an allocational bias measure, which consistently demonstrates better correlations with group disparities in allocation outcomes. Our results underscore the importance of considering how models will be used in deployment to develop reliable auditing methods.

Paper: Hannah Chen, Yangfeng Ji, David Evans. The Mismeasure of Man and Models: Evaluating Allocational Harms in Large Language Models. In arXiv Preprint, 02 August 2024.

Code: https://github.com/hannahxchen/llm-allocational-harm-eval