{ "cells": [ { "cell_type": "markdown", "id": "cc27622d", "metadata": { "papermill": { "duration": 0.005109, "end_time": "2024-05-02T22:13:31.797081", "exception": false, "start_time": "2024-05-02T22:13:31.791972", "status": "completed" }, "tags": [] }, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "id": "c6edf4ef", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:13:31.807855Z", "iopub.status.busy": "2024-05-02T22:13:31.807374Z", "iopub.status.idle": "2024-05-02T22:13:35.303544Z", "shell.execute_reply": "2024-05-02T22:13:35.302676Z" }, "papermill": { "duration": 3.520728, "end_time": "2024-05-02T22:13:35.322506", "exception": false, "start_time": "2024-05-02T22:13:31.801778", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.utils.notebook.plotting: Please see\n", " (https://ax.dev/tutorials/visualizations.html#Fix-for-plots-that-are-not-rendering)\n", " if visualizations are not rendering.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient, ObjectiveProperties\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import init_notebook_plotting, render\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "id": "6f47df14", "metadata": { "papermill": { "duration": 0.034748, "end_time": "2024-05-02T22:13:35.394025", "exception": false, "start_time": "2024-05-02T22:13:35.359277", "status": "completed" }, "tags": [] }, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "id": "d877570b", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:13:35.465112Z", "iopub.status.busy": "2024-05-02T22:13:35.464411Z", "iopub.status.idle": "2024-05-02T22:13:35.468809Z", "shell.execute_reply": "2024-05-02T22:13:35.468229Z" }, "papermill": { "duration": 0.041533, "end_time": "2024-05-02T22:13:35.470126", "exception": false, "start_time": "2024-05-02T22:13:35.428593", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "id": "f4603ff6", "metadata": { "papermill": { "duration": 0.034575, "end_time": "2024-05-02T22:13:35.539606", "exception": false, "start_time": "2024-05-02T22:13:35.505031", "status": "completed" }, "tags": [] }, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objectives and outcome constraints). Note that:\n", "- Only `parameters`, and `objectives` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "id": "49b00550", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:13:35.610545Z", "iopub.status.busy": "2024-05-02T22:13:35.610046Z", "iopub.status.idle": "2024-05-02T22:13:35.622966Z", "shell.execute_reply": "2024-05-02T22:13:35.622309Z" }, "papermill": { "duration": 0.051374, "end_time": "2024-05-02T22:13:35.625724", "exception": false, "start_time": "2024-05-02T22:13:35.574350", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 12 trials, BoTorch for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objectives={\"hartmann6\": ObjectiveProperties(minimize=True)},\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "id": "95a301c7", "metadata": { "papermill": { "duration": 0.03517, "end_time": "2024-05-02T22:13:35.696381", "exception": false, "start_time": "2024-05-02T22:13:35.661211", "status": "completed" }, "tags": [] }, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objectives` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "id": "542cbdee", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:13:35.768895Z", "iopub.status.busy": "2024-05-02T22:13:35.768247Z", "iopub.status.idle": "2024-05-02T22:13:35.772750Z", "shell.execute_reply": "2024-05-02T22:13:35.772097Z" }, "papermill": { "duration": 0.042465, "end_time": "2024-05-02T22:13:35.774141", "exception": false, "start_time": "2024-05-02T22:13:35.731676", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "import numpy as np\n", "\n", "\n", "def evaluate(parameterization):\n", " x = np.array([parameterization.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x**2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "id": "61eaf710", "metadata": { "papermill": { "duration": 0.035259, "end_time": "2024-05-02T22:13:35.845026", "exception": false, "start_time": "2024-05-02T22:13:35.809767", "status": "completed" }, "tags": [] }, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "id": "1581a203", "metadata": { "papermill": { "duration": 0.035254, "end_time": "2024-05-02T22:13:35.915573", "exception": false, "start_time": "2024-05-02T22:13:35.880319", "status": "completed" }, "tags": [] }, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "id": "67bcdcf8", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:13:35.988292Z", "iopub.status.busy": "2024-05-02T22:13:35.987828Z", "iopub.status.idle": "2024-05-02T22:15:23.990702Z", "shell.execute_reply": "2024-05-02T22:15:23.990013Z" }, "papermill": { "duration": 108.087727, "end_time": "2024-05-02T22:15:24.038981", "exception": false, "start_time": "2024-05-02T22:13:35.951254", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:35] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.683048, 'x2': 0.650143, 'x3': 0.119252, 'x4': 0.288837, 'x5': 0.56801, 'x6': 0.991039} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.080797, 0.0), 'l2norm': (1.51383, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.356336, 'x2': 0.978032, 'x3': 0.00764, 'x4': 0.858375, 'x5': 0.081893, 'x6': 0.129771} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-1.093061, 0.0), 'l2norm': (1.357916, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.441238, 'x2': 0.964615, 'x3': 0.162928, 'x4': 0.098958, 'x5': 0.14974, 'x6': 0.723757} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.108989, 0.0), 'l2norm': (1.306812, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.619502, 'x2': 0.202555, 'x3': 0.289526, 'x4': 0.939453, 'x5': 0.721105, 'x6': 0.216677} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.006479, 0.0), 'l2norm': (1.39934, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.443013, 'x2': 0.879161, 'x3': 0.288397, 'x4': 0.497797, 'x5': 0.117522, 'x6': 0.530443} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.223665, 0.0), 'l2norm': (1.263068, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.728372, 'x2': 0.909787, 'x3': 0.556529, 'x4': 0.917842, 'x5': 0.422513, 'x6': 0.232883} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.096056, 0.0), 'l2norm': (1.656245, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.693003, 'x2': 0.649502, 'x3': 0.814413, 'x4': 0.856153, 'x5': 0.910842, 'x6': 0.399173} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.034878, 0.0), 'l2norm': (1.813103, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.942625, 'x2': 0.84833, 'x3': 0.677237, 'x4': 0.47833, 'x5': 0.558738, 'x6': 0.017199} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.021338, 0.0), 'l2norm': (1.614973, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.235669, 'x2': 0.341075, 'x3': 0.008389, 'x4': 0.355622, 'x5': 0.052378, 'x6': 0.206685} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.205231, 0.0), 'l2norm': (0.586406, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.361175, 'x2': 0.30193, 'x3': 0.993517, 'x4': 0.268016, 'x5': 0.439813, 'x6': 0.791396} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.994192, 0.0), 'l2norm': (1.449227, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.079403, 'x2': 0.839636, 'x3': 0.256346, 'x4': 0.107266, 'x5': 0.551899, 'x6': 0.29639} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.089359, 0.0), 'l2norm': (1.086716, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.125327, 'x2': 0.011482, 'x3': 0.78728, 'x4': 0.751094, 'x5': 0.703226, 'x6': 0.579849} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:36] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.069983, 0.0), 'l2norm': (1.424971, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:45] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.291886, 'x2': 0.802048, 'x3': 0.0, 'x4': 0.720476, 'x5': 0.064944, 'x6': 0.151729} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:45] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-1.590806, 0.0), 'l2norm': (1.129072, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:53] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.246646, 'x2': 0.761987, 'x3': 0.0, 'x4': 0.750669, 'x5': 0.013078, 'x6': 0.107559} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:13:53] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-1.227857, 0.0), 'l2norm': (1.103042, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:02] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.321154, 'x2': 0.825067, 'x3': 0.0, 'x4': 0.686749, 'x5': 0.112809, 'x6': 0.180487} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:02] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.775128, 0.0), 'l2norm': (1.140527, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:18] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.345251, 'x2': 0.873911, 'x3': 0.0, 'x4': 0.630584, 'x5': 0.118401, 'x6': 0.17155} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:18] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-2.197645, 0.0), 'l2norm': (1.150654, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:25] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.352053, 'x2': 0.914785, 'x3': 0.0, 'x4': 0.587442, 'x5': 0.083419, 'x6': 0.135297} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:25] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-2.554454, 0.0), 'l2norm': (1.153744, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:31] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.364501, 'x2': 0.958507, 'x3': 0.0, 'x4': 0.542167, 'x5': 0.051475, 'x6': 0.102869} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:31] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.67386, 0.0), 'l2norm': (1.165664, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:38] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.282416, 'x2': 0.98774, 'x3': 0.0, 'x4': 0.533095, 'x5': 0.056501, 'x6': 0.121097} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:38] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-1.955985, 0.0), 'l2norm': (1.165091, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:45] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.395849, 'x2': 0.899791, 'x3': 0.0, 'x4': 0.554687, 'x5': 0.042473, 'x6': 0.077705} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:45] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.992557, 0.0), 'l2norm': (1.132183, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:52] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.447521, 'x2': 0.877813, 'x3': 0.0, 'x4': 0.544158, 'x5': 0.029683, 'x6': 0.053453} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:52] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.948906, 0.0), 'l2norm': (1.127243, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:57] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.399964, 'x2': 0.873553, 'x3': 0.0, 'x4': 0.536346, 'x5': 0.071129, 'x6': 0.023534} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:14:58] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-3.026365, 0.0), 'l2norm': (1.102881, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:06] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.396877, 'x2': 0.862816, 'x3': 0.0, 'x4': 0.527773, 'x5': 0.0, 'x6': 0.036893} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:06] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.999803, 0.0), 'l2norm': (1.087138, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:13] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.405402, 'x2': 0.894451, 'x3': 0.0, 'x4': 0.574774, 'x5': 0.021515, 'x6': 0.014428} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:13] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-3.051731, 0.0), 'l2norm': (1.13817, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:23] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.405848, 'x2': 0.888468, 'x3': 0.048106, 'x4': 0.559529, 'x5': 0.032062, 'x6': 0.021989} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:23] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-3.073983, 0.0), 'l2norm': (1.12738, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameterization, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameterization))" ] }, { "cell_type": "markdown", "id": "c646fc65", "metadata": { "papermill": { "duration": 0.03858, "end_time": "2024-05-02T22:15:24.130349", "exception": false, "start_time": "2024-05-02T22:15:24.091769", "status": "completed" }, "tags": [] }, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "id": "8bae7ff3", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:24.209488Z", "iopub.status.busy": "2024-05-02T22:15:24.208836Z", "iopub.status.idle": "2024-05-02T22:15:24.215542Z", "shell.execute_reply": "2024-05-02T22:15:24.214899Z" }, "papermill": { "duration": 0.048015, "end_time": "2024-05-02T22:15:24.216967", "exception": false, "start_time": "2024-05-02T22:15:24.168952", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "id": "4d01ee31", "metadata": { "papermill": { "duration": 0.038248, "end_time": "2024-05-02T22:15:24.293664", "exception": false, "start_time": "2024-05-02T22:15:24.255416", "status": "completed" }, "tags": [] }, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "id": "98431e9b", "metadata": { "papermill": { "duration": 0.038273, "end_time": "2024-05-02T22:15:24.370241", "exception": false, "start_time": "2024-05-02T22:15:24.331968", "status": "completed" }, "tags": [] }, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "id": "d900faae", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:24.448812Z", "iopub.status.busy": "2024-05-02T22:15:24.448165Z", "iopub.status.idle": "2024-05-02T22:15:24.469208Z", "shell.execute_reply": "2024-05-02T22:15:24.468457Z" }, "papermill": { "duration": 0.061875, "end_time": "2024-05-02T22:15:24.470619", "exception": false, "start_time": "2024-05-02T22:15:24.408744", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:24] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
0GenerationStep_0Sobol0COMPLETED{'0_0': {'x1': 0.68, 'x2': 0.65, 'x3': 0.12, '...
1GenerationStep_0Sobol1COMPLETED{'1_0': {'x1': 0.36, 'x2': 0.98, 'x3': 0.01, '...
2GenerationStep_0Sobol2COMPLETED{'2_0': {'x1': 0.44, 'x2': 0.96, 'x3': 0.16, '...
3GenerationStep_0Sobol3COMPLETED{'3_0': {'x1': 0.62, 'x2': 0.2, 'x3': 0.29, 'x...
4GenerationStep_0Sobol4COMPLETED{'4_0': {'x1': 0.44, 'x2': 0.88, 'x3': 0.29, '...
5GenerationStep_0Sobol5COMPLETED{'5_0': {'x1': 0.73, 'x2': 0.91, 'x3': 0.56, '...
6GenerationStep_0Sobol6COMPLETED{'6_0': {'x1': 0.69, 'x2': 0.65, 'x3': 0.81, '...
7GenerationStep_0Sobol7COMPLETED{'7_0': {'x1': 0.94, 'x2': 0.85, 'x3': 0.68, '...
8GenerationStep_0Sobol8COMPLETED{'8_0': {'x1': 0.24, 'x2': 0.34, 'x3': 0.01, '...
9GenerationStep_0Sobol9COMPLETED{'9_0': {'x1': 0.36, 'x2': 0.3, 'x3': 0.99, 'x...
10GenerationStep_0Sobol10COMPLETED{'10_0': {'x1': 0.08, 'x2': 0.84, 'x3': 0.26, ...
11GenerationStep_0Sobol11COMPLETED{'11_0': {'x1': 0.13, 'x2': 0.01, 'x3': 0.79, ...
12GenerationStep_1BoTorch12COMPLETED{'12_0': {'x1': 0.29, 'x2': 0.8, 'x3': 0.0, 'x...
13GenerationStep_1BoTorch13COMPLETED{'13_0': {'x1': 0.25, 'x2': 0.76, 'x3': 0.0, '...
14GenerationStep_1BoTorch14COMPLETED{'14_0': {'x1': 0.32, 'x2': 0.83, 'x3': 0.0, '...
15GenerationStep_1BoTorch15COMPLETED{'15_0': {'x1': 0.35, 'x2': 0.87, 'x3': 0.0, '...
16GenerationStep_1BoTorch16COMPLETED{'16_0': {'x1': 0.35, 'x2': 0.91, 'x3': 0.0, '...
17GenerationStep_1BoTorch17COMPLETED{'17_0': {'x1': 0.36, 'x2': 0.96, 'x3': 0.0, '...
18GenerationStep_1BoTorch18COMPLETED{'18_0': {'x1': 0.28, 'x2': 0.99, 'x3': 0.0, '...
19GenerationStep_1BoTorch19COMPLETED{'19_0': {'x1': 0.4, 'x2': 0.9, 'x3': 0.0, 'x4...
20GenerationStep_1BoTorch20COMPLETED{'20_0': {'x1': 0.45, 'x2': 0.88, 'x3': 0.0, '...
21GenerationStep_1BoTorch21COMPLETED{'21_0': {'x1': 0.4, 'x2': 0.87, 'x3': 0.0, 'x...
22GenerationStep_1BoTorch22COMPLETED{'22_0': {'x1': 0.4, 'x2': 0.86, 'x3': 0.0, 'x...
23GenerationStep_1BoTorch23COMPLETED{'23_0': {'x1': 0.41, 'x2': 0.89, 'x3': 0.0, '...
24GenerationStep_1BoTorch24COMPLETED{'24_0': {'x1': 0.41, 'x2': 0.89, 'x3': 0.05, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 GenerationStep_0 Sobol 0 COMPLETED \n", "1 GenerationStep_0 Sobol 1 COMPLETED \n", "2 GenerationStep_0 Sobol 2 COMPLETED \n", "3 GenerationStep_0 Sobol 3 COMPLETED \n", "4 GenerationStep_0 Sobol 4 COMPLETED \n", "5 GenerationStep_0 Sobol 5 COMPLETED \n", "6 GenerationStep_0 Sobol 6 COMPLETED \n", "7 GenerationStep_0 Sobol 7 COMPLETED \n", "8 GenerationStep_0 Sobol 8 COMPLETED \n", "9 GenerationStep_0 Sobol 9 COMPLETED \n", "10 GenerationStep_0 Sobol 10 COMPLETED \n", "11 GenerationStep_0 Sobol 11 COMPLETED \n", "12 GenerationStep_1 BoTorch 12 COMPLETED \n", "13 GenerationStep_1 BoTorch 13 COMPLETED \n", "14 GenerationStep_1 BoTorch 14 COMPLETED \n", "15 GenerationStep_1 BoTorch 15 COMPLETED \n", "16 GenerationStep_1 BoTorch 16 COMPLETED \n", "17 GenerationStep_1 BoTorch 17 COMPLETED \n", "18 GenerationStep_1 BoTorch 18 COMPLETED \n", "19 GenerationStep_1 BoTorch 19 COMPLETED \n", "20 GenerationStep_1 BoTorch 20 COMPLETED \n", "21 GenerationStep_1 BoTorch 21 COMPLETED \n", "22 GenerationStep_1 BoTorch 22 COMPLETED \n", "23 GenerationStep_1 BoTorch 23 COMPLETED \n", "24 GenerationStep_1 BoTorch 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.68, 'x2': 0.65, 'x3': 0.12, '... \n", "1 {'1_0': {'x1': 0.36, 'x2': 0.98, 'x3': 0.01, '... \n", "2 {'2_0': {'x1': 0.44, 'x2': 0.96, 'x3': 0.16, '... \n", "3 {'3_0': {'x1': 0.62, 'x2': 0.2, 'x3': 0.29, 'x... \n", "4 {'4_0': {'x1': 0.44, 'x2': 0.88, 'x3': 0.29, '... \n", "5 {'5_0': {'x1': 0.73, 'x2': 0.91, 'x3': 0.56, '... \n", "6 {'6_0': {'x1': 0.69, 'x2': 0.65, 'x3': 0.81, '... \n", "7 {'7_0': {'x1': 0.94, 'x2': 0.85, 'x3': 0.68, '... \n", "8 {'8_0': {'x1': 0.24, 'x2': 0.34, 'x3': 0.01, '... \n", "9 {'9_0': {'x1': 0.36, 'x2': 0.3, 'x3': 0.99, 'x... \n", "10 {'10_0': {'x1': 0.08, 'x2': 0.84, 'x3': 0.26, ... \n", "11 {'11_0': {'x1': 0.13, 'x2': 0.01, 'x3': 0.79, ... \n", "12 {'12_0': {'x1': 0.29, 'x2': 0.8, 'x3': 0.0, 'x... \n", "13 {'13_0': {'x1': 0.25, 'x2': 0.76, 'x3': 0.0, '... \n", "14 {'14_0': {'x1': 0.32, 'x2': 0.83, 'x3': 0.0, '... \n", "15 {'15_0': {'x1': 0.35, 'x2': 0.87, 'x3': 0.0, '... \n", "16 {'16_0': {'x1': 0.35, 'x2': 0.91, 'x3': 0.0, '... \n", "17 {'17_0': {'x1': 0.36, 'x2': 0.96, 'x3': 0.0, '... \n", "18 {'18_0': {'x1': 0.28, 'x2': 0.99, 'x3': 0.0, '... \n", "19 {'19_0': {'x1': 0.4, 'x2': 0.9, 'x3': 0.0, 'x4... \n", "20 {'20_0': {'x1': 0.45, 'x2': 0.88, 'x3': 0.0, '... \n", "21 {'21_0': {'x1': 0.4, 'x2': 0.87, 'x3': 0.0, 'x... \n", "22 {'22_0': {'x1': 0.4, 'x2': 0.86, 'x3': 0.0, 'x... \n", "23 {'23_0': {'x1': 0.41, 'x2': 0.89, 'x3': 0.0, '... \n", "24 {'24_0': {'x1': 0.41, 'x2': 0.89, 'x3': 0.05, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "id": "b0af41c4", "metadata": { "papermill": { "duration": 0.038575, "end_time": "2024-05-02T22:15:24.547769", "exception": false, "start_time": "2024-05-02T22:15:24.509194", "status": "completed" }, "tags": [] }, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "id": "0d6887d1", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:24.627074Z", "iopub.status.busy": "2024-05-02T22:15:24.626582Z", "iopub.status.idle": "2024-05-02T22:15:25.108660Z", "shell.execute_reply": "2024-05-02T22:15:25.107904Z" }, "papermill": { "duration": 0.527958, "end_time": "2024-05-02T22:15:25.114539", "exception": false, "start_time": "2024-05-02T22:15:24.586581", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.40584802343161164,\n", " 'x2': 0.8884679320386826,\n", " 'x3': 0.04810614742342431,\n", " 'x4': 0.5595286786399037,\n", " 'x5': 0.032061937072302774,\n", " 'x6': 0.021988965574096745}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "id": "afa21de7", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:25.229196Z", "iopub.status.busy": "2024-05-02T22:15:25.228666Z", "iopub.status.idle": "2024-05-02T22:15:25.233947Z", "shell.execute_reply": "2024-05-02T22:15:25.233346Z" }, "papermill": { "duration": 0.060244, "end_time": "2024-05-02T22:15:25.235219", "exception": false, "start_time": "2024-05-02T22:15:25.174975", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 1.127380821811623, 'hartmann6': -3.0739734813182498}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means" ] }, { "cell_type": "markdown", "id": "7ae7d34c", "metadata": { "papermill": { "duration": 0.038923, "end_time": "2024-05-02T22:15:25.313221", "exception": false, "start_time": "2024-05-02T22:15:25.274298", "status": "completed" }, "tags": [] }, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "id": "76bc030b", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:25.392995Z", "iopub.status.busy": "2024-05-02T22:15:25.392458Z", "iopub.status.idle": "2024-05-02T22:15:25.397146Z", "shell.execute_reply": "2024-05-02T22:15:25.396559Z" }, "papermill": { "duration": 0.046387, "end_time": "2024-05-02T22:15:25.398497", "exception": false, "start_time": "2024-05-02T22:15:25.352110", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "id": "31ed98cf", "metadata": { "papermill": { "duration": 0.039303, "end_time": "2024-05-02T22:15:25.477271", "exception": false, "start_time": "2024-05-02T22:15:25.437968", "status": "completed" }, "tags": [] }, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "id": "43a28475", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:25.557224Z", "iopub.status.busy": "2024-05-02T22:15:25.556748Z", "iopub.status.idle": "2024-05-02T22:15:26.214784Z", "shell.execute_reply": "2024-05-02T22:15:26.214060Z" }, "papermill": { "duration": 0.702646, "end_time": "2024-05-02T22:15:26.219300", "exception": false, "start_time": "2024-05-02T22:15:25.516654", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:25] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.19596596291582435, -0.1913542519352176, -0.18699700017244414, -0.18295486998060184, -0.1792872352360404, -0.1760501561054002, -0.1732941814351956, -0.17106208721688554, -0.1693866919210516, -0.16828891412828573, -0.16777624873668318, -0.1678418297816533, -0.16846421750313412, -0.1696079952443812, -0.17122519276259585, -0.17325747503367328, -0.1756389603466335, -0.17829946914179207, -0.1811679641667483, -0.18417592781444259, -0.18726043434539674, -0.1903667096672086, -0.1934500234867571, -0.19647682090425733, -0.1994250659458201, -0.20228383208588108, -0.20505222964916459, -0.20773780346775594, -0.2103545637717399, -0.21292082753577213, -0.2154570460344285, -0.2179837780858198, -0.2205199396599562, -0.2230814227562823, -0.22568013421850597, -0.22832346330911446, -0.23101414988872726, -0.2337504963606789, -0.23652684806872748, -0.23933425886973714, -0.24216126001793814, -0.24499465918493946, -0.2478203098386318, -0.2506238067862523, -0.25339107931166693, -0.2561088674418204, -0.2587650785176261, -0.2613490300258563, -0.26385159059982843, -0.2662652345275982 ], [ -0.19203717638938933, -0.18726704619757273, -0.1827704416369167, -0.17861245405167891, -0.17485691598653608, -0.17156418929161465, -0.16878874421920886, -0.16657664732076483, -0.16496311461132152, -0.1639703171044058, -0.163605641041368, -0.1638605982439607, -0.1647105488854943, -0.16611533978772974, -0.1680208814913089, -0.1703615969423622, -0.17306358666988841, -0.17604828281810425, -0.17923631754728553, -0.1825513155288203, -0.18592333556745633, -0.18929172824476903, -0.19260723744154995, -0.19583324515564726, -0.19894613311299758, -0.20193480450220425, -0.20479946955046646, -0.2075498458721401, -0.21020295607946293, -0.2127807196835685, -0.21530753362407795, -0.2178080169529355, -0.22030506281456552, -0.22281829884906457, -0.22536301046367124, -0.22794953541146645, -0.23058309769305008, -0.23326401767709837, -0.2359882155546651, -0.23874791702799358, -0.2415324721541552, -0.2443292081246391, -0.24712425160904727, -0.2499032733452644, -0.2526521246006519, -0.2553573502954196, -0.258006575992342, -0.26058877523714163, -0.2630944299541005, -0.2655156001269603 ], [ -0.18820833519037694, -0.1832954320521174, -0.17867693371960303, -0.17442248704313967, -0.17060050191492593, -0.16727574335596107, -0.1645066742718413, -0.16234267611633912, -0.16082132046866326, -0.1599659021184343, -0.15978346474664562, -0.16026354532320286, -0.16137782745598583, -0.16308082683116476, -0.16531163970916274, -0.1679966802686259, -0.171053230126192, -0.174393539354879, -0.17792916495769928, -0.18157521617605799, -0.18525419573923219, -0.18889917621972252, -0.19245612178955196, -0.19588524767521798, -0.19916139314558, -0.20227346141892433, -0.20522304594324758, -0.2080224133500681, -0.2106920466624964, -0.213257966872054, -0.2157490467739409, -0.21819450929969508, -0.22062176635646824, -0.22305470770016256, -0.22551249806716944, -0.22800889049623185, -0.23055201982475926, -0.2331446067532752, -0.23578448177874134, -0.2384653298516819, -0.24117755926015927, -0.24390920929980986, -0.24664682759957812, -0.24937626650721945, -0.2520833662012185, -0.25475450842565284, -0.25737703793352695, -0.25993955851042094, -0.26243211695144764, -0.26484629200077836 ], [ -0.18451120400909482, -0.17947502815437377, -0.17475619999453862, -0.1704290190590323, -0.16656655324681147, -0.16323802603156, -0.16050591066395148, -0.15842286801081995, -0.1570287183275636, -0.15634768278780653, -0.15638615734210237, -0.1571312791017585, -0.15855050683746663, -0.160592361387508, -0.163188365712444, -0.16625610237764965, -0.1697031873233401, -0.1734318618847175, -0.17734384463175723, -0.18134506764638547, -0.18534994712368835, -0.1892848979116184, -0.19309088436154664, -0.19672489349755984, -0.20016031029631076, -0.20338626052910702, -0.20640605842125415, -0.20923495068591347, -0.2118973831833415, -0.21442403062548276, -0.21684882363198654, -0.21920618264053982, -0.22152862784118654, -0.22384488315999995, -0.22617853625777262, -0.2285472618453952, -0.23096256810424953, -0.23342998992578123, -0.23594963028311722, -0.23851694237854582, -0.24112364849271972, -0.24375870371142194, -0.24640923047182484, -0.24906136987401895, -0.2517010152772434, -0.25431441098944885, -0.2568886128275514, -0.2594118176301814, -0.26187357560601465, -0.26426490317208606 ], [ -0.18097929182145922, -0.17584353354680493, -0.17105041686611666, -0.16667895774973918, -0.1628069182912717, -0.15950798061937554, -0.1568485813472349, -0.15488455248795896, -0.15365777704772854, -0.1531931219624154, -0.15349594507067987, -0.154550473766087, -0.15631931172622893, -0.15874424482109117, -0.16174839571448119, -0.1652396357895678, -0.1691150255772471, -0.17326594363993864, -0.17758349599205037, -0.18196378136764046, -0.1863126197517173, -0.1905494226102924, -0.19460997919293055, -0.19844803976500325, -0.2020356814213391, -0.2053625362259741, -0.20843403893801016, -0.21126890908484874, -0.21389611787009444, -0.2163516037906712, -0.21867499244286193, -0.22090654771239837, -0.2230845368580452, -0.22524313602453283, -0.22741094180878219, -0.2296100954286826, -0.23185597495922994, -0.23415737255339497, -0.236517049865149, -0.2389325559989277, -0.2413971962112127, -0.24390105300784848, -0.24643198047143144, -0.24897651409754684, -0.25152065928313405, -0.25405053995092697, -0.25655290354812776, -0.2590154894980623, -0.2614272753122391, -0.2637786185095021 ], [ -0.1776475198945886, -0.17244036721155198, -0.16760382678701058, -0.16322165805896893, -0.15937630312833706, -0.15614583928032055, -0.15360054360198028, -0.15179922475837548, -0.15078554855441584, -0.15058464822735562, -0.15120035274669874, -0.15261337144405562, -0.15478072953756072, -0.15763665352567857, -0.16109496661269507, -0.16505289229618803, -0.16939600612922945, -0.17400394868381674, -0.1787564370317103, -0.18353909617492614, -0.18824867225491837, -0.19279727342085007, -0.19711539496710007, -0.20115360589275744, -0.20488289055717934, -0.20829374188834238, -0.2113941857297863, -0.21420697628415053, -0.21676623892582025, -0.21911384879227014, -0.2212958224606496, -0.22335896790577459, -0.22534798865497496, -0.22730317711126835, -0.2292587661963743, -0.2312419449823082, -0.2332724893558935, -0.2353629177722638, -0.23751905717012312, -0.23974089499392437, -0.24202359775477977, -0.24435859109855929, -0.246734616912464, -0.24913870584169007, -0.25155702571410465, -0.2539755857533008, -0.25638079200941966, -0.25875986083879776, -0.26110110475536596, -0.2633941091254093 ], [ -0.17455180659610492, -0.16930620959152498, -0.16446223748862887, -0.16010838122559412, -0.15633169340531117, -0.15321451139220854, -0.1508307431450122, -0.14924187985166126, -0.1484929808058073, -0.14860895097475613, -0.14959148330585026, -0.15141704771873843, -0.15403626260615422, -0.15737487801203098, -0.16133644192931307, -0.1658065357484353, -0.17065828398320182, -0.17575869929000887, -0.18097534000939652, -0.186182743316623, -0.1912681473384661, -0.1961361144938294, -0.20071179545859463, -0.20494270893144573, -0.20879904128037086, -0.2122725818116704, -0.21537449798620156, -0.21813221776752112, -0.22058572269661547, -0.22278356566341362, -0.22477891307382203, -0.2266258748119363, -0.22837633127944224, -0.23007740075786165, -0.23176961958812337, -0.23348583981138393, -0.2352507908144681, -0.2370812081476219, -0.23898640643626234, -0.2409691639281466, -0.24302679123808724, -0.24515227243852178, -0.24733538850875791, -0.2495637573347762, -0.2518237478047385, -0.2541012459602474, -0.2563822675213603, -0.25865342309861683, -0.260902250304613, -0.2631174313851248 ], [ -0.17172856912555012, -0.16648244482303665, -0.1616724041889126, -0.15739161781970723, -0.15373162046106725, -0.15077879633077917, -0.1486103782178123, -0.1472901334123764, -0.1468640010615445, -0.14735603189892377, -0.14876504297468607, -0.15106241544296317, -0.1541914151028636, -0.15806829693748137, -0.16258527662994626, -0.16761524109989123, -0.17301786440314437, -0.17864663287908278, -0.18435619148437388, -0.19000941184052267, -0.1954836443295287, -0.20067573214961598, -0.20550551037820064, -0.2099176652045014, -0.21388197036457735, -0.2173920384884651, -0.220462818906205, -0.22312713839257858, -0.2254316173115536, -0.2274323016908808, -0.22919033382478005, -0.23076794312816729, -0.23222497975949352, -0.23361614228628746, -0.23498897498372395, -0.23638263820742633, -0.23782739379633866, -0.23934470177031564, -0.2409477971060272, -0.24264260571892526, -0.24442886427100063, -0.24630132497635326, -0.24825094966016215, -0.2502660227796294, -0.252333137658709, -0.25443803162896694, -0.256566262955894, -0.25870373505886235, -0.2608370818914687, -0.26295393307149184 ], [ -0.16921414620329034, -0.164010506946769, -0.15928129687591008, -0.15512427531231143, -0.15163527025141255, -0.1489044167428284, -0.14701186203872552, -0.1460231197706956, -0.14598435727113834, -0.1469179982527109, -0.14881909539242755, -0.15165294882843683, -0.15535439604142454, -0.1598290676497327, -0.164956703354336, -0.17059638386587306, -0.1765933023723234, -0.1827865173059846, -0.189017028165545, -0.19513550856193929, -0.20100910567313135, -0.2065268493110619, -0.21160337840907806, -0.2161808622006567, -0.220229148717636, -0.22374430303197657, -0.22674579654932758, -0.22927267525173023, -0.231379069804432, -0.23312941563622713, -0.23459372898308017, -0.23584323901392223, -0.2369466115863934, -0.23796692360717864, -0.23895946636040089, -0.23997037980605374, -0.24103605509170634, -0.24218319460266358, -0.24342939019632537, -0.24478407031388238, -0.24624967255897134, -0.24782291576218696, -0.24949606976568983, -0.2512581478227369, -0.2530959722049708, -0.2549950860745709, -0.2569405027209002, -0.25891729657075624, -0.2609110492574087, -0.262908169132434 ], [ -0.16704415022115238, -0.16193113865171038, -0.15733526092011507, -0.15335873771790465, -0.15010144145664106, -0.14765687709896524, -0.1461075864395105, -0.14552016788523714, -0.14594021586988482, -0.14738759395644907, -0.14985253889884143, -0.153293120642217, -0.15763453044512787, -0.1627705252171976, -0.16856713256822609, -0.1748684535812728, -0.18150414007100002, -0.1882979212761371, -0.19507644718140082, -0.20167771304979887, -0.20795841956964423, -0.21379977709078313, -0.21911144781837866, -0.22383350753619236, -0.22793647774541692, -0.23141961812904133, -0.23430777300836092, -0.2366471333177973, -0.2385003091534621, -0.2399411096841395, -0.2410494003408008, -0.24190635586401932, -0.2425903575321231, -0.2431737008357715, -0.2437201943181393, -0.24428364981458173, -0.2449071964167422, -0.24562330044462088, -0.24645434388265453, -0.24741360347520813, -0.24850647891803113, -0.24973183680432776, -0.25108336224878625, -0.2525508379200534, -0.2541212970362974, -0.2557800203712568, -0.25751136624953963, -0.259299436552751, -0.2611285912143033, -0.2629838292200981 ], [ -0.16525276213660534, -0.16028357689027262, -0.15587908615815338, -0.1521458129173967, -0.14918736843182923, -0.1471001627873001, -0.1459685011012799, -0.14585926834135332, -0.14681652766581332, -0.1488564786356188, -0.15196331552810327, -0.1560865597495873, -0.16114038496646832, -0.16700529570178957, -0.17353227224844114, -0.18054919704666283, -0.1878690885568961, -0.19529944657939713, -0.20265189798825833, -0.20975133534588464, -0.2164438469183665, -0.22260291210838012, -0.22813354361791305, -0.23297426437526592, -0.23709699098335024, -0.2405050438596199, -0.2432296127712481, -0.24532507527928193, -0.24686359714975503, -0.24792944145996, -0.2486133808860993, -0.24900755031707722, -0.24920100060700978, -0.24927612652764197, -0.2493060514567944, -0.2493529668041008, -0.249467353242669, -0.24968795876836847, -0.2500423777030769, -0.2505480641994602, -0.25121362035080463, -0.25204021795808895, -0.25302303925353575, -0.254152650785916, -0.25541625260529943, -0.2567987694196654, -0.2582837702555312, -0.25985421798762887, -0.26149306020377217, -0.26318367891518224 ], [ -0.16387198713816242, -0.15910468558302004, -0.15495500675830165, -0.15153359185600968, -0.14894743476026306, -0.14729530665862223, -0.14666253596884116, -0.1471153591504526, -0.14869518926152847, -0.15141328134480547, -0.1552463775116837, -0.16013395370687933, -0.1659776315206518, -0.17264314610993292, -0.1799649884444614, -0.18775351162593035, -0.1958039728097669, -0.2039067401529313, -0.2118577727262505, -0.21946849199926155, -0.2265742869447407, -0.23304109279420704, -0.23876971355218624, -0.24369778479705873, -0.24779947190863028, -0.2510831569355043, -0.2535874806573264, -0.25537617593538964, -0.25653215754823866, -0.2571513266931704, -0.25733651003725666, -0.2571918892203089, -0.25681819381417315, -0.25630883700168106, -0.2557470776318529, -0.25520420376716624, -0.25473865900421244, -0.2543959789303545, -0.2542093731944033, -0.2542007778569546, -0.25438220953205715, -0.25475727247317037, -0.2553226969459379, -0.25606981720886957, -0.2569859264611811, -0.25805547171730825, -0.2592610724005635, -0.2605843621298882, -0.26200666398314465, -0.26350951613067597 ], [ -0.16293089340309108, -0.1584280610931592, -0.15460166100594464, -0.1515662521906569, -0.14943181325649313, -0.14829886182395002, -0.14825290813413106, -0.14935847354425258, -0.15165304444072647, -0.15514147394523548, -0.15979145611276868, -0.16553074044950655, -0.17224669163457684, -0.17978861188089534, -0.187972945297322, -0.19659112452553673, -0.20541947312021036, -0.21423031579533203, -0.22280332159064486, -0.2309361237553027, -0.23845340177282792, -0.24521383212397807, -0.2511145678863389, -0.25609315400917887, -0.26012699917740334, -0.2632306933527473, -0.2654515784389233, -0.266864049685577, -0.26756309169608294, -0.2676575405437922, -0.2672635183659322, -0.26649841541824837, -0.2654757044846363, -0.26430077239305083, -0.26306785251347486, -0.26185804956450776, -0.26073837143106227, -0.2597616270584575, -0.258967016762893, -0.2583812303267372, -0.2580198754404366, -0.2578890794000568, -0.25798713510094595, -0.2583060934219419, -0.25883323425552196, -0.25955237513950236, -0.2604449983010504, -0.26149119351142236, -0.26267042572689014, -0.2639621437229107 ], [ -0.16245485964360196, -0.15828314060302384, -0.154853045897813, -0.15228284623298238, -0.1506850772599828, -0.150161330375987, -0.15079636729916457, -0.15265180768821995, -0.15575978641656452, -0.1601171269897339, -0.16568069646848183, -0.17236465238745757, -0.180040223286285, -0.1885384610507217, -0.19765608004599833, -0.20716410918163164, -0.21681870896304511, -0.2263732263430258, -0.2355904286014352, -0.24425388498547385, -0.252177625060489, -0.25921344741164676, -0.26525552970873756, -0.27024225883444797, -0.2741554300540865, -0.27701714315861437, -0.27888484731523455, -0.27984505720019714, -0.28000628601044597, -0.2794917225251108, -0.27843212649667315, -0.2769593369238317, -0.27520068967935374, -0.273274533860145, -0.2712869297884457, -0.26932951497502655, -0.26747844504256046, -0.26579425943238943, -0.2643224883437645, -0.2630948063857028, -0.262130546078559, -0.26143840547153796, -0.2610182132657588, -0.2608626470012032, -0.26095883118980656, -0.2612897701227903, -0.2618355930089986, -0.26257460664830945, -0.2634841632402265, -0.2645413588260286 ], [ -0.1624648591376885, -0.158694346367507, -0.15573750533327413, -0.15371611821744846, -0.15274483474803224, -0.15292560608517114, -0.15434144411824668, -0.1570497782512159, -0.16107583555118188, -0.16640662610082435, -0.17298623823760995, -0.18071319278188036, -0.18944052839817194, -0.19897906983855584, -0.2091039828490726, -0.21956430246585734, -0.2300947221223466, -0.24042863570158546, -0.25031128973847183, -0.25951193967770814, -0.26783408290367827, -0.275123109462309, -0.28127101295089707, -0.28621809341014237, -0.2899518315211467, -0.29250330412329606, -0.29394164099877007, -0.29436709457275323, -0.2939033136138134, -0.2926893867058864, -0.29087215951484935, -0.2885992406449378, -0.28601300379505434, -0.28324577911379833, -0.2804163142306453, -0.2776274846287847, -0.27496515111769315, -0.2724980036702762, -0.2702781971288406, -0.2683425735646807, -0.26671427439952144, -0.2654045674608263, -0.26441474436928125, -0.26373797702263024, -0.2633610544925229, -0.2632659506992363, -0.26343119728269726, -0.26383305464147844, -0.2644464873664949, -0.2652459588932574 ], [ -0.16297680818617333, -0.15968029953342366, -0.15727679204262812, -0.15589139810333963, -0.15564044000215582, -0.15662549353632538, -0.1589267714834297, -0.16259614694011293, -0.16765027567829072, -0.1740644365066455, -0.18176783235226845, -0.19064113515067982, -0.20051696988516277, -0.21118379450032565, -0.22239326027801565, -0.23387069407352823, -0.2453279219522404, -0.2564773446850872, -0.2670460385031872, -0.27678870059635186, -0.285498455896543, -0.2930148331571516, -0.29922854436963275, -0.30408301350818556, -0.3075728665811599, -0.30973979878560054, -0.31066637159011856, -0.3104683654727358, -0.3092863295137738, -0.30727693586526206, -0.30460467516467626, -0.30143432879404286, -0.2979245365134249, -0.29422265452734186, -0.2904609800783111, -0.2867543134664363, -0.283198743989002, -0.2798714867582517, -0.27683156356015437, -0.2741211107983994, -0.27176710686326366, -0.2697833345056859, -0.26817242530651675, -0.26692786802363044, -0.2660358964731342, -0.26547720291810895, -0.26522844816568125, -0.265263559168186, -0.26555481906333256, -0.26607376390017157 ], [ -0.16400100519760863, -0.16125313545952125, -0.1594852417108421, -0.15882561762185454, -0.1593918363776048, -0.1612843654371805, -0.16457954865586788, -0.16932228960543716, -0.17551893333620372, -0.18313100518459047, -0.19207058640439123, -0.20219813888858162, -0.21332348951649593, -0.2252104262933743, -0.23758496275508656, -0.2501468601583581, -0.2625835556066527, -0.2745853238654319, -0.2858603626274441, -0.2961485464288951, -0.3052328091286387, -0.312947429242143, -0.31918284333180313, -0.32388694843817634, -0.32706314081159316, -0.3287655569044474, -0.3290921280003707, -0.32817613442314486, -0.32617695633932686, -0.3232706759190511, -0.31964110178799676, -0.3154716738088139, -0.31093857697613103, -0.30620525988655567, -0.3014184270310116, -0.2967054643338305, -0.2921731705801738, -0.2879076071491855, -0.2839748451037698, -0.2804223796448533, -0.27728099262824046, -0.2745668686015341, -0.2722838028671113, -0.2704253762762512, -0.2689770067730426, -0.2679178193676319, -0.26722230266286107, -0.26686174071695157, -0.2668054240551292, -0.26702165366622754 ], [ -0.16554168285834203, -0.1634179481788518, -0.16236909289304502, -0.162526488847488, -0.1640085777476632, -0.166914013354992, -0.17131421124635993, -0.17724568028885845, -0.18470267674009277, -0.19363088242530724, -0.20392292346977836, -0.2154165665184269, -0.22789631008248, -0.24109880867802436, -0.2547221486088407, -0.26843850588805696, -0.2819092590031669, -0.29480130000318616, -0.3068031495581971, -0.3176395462550201, -0.3270834120632822, -0.33496443289546707, -0.3411738696502842, -0.34566557644957674, -0.3484535116608596, -0.3496062631716882, -0.3492392648217931, -0.3475054577119998, -0.3445851562087272, -0.3406758256194009, -0.33598238071182374, -0.3307084864075347, -0.32504919887935335, -0.3191851406520647, -0.3132782689911746, -0.3074691821345754, -0.3018758189315647, -0.29659334700285056, -0.29169500219778266, -0.2872336347740345, -0.28324373036260075, -0.2797437005066523, -0.27673827248363536, -0.2742208460540938, -0.27217572167775583, -0.2705801378215238, -0.26940608268029553, -0.26862186735852234, -0.2681934634676373, -0.26808561880368664 ], [ -0.1675966903253414, -0.16617238506993814, -0.1659259785532352, -0.1669918764956828, -0.16948906570622002, -0.17351373518074942, -0.17913135662264557, -0.18636864576110468, -0.19520599525929438, -0.20557112756718032, -0.2173348214296147, -0.2303095699476707, -0.2442518874303461, -0.25886867849039175, -0.2738276409559679, -0.28877116639266953, -0.3033327305983984, -0.3171544306162877, -0.3299041880653899, -0.3412912120993651, -0.351078563275967, -0.35909201914503275, -0.36522484550113554, -0.36943846642865763, -0.3717593607668973, -0.37227276857319713, -0.37111395865689845, -0.3684578879896683, -0.36450808414999913, -0.35948551656713645, -0.3536181079258236, -0.3471313915558645, -0.3402406612956407, -0.3331448026427506, -0.3260218506105279, -0.3190261997901447, -0.3122873011795573, -0.3059096202679583, -0.29997360031985365, -0.2945373699197671, -0.28963894911442467, -0.2852987377376075, -0.28152210670545386, -0.2783019530136024, -0.27562111781172316, -0.2734546015184529, -0.2717715389099358, -0.27053691989501094, -0.2697130584367309, -0.26926082342616886 ], [ -0.17015731556172975, -0.16950640453628107, -0.17014460511256968, -0.17220938329826918, -0.17582002565170662, -0.18106968639592447, -0.18801695576301136, -0.19667742525932108, -0.20701589724930902, -0.21894003903486658, -0.23229637407538584, -0.2468694868494099, -0.26238515195001333, -0.2785177678603006, -0.29490201035524066, -0.3111480945460625, -0.3268595516088302, -0.3416520855576589, -0.3551719403934971, -0.3671122900248931, -0.3772264271201352, -0.38533690940559295, -0.3913402534580742, -0.3952071862033272, -0.3969788283306258, -0.39675946351748825, -0.3947067294023793, -0.3910201496408716, -0.385928919902334, -0.37967978019440185, -0.37252567158514205, -0.36471570878017656, -0.35648682156853406, -0.3480572454051237, -0.3396218878403984, -0.3313494721625774, -0.323381267129748, -0.3158311527639823, -0.308786744384004, -0.30231129558792613, -0.2964461196454571, -0.2912133011925433, -0.2866185100854055, -0.2826537715373374, -0.2793000872300404, -0.2765298382576753, -0.2743089310112994, -0.27259867090556256, -0.27135736637243246, -0.27054167745639135 ], [ -0.1732082505007011, -0.17340220040501086, -0.17500462386911853, -0.17815615456293132, -0.18297622914544864, -0.1895545037945916, -0.1979418613557291, -0.2081415461605045, -0.220101137605911, -0.233706220290689, -0.24877668540465137, -0.26506655792218314, -0.28226804920231197, -0.3000201751909606, -0.3179217899905473, -0.3355483407385047, -0.35247115632794035, -0.3682777379351153, -0.38259138621677113, -0.3950885902119633, -0.4055128821942252, -0.4136842686530672, -0.41950380998713555, -0.42295337677169065, -0.4240910089451947, -0.4230426122890443, -0.4199909262268384, -0.4151627848292554, -0.4088156780887249, -0.40122452170192346, -0.3926693852028261, -0.383424736460685, -0.37375055959001635, -0.3638855131932678, -0.35404213099736526, -0.34440393604409814, -0.33512424615511693, -0.3263263916750274, -0.31810504262615136, -0.31052834549811603, -0.30364059309145897, -0.2974651872140148, -0.2920076972935992, -0.28725886290096536, -0.28319743085174487, -0.27979275536569803, -0.2770071212749581, -0.2747977750173103, -0.2731186663599181, -0.27192191617292716 ], [ -0.17672769447408587, -0.17783428788230782, -0.18047668887854607, -0.18479889507368874, -0.19092045455730244, -0.19892719230814349, -0.20886160122427877, -0.22071350296211922, -0.23441176066774672, -0.24981796569149717, -0.2667230797482445, -0.2848479467656764, -0.3038483611033802, -0.3233249869396788, -0.34283790609142306, -0.3619250088839231, -0.3801229387529107, -0.3969889528304268, -0.41212192921025737, -0.4251808491615138, -0.43589937694339687, -0.444095590572961, -0.4496764135260781, -0.45263679314783867, -0.453054110926174, -0.4510786519998419, -0.44692118230254163, -0.4408387748950393, -0.43312000177185206, -0.42407048599696007, -0.4139996213268119, -0.40320904439780303, -0.3919832170557589, -0.380582266323799, -0.36923705221345937, -0.3581462971848772, -0.3474755175410047, -0.3373574438141559, -0.3278935986825713, -0.3191567099284309, -0.3111936647041049, -0.30402875254430195, -0.2976669917101964, -0.2920973814016523, -0.2872959673305058, -0.28322864764632527, -0.2798536789425823, -0.27712386767375663, -0.27498845109277825, -0.2733946845326811 ], [ -0.180687585087574, -0.18276973829926857, -0.18652268622315438, -0.19209408056828758, -0.1996036651601243, -0.2091332506877457, -0.22071642921184043, -0.23432870806231443, -0.24987892357316754, -0.2672029285540676, -0.28606058815419977, -0.306137022135442, -0.3270487681596037, -0.3483551128412459, -0.3695742896533619, -0.39020365913914656, -0.40974247104677664, -0.4277154546482914, -0.44369535229278556, -0.45732261497084736, -0.4683207877473212, -0.47650656988227214, -0.4817940696412253, -0.48419331708843205, -0.4838035866891782, -0.4808024653978875, -0.4754318489890166, -0.4679821486551645, -0.4587759512979348, -0.4481522274064298, -0.4364519568995262, -0.42400578489534146, -0.4111240606998158, -0.39808938047959685, -0.38515156333212297, -0.3725248489135411, -0.36038701240418325, -0.3488800444904183, -0.3381120325635757, -0.3281598957155021, -0.31907266165707937, -0.3108750205570372, -0.30357094243666305, -0.29714719607773254, -0.29157665479700223, -0.28682131564668323, -0.28283499248990807, -0.27956566973987473, -0.27695752275603724, -0.2749526237983482 ], [ -0.18505394116599305, -0.1881685444554091, -0.1930961132117468, -0.1999883386165675, -0.20896537536630477, -0.2201050023026856, -0.23343159523806967, -0.24890567168668176, -0.26641495360589507, -0.285768022130618, -0.30669166028986883, -0.32883285211419566, -0.3517661044409839, -0.37500629023253973, -0.3980266306413267, -0.42028082516621346, -0.44122780892177293, -0.46035725553294726, -0.4772138110030044, -0.49141815154196977, -0.5026832809745992, -0.51082496811317, -0.515765803585473, -0.5175329553536638, -0.516250250505366, -0.5121256459074297, -0.5054354292453599, -0.49650659812292963, -0.4856988090163903, -0.473387103179554, -0.4599463491620732, -0.44573803959428104, -0.4310997847671426, -0.4163375870371595, -0.40172077506640025, -0.387479330949939, -0.37380325370131284, -0.36084356160675146, -0.3487145334986209, -0.3374968144850028, -0.32724105533928105, -0.3179718082701095, -0.3096914585243147, -0.3023840262976596, -0.29601872338780866, -0.2905531919217814, -0.2859363874292147, -0.2821110954589945, -0.27901609039806985, -0.27658795808368697 ], [ -0.18978730001488997, -0.19398409573970077, -0.20014258323123824, -0.20841897080283567, -0.21893417292001804, -0.23176209466613518, -0.24691779406728442, -0.26434636688532476, -0.28391359268821237, -0.30539950515298053, -0.3284960536561681, -0.3528098640128142, -0.37787076306826006, -0.40314622099381814, -0.42806124533446555, -0.45202262461616394, -0.47444587094091495, -0.4947828399314902, -0.5125478675231488, -0.5273403707840305, -0.5388621936437485, -0.5469284921495452, -0.5514715833710022, -0.5525378497037036, -0.5502784122378602, -0.5449347852143887, -0.5368210415614714, -0.526304133134266, -0.5137839307637043, -0.4996743203098839, -0.48438636960730386, -0.46831422700880176, -0.45182407476400155, -0.435246173361286, -0.41886981324366845, -0.40294084122744345, -0.38766134435219957, -0.3731910425056474, -0.35964994998169453, -0.34712190258485565, -0.3356586000735795, -0.32528387484484833, -0.315997960161569, -0.30778159023134233, -0.30059981704580707, -0.2944054734210644, -0.2891422475289147, -0.2847473615416716, -0.2811538665390252, -0.27829257859657 ], [ -0.19484323124685154, -0.20016374262002734, -0.2076004329959975, -0.21731459001140552, -0.2294283679326765, -0.24401213589659232, -0.26107175880847744, -0.28053674423267716, -0.30225039339561777, -0.3259632174948299, -0.3513308684915686, -0.37791764293319907, -0.4052062313105518, -0.4326138276637176, -0.45951405164592807, -0.4852634661933434, -0.5092309033109154, -0.530827424327116, -0.549534590780654, -0.5649288235174712, -0.5766999676219424, -0.584662723782528, -0.588760294240357, -0.5890603415237694, -0.5857440713706189, -0.5790898284723882, -0.569452959491179, -0.5572438191279443, -0.5429056866505397, -0.5268940756843448, -0.5096585327606009, -0.49162760379842785, -0.4731972614669884, -0.45472276789285193, -0.43651371288863183, -0.4188318176290132, -0.40189101686449225, -0.38585931382454497, -0.3708619245746746, -0.3569852779946603, -0.3442815016499946, -0.3327730934416786, -0.32245754749637845, -0.31331176596813437, -0.3052961436824464, -0.2983582586111595, -0.2924361377495479, -0.28746109549983534, -0.2833601610442533, -0.2800581236010944 ], [ -0.20017291168041007, -0.20664943336039254, -0.2154014135497644, -0.2265958529541483, -0.24035674815773844, -0.2567514474627772, -0.27577697938450174, -0.2973473785366232, -0.3212832522507916, -0.34730495666116734, -0.3750307255142551, -0.4039808738915567, -0.4335887689019715, -0.46321865150422614, -0.49218968423074405, -0.5198048934344539, -0.5453830774309227, -0.5682913450637818, -0.5879757796862154, -0.6039878089239394, -0.6160041989440374, -0.6238391628894778, -0.6274478276956326, -0.6269211544309433, -0.6224732344673434, -0.6144225594913365, -0.6031692876347039, -0.5891706565421191, -0.5729165463241352, -0.5549068406119795, -0.5356317660633556, -0.5155559008448695, -0.49510610087230256, -0.4746632403762957, -0.45455741540104366, -0.43506611019125463, -0.41641476079125905, -0.39877914699436634, -0.38228908293694996, -0.3670329410280494, -0.3530626203142109, -0.34039864932455843, -0.32903518861160697, -0.31894476574489117, -0.3100826333800131, -0.3023906884498335, -0.29580092762825916, -0.2902384417191761, -0.2856239706292374, -0.2818760524252877 ], [ -0.20572374990472708, -0.21337841137010272, -0.22347145379481392, -0.23617627784850148, -0.2516194325358385, -0.2698659285834575, -0.290904546105212, -0.31463425402025735, -0.3408530946910908, -0.3692510189227741, -0.3994081209513042, -0.4307994733225381, -0.46280728688593875, -0.49474046071237554, -0.5258608271525799, -0.5554146506422072, -0.5826673110442464, -0.6069386682072205, -0.6276364045038183, -0.644284697035277, -0.6565458952739702, -0.664233475330409, -0.6673153741100426, -0.6659077817435788, -0.6602604405807629, -0.6507352975935138, -0.6377808521895411, -0.6219046754915065, -0.6036463770130746, -0.58355285190983, -0.5621570763698439, -0.539961142727181, -0.5174237217982242, -0.49495175234357114, -0.47289589782245567, -0.4515491672457562, -0.43114804662690354, -0.4118755037985191, -0.3938652879642307, -0.37720702678385054, -0.36195171378716784, -0.34811726789009034, -0.33569392884226024, -0.32464932433468285, -0.31493310483572756, -0.30648109080097985, -0.29921891428039116, -0.29306516416850226, -0.28793406274275846, -0.2837377121991753 ], [ -0.21144005432262447, -0.22028396849788057, -0.2317314943663673, -0.24596314883109183, -0.26310882988179696, -0.2832320461847313, -0.30631414117458333, -0.33223972166054727, -0.36078475803654597, -0.3916089655111037, -0.42425403424302965, -0.45814900044833495, -0.49262353178814, -0.5269291861747207, -0.5602678915332916, -0.5918261052607205, -0.6208124507594968, -0.6464961595209425, -0.6682434021849315, -0.6855485961343155, -0.6980580685722024, -0.7055840676333222, -0.708108036152435, -0.7057731913411521, -0.6988676023098592, -0.6877999085156945, -0.6730704023394339, -0.6552403349588249, -0.6349020356839351, -0.6126518823284393, -0.5890674769752728, -0.5646897056826415, -0.5400097877505702, -0.5154609965882226, -0.49141446581567894, -0.46817836086237186, -0.4459996661163006, -0.4250678774158767, -0.40551997068432544, -0.3874461179133245, -0.3708957264100904, -0.35588347676312315, -0.3423951240619484, -0.3303929030724033, -0.3198204406699521, -0.3106071282989069, -0.302671944603468, -0.29592674505826744, -0.2902790529831001, -0.28563439640802657 ], [ -0.21726374396151793, -0.22729625671370135, -0.2400983988675911, -0.25585852041646184, -0.27471072431849297, -0.29671798253102466, -0.32185522307204617, -0.34999368868527714, -0.3808881494598919, -0.41416870926236926, -0.44933890277917854, -0.4857814813954101, -0.5227727249336438, -0.5595053487752744, -0.5951192126923689, -0.6287382074066689, -0.6595109984963912, -0.6866527950683927, -0.7094850011813751, -0.7274695337820628, -0.7402348241470318, -0.7475911421020964, -0.7495339093762229, -0.7462349870989458, -0.7380232942445557, -0.7253572529523312, -0.7087922369610221, -0.6889463308642395, -0.6664673487652528, -0.642003372445283, -0.6161782459983631, -0.5895726740120779, -0.5627109229209448, -0.5360526664112044, -0.5099892431660479, -0.48484347756878177, -0.4608722092082669, -0.43827074443746905, -0.4171785495473209, -0.3976856262572003, -0.3798391305361347, -0.3636499061898877, -0.34909870072501215, -0.33614191122056225, -0.32471677250845543, -0.31474595000819483, -0.30614153664593147, -0.2988084791653913, -0.292647475624332, -0.2875573947757304 ], [ -0.22313510611171505, -0.23434316672091748, -0.24848595723401723, -0.265760345074312, -0.28630552120836783, -0.3101849875338356, -0.33736846669345244, -0.36771512146313823, -0.40095978058899184, -0.4367040450719183, -0.47441410910332626, -0.5134268127013742, -0.5529648425605643, -0.5921611794486069, -0.6300919790210193, -0.6658162048212045, -0.6984196011784343, -0.7270600285536728, -0.7510107855279808, -0.7696983531303708, -0.7827311388987559, -0.7899164162115571, -0.7912638048856871, -0.7869751925291237, -0.7774226443379305, -0.763117216998038, -0.7446723883248668, -0.7227659310132282, -0.6981035831216201, -0.6713870133275194, -0.6432875915470371, -0.6144265574666692, -0.5853614532677862, -0.556578195473353, -0.5284878900297093, -0.5014273994013752, -0.4756626968489792, -0.4513941423430685, -0.42876294886744937, -0.4078582511988308, -0.3887243257738521, -0.3713676316336353, -0.355763445300456, -0.341861946382781, -0.3295936768831953, -0.3188743474653948, -0.309609000424772, -0.30169556392346863, -0.29502784725273123, -0.28949803444084155 ], [ -0.22899360796948942, -0.24135128588757881, -0.25680600074421167, -0.2755637528403252, -0.2977696944695021, -0.3234889913672241, -0.3526875324185781, -0.3852139550796353, -0.4207847942560392, -0.45897476319313046, -0.49921414335517544, -0.5407949296383237, -0.5828867423593318, -0.6245626540828587, -0.6648341264905911, -0.7026933538235284, -0.7371605460257183, -0.7673330554170796, -0.7924327329291753, -0.8118475521977505, -0.8251635484285653, -0.8321837172900737, -0.8329318155194806, -0.8276408471243728, -0.8167280059228186, -0.8007594874338352, -0.7804095092144873, -0.7564179656751716, -0.7295505190078952, -0.7005638731422407, -0.670177800462241, -0.6390544316877658, -0.6077845119533486, -0.5768798067203926, -0.5467705794950254, -0.5178069976822779, -0.490263386340717, -0.4643443847565215, -0.44019222536409175, -0.41789452114003933, -0.39749210060389273, -0.378986561719141, -0.36234732526078484, -0.3475180554423267, -0.3344223829661098, -0.3229689158190572, -0.3130555587303083, -0.30457318572333025, -0.2974087239234471, -0.29144771283872295 ], [ -0.23477877011742243, -0.24824694842458728, -0.2649696485837818, -0.2851625120863839, -0.3089774761646491, -0.3364825327827119, -0.36764123677047056, -0.4022935020970143, -0.44013959779501466, -0.4807294829702913, -0.5234596019655237, -0.5675789228133692, -0.6122053401253119, -0.6563526638916936, -0.698967432323367, -0.7389738684482752, -0.7753245083219483, -0.8070533219839827, -0.8333274741276363, -0.8534933105384952, -0.8671119829317651, -0.8739806859107746, -0.8741369498688485, -0.867845627442033, -0.8555706067510755, -0.8379352495279884, -0.8156766202163735, -0.7895986085721611, -0.7605282379760515, -0.7292781601149918, -0.6966169444820525, -0.6632475594421026, -0.6297935533816041, -0.596791903643286, -0.5646912570166962, -0.5338542573458619, -0.5045627619870886, -0.47702492341531244, -0.45138330898570234, -0.42772342232698823, -0.4060821592394499, -0.38645587348425037, -0.36880784299538705, -0.3530750170379634, -0.3391739929523778, -0.32700622079812014, -0.3164624686326667, -0.3074266031660897, -0.2997787526299205, -0.29339792314123603 ], [ -0.24043110730465278, -0.25495738723218175, -0.2728887009433538, -0.29445069392275935, -0.31980282055659104, -0.3490170474744938, -0.38205618367175453, -0.4187534365086275, -0.4587951978617286, -0.5017093222595167, -0.5468611586110381, -0.5934592593479111, -0.6405720117945977, -0.6871555135216981, -0.7320920148051102, -0.7742373272049707, -0.8124747815573435, -0.8457725182954374, -0.8732400191645235, -0.8941789536813269, -0.9081230038741543, -0.9148618373138455, -0.914446075494322, -0.9071727206359881, -0.8935533837899434, -0.8742699929488529, -0.8501238771507309, -0.8219840819646415, -0.7907397341406516, -0.7572597072183048, -0.7223612092041888, -0.6867875413518283, -0.6511943111277568, -0.616142828733923, -0.5820991997137704, -0.5494376430441907, -0.5184467181631401, -0.4893373611856434, -0.462251860500385, -0.4372731163602892, -0.4144337144097042, -0.39372449530234455, -0.3751024229214256, -0.35849764590002786, -0.3438197155468872, -0.3309629721324856, -0.31981114449472403, -0.3102412282463869, -0.302126718217131, -0.29534027351211045 ], [ -0.24589313638910149, -0.2614119890046174, -0.28047718300406177, -0.30332454866503866, -0.3301216567286587, -0.36094553807179763, -0.3957598872973719, -0.43439339524855547, -0.4765212922651616, -0.5216524725907933, -0.5691245930594623, -0.618109210458484, -0.6676283392571891, -0.7165828822592375, -0.7637923922123545, -0.8080447089523655, -0.8481531808531664, -0.8830182652015173, -0.9116891796315251, -0.9334200996992646, -0.9477146954399825, -0.9543532367902068, -0.9533984203912564, -0.9451791839131479, -0.9302552143702885, -0.9093676084936209, -0.8833825111290994, -0.8532344083083356, -0.8198744434726736, -0.7842272489580535, -0.7471578960195736, -0.709449030250491, -0.671787221672674, -0.6347570021202075, -0.5988408822684509, -0.5644237096147626, -0.5317999348124484, -0.5011826146820144, -0.47271324376223633, -0.44647174417796, -0.4224861440675819, -0.4007416358819146, -0.38118883069657283, -0.3637511184753528, -0.3483311124894609, -0.33481620382392485, -0.32308328329290337, -0.313002706604367, -0.3044415871468784, -0.297266501790737 ], [ -0.25111044270423455, -0.2675436423197284, -0.2876530281907046, -0.3116845817790148, -0.3398144168220153, -0.3721256133003952, -0.40858437565505956, -0.44901718930273016, -0.49309111529353367, -0.5402996827026545, -0.5899568886402129, -0.6412015066313702, -0.6930132345827336, -0.744241300234938, -0.7936451746420461, -0.839946158522204, -0.8818877514348478, -0.9183016608601074, -0.9481748843143103, -0.9707117123316513, -0.9853834530329035, -0.991959037272104, -0.9905118741602076, -0.9814020129939787, -0.9652367395910967, -0.9428159392152102, -0.9150700710393702, -0.8829983061155893, -0.8476127603168064, -0.8098925358531213, -0.7707491241159024, -0.7310030225455026, -0.6913703177238281, -0.65245743789608, -0.6147621432319855, -0.5786789488759524, -0.5445074367955685, -0.5124622182296323, -0.4826836052270749, -0.4552483102004572, -0.4301797069397557, -0.40745735549112283, -0.3870256218420901, -0.36880131819946405, -0.352680357395484, -0.3385434613233095, -0.32626099294413935, -0.31569699805749263, -0.3067125497202805, -0.29916848749747293 ], [ -0.2560327852286388, -0.2732901534801777, -0.2943398689478065, -0.31943779020897356, -0.34876879276036044, -0.38242284073169164, -0.4203702108445263, -0.4624375524437683, -0.5082869578930669, -0.5574005673323624, -0.6090733140982995, -0.6624161397974773, -0.7163713721265614, -0.7697410872052475, -0.8212283636522495, -0.8694904935639389, -0.9132023376178785, -0.951126789626245, -0.9821875366836876, -1.0055372464233503, -1.0206128785996575, -1.027170096734248, -1.0252912981717601, -1.0153661070731883, -0.998047936596739, -0.9741939075253125, -0.944797055247043, -0.9109192855063395, -0.8736315706634468, -0.8339652961772075, -0.7928762279017727, -0.7512207126919962, -0.709742571965429, -0.6690686167136601, -0.6297106301309147, -0.5920718523477881, -0.556456318714496, -0.5230797532384638, -0.49208104736569924, -0.4635336358145675, -0.43745630845828587, -0.41382317307902994, -0.3925726153201533, -0.37361519756577144, -0.3568405054092486, -0.34212299521799194, -0.32932692413005626, -0.31831045859503204, -0.30892906246102925, -0.30103826323726146 ], [ -0.26061520894222556, -0.2785956883798686, -0.30046888105516256, -0.3264999905997439, -0.35688263626941086, -0.3917143093060119, -0.4309708022245794, -0.47448128348005403, -0.5219061992541681, -0.572720561319724, -0.6262052984919496, -0.6814491174362114, -0.7373627399971208, -0.7927065844338782, -0.8461321228653578, -0.8962363611527154, -0.9416279756355184, -0.9810022149360711, -1.013219490065605, -1.0373800042243928, -1.0528849270259244, -1.0594748262045146, -1.0572389844121983, -1.0465942455523463, -1.0282375230653935, -1.0030802678517095, -0.9721749510001452, -0.9366429363215543, -0.8976107760762617, -0.8561590064421323, -0.8132848045938522, -0.7698778632614791, -0.7267076446978361, -0.6844196712088878, -0.6435384843051958, -0.604475155776648, -0.567537606162227, -0.5329423788284731, -0.5008268763418937, -0.4712613666313987, -0.44426030508013503, -0.41979270037413496, -0.397791385748119, -0.3781611528411536, -0.36078577129430345, -0.3455339604817679, -0.3322644057965307, -0.32082992487862216, -0.31108089234613945, -0.30286802764484966 ], [ -0.26481912118952255, -0.283412182715731, -0.3059806058858032, -0.332798142188083, -0.3640668795523787, -0.39989225005417894, -0.4402568291995881, -0.4849945656067832, -0.5337676009338782, -0.5860482411526596, -0.6411087990943469, -0.6980218568676314, -0.7556730012637254, -0.8127873883273191, -0.867970763088015, -0.9197648370975371, -0.9667159620518633, -1.0074543686750776, -1.0407786071712004, -1.0657367093969312, -1.0816933320722875, -1.0883722994086398, -1.0858672807734908, -1.0746190709212526, -1.0553641611194218, -1.029063926554698, -0.9968256030305956, -0.9598253170354848, -0.919240710257671, -0.8761973723673646, -0.8317303180358341, -0.7867596040510453, -0.7420779579219777, -0.698347816628035, -0.6561052076235914, -0.6157682168750442, -0.5776482132839812, -0.5419624311444745, -0.5088468979869245, -0.47836901321267755, -0.4505393314836693, -0.42532229145878486, -0.40264576606063207, -0.38240940594208617, -0.36449181265200603, -0.3487566197056007, -0.3350575840919656, -0.32324280203600586, -0.31315816442679223, -0.3046501619478146 ], [ -0.268613279470582, -0.28770064980494126, -0.3108266571624183, -0.3382725431796606, -0.37024832242734473, -0.40686752274159266, -0.4481205390310691, -0.4938481833749929, -0.5437175391935253, -0.5972026484087075, -0.6535727633761593, -0.7118907996313392, -0.7710242394608972, -0.8296701728270465, -0.8863955585958567, -0.9396931278820652, -0.9880523083612959, -1.0300425978357912, -1.0644037068496788, -1.090133129912122, -1.1065591555143706, -1.1133874660652863, -1.1107132136662072, -1.0989968939431654, -1.0790092639314355, -1.0517556250844708, -1.0183917072933042, -0.9801422474691861, -0.9382302640887435, -0.8938213529406223, -0.847984110219212, -0.8016655311249891, -0.755678985606186, -0.7107019339262063, -0.667280634162849, -0.6258394632971839, -0.5866929457250927, -0.5500590507125283, -0.5160727300793085, -0.48479900049123104, -0.45624513182933235, -0.43037169388720686, -0.4071023506475179, -0.38633238668175773, -0.36793601400844234, -0.3517725480339865, -0.33769156400115063, -0.32553715516277304, -0.3151514141048912, -0.3063772520133736 ], [ -0.27197463252850684, -0.2914323074078715, -0.3149712077973439, -0.34287876435514086, -0.37537211138532345, -0.4125727492170772, -0.4544796501493482, -0.5009423135182559, -0.5516357964186208, -0.6060401832751847, -0.6634272077503252, -0.7228567347444168, -0.7831855582411087, -0.8430905676118843, -0.9011078733622491, -0.9556888759267841, -1.0052731084697268, -1.0483754190508932, -1.0836814658132214, -1.1101413262450865, -1.127048037416794, -1.1340880449499984, -1.1313546837531803, -1.1193229023828564, -1.0987910000435883, -1.0708006039969418, -1.036548077584014, -0.9972991883274296, -0.9543154399320135, -0.9087964862027211, -0.8618396152226799, -0.8144149336278815, -0.7673536175024267, -0.7213461884396417, -0.6769479119894883, -0.6345888345995352, -0.5945864882579208, -0.5571597899941428, -0.5224430936508638, -0.4904996972240837, -0.46133437340696537, -0.4349046852936592, -0.4111309874119853, -0.3899051074024905, -0.3710977665913825, -0.354564836811591, -0.34015255235269826, -0.3277018044688689, -0.31705164492505866, -0.3080421173913821 ], [ -0.27488895626748033, -0.29458944418497324, -0.3183921508732339, -0.3465891808937124, -0.3794037313737303, -0.416964866770816, -0.45928057990226256, -0.5062105486702257, -0.5574405075611836, -0.6124606010988612, -0.6705503869899736, -0.7307732533023041, -0.791982916244515, -0.8528444422404037, -0.9118719249570065, -0.9674843784454759, -1.0180801130943584, -1.0621272578849932, -1.0982640347626587, -1.1253977698989392, -1.1427883861839898, -1.1501023418072522, -1.1474275022207805, -1.1352470793809821, -1.1143788543731128, -1.0858916698292973, -1.0510131754306615, -1.0110412671563251, -0.9672679611512189, -0.9209202037319687, -0.8731185168596216, -0.8248519367917436, -0.7769664250396643, -0.7301635462691606, -0.6850063850174887, -0.6419301310021538, -0.6012553085114221, -0.5632021476293666, -0.5279050419481636, -0.4954263938399317, -0.46576941880001566, -0.4388896777924921, -0.41470524592787983, -0.39310552100240925, -0.37395873779143096, -0.35711829223882596, -0.3424280002556208, -0.3297264234430053, -0.31885039222154066, -0.3096378483796767 ], [ -0.27735123171458653, -0.2971659538429743, -0.32108183827181236, -0.3493939750574432, -0.38233034495089646, -0.42002689045607944, -0.462500732187359, -0.5096228285752863, -0.5610918692100948, -0.6164116482437255, -0.6748745171022669, -0.7355537235113223, -0.797307513548974, -0.858797840844661, -0.9185263590663868, -0.9748898206030905, -1.026255540070085, -1.0710546348091592, -1.1078862755745538, -1.135621204050265, -1.153489373195696, -1.161136881793218, -1.1586422132416192, -1.1464898590203014, -1.125507873207121, -1.096781900813858, -1.0615602487122329, -1.0211629002087026, -0.9769034808885516, -0.9300287609098138, -0.8816765481494719, -0.8328503188054615, -0.7844076361319646, -0.7370590353431793, -0.6913742543793248, -0.6477931744845267, -0.6066394032034003, -0.5681349723840103, -0.5324150832479831, -0.4995421953058138, -0.46951903141039164, -0.44230027146973083, -0.41780284804602574, -0.3959148526375641, -0.37650312362966787, -0.3594196246922825, -0.344506742393208, -0.3316016387905154, -0.3205397923512321, -0.3111578515418798 ], [ -0.27936572397610515, -0.29916748072636423, -0.32304732102535416, -0.3513015087058322, -0.38416134626790643, -0.42176871293513585, -0.46414962635227164, -0.51118700396287, -0.5625942706211956, -0.6178919206895807, -0.6763895487766692, -0.7371761862021585, -0.7991220216815317, -0.8608947405495537, -0.9209936798950173, -0.9778044354168423, -1.029674903063617, -1.0750104647006067, -1.1123811984812584, -1.1406287775783666, -1.1589572639158228, -1.1669924384625354, -1.1647993783046475, -1.1528563206441071, -1.131991539169257, -1.1032960872726816, -1.0680273196486691, -1.0275163835369039, -0.9830888801846931, -0.9360033727146585, -0.8874086054722681, -0.8383177425203012, -0.7895966149796585, -0.7419625913938063, -0.695990894677709, -0.6521256853938605, -0.610693811981311, -0.5719196791434665, -0.5359401533831833, -0.5028187954394331, -0.47255898901766413, -0.445115738057582, -0.4204060470189869, -0.39831789501505144, -0.37871787710422433, -0.3614576238413578, -0.3463791300168587, -0.3333191302697023, -0.322112656585138, -0.31259590343598664 ], [ -0.2809457381499616, -0.3006111435131631, -0.3243100457372332, -0.3523380038183308, -0.3849280469633565, -0.4222268315704544, -0.4642687217440452, -0.5109488420239644, -0.5619965975131694, -0.6169516223642295, -0.6751445757595487, -0.7356856409505403, -0.7974639900587156, -0.8591618073013689, -0.919286534015608, -0.9762244047161412, -1.028316497170634, -1.0739549576333598, -1.1116919792323214, -1.1403487815267248, -1.1591084268906902, -1.1675768737407477, -1.165801859670828, -1.1542476157577621, -1.1337321430099703, -1.1053399477456456, -1.0703252272808754, -1.0300188054457626, -0.985748134437787, -0.9387751404378331, -0.8902528501418222, -0.841199145289742, -0.7924846465029126, -0.7448313330867317, -0.6988187044475577, -0.6548947813761057, -0.6133898271325594, -0.5745312219148125, -0.538458395915746, -0.5052371006649801, -0.4748725811568605, -0.44732141658907, -0.4225019415734438, -0.40030325726358296, -0.38059290512411126, -0.36322331434234134, -0.348037153990688, -0.3348717279572061, -0.32356254806696927, -0.31394621160831937 ], [ -0.28211304888918765, -0.3015248316457495, -0.3249049985340564, -0.3525465175743656, -0.38468247285052226, -0.42146296965551644, -0.4629298861973119, -0.5089903933144038, -0.559390585863556, -0.6136910385934704, -0.6712466069908269, -0.7311933357641711, -0.7924458944241517, -0.8537094378925266, -0.9135099382046166, -0.9702463860856072, -1.0222662323261762, -1.0679616503839582, -1.105878975307378, -1.1348283602832203, -1.1539774131643952, -1.1629132627113838, -1.1616627057046385, -1.150668389446339, -1.1307275861547568, -1.1029062250060861, -1.0684429867226777, -1.028656682693799, -0.9848662703548612, -0.9383283911056812, -0.8901935003772361, -0.8414790550853621, -0.7930568452499056, -0.7456511268235101, -0.6998443831529244, -0.6560880157123175, -0.6147158354531757, -0.5759587749869024, -0.539959712580641, -0.5067876746782081, -0.4764509685820525, -0.44890900452201543, -0.42408271242061246, -0.4018635579312172, -0.38212122691350603, -0.36471008676845096, -0.3494745538922708, -0.3362535039663843, -0.32488385963087807, -0.3152034812217246 ], [ -0.2828970226409424, -0.30194609923877325, -0.32487932802185493, -0.3519852508811885, -0.38349531760964195, -0.4195616437372701, -0.4602325620899046, -0.5054267675995959, -0.5549072542359645, -0.6082567151562697, -0.664856629362488, -0.7238728925586858, -0.7842515314920354, -0.8447286336993995, -0.9038588164527861, -0.96006584413026, -1.0117168185097623, -1.0572174300139288, -1.0951205070879417, -1.1242349235950215, -1.1437188484124492, -1.1531421106096957, -1.1525075473571673, -1.1422292300999415, -1.1230737814742393, -1.0960769613166188, -1.0624498870312171, -1.0234878510173424, -0.9804910371944859, -0.9347021312333293, -0.8872620789487464, -0.8391826494043921, -0.7913330460467964, -0.7444373305942891, -0.6990795492203519, -0.6557138891109182, -0.614677741472569, -0.5762060831423539, -0.5404460539003466, -0.507470980838058, -0.4772933869348108, -0.4498767305069198, -0.42514577047630264, -0.40299555374382157, -0.383299087320246, -0.36591379858191764, -0.3506869090233081, -0.3374598552749545, -0.32607188975231405, -0.3163629850712333 ], [ -0.2833334731062713, -0.30192071014234223, -0.32429051713670054, -0.3507252795988095, -0.38145316485992387, -0.4166268122001776, -0.4562997884897032, -0.5004014966944577, -0.5487116036666059, -0.6008355285881953, -0.6561831229251512, -0.7139533810354282, -0.7731287956914124, -0.8324836401504555, -0.8906106606369051, -0.9459698752421126, -0.9969608747324585, -1.0420160251350146, -1.0797068126952276, -1.1088506339897035, -1.1286025092757757, -1.1385170563284441, -1.1385709421476669, -1.1291436382492257, -1.110962203891377, -1.0850215667909309, -1.0524940015751834, -1.0146403391566658, -0.9727320706426416, -0.9279894357056656, -0.8815369730886289, -0.8343754431545561, -0.7873675866531619, -0.7412346464779869, -0.6965606440627118, -0.6538017920012879, -0.6132989385302919, -0.5752914547589766, -0.5399314294815336, -0.5072974061624775, -0.47740718184284414, -0.45022939858382927, -0.4256938085298648, -0.4037001973554424, -0.38412601940131996, -0.36683284039925657, -0.3516717072636145, -0.3384875741327146, -0.32712291353427414, -0.3174206342437391 ], [ -0.28346330883693915, -0.3015009123841419, -0.32320420624581536, -0.3488478402592289, -0.3786551452940268, -0.41277781168578564, -0.45127332960699373, -0.49408077963585284, -0.540995923743678, -0.5916470237301072, -0.6454734316852938, -0.7017097575229961, -0.7593792525988867, -0.8173007500727193, -0.8741136855946248, -0.9283248632716097, -0.978378264731238, -1.0227452349893604, -1.0600274156400964, -1.0890601777040738, -1.1090017587703573, -1.119394201183987, -1.1201867666803582, -1.1117195790275496, -1.094672623032599, -1.069990687150974, -1.0387970985198536, -1.0023082022099161, -0.9617575190685712, -0.9183347396916468, -0.8731412755425241, -0.8271615769877991, -0.7812479572437293, -0.7361160601284382, -0.6923481037667701, -0.6504013619708373, -0.6106198148798332, -0.5732473870703122, -0.5384416289556868, -0.5062870592327563, -0.4768076688043158, -0.4499782979799217, -0.4257347511658396, -0.40398261938634816, -0.3846048519698745, -0.3674681635496, -0.352428388033886, -0.33933490254865417, -0.3280342454434644, -0.3183730463418972 ], [ -0.2833310451684332, -0.3007435377237122, -0.32169179278609694, -0.34644133198902827, -0.3752092345382061, -0.4081448388316179, -0.4453082265875643, -0.486646993806349, -0.5319721608568196, -0.5809345509648546, -0.6330036012050441, -0.6874513594331337, -0.7433452784996287, -0.7995541172677542, -0.8547713981688561, -0.9075599518439439, -0.956418698697081, -0.9998689691730529, -1.0365529836151557, -1.0653328691230002, -1.0853763273173769, -1.0962159552787087, -1.097773434334269, -1.090346269470194, -1.0745615453663198, -1.0513062850248662, -1.0216462680022427, -0.9867445509340727, -0.9477883058352585, -0.9059291592571814, -0.862238996688216, -0.8176807698771422, -0.7730923616322776, -0.7291808986218353, -0.6865248201346686, -0.645581271101634, -0.6066968045907521, -0.5701198297502817, -0.5360136570992909, -0.5044693436094781, -0.47551781803076054, -0.44914097761780913, -0.4252816012592465, -0.4038520324891325, -0.38474165942609895, -0.36782326596029913, -0.3529583562190738, -0.34000156761434364, -0.3288042905311688, -0.3192176080453484 ] ], "zauto": true, "zmax": 1.1675768737407477, "zmin": -1.1675768737407477 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.6948235718918542, 0.6923971584374794, 0.6898831691612487, 0.6873241746331002, 0.6847706691767009, 0.6822794845993663, 0.6799113450884438, 0.6777276216573604, 0.675786472029189, 0.6741386844198834, 0.6728236543228964, 0.6718659821232766, 0.6712731617770805, 0.6710347273012136, 0.6711230457502642, 0.6714957243775598, 0.6720993797352477, 0.6728743409121207, 0.6737597581937698, 0.6746985721994826, 0.6756418573014673, 0.6765521640965063, 0.6774056222075199, 0.6781927039352484, 0.6789176763549425, 0.6795968774008826, 0.6802560385726854, 0.6809269430136687, 0.6816437515166842, 0.6824393469693396, 0.6833420352259936, 0.6843728942803913, 0.6855439852618702, 0.6868575358471359, 0.6883060928468308, 0.6898735330909852, 0.6915367367321337, 0.69326767638731, 0.695035663462931, 0.6968095161618364, 0.6985594627624032, 0.7002586566019402, 0.7018842438340601, 0.7034179820447524, 0.7048464514385975, 0.7061609284286461, 0.7073570048643459, 0.7084340374321011, 0.7093945043911162, 0.7102433342035972 ], [ 0.6929088154661655, 0.6902096970747948, 0.6874067140539633, 0.6845474773030513, 0.6816890303948336, 0.6788961419088255, 0.6762385702236536, 0.6737873479389805, 0.6716102876222856, 0.669767076196843, 0.6683044683709809, 0.6672521711088591, 0.6666199981660361, 0.6663967516653271, 0.6665510695700962, 0.6670342041253061, 0.6677844240222259, 0.6687325185085857, 0.669807763324864, 0.6709436973024873, 0.6720831397463553, 0.6731820209791654, 0.6742117665275873, 0.6751601407262439, 0.6760306006788748, 0.6768403300163226, 0.677617213986316, 0.6783960851967563, 0.679214612978774, 0.6801092257292515, 0.6811114396438812, 0.6822449150769496, 0.6835234743075361, 0.6849501998844372, 0.6865176061044038, 0.6882087567519654, 0.6899991085124206, 0.6918588045393201, 0.6937551311360546, 0.6956548782352554, 0.6975264005284855, 0.6993412468088199, 0.7010752969097989, 0.7027094081819208, 0.7042296205952384, 0.7056269992674749, 0.7068972066582891, 0.7080398969618608, 0.7090580162827879, 0.7099570778241 ], [ 0.6909029415413559, 0.6879138297273626, 0.6848026219251341, 0.681622241827885, 0.6784367441201833, 0.6753195001703198, 0.6723501652042218, 0.6696104559900463, 0.667178953497157, 0.665125350056497, 0.66350474383802, 0.6623526948346693, 0.661681751526355, 0.6614800145803257, 0.6617120378583929, 0.6623220289225247, 0.6632389751810175, 0.6643830606970891, 0.6656726010638864, 0.6670307215104297, 0.6683911142278998, 0.6697023921354249, 0.6709307621882333, 0.6720609362929179, 0.6730953621864006, 0.6740519848331062, 0.6749608441432781, 0.675859882207971, 0.6767903749628595, 0.6777924167741348, 0.6789008663320146, 0.680142103648425, 0.681531851259711, 0.6830741864140951, 0.6847617316292354, 0.6865768798514206, 0.688493808169771, 0.6904809751217276, 0.6925037859700566, 0.6945271429344899, 0.6965176608483377, 0.6984454074128322, 0.7002851062260503, 0.7020168087639475, 0.7036260920041171, 0.7051038695178943, 0.706445917198551, 0.7076522139807778, 0.708726187336548, 0.7096739372172552 ], [ 0.6888174398370822, 0.6855227187341089, 0.6820857435359314, 0.6785649693485478, 0.6750318690868012, 0.6715690337361576, 0.6682668410254674, 0.6652186948921492, 0.6625150582808293, 0.6602367532620347, 0.6584482348863684, 0.6571916947089786, 0.6564828573532017, 0.6563091678657883, 0.6566307446207368, 0.6573840568162556, 0.6584878726133224, 0.6598507076451365, 0.6613788450892666, 0.662984009851292, 0.6645899282803444, 0.6661372339445721, 0.6675864304411404, 0.6689188504244795, 0.6701357340417983, 0.6712556863786143, 0.6723108694566747, 0.6733423487650196, 0.674395051977071, 0.6755128068243431, 0.6767339000365578, 0.6780875339829872, 0.679591451791042, 0.6812508639548842, 0.6830586576399668, 0.684996727407922, 0.6870381556491438, 0.6891499084797033, 0.6912957033719216, 0.6934387424615314, 0.6955440763358344, 0.6975804497255795, 0.6995215665344043, 0.7013467848574692, 0.7030413062952952, 0.7045959562446366, 0.7060066649700469, 0.7072737572874299, 0.7084011464978964, 0.7093955103757418 ], [ 0.686666545827471, 0.6830529009306069, 0.6792750077079514, 0.6753970044197563, 0.6714981139030836, 0.6676706861528805, 0.6640165753728022, 0.6606418171964225, 0.6576498301596991, 0.6551336705871178, 0.6531681616124949, 0.6518029146075057, 0.651057286980092, 0.6509181302351803, 0.6513407924374954, 0.6522533307038594, 0.6535633843728614, 0.6551667784633814, 0.6569567463125717, 0.6588326913574305, 0.6607076050003442, 0.6625135445007367, 0.6642048770140835, 0.6657592606839947, 0.6671765373812261, 0.6684758541325885, 0.6696914238463513, 0.6708673944171097, 0.6720523265115581, 0.6732937837825566, 0.674633508420971, 0.6761035828229275, 0.6777238634360371, 0.6795008242533482, 0.6814277839603037, 0.683486337699867, 0.6856486965005422, 0.6878805717692971, 0.6901442342117352, 0.6924014193314194, 0.6946158297368691, 0.6967550787171337, 0.6987920121985969, 0.7007054242743299, 0.7024802380028979, 0.7041072565957287, 0.7055826029192194, 0.7069069620966624, 0.7080847282321007, 0.7091231368128117 ], [ 0.6844671167359944, 0.6805241850611505, 0.6763933544205327, 0.672144519511216, 0.6678648886307702, 0.6636570023716253, 0.6596348344364196, 0.6559178922634514, 0.6526235346383468, 0.6498580894100616, 0.6477077158856045, 0.6462302133637383, 0.6454490284311065, 0.6453504980712139, 0.6458848986247968, 0.6469712525600119, 0.6485052313988954, 0.6503690371938331, 0.6524419413577494, 0.654610217972646, 0.6567754652890287, 0.6588606648944466, 0.6608136891784582, 0.6626082718879382, 0.6642426791432966, 0.6657364638696381, 0.6671257741778385, 0.6684577353912644, 0.6697844475725597, 0.6711571362812997, 0.6726209568614113, 0.6742108735152702, 0.6759489114007989, 0.677842921522163, 0.6798868242272359, 0.6820621346788431, 0.6843404492180841, 0.6866865034083727, 0.6890614061956405, 0.6914257024030025, 0.693742000675592, 0.6959770052966109, 0.6981028890255353, 0.7000980265637154, 0.701947167259224, 0.7036411599329562, 0.7051763551387376, 0.7065538059027531, 0.7077783727621794, 0.7088578179641658 ], [ 0.6822383538718932, 0.6779593633306112, 0.6734674471559319, 0.6688382422377421, 0.6641670623106265, 0.6595669313849385, 0.655164432377457, 0.6510932284445242, 0.647485457081019, 0.6444616305895058, 0.6421201189554417, 0.6405276197878512, 0.6397121052185648, 0.6396594943696877, 0.6403147449945505, 0.6415873123749832, 0.6433601835326167, 0.6455011534521805, 0.6478747836521638, 0.6503535778922225, 0.6528272386535244, 0.6552093038290736, 0.6574408900496816, 0.6594916146125538, 0.6613580077809602, 0.6630598723708007, 0.6646351251312717, 0.6661336907318098, 0.6676110295966857, 0.6691218674357217, 0.6707146495267962, 0.6724271569282985, 0.6742835912555923, 0.6762932676177829, 0.678450872418389, 0.6807380723982256, 0.6831261315470181, 0.685579122630855, 0.6880573156024472, 0.6905203776360653, 0.6929301106114732, 0.6952525594682056, 0.69745942890496, 0.6995288321211898, 0.7014454564022629, 0.7032002652706015, 0.7047898689540896, 0.7062156896233888, 0.7074830313230962, 0.7086001422539094 ], [ 0.680001356129377, 0.6753837142909193, 0.670527131953753, 0.6655128808699388, 0.6604443680509537, 0.6554452253728145, 0.650654938123063, 0.6462217974943207, 0.6422933484179463, 0.6390050109714902, 0.6364680877026978, 0.63475878249688, 0.6339099856477176, 0.6339073136486628, 0.6346902388845429, 0.6361582533040148, 0.6381811256327239, 0.6406116747204721, 0.6432992335336306, 0.6461021188659033, 0.648897836152278, 0.6515902756107199, 0.6541136547301728, 0.6564333499357868, 0.6585440147276704, 0.6604655222063041, 0.662237333311281, 0.6639119120352396, 0.6655478050043384, 0.6672029785533838, 0.6689289535968469, 0.6707661860882481, 0.6727410037852839, 0.6748642360283865, 0.6771314833277882, 0.6795247972159456, 0.6820154072356571, 0.6845670611373231, 0.6871395418794557, 0.6896919817166448, 0.692185690059514, 0.6945863246725034, 0.6968653442197386, 0.6990007694412217, 0.7009773429944033, 0.702786213375374, 0.7044242799703869, 0.7058933300990734, 0.7071990812927288, 0.7083502187004641 ], [ 0.6777784994308375, 0.67282428577043, 0.6676046235388821, 0.6622062176373594, 0.6567404118139913, 0.6513413758947565, 0.6461615528976911, 0.6413640670436748, 0.6371122232108442, 0.633556812573055, 0.6308225743802756, 0.6289956743255193, 0.6281142431145985, 0.6281637299045414, 0.6290780644941532, 0.630746568343893, 0.6330255083433788, 0.6357524455497848, 0.6387612634231946, 0.6418959572710745, 0.6450217792561036, 0.6480329610528544, 0.6508568113029, 0.6534544146783617, 0.6558184251178004, 0.6579685775186326, 0.6599455873291735, 0.6618041078139905, 0.6636053943044542, 0.6654102882136933, 0.6672730721943578, 0.6692366490025017, 0.6713293541845186, 0.6735635335620341, 0.6759358217615755, 0.6784288778295848, 0.6810141982195975, 0.6836555566297485, 0.6863126197595094, 0.6889443483250877, 0.6915118933199715, 0.6939808144679369, 0.6963225595650522, 0.6985152349157706, 0.7005437609819329, 0.7023995430122051, 0.7040797977029808, 0.7055866700459249, 0.7069262560588527, 0.7081076229239838 ], [ 0.6755926501422975, 0.6703089626138073, 0.6647334178992914, 0.6589578612669748, 0.6531012656398901, 0.6473080544863462, 0.6417434103204207, 0.6365851763157507, 0.6320124289811253, 0.6281914632010072, 0.6252606743674591, 0.6233164409632699, 0.6224023583682614, 0.6225038661723903, 0.6235494361982378, 0.6254182574900461, 0.6279531321979167, 0.6309764427886838, 0.6343067668174269, 0.6377739794836088, 0.641231306470774, 0.6445635258374727, 0.6476911714287871, 0.6505710599300777, 0.6531937367540284, 0.6555785544927175, 0.6577671209543556, 0.6598158318452076, 0.6617881642681052, 0.6637473573041116, 0.6657500355924102, 0.6678412271276872, 0.6700510799458216, 0.6723934000905862, 0.6748659361124055, 0.6774521536165444, 0.6801241072655577, 0.6828459477744705, 0.6855776031166468, 0.6882782362486313, 0.6909091853242799, 0.6934362120494105, 0.6958309976751829, 0.698071918985309, 0.7001442011873656, 0.7020395803490946, 0.7037556190114694, 0.7052948112205274, 0.7066635942014088, 0.7078713591893045 ], [ 0.6734662364163254, 0.6678653440399867, 0.6619469553942209, 0.6558076799803532, 0.6495736610976216, 0.6433990652495637, 0.637461295924666, 0.6319524394541771, 0.6270669582634094, 0.6229863883968404, 0.6198626534552496, 0.6178023417388837, 0.6168546137452752, 0.6170050834782439, 0.618177024204962, 0.6202398315448042, 0.6230232683891903, 0.6263350469130659, 0.6299790061421823, 0.6337714829703134, 0.6375542146830276, 0.6412029601529913, 0.644631758965879, 0.647793254126936, 0.6506757801633095, 0.6532980200305033, 0.6557020328629792, 0.6579454084844443, 0.6600932460508818, 0.6622105901905757, 0.6643558785056074, 0.6665758442192203, 0.6689021684130396, 0.6713499929400365, 0.6739182080345207, 0.6765912478172019, 0.6793419923030825, 0.682135306571834, 0.6849317515110742, 0.6876910656104336, 0.6903751226255124, 0.6929501908708237, 0.6953884345573752, 0.6976686908543728, 0.6997766210058209, 0.7017043694530264, 0.7034498756813995, 0.705015975853962, 0.7064094120120571, 0.7076398416792914 ], [ 0.6714202188145307, 0.6655194780520022, 0.6592770873477611, 0.6527939722598746, 0.6462028428404119, 0.6396668695986173, 0.6333748440778307, 0.6275322300855743, 0.6223480513475856, 0.6180183770685895, 0.6147081330639127, 0.6125338200369199, 0.6115501197860742, 0.6117430362910653, 0.6130311092096687, 0.615274630106324, 0.6182911942731566, 0.6218748363034714, 0.6258156924453816, 0.6299175532748268, 0.6340115318789111, 0.637965034564128, 0.6416860283781523, 0.6451231384154013, 0.6482623831242847, 0.6511214376888546, 0.6537422879282679, 0.6561830660188467, 0.6585097806460141, 0.6607885757661317, 0.6630790634925924, 0.6654291616862108, 0.6678717159758725, 0.6704230035110025, 0.6730830212238313, 0.6758372838964687, 0.6786597261411547, 0.6815162373440388, 0.6843683644105928, 0.6871767833222641, 0.6899042461589616, 0.692517830938344, 0.6949904357631698, 0.6973015514677234, 0.6994374111359537, 0.7013906501696053, 0.7031596211922955, 0.7047475003801522, 0.7061613025627214, 0.7074108975606932 ], [ 0.6694730186138936, 0.6632945232649619, 0.6567524293478672, 0.6499514718148669, 0.6430301915694999, 0.6361598042380078, 0.6295393433788453, 0.6233863860319973, 0.6179232343396277, 0.6133593095337837, 0.6098715853992146, 0.6075858586235711, 0.6065621332032866, 0.6067870573983545, 0.6081751324466994, 0.6105786220938524, 0.6138043114119445, 0.6176340686380875, 0.6218458543287779, 0.6262323248573348, 0.6306151578705355, 0.6348542964437429, 0.6388521848166393, 0.6425536342644051, 0.6459422286770021, 0.649034240146865, 0.6518709708308678, 0.6545103415262296, 0.657018448832565, 0.6594617200444626, 0.6619001972360673, 0.664382362734144, 0.6669417669846915, 0.6695955402014097, 0.6723446795282758, 0.6751758316259446, 0.6780641646209798, 0.6809768621330817, 0.6838767798908851, 0.6867258718725816, 0.6894880975079045, 0.6921316404475388, 0.6946303817109063, 0.6969646611819356, 0.6991214245534685, 0.7010938875881949, 0.7028808600559819, 0.704485864182457, 0.7059161635169037, 0.7071817936115036 ], [ 0.6676394766195196, 0.6612094287169643, 0.6543967121775782, 0.6473093203341487, 0.6400907743254626, 0.6329191753757074, 0.6260023582298847, 0.6195683649650658, 0.6138510437447295, 0.6090715160934069, 0.6054174195916012, 0.6030229095861048, 0.6019529600943975, 0.6021951655619474, 0.6036609289755159, 0.606195966041672, 0.6095981079599975, 0.6136390916697089, 0.6180867158654962, 0.622724321367337, 0.6273656441320441, 0.6318642544226105, 0.6361177313661213, 0.6400673090662024, 0.6436939950568021, 0.6470122018167953, 0.6500618531111015, 0.652899807974281, 0.6555913277934488, 0.6582022054543498, 0.6607920691043484, 0.6634092499685423, 0.6660874531404822, 0.6688442951110972, 0.6716815891049073, 0.6745870952533685, 0.6775373335638082, 0.6805010011499105, 0.6834425449896728, 0.6863255073804191, 0.6891153635563945, 0.6917816867705564, 0.6942995853409953, 0.6966504448195926, 0.6988220699303572, 0.7008083549036266, 0.702608621219544, 0.7042267545968739, 0.705670254714397, 0.7069492872706358 ], [ 0.6659299246082928, 0.6592777362452282, 0.6522272617591327, 0.6448891705494396, 0.6374110197126173, 0.6299764648656714, 0.6228004418758297, 0.6161194653978018, 0.6101767882310374, 0.6052031478043606, 0.6013950640535362, 0.5988938185349468, 0.5977688682455091, 0.5980091134730093, 0.5995240453564945, 0.6021547061831862, 0.6056923094255681, 0.6099009908947368, 0.6145408523592926, 0.6193881056096996, 0.6242503062061254, 0.628975910516505, 0.6334583729895549, 0.6376356030533332, 0.6414858585358549, 0.6450211738465776, 0.648279320432876, 0.6513151577251877, 0.6541920984604312, 0.6569742929283906, 0.6597200219476603, 0.6624766618064534, 0.665277435371656, 0.6681399942384187, 0.6710667028514329, 0.6740463411341395, 0.6770568315005723, 0.6800685452005205, 0.6830477547948411, 0.6859598642784086, 0.688772147240358, 0.6914558348720571, 0.6939875005396081, 0.6963497728698572, 0.6985314685530465, 0.7005272689744274, 0.7023370750369214, 0.7039651678395689, 0.7054192853243406, 0.7067097020000991 ], [ 0.6643494534504962, 0.6575066145641774, 0.6502537480216499, 0.6427035963506844, 0.6350067375894607, 0.6273509157824463, 0.619956259901575, 0.6130654843935597, 0.6069287687837503, 0.6017840239680624, 0.5978345424397566, 0.5952272596536335, 0.5940355286965564, 0.5942499838407221, 0.5957796226768529, 0.5984630466576951, 0.6020876134054264, 0.6064128187414858, 0.611193916887484, 0.6162024825324014, 0.6212418663645621, 0.6261567969868707, 0.6308373989820996, 0.6352185093715036, 0.6392754259225375, 0.6430172275414421, 0.6464786891937696, 0.6497116580158057, 0.652776608479354, 0.6557349635088394, 0.6586426458548471, 0.6615451942953235, 0.6644746322571571, 0.6674481139979407, 0.6704682097524283, 0.6735245480620156, 0.6765964325680929, 0.6796560059661167, 0.6826715478096157, 0.6856105558739735, 0.6884423552948601, 0.691140085579085, 0.6936820151244896, 0.6960522138225601, 0.6982406707438139, 0.7002429754318232, 0.7020596913608816, 0.703695543973449, 0.7051585291285312, 0.7064590258713048 ], [ 0.6628974549362882, 0.655896226861184, 0.6484773355753838, 0.6407549808574512, 0.6328816993254068, 0.6250477653651548, 0.6174764490070611, 0.6104141958725263, 0.6041153982451177, 0.5988224474813535, 0.5947430723610811, 0.5920282322396695, 0.5907545395935556, 0.5909148696849931, 0.5924193468745805, 0.5951066585163418, 0.5987634074969855, 0.6031477457191907, 0.6080132201463906, 0.6131294836393769, 0.6182978063768063, 0.6233606555432245, 0.6282056456052822, 0.6327647789113532, 0.6370101434787936, 0.6409472326575866, 0.6446069225253906, 0.6480369754042111, 0.6512937776461434, 0.6544348787348816, 0.6575127688001519, 0.6605701989117263, 0.6636372039203476, 0.6667298327699612, 0.6698504387881399, 0.6729892517508899, 0.6761268634223391, 0.6792372207345012, 0.6822907370771605, 0.6852571931286385, 0.6881081880459549, 0.69081900123274, 0.6933698181268034, 0.6957463492860314, 0.6979399250664303, 0.6999471779834451, 0.7017694345203945, 0.703411932587702, 0.7048829653360934, 0.7061930313512759 ], [ 0.6615674979438471, 0.6544395136621053, 0.6468903449200463, 0.6390350248222959, 0.6310269617559111, 0.6230573560641987, 0.6153504949236027, 0.6081539893791879, 0.6017236149035204, 0.5963034311514519, 0.5921031665554158, 0.5892761185340726, 0.5879015329736528, 0.5879751209876005, 0.5894099132342431, 0.5920474188138843, 0.5956768150799266, 0.6000584216364421, 0.604947397116194, 0.6101143163803604, 0.6153605699589818, 0.6205278608312468, 0.6255021092856408, 0.6302126941700857, 0.6346282051230457, 0.6387498760341404, 0.6426037371440947, 0.6462323495489349, 0.6496868176310383, 0.65301962534586, 0.6562787054727575, 0.6595030152274794, 0.6627197495023378, 0.6659431762064242, 0.6691749378858549, 0.6724055465716937, 0.6756167204941534, 0.6787841814720273, 0.6818805506372678, 0.6848780388493326, 0.6877507118643609, 0.6904762024733271, 0.6930368279146042, 0.6954201408682514, 0.6976189913743812, 0.6996312047149642, 0.7014589894289721, 0.70310818461203, 0.7045874412987916, 0.7059074134132786 ], [ 0.6603475748045685, 0.6531224410396883, 0.645476492853788, 0.637524967731473, 0.6294210564805183, 0.6213552811515315, 0.6135508254123685, 0.6062539074144602, 0.5997188698894589, 0.5941886517040792, 0.5898725810238276, 0.5869246620650167, 0.5854262231417039, 0.5853765005595901, 0.586693319165532, 0.5892238580516934, 0.592763302681281, 0.5970777373382333, 0.6019273100152696, 0.6070863911217942, 0.6123586955463841, 0.6175866418379781, 0.6226552415496109, 0.6274914248164484, 0.6320599574392154, 0.6363571057299553, 0.6404030762278486, 0.6442340835499294, 0.6478947270986588, 0.6514312009659146, 0.6548857180853623, 0.6582923908446461, 0.6616746705791388, 0.6650443098275108, 0.6684016836366697, 0.6717372032554298, 0.6750334898515233, 0.678267954385943, 0.6814154514708839, 0.6844507313938311, 0.6873504921304564, 0.6900949174591027, 0.6926686655533105, 0.6950613359311343, 0.6972674871456002, 0.6992863028064362, 0.7011210118833252, 0.7027781646746002, 0.7042668526324298, 0.7055979423594146 ], [ 0.6592207229321592, 0.6519247241133463, 0.6442117289442082, 0.6361965478523601, 0.6280310829587784, 0.6199036184694573, 0.6120341896262107, 0.6046651719824754, 0.5980467984600687, 0.5924182588920329, 0.5879862503752449, 0.5849040130536856, 0.5832545418334638, 0.5830413854463804, 0.5841891065381826, 0.586553418150281, 0.5899389302672952, 0.5941210477007612, 0.5988682292606794, 0.6039614506731183, 0.6092088900786585, 0.6144550999216901, 0.619584914413209, 0.6245229453368044, 0.6292297748712241, 0.6336959681546736, 0.6379349108735, 0.641975309346251, 0.6458540175174792, 0.6496096937427798, 0.6532776407339006, 0.6568860397226001, 0.6604536521501838, 0.6639889319508275, 0.6674903770505695, 0.6709478607442652, 0.6743446312664867, 0.6776596553129471, 0.68087000614544, 0.6839530509564725, 0.6868882634718645, 0.689658563717404, 0.6922511567170403, 0.6946578982910028, 0.696875255572575, 0.6989039521766975, 0.7007483952842419, 0.7024159776616652, 0.7039163355727804, 0.7052606271358899 ], [ 0.6581659934706864, 0.650820992008077, 0.6430656278985528, 0.6350136540401333, 0.6268146506113437, 0.6186531895278504, 0.6107442529219789, 0.6033241215287249, 0.5966364890390916, 0.5909144472708715, 0.5863601130501314, 0.5831247404039126, 0.5812927585388459, 0.5808729132135274, 0.581798455938652, 0.5839364281208286, 0.58710415775765, 0.5910897760478325, 0.5956732196081387, 0.6006447361666025, 0.6058189834502055, 0.6110439679787181, 0.6162050045266306, 0.621224465812984, 0.6260583579749943, 0.6306907921089384, 0.6351273244884246, 0.6393879825492271, 0.6435006238470916, 0.6474951099258119, 0.6513986212714209, 0.6552322931899319, 0.6590092163026132, 0.6627337234269289, 0.6664017837655712, 0.6700022530771514, 0.6735186902799832, 0.6769314479449795, 0.6802197725608251, 0.6833637022566268, 0.6863456144310783, 0.6891513429357714, 0.6917708453545365, 0.694198449669398, 0.6964327434993266, 0.6984761881237433, 0.7003345455295448, 0.7020162026417722, 0.7035314659038594, 0.7048918844478608 ], [ 0.6571597069044655, 0.6497823185873124, 0.6420032431155258, 0.6339345518277026, 0.6257225258724208, 0.6175466697948406, 0.6096152002098533, 0.6021563175240813, 0.5954050766973511, 0.5895864889370728, 0.5848965035825344, 0.5814834761606147, 0.5794332519585915, 0.5787607505175715, 0.5794098314766067, 0.5812615244007912, 0.584148967010643, 0.5878761924526773, 0.5922375556708653, 0.5970350421338033, 0.6020916411823871, 0.6072600088651072, 0.6124265107912408, 0.6175113036034516, 0.6224653925106551, 0.6272656649900756, 0.6319088307794729, 0.636405061142474, 0.6407719570589059, 0.6450293079853167, 0.6491949404056166, 0.6532818042222076, 0.6572963100219096, 0.661237816750733, 0.6650990827091983, 0.6688674371156679, 0.6725264062420435, 0.676057535342257, 0.6794421799252269, 0.6826630895376655, 0.6857056652439427, 0.6885588300503912, 0.6912155029761613, 0.6936727080542172, 0.695931377416407, 0.697995922972804, 0.6998736556469284, 0.7015741270501641, 0.703108458475968, 0.7044887086323629 ], [ 0.6561769091370682, 0.6487780087066465, 0.6409872819578217, 0.6329145091318745, 0.6247017681478416, 0.6165222870554901, 0.6085760333482759, 0.6010814531484702, 0.5942632426069154, 0.5883367647234765, 0.5834906171946309, 0.5798696814994307, 0.5775614236633927, 0.5765879950444402, 0.5769057225539593, 0.578412108475368, 0.5809589438781391, 0.5843690635188208, 0.588453914727331, 0.5930294539449615, 0.5979286675221307, 0.6030099178751446, 0.608161096779973, 0.6133001083909824, 0.6183724983366354, 0.6233471427268641, 0.6282108762738354, 0.6329628257160413, 0.637609060788038, 0.6421580045946523, 0.6466168752181363, 0.6509892733305364, 0.6552738962714494, 0.659464254368929, 0.6635491938576865, 0.6675139928336102, 0.6713417894313752, 0.6750151195089302, 0.6785173776435399, 0.6818340626232356, 0.6849537196095528, 0.687868539633661, 0.6905746186035837, 0.6930719099197549, 0.6953639262033501, 0.6974572569796342, 0.6993609717864391, 0.7010859739465286, 0.7026443611549017, 0.7040488370112113 ], [ 0.6551929235787339, 0.6477775066374076, 0.639980433959593, 0.6319086102306455, 0.6236990935595708, 0.6155177904421463, 0.6075551842490994, 0.6000186233463024, 0.5931211194672538, 0.5870672432331203, 0.5820374597980451, 0.5781729299287964, 0.5755631535757851, 0.5742386352706069, 0.5741699495795571, 0.5752733638371027, 0.577421904105094, 0.5804598203302381, 0.5842180533663138, 0.5885285282164778, 0.5932357064822894, 0.5982045762751548, 0.6033249374053056, 0.6085123461712352, 0.6137063943148952, 0.6188671355856692, 0.6239704814692407, 0.6290033039681394, 0.6339588407803385, 0.63883282494649, 0.6436205818125098, 0.6483151719372394, 0.6529065247616933, 0.6573814128814524, 0.6617240620660532, 0.6659171735878853, 0.6699431453736885, 0.6737853081301092, 0.6774290334457462, 0.6808626157781512, 0.6840778737389832, 0.6870704544572898, 0.6898398558335879, 0.6923892042684174, 0.6947248399940034, 0.6968557691574487, 0.6987930424052489, 0.7005491152142618, 0.7021372369836992, 0.7035709053064318 ], [ 0.654184887141291, 0.6467522840614338, 0.6389476722603414, 0.6308745341495344, 0.6226641915331587, 0.6144743581356049, 0.6064850507205571, 0.5988915017270776, 0.591894090757072, 0.5856858471445513, 0.580438688817779, 0.5762900976161612, 0.5733321922504798, 0.5716049881160656, 0.5710949957940327, 0.5717393487499303, 0.5734346405499431, 0.5760488846079657, 0.5794346680315867, 0.5834416710237168, 0.5879271437712249, 0.5927634998744166, 0.5978427480043517, 0.6030779482477325, 0.6084022075659319, 0.6137659155127568, 0.6191329793102411, 0.6244767675465878, 0.6297763415618635, 0.6350133758005662, 0.6401699776888232, 0.6452274448356423, 0.6501658642917743, 0.6549643749813256, 0.6596018787321024, 0.6640579881892504, 0.668314028462142, 0.6723539511139435, 0.6761650641751827, 0.6797385237595931, 0.6830695681658442, 0.68615750288409, 0.689005464859974, 0.6916200075075152, 0.6940105552956372, 0.6961887792042252, 0.698167942785208, 0.6999622637201861, 0.7015863283708975, 0.7030545876487867 ], [ 0.653133161189522, 0.6456775700256108, 0.6378583561951113, 0.6297750849391476, 0.621552735616313, 0.6133401344760342, 0.6053060925925783, 0.5976330090928337, 0.590508020050914, 0.5841122029015569, 0.5786088132194349, 0.5741319169139433, 0.5707769506092154, 0.568594596157464, 0.5675888820290991, 0.5677197272991409, 0.5689094061020745, 0.5710518214577877, 0.5740231605685875, 0.5776924840478169, 0.5819310236725345, 0.5866193349277465, 0.5916518805958987, 0.5969390368943075, 0.6024068604480265, 0.6079951953438419, 0.6136548140208844, 0.6193442732717082, 0.6250270483310669, 0.630669322841242, 0.6362386072837518, 0.6417031759165893, 0.6470321809724647, 0.6521962333251548, 0.6571682253772348, 0.6619241988961859, 0.666444109253364, 0.6707123917759692, 0.6747182847222105, 0.67845590133273, 0.6819240694741202, 0.6851259731743213, 0.6880686384826137, 0.6907623091186235, 0.693219757213722, 0.6954555722306831, 0.6974854673797061, 0.6993256376733273, 0.7009921972326191, 0.7025007157444982 ], [ 0.6520225216069626, 0.6445338030795227, 0.6366879869321546, 0.628580293039069, 0.62032887113955, 0.612073139660935, 0.6039701906785304, 0.5961891365693051, 0.5889035374802088, 0.5822823713858618, 0.5764803297461668, 0.5716284602395022, 0.5678262561174995, 0.5651361667878506, 0.5635811905678757, 0.5631457769794008, 0.5637798083090908, 0.5654050353959813, 0.567923066550762, 0.5712238759650927, 0.5751938147740804, 0.5797222680619925, 0.5847063825257985, 0.5900536469472171, 0.5956824740735152, 0.6015212339077467, 0.6075063655378802, 0.6135802217195828, 0.619689191956235, 0.6257824530177847, 0.6318114727261107, 0.6377301997819637, 0.643495745177244, 0.6490693093705607, 0.6544171224989794, 0.659511219193413, 0.6643299399857294, 0.6688581180325629, 0.6730869613721084, 0.6770136734551475, 0.6806408700799034, 0.6839758537475399, 0.6870298020071887, 0.6898169188378631, 0.6923535902670881, 0.6946575784938347, 0.6967472828724296, 0.6986410907044834, 0.7003568352143638, 0.7019113718978818 ], [ 0.6508430533756723, 0.6433077138416077, 0.6354195045100004, 0.6272689535995204, 0.618967020958266, 0.6106433672352838, 0.6024430573813858, 0.5945216866298383, 0.5870391232990065, 0.5801522796465236, 0.5740075001030168, 0.5687332491971361, 0.5644337666777358, 0.5611842477199424, 0.5590279424794856, 0.5579753936214639, 0.5580058584252617, 0.5590707783359786, 0.5610989434493546, 0.5640027652958931, 0.5676848792345828, 0.572044231507071, 0.5769809225658237, 0.5823993687093307, 0.5882097302221936, 0.5943279214622312, 0.6006747629185321, 0.607174902371417, 0.6137560297360534, 0.6203486963875506, 0.6268868053281245, 0.6333086354744134, 0.639558144239339, 0.6455862652433633, 0.6513519630842232, 0.6568228922823476, 0.6619756008890677, 0.666795297810519, 0.6712752553244894, 0.6754159432987707, 0.6792239944870262, 0.6827110889129957, 0.6858928274996599, 0.6887876466433386, 0.6914158098276664, 0.6937985008365508, 0.6959570352615637, 0.6979122015541598, 0.6996837384246947, 0.7012899508431091 ], [ 0.6495907019945136, 0.6419929810940659, 0.6340440590579333, 0.6258295232625523, 0.6174529187322643, 0.609033966263516, 0.6007055829660759, 0.5926098029920112, 0.5848928463293404, 0.5776996980545478, 0.5711685999388935, 0.5654258066078521, 0.5605808480065373, 0.5567224353917708, 0.5539151200132665, 0.5521968857489501, 0.5515779735120212, 0.5520412804396885, 0.5535445464990958, 0.5560242226386188, 0.5594005149672195, 0.5635827941589685, 0.5684744943884174, 0.5739768386507219, 0.5799911312386586, 0.5864197945576672, 0.5931666420634649, 0.6001369843364857, 0.6072380629016556, 0.6143800695996869, 0.6214777410260541, 0.6284523070045406, 0.6352334676373403, 0.6417610780069601, 0.647986303182294, 0.6538721258740418, 0.659393206008603, 0.6645351802951975, 0.6692935405668342, 0.6736722444692338, 0.6776822001776649, 0.6813397396936544, 0.6846651632031402, 0.6876814073184511, 0.6904128667488941, 0.69288438307428, 0.6951204048065598, 0.6971443177481319, 0.698977941566756, 0.7006411857533749 ], [ 0.6482674639421795, 0.6405904426380358, 0.6325612368452058, 0.6242603558238137, 0.6157838501242004, 0.6072414883037207, 0.5987540964362399, 0.590450265224698, 0.582462726923829, 0.5749247221253736, 0.5679665836737348, 0.5617125758046293, 0.5562778161352163, 0.5517649946929101, 0.5482606918385116, 0.5458314010061196, 0.5445197665490116, 0.5443418391894023, 0.5452861353352582, 0.5473149086054864, 0.5503674434764687, 0.5543646284195557, 0.5592138033144768, 0.564812997052947, 0.5710540868851383, 0.5778249156941101, 0.5850107866795223, 0.5924958932817902, 0.6001651324518813, 0.6079064837918364, 0.6156138446065716, 0.6231899987398742, 0.6305493170616422, 0.6376198338505741, 0.644344472561481, 0.6506813517864433, 0.6566032421619192, 0.6620963411720978, 0.6671585781064079, 0.6717976625779911, 0.6760290607997587, 0.6798740393590132, 0.683357869237839, 0.6865082418727121, 0.689353918372192, 0.691923613247943, 0.6942451033656821, 0.6963445483194698, 0.6982460070068651, 0.6999711344145592 ], [ 0.6468812284783988, 0.6391078801052925, 0.6309787689154662, 0.6225693145091301, 0.6139681504366523, 0.6052752582145271, 0.5965996086803196, 0.5880566204387483, 0.5797657953498933, 0.571848820264284, 0.5644282074347566, 0.5576262213919708, 0.5515635241374416, 0.546356830698917, 0.5421150447928744, 0.5389338573421366, 0.5368894757847876, 0.5360327074910899, 0.5363847522187565, 0.5379356563844503, 0.5406456052380112, 0.5444484292049494, 0.549256226036715, 0.5549640126773294, 0.561453735032105, 0.5685975282221264, 0.5762605643139159, 0.5843039869710118, 0.592588306813858, 0.6009773329722226, 0.6093424033206806, 0.6175664726802467, 0.625547576257496, 0.6332012857615376, 0.6404619578051611, 0.6472827710417685, 0.6536347092110647, 0.6595047464582555, 0.6648935264390198, 0.669812810251602, 0.6742829189930547, 0.6783303334776974, 0.6819855512409562, 0.6852812488509344, 0.6882507599730628, 0.6909268565945292, 0.6933408096028407, 0.6955217015753583, 0.6974959652292011, 0.6992871224181213 ], [ 0.6454453107485583, 0.6375594315328948, 0.6293117926935412, 0.6207728501486589, 0.6120240682038157, 0.6031559982294334, 0.59426618456505, 0.5854573103592251, 0.5768360066927359, 0.5685125996350187, 0.5606017398990251, 0.5532234053640076, 0.5465033399023702, 0.5405718056143365, 0.5355597614093439, 0.5315922704869378, 0.528779888547924, 0.5272096138276285, 0.5269372964728398, 0.5279830261214722, 0.530330099096988, 0.5339271332228162, 0.5386922019503779, 0.5445177405713852, 0.5512753663275065, 0.5588203580422348, 0.5669960293990239, 0.5756384024579201, 0.5845814376196747, 0.5936627453323814, 0.6027293814287403, 0.6116431506297331, 0.6202848565514234, 0.6285571038835681, 0.6363854998325756, 0.6437183380524618, 0.6505250252722843, 0.6567936068703908, 0.6625277668653227, 0.6677436393617371, 0.6724666965496778, 0.6767288950831484, 0.6805661846533884, 0.6840164197677452, 0.6871176719938276, 0.6899069143993223, 0.6924190388455114, 0.6946861651762738, 0.6967372043432503, 0.698597641381665 ], [ 0.6439777390174348, 0.6359647138714333, 0.6275817717497246, 0.6188946766232587, 0.6099781543109785, 0.6009138930974188, 0.5917886571847424, 0.5826930259992996, 0.5737212531431705, 0.5649725255505919, 0.5565534741547522, 0.5485812118201416, 0.5411856326360227, 0.5345094521874334, 0.5287047244011819, 0.5239253933350193, 0.5203166213117756, 0.5180027385896107, 0.5170761983982128, 0.5175896275165393, 0.5195520642902409, 0.5229292432251358, 0.5276468667751784, 0.5335955274837719, 0.5406362688016029, 0.5486063785755028, 0.5573255113147539, 0.566602397365369, 0.5762422145147319, 0.5860543411573209, 0.595859895670111, 0.6054983398726834, 0.6148325160704287, 0.6237517353857719, 0.6321728398586328, 0.6400394328446886, 0.6473196582421732, 0.6540029940771714, 0.6600965227429128, 0.665621075408678, 0.670607551148886, 0.6750936073018211, 0.6791208242123848, 0.6827323747801958, 0.6859711802642346, 0.6888785066976401, 0.6914929461102479, 0.6938497274471314, 0.6959803078701141, 0.6979122016648381 ], [ 0.6425003748290944, 0.634347757168257, 0.6258152028451389, 0.6169642041353744, 0.6078633715781003, 0.5985863266037409, 0.589209948034735, 0.5798135814295857, 0.5704797827398473, 0.5612969063716541, 0.552363336998976, 0.5437924804694871, 0.5357169718374758, 0.5282902143917543, 0.5216835963583092, 0.5160786323841509, 0.5116546465722457, 0.5085739778476182, 0.5069674827006209, 0.5069229760566947, 0.5084782581553957, 0.5116190049888748, 0.5162806738208296, 0.5223531086956051, 0.5296867355882668, 0.5380997839644412, 0.5473864385211572, 0.5573259481147668, 0.5676924997149335, 0.5782653010764462, 0.5888380418452711, 0.5992268602673589, 0.6092761375550085, 0.6188617834337299, 0.6278920448180413, 0.6363061701341391, 0.644071446657184, 0.6511791928128011, 0.6576402548610758, 0.6634804622336761, 0.6687363721077075, 0.6734515088616002, 0.6776731961054304, 0.6814499974262785, 0.6848297289495162, 0.6878579791641962, 0.6905770630225143, 0.6930253408961257, 0.6952368419392848, 0.6972411408049356 ], [ 0.6410379523551081, 0.6327358608815284, 0.6240422498694088, 0.6150149039305453, 0.6057171365868365, 0.5962155420105746, 0.5865782865354631, 0.5768746376140914, 0.5671763853958485, 0.5575615220095661, 0.5481199735401681, 0.5389604050071402, 0.5302163493465928, 0.5220494576532311, 0.5146478303570746, 0.5082183001185608, 0.5029730283370667, 0.49911236840629375, 0.49680702286102674, 0.49618262962398185, 0.4973090377252357, 0.500195119356144, 0.5047886686917655, 0.5109802529845812, 0.5186098906853093, 0.5274758317899435, 0.5373450754308352, 0.547965306123342, 0.5590776752579399, 0.570429514578443, 0.5817858813730662, 0.5929389195600194, 0.6037143461978873, 0.6139748165865572, 0.6236203481678205, 0.6325863005660886, 0.6408395799452955, 0.6483737697574371, 0.6552038215850466, 0.6613608110786227, 0.6668871127926431, 0.6718322025067763, 0.676249174327392, 0.6801919708997337, 0.6837132692338447, 0.686862937479497, 0.6896869720352892, 0.6922268313525671, 0.6945190952428777, 0.6965953909069531 ], [ 0.6396171212037279, 0.6311584793311834, 0.6222954395014135, 0.6130827725479686, 0.6035795004088005, 0.593846476279112, 0.5839446250853397, 0.5739346194451318, 0.563878733393592, 0.5538453197590566, 0.5439157543545576, 0.5341928481762185, 0.5248088563956645, 0.5159306325375762, 0.5077595189041803, 0.5005244099353894, 0.49446795625878637, 0.48982764321614175, 0.48681484149251725, 0.48559536199242387, 0.4862744232299307, 0.48888760987967983, 0.4933980005198363, 0.49969871996929305, 0.5076198956860237, 0.5169391334410675, 0.5273947802330687, 0.5387011622605358, 0.5505647032449773, 0.5626995623210829, 0.5748413933649543, 0.5867580897727829, 0.5982568608391992, 0.6091875347755413, 0.6194424576077698, 0.6289536744631617, 0.6376882217968219, 0.6456423520754127, 0.6528354026915147, 0.6593038567125059, 0.6650959646761511, 0.670267132550229, 0.6748761480656658, 0.6789822228742723, 0.6826427706961697, 0.685911815930638, 0.6888389244215846, 0.6914685588692384, 0.6938397775355276, 0.6959862104022368 ], [ 0.6382655654848974, 0.6296462274864257, 0.6206085328489049, 0.6112050383837645, 0.6014916457096041, 0.591524986799803, 0.5813605160768904, 0.571052145705578, 0.5606542530093395, 0.5502266113104901, 0.53984219132954, 0.5295968999295465, 0.5196193616481899, 0.5100781275809885, 0.5011835692736591, 0.49318241374042493, 0.4863443540838509, 0.48094204286647396, 0.4772274230981465, 0.47540818815222935, 0.47562792896496225, 0.47795243288523087, 0.4823631922627706, 0.488758022133902, 0.49695803082883205, 0.5067199133903065, 0.5177523537847598, 0.5297350523846467, 0.5423386008506288, 0.5552433022222238, 0.5681552242471114, 0.5808182692581888, 0.593021704925448, 0.6046032496744177, 0.6154483098494649, 0.6254862632135539, 0.6346847812631917, 0.6430431257540187, 0.6505851999059551, 0.6573529347952847, 0.6634003873393519, 0.6687887454208599, 0.6735822932424063, 0.6778452911634874, 0.6816396668019808, 0.6850233908324282, 0.6880494118307292, 0.690765039425926, 0.6932116850011187, 0.6954248878124698 ], [ 0.637011252054066, 0.628230071396751, 0.6190156522646487, 0.609419209403772, 0.5994948249174762, 0.5892966289673606, 0.5788766521642784, 0.5682842266203777, 0.5575678459849126, 0.5467801631391379, 0.5359862336874052, 0.5252742284720332, 0.5147668067209524, 0.5046304690451147, 0.49507986382000835, 0.4863744888240702, 0.47880655965969465, 0.4726807204005425, 0.46828818411545475, 0.4658791871019041, 0.46563792669264675, 0.46766345302561024, 0.4719587000001224, 0.47842847918346404, 0.4868861419287366, 0.49706777001304736, 0.5086520789083182, 0.5212836833476207, 0.5345970916316567, 0.5482388963722679, 0.5618861354264038, 0.5752595801427182, 0.5881315623060605, 0.6003286879243294, 0.6117302948953736, 0.6222637679546401, 0.6318978638618001, 0.6406350858184031, 0.6485039444450496, 0.6555517082811484, 0.6618380195142283, 0.667429555677729, 0.6723957682931431, 0.6768056281819528, 0.6807252506359535, 0.6842162532946975, 0.6873347045349496, 0.6901305393196023, 0.6926473432528746, 0.6949224272601128 ], [ 0.6358818349026532, 0.6269407325205021, 0.6175506965094819, 0.607762502195401, 0.5976297918104311, 0.5872060568575832, 0.5765421726824981, 0.5656853763779549, 0.55468066920128, 0.5435754674941934, 0.5324278271830472, 0.5213177150748599, 0.5103597201963126, 0.4997145652956367, 0.4895961660612908, 0.48027114352954264, 0.47204878546659174, 0.46526131655868, 0.46023648869918404, 0.45726629379249817, 0.45657650302717795, 0.45830157268293237, 0.4624684330497294, 0.46899118261876277, 0.4776770742164058, 0.48824260581628515, 0.5003371914479179, 0.5135710040587613, 0.5275433369802334, 0.5418682489494607, 0.5561951686203512, 0.5702232533039439, 0.5837093480704447, 0.596470194501154, 0.6083800267430913, 0.6193648876119088, 0.6293949676430607, 0.638476095542466, 0.6466412610438814, 0.6539427853935391, 0.6604455076500609, 0.6662211488558275, 0.671343861284088, 0.6758868677878881, 0.6799200415452035, 0.6835082595824138, 0.686710372568807, 0.6895786566891096, 0.6921586408788526, 0.6944892272676164 ], [ 0.6349042140356688, 0.6258082964797284, 0.6162470261347308, 0.6062716261481702, 0.595936695068156, 0.5852970163348347, 0.5744047163936438, 0.5633076463293569, 0.5520500231771558, 0.540676312885316, 0.5292389491344807, 0.5178097033588739, 0.5064934168668536, 0.4954416037651297, 0.48486250721231383, 0.47502396438412015, 0.46624620852063253, 0.45888350489631274, 0.45329588757082884, 0.4498145641676302, 0.4487061245520319, 0.4501411584501048, 0.45417225480370405, 0.4607248264675867, 0.469602041018104, 0.4805027082905217, 0.4930488193067602, 0.5068181161615825, 0.521376890691871, 0.5363090299037463, 0.5512387177762256, 0.5658456890167696, 0.5798731711306848, 0.5931294952442703, 0.6054847992043243, 0.6168643645674992, 0.6272400235578475, 0.6366208373241691, 0.645043956983317, 0.6525662859726896, 0.6592572992756647, 0.6651931607472725, 0.6704521218330735, 0.6751110830556026, 0.6792431472810603, 0.6829159804323972, 0.6861908084608024, 0.6891219066313624, 0.6917564680655706, 0.6941347656951861 ], [ 0.6341042200253284, 0.6248619799727467, 0.6151373517478509, 0.6049828317925583, 0.5944553186604149, 0.5836127939840261, 0.5725110695321906, 0.5612014258291125, 0.5497302126892394, 0.5381415579096455, 0.5264840928876207, 0.5148219386831351, 0.5032490918978072, 0.4919049709425818, 0.4809875990497547, 0.47076022137488943, 0.46154754792097363, 0.4537194533591522, 0.4476625464175987, 0.44374283251029234, 0.4422649345594347, 0.443434475628247, 0.447330074555333, 0.45388994479868444, 0.4629154324312139, 0.4740904756510083, 0.48701288219691136, 0.5012315111490019, 0.5162833451763716, 0.5317257205699338, 0.5471609001829802, 0.5622520360628952, 0.5767309802399121, 0.5903992616864353, 0.6031239263857597, 0.614829969980976, 0.6254909108544281, 0.6351187604675174, 0.643754320957811, 0.6514584248987189, 0.6583044571903004, 0.6643722792342361, 0.6697435161825204, 0.6744980672122798, 0.6787116490203697, 0.6824541728071702, 0.6857887718545965, 0.6887713275627152, 0.6914503757164703, 0.693867304306919 ], [ 0.6335063740501423, 0.6241299806303889, 0.6142537187103222, 0.6039320797837414, 0.5932254840534769, 0.5821968935166205, 0.5709081395915386, 0.5594167072788502, 0.547774055700596, 0.5360267845283166, 0.524221905093331, 0.5124169626425881, 0.5006946774166521, 0.48918021122374666, 0.47805748415496363, 0.46757977824254354, 0.4580698364770033, 0.44990616430896624, 0.4434950442926332, 0.43923109523895437, 0.4374520929363829, 0.4383955512899825, 0.4421649122544183, 0.44871187321565265, 0.4578383036478948, 0.46921694053578966, 0.48242600827506826, 0.49699058209234803, 0.5124235009137889, 0.5282603931859563, 0.5440858226094127, 0.5595497780896267, 0.5743752879198089, 0.5883587926161732, 0.6013652163455077, 0.6133196242541924, 0.6241971011045876, 0.6340121468002783, 0.6428085274556986, 0.6506501888330974, 0.6576135558019998, 0.6637813185085714, 0.6692376463799965, 0.674064671775415, 0.6783400378537672, 0.6821352983262222, 0.6855149767393387, 0.6885361266463923, 0.6912482704593489, 0.6936936262947717 ], [ 0.633133661341439, 0.6236393187474866, 0.6136274600806502, 0.6031551566627864, 0.5922873865241859, 0.5810936514704164, 0.5696439024605443, 0.558004399325365, 0.5462345670640626, 0.5343863127747691, 0.522507434402757, 0.5106504288081855, 0.49888697815278105, 0.48732664900759703, 0.4761362276020063, 0.46555437344622486, 0.45589579318558204, 0.44754049861659073, 0.4409067620719707, 0.4364102179253774, 0.43441504708053913, 0.4351855317009061, 0.43884706375321747, 0.4453645225700199, 0.454542513265696, 0.46604688837530595, 0.47944205601804074, 0.4942357743283644, 0.5099232006022463, 0.5260241572424587, 0.5421104900443874, 0.5578229168606461, 0.572878431918459, 0.5870701678396009, 0.6002618517058393, 0.6123788633595089, 0.6233975934336304, 0.6333344202040033, 0.6422352451539589, 0.6501661839505475, 0.6572057215053396, 0.6634384155488391, 0.668950074205388, 0.6738242353683002, 0.6781397305960846, 0.6819691117572226, 0.6853777410627757, 0.6884233811049785, 0.691156159907617, 0.6936188190589853 ], [ 0.6330072559770265, 0.6234155805685216, 0.6132889903648551, 0.6026875627375058, 0.5916816328899471, 0.5803484908484225, 0.5687679436868123, 0.5570172248358656, 0.545166267742455, 0.5332749463281925, 0.5213942925844793, 0.5095735961330191, 0.49787433648790175, 0.48638997598306316, 0.47526808391499326, 0.4647289395337652, 0.4550738123786633, 0.4466773536655426, 0.43996185474463556, 0.4353554917292152, 0.43324072852180573, 0.4339018708073639, 0.4374818832354023, 0.4439574963408689, 0.453137916134363, 0.4646867456414819, 0.47816112843781283, 0.4930589549277997, 0.5088651117571474, 0.5250902909570366, 0.5412991497721392, 0.5571273611718502, 0.5722888375321055, 0.5865752251246672, 0.5998499428546104, 0.6120388525569087, 0.6231192946562407, 0.6331088181842668, 0.6420545409762021, 0.6500237265256525, 0.6570958740827207, 0.6633563945462342, 0.6688917868728603, 0.6737861335144487, 0.6781186899285766, 0.6819623403610119, 0.6853827161191861, 0.688437810031926, 0.6911779604951637, 0.69364611265106 ], [ 0.6331461474166699, 0.6234824910811277, 0.6132673375458174, 0.6025640291732433, 0.5914487857642279, 0.5800075530604032, 0.5683312565591527, 0.556509777077871, 0.5446255953382481, 0.5327488241220953, 0.520936007354688, 0.5092351985614176, 0.497698973416039, 0.4864049442443261, 0.47548034155725466, 0.46512431536708443, 0.455620186126939, 0.44733099065559384, 0.4406752823254044, 0.4360850491119058, 0.4339522061868157, 0.43457330998466126, 0.4381034180504118, 0.44452887974348304, 0.45366486104887244, 0.46517728147545967, 0.47862284143903105, 0.49349745681892315, 0.5092836209795132, 0.5254899636378811, 0.5416797630514909, 0.5574880440261442, 0.5726286725868562, 0.5868936534263816, 0.60014697340843, 0.612315113005184, 0.6233759700034134, 0.6333475218739317, 0.6422771545630271, 0.650232235007169, 0.6572922156353237, 0.66354233654559, 0.6690688346365533, 0.6739554739500928, 0.6782811689765009, 0.682118470632744, 0.6855327093668849, 0.6885816279963363, 0.6913153772371512, 0.6937767816261148 ], [ 0.6335666424340136, 0.6238612779449989, 0.6135893574059514, 0.6028175830240043, 0.5916282977751453, 0.580116544050163, 0.5683850714444677, 0.5565374328554982, 0.5446700263489239, 0.5328648913099988, 0.5211859805525816, 0.5096820101706803, 0.49839824504742336, 0.4873973499826475, 0.4767860112462222, 0.4667405494728737, 0.4575228572088497, 0.44947899118122503, 0.44301665447813926, 0.4385632511520067, 0.4365113100964636, 0.43716154683947867, 0.440675093682898, 0.4470450676913805, 0.4560933888132548, 0.4674924293352167, 0.48080498930944054, 0.49553274578255696, 0.511163595523486, 0.5272111337712695, 0.5432430481885665, 0.5588981008971409, 0.5738931434502247, 0.5880223878498059, 0.6011512771338181, 0.6132070666492573, 0.6241678451066758, 0.6340513069764186, 0.6429041921891141, 0.6507929624825365, 0.6577959982020489, 0.6639973794364487, 0.6694821606699687, 0.6743329539984524, 0.6786275937570051, 0.6824376533281316, 0.6858276094703124, 0.6888544875124791, 0.6915678610723495, 0.6940101148019248 ], [ 0.6342817464777676, 0.6245698321490839, 0.6142786355660761, 0.6034781618992321, 0.5922568277033796, 0.5807187679395748, 0.5689786593734643, 0.5571540214777394, 0.5453557505618325, 0.5336787586128877, 0.5221957395510965, 0.510957706731794, 0.5000043256025631, 0.48938472655920545, 0.4791856815970876, 0.46956002018489973, 0.46074583550399417, 0.45306790676724057, 0.44691693449257003, 0.4427081506257178, 0.4408264724067496, 0.4415690470908186, 0.4450971321630906, 0.4514075201502445, 0.46032916925918366, 0.4715443540520857, 0.4846277665765909, 0.49909386852084525, 0.5144431515566957, 0.5302007376760733, 0.5459441862527177, 0.5613201804997638, 0.5760514879740922, 0.5899363505664392, 0.6028425818730394, 0.6146984284786466, 0.6254818834424659, 0.6352097360269247, 0.6439272574012215, 0.651699084193248, 0.6586015824577622, 0.6647167586736611, 0.6701276317969563, 0.6749148869696822, 0.6791545890256802, 0.6829167310428811, 0.686264416747649, 0.6892535126368367, 0.6919326452931195, 0.6943434538244515 ], [ 0.6353004607790591, 0.6256217178425003, 0.6153541487385193, 0.6045708706358823, 0.5933660515910447, 0.5818524787999116, 0.5701562512962713, 0.558408391242953, 0.5467340256960805, 0.5352410484678124, 0.5240115331689952, 0.5131000088612515, 0.502542213662051, 0.4923755262308045, 0.4826681650482909, 0.47354979155231275, 0.46523344435536873, 0.4580194817907276, 0.45227659647023555, 0.4484013835401663, 0.4467639870740739, 0.447651165794299, 0.45121895102682535, 0.45746486353943977, 0.46622482025788703, 0.47719364750316695, 0.48996265779427184, 0.504064994008695, 0.5190199081051277, 0.5343697808930702, 0.5497069048316455, 0.5646896817085937, 0.5790495173087054, 0.5925904324765385, 0.6051835464146159, 0.6167583945086567, 0.6272927035509106, 0.636801867525709, 0.6453290017346717, 0.6529361287776274, 0.6596967797043124, 0.6656900832141505, 0.6709962659530945, 0.675693394259122, 0.6798551445979315, 0.6835493855864551, 0.6868373763002666, 0.6897734209499463, 0.6924048582970499, 0.6947722977765851 ], [ 0.6366270598664996, 0.6270251250682666, 0.6168288154719826, 0.6061140541983125, 0.5949801932612656, 0.5835478290098315, 0.5719534053282188, 0.560340254128132, 0.5488466295481097, 0.5375926632531269, 0.5266696999943469, 0.5161364948638073, 0.5060263695616172, 0.496366968277251, 0.48720992099997484, 0.4786629309707172, 0.4709137884172955, 0.4642364424790388, 0.45897379174049596, 0.45549861547719983, 0.45416044887526846, 0.45523009268140463, 0.4588539683644879, 0.4650278369544087, 0.47359431664107293, 0.48426265829817017, 0.49664433456280305, 0.5102957150170602, 0.5247596873522054, 0.5396005401911954, 0.5544293463538341, 0.568919477498591, 0.5828133844965846, 0.5959224807153637, 0.6081221195388662, 0.6193435014524318, 0.6295640458235934, 0.6387974160868702, 0.6470840470969329, 0.654482717274451, 0.6610634500280288, 0.6669018257983531, 0.6720746399178708, 0.6766567497938297, 0.6807189109955833, 0.6843263955770165, 0.6875382054087915, 0.6904067263934128, 0.6929777058457056, 0.6952904676287499 ], [ 0.6382604331852014, 0.6287818869543121, 0.6187081067289668, 0.6081174178090079, 0.5971135777136033, 0.5858238002571005, 0.5743932969438161, 0.5629758725044598, 0.5517210534201313, 0.5407596795579871, 0.5301915416859508, 0.520079801394112, 0.5104566347552526, 0.5013420767646413, 0.4927735866999047, 0.48483885881786065, 0.47770118560886415, 0.4716072041072844, 0.46687143671438663, 0.46383899375334087, 0.462834386159059, 0.46410828190200376, 0.4677942568115485, 0.47388447587198745, 0.4822279941788301, 0.492549699621087, 0.5044836170760679, 0.5176125032954493, 0.5315063754749363, 0.5457548729120364, 0.5599909530248952, 0.5739055461872024, 0.5872541463484343, 0.5998569697245622, 0.6115944822888929, 0.6223999809073523, 0.6322506571419338, 0.6411582651726387, 0.6491602056901695, 0.6563115534717554, 0.662678313113331, 0.668331993478225, 0.673345450103114, 0.6777898546734814, 0.6817326060182741, 0.6852359886797693, 0.6883564017835436, 0.6911440112561015, 0.6936427125127455, 0.6958903213828316 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.0807968 (SEM: 0)
x1: 0.683048
x2: 0.650143
x3: 0.119252
x4: 0.288837
x5: 0.56801
x6: 0.991039", "Arm 1_0
hartmann6: -1.09306 (SEM: 0)
x1: 0.356336
x2: 0.978032
x3: 0.00764026
x4: 0.858375
x5: 0.0818928
x6: 0.129771", "Arm 2_0
hartmann6: -0.108989 (SEM: 0)
x1: 0.441238
x2: 0.964615
x3: 0.162928
x4: 0.0989579
x5: 0.14974
x6: 0.723757", "Arm 3_0
hartmann6: -0.00647902 (SEM: 0)
x1: 0.619502
x2: 0.202555
x3: 0.289526
x4: 0.939453
x5: 0.721105
x6: 0.216677", "Arm 4_0
hartmann6: -0.223665 (SEM: 0)
x1: 0.443013
x2: 0.879161
x3: 0.288397
x4: 0.497797
x5: 0.117522
x6: 0.530443", "Arm 5_0
hartmann6: -0.0960562 (SEM: 0)
x1: 0.728372
x2: 0.909787
x3: 0.556529
x4: 0.917842
x5: 0.422513
x6: 0.232883", "Arm 6_0
hartmann6: -0.0348777 (SEM: 0)
x1: 0.693003
x2: 0.649502
x3: 0.814413
x4: 0.856153
x5: 0.910842
x6: 0.399173", "Arm 7_0
hartmann6: -0.0213385 (SEM: 0)
x1: 0.942625
x2: 0.84833
x3: 0.677237
x4: 0.47833
x5: 0.558738
x6: 0.0171991", "Arm 8_0
hartmann6: -0.205231 (SEM: 0)
x1: 0.235669
x2: 0.341075
x3: 0.00838903
x4: 0.355622
x5: 0.0523779
x6: 0.206685", "Arm 9_0
hartmann6: -0.994192 (SEM: 0)
x1: 0.361175
x2: 0.30193
x3: 0.993517
x4: 0.268016
x5: 0.439813
x6: 0.791396", "Arm 10_0
hartmann6: -0.0893587 (SEM: 0)
x1: 0.0794026
x2: 0.839636
x3: 0.256346
x4: 0.107266
x5: 0.551899
x6: 0.29639", "Arm 11_0
hartmann6: -0.0699834 (SEM: 0)
x1: 0.125327
x2: 0.0114823
x3: 0.78728
x4: 0.751094
x5: 0.703226
x6: 0.579849", "Arm 12_0
hartmann6: -1.59081 (SEM: 0)
x1: 0.291886
x2: 0.802048
x3: 7.1236e-17
x4: 0.720476
x5: 0.0649436
x6: 0.151729", "Arm 13_0
hartmann6: -1.22786 (SEM: 0)
x1: 0.246646
x2: 0.761987
x3: 2.18696e-15
x4: 0.750669
x5: 0.013078
x6: 0.107559", "Arm 14_0
hartmann6: -1.77513 (SEM: 0)
x1: 0.321154
x2: 0.825067
x3: 0
x4: 0.686749
x5: 0.112809
x6: 0.180487", "Arm 15_0
hartmann6: -2.19764 (SEM: 0)
x1: 0.345251
x2: 0.873911
x3: 1.56621e-16
x4: 0.630584
x5: 0.118401
x6: 0.17155", "Arm 16_0
hartmann6: -2.55445 (SEM: 0)
x1: 0.352053
x2: 0.914785
x3: 2.34788e-15
x4: 0.587442
x5: 0.0834193
x6: 0.135297", "Arm 17_0
hartmann6: -2.67386 (SEM: 0)
x1: 0.364501
x2: 0.958507
x3: 2.49352e-14
x4: 0.542167
x5: 0.0514755
x6: 0.102869", "Arm 18_0
hartmann6: -1.95599 (SEM: 0)
x1: 0.282416
x2: 0.98774
x3: 6.45181e-13
x4: 0.533095
x5: 0.0565007
x6: 0.121097", "Arm 19_0
hartmann6: -2.99256 (SEM: 0)
x1: 0.395849
x2: 0.899791
x3: 3.14281e-11
x4: 0.554687
x5: 0.0424725
x6: 0.0777052", "Arm 20_0
hartmann6: -2.94891 (SEM: 0)
x1: 0.447521
x2: 0.877813
x3: 2.36188e-14
x4: 0.544158
x5: 0.0296832
x6: 0.0534532", "Arm 21_0
hartmann6: -3.02636 (SEM: 0)
x1: 0.399964
x2: 0.873553
x3: 0
x4: 0.536346
x5: 0.0711293
x6: 0.0235337", "Arm 22_0
hartmann6: -2.9998 (SEM: 0)
x1: 0.396877
x2: 0.862816
x3: 8.46648e-12
x4: 0.527773
x5: 6.85574e-11
x6: 0.036893", "Arm 23_0
hartmann6: -3.05173 (SEM: 0)
x1: 0.405402
x2: 0.894451
x3: 8.30012e-11
x4: 0.574774
x5: 0.0215146
x6: 0.0144279" ], "type": "scatter", "x": [ 0.683047890663147, 0.3563357926905155, 0.44123843405395746, 0.6195022044703364, 0.4430128764361143, 0.7283716881647706, 0.6930027222260833, 0.9426247421652079, 0.23566909786313772, 0.36117489263415337, 0.07940262276679277, 0.12532732635736465, 0.2918858754281117, 0.24664562790136724, 0.3211538053896731, 0.3452510063185415, 0.3520527990780777, 0.3645013604473095, 0.28241633395889637, 0.39584867123770423, 0.44752063878526455, 0.3999636756068057, 0.39687664002075385, 0.40540241577826924 ], "xaxis": "x", "y": [ 0.6501427292823792, 0.9780319770798087, 0.964614593423903, 0.20255481638014317, 0.8791612721979618, 0.909786757081747, 0.6495023537427187, 0.848329939879477, 0.3410754641517997, 0.30192967411130667, 0.8396363509818912, 0.011482344940304756, 0.8020475529581593, 0.7619869222759237, 0.8250669691445406, 0.8739114444113665, 0.9147847678173355, 0.9585065762264698, 0.987739840448971, 0.8997906984526503, 0.8778132257058378, 0.873553303418696, 0.8628164856862732, 0.8944508109996436 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.0807968 (SEM: 0)
x1: 0.683048
x2: 0.650143
x3: 0.119252
x4: 0.288837
x5: 0.56801
x6: 0.991039", "Arm 1_0
hartmann6: -1.09306 (SEM: 0)
x1: 0.356336
x2: 0.978032
x3: 0.00764026
x4: 0.858375
x5: 0.0818928
x6: 0.129771", "Arm 2_0
hartmann6: -0.108989 (SEM: 0)
x1: 0.441238
x2: 0.964615
x3: 0.162928
x4: 0.0989579
x5: 0.14974
x6: 0.723757", "Arm 3_0
hartmann6: -0.00647902 (SEM: 0)
x1: 0.619502
x2: 0.202555
x3: 0.289526
x4: 0.939453
x5: 0.721105
x6: 0.216677", "Arm 4_0
hartmann6: -0.223665 (SEM: 0)
x1: 0.443013
x2: 0.879161
x3: 0.288397
x4: 0.497797
x5: 0.117522
x6: 0.530443", "Arm 5_0
hartmann6: -0.0960562 (SEM: 0)
x1: 0.728372
x2: 0.909787
x3: 0.556529
x4: 0.917842
x5: 0.422513
x6: 0.232883", "Arm 6_0
hartmann6: -0.0348777 (SEM: 0)
x1: 0.693003
x2: 0.649502
x3: 0.814413
x4: 0.856153
x5: 0.910842
x6: 0.399173", "Arm 7_0
hartmann6: -0.0213385 (SEM: 0)
x1: 0.942625
x2: 0.84833
x3: 0.677237
x4: 0.47833
x5: 0.558738
x6: 0.0171991", "Arm 8_0
hartmann6: -0.205231 (SEM: 0)
x1: 0.235669
x2: 0.341075
x3: 0.00838903
x4: 0.355622
x5: 0.0523779
x6: 0.206685", "Arm 9_0
hartmann6: -0.994192 (SEM: 0)
x1: 0.361175
x2: 0.30193
x3: 0.993517
x4: 0.268016
x5: 0.439813
x6: 0.791396", "Arm 10_0
hartmann6: -0.0893587 (SEM: 0)
x1: 0.0794026
x2: 0.839636
x3: 0.256346
x4: 0.107266
x5: 0.551899
x6: 0.29639", "Arm 11_0
hartmann6: -0.0699834 (SEM: 0)
x1: 0.125327
x2: 0.0114823
x3: 0.78728
x4: 0.751094
x5: 0.703226
x6: 0.579849", "Arm 12_0
hartmann6: -1.59081 (SEM: 0)
x1: 0.291886
x2: 0.802048
x3: 7.1236e-17
x4: 0.720476
x5: 0.0649436
x6: 0.151729", "Arm 13_0
hartmann6: -1.22786 (SEM: 0)
x1: 0.246646
x2: 0.761987
x3: 2.18696e-15
x4: 0.750669
x5: 0.013078
x6: 0.107559", "Arm 14_0
hartmann6: -1.77513 (SEM: 0)
x1: 0.321154
x2: 0.825067
x3: 0
x4: 0.686749
x5: 0.112809
x6: 0.180487", "Arm 15_0
hartmann6: -2.19764 (SEM: 0)
x1: 0.345251
x2: 0.873911
x3: 1.56621e-16
x4: 0.630584
x5: 0.118401
x6: 0.17155", "Arm 16_0
hartmann6: -2.55445 (SEM: 0)
x1: 0.352053
x2: 0.914785
x3: 2.34788e-15
x4: 0.587442
x5: 0.0834193
x6: 0.135297", "Arm 17_0
hartmann6: -2.67386 (SEM: 0)
x1: 0.364501
x2: 0.958507
x3: 2.49352e-14
x4: 0.542167
x5: 0.0514755
x6: 0.102869", "Arm 18_0
hartmann6: -1.95599 (SEM: 0)
x1: 0.282416
x2: 0.98774
x3: 6.45181e-13
x4: 0.533095
x5: 0.0565007
x6: 0.121097", "Arm 19_0
hartmann6: -2.99256 (SEM: 0)
x1: 0.395849
x2: 0.899791
x3: 3.14281e-11
x4: 0.554687
x5: 0.0424725
x6: 0.0777052", "Arm 20_0
hartmann6: -2.94891 (SEM: 0)
x1: 0.447521
x2: 0.877813
x3: 2.36188e-14
x4: 0.544158
x5: 0.0296832
x6: 0.0534532", "Arm 21_0
hartmann6: -3.02636 (SEM: 0)
x1: 0.399964
x2: 0.873553
x3: 0
x4: 0.536346
x5: 0.0711293
x6: 0.0235337", "Arm 22_0
hartmann6: -2.9998 (SEM: 0)
x1: 0.396877
x2: 0.862816
x3: 8.46648e-12
x4: 0.527773
x5: 6.85574e-11
x6: 0.036893", "Arm 23_0
hartmann6: -3.05173 (SEM: 0)
x1: 0.405402
x2: 0.894451
x3: 8.30012e-11
x4: 0.574774
x5: 0.0215146
x6: 0.0144279" ], "type": "scatter", "x": [ 0.683047890663147, 0.3563357926905155, 0.44123843405395746, 0.6195022044703364, 0.4430128764361143, 0.7283716881647706, 0.6930027222260833, 0.9426247421652079, 0.23566909786313772, 0.36117489263415337, 0.07940262276679277, 0.12532732635736465, 0.2918858754281117, 0.24664562790136724, 0.3211538053896731, 0.3452510063185415, 0.3520527990780777, 0.3645013604473095, 0.28241633395889637, 0.39584867123770423, 0.44752063878526455, 0.3999636756068057, 0.39687664002075385, 0.40540241577826924 ], "xaxis": "x2", "y": [ 0.6501427292823792, 0.9780319770798087, 0.964614593423903, 0.20255481638014317, 0.8791612721979618, 0.909786757081747, 0.6495023537427187, 0.848329939879477, 0.3410754641517997, 0.30192967411130667, 0.8396363509818912, 0.011482344940304756, 0.8020475529581593, 0.7619869222759237, 0.8250669691445406, 0.8739114444113665, 0.9147847678173355, 0.9585065762264698, 0.987739840448971, 0.8997906984526503, 0.8778132257058378, 0.873553303418696, 0.8628164856862732, 0.8944508109996436 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "hartmann6" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "id": "b1275695", "metadata": { "papermill": { "duration": 0.053292, "end_time": "2024-05-02T22:15:26.327321", "exception": false, "start_time": "2024-05-02T22:15:26.274029", "status": "completed" }, "tags": [] }, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "id": "1c3e709c", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:26.435561Z", "iopub.status.busy": "2024-05-02T22:15:26.434896Z", "iopub.status.idle": "2024-05-02T22:15:27.147096Z", "shell.execute_reply": "2024-05-02T22:15:27.146382Z" }, "papermill": { "duration": 0.771321, "end_time": "2024-05-02T22:15:27.151892", "exception": false, "start_time": "2024-05-02T22:15:26.380571", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:26] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.9835407644122491, 0.9844187453802027, 0.9860309667330663, 0.9883792894347679, 0.9914613116529761, 0.9952704236497947, 0.9997959087058972, 1.0050230823957644, 1.0109334624580941, 1.0175049622440944, 1.0247121021084848, 1.0325262348649549, 1.0409157832388674, 1.049846488801368, 1.059281672915173, 1.0691825106288733, 1.079508318220397, 1.090216854325246, 1.1012646334863008, 1.1126072497546815, 1.1241997068633898, 1.135996750642724, 1.1479531988360485, 1.1600242633267026, 1.172165859969026, 1.1843349016621079, 1.196489570932795, 1.2085895690241828, 1.2205963392471706, 1.2324732630917534, 1.2441858282739726, 1.255701768492466, 1.2669911751759981, 1.2780265819206316, 1.288783022648835, 1.299238064782412, 1.3093718189182373, 1.319166926640968, 1.328608528210359, 1.3376842119304475, 1.3463839470503736, 1.3547000020665205, 1.362626850296381, 1.370161064578112, 1.3773012029175455, 1.38404768685706, 1.390402674278978, 1.396369928280419, 1.4019546836677055, 1.4071635125175153 ], [ 0.9799903824871625, 0.9808857090242722, 0.9825291564769016, 0.9849227774522882, 0.9880642367786092, 0.9919468685715933, 0.9965597813942495, 1.0018880032492987, 1.007912658062696, 1.014611166124427, 1.0219574624669567, 1.0299222290896213, 1.0384731389269724, 1.0475751111660672, 1.0571905786703029, 1.0672797687174143, 1.077800998001362, 1.088710982007579, 1.0999651576626766, 1.111518016832459, 1.123323447024842, 1.13533507471916, 1.1475066061854045, 1.159792160497771, 1.172146589648729, 1.1845257811579848, 1.1968869392543326, 1.2091888414981198, 1.2213920685308621, 1.233459205427469, 1.2453550138458453, 1.2570465747959276, 1.2685034023771466, 1.279697529261651, 1.2906035650388772, 1.301198728796717, 1.3114628575088407, 1.3213783919387025, 1.3309303418695282, 1.3401062325348816, 1.348896034163085, 1.3572920765657497, 1.365288950699113, 1.3728833991088196, 1.3800741971352506, 1.386862026708065, 1.3932493444955643, 1.3992402460972444, 1.4048403278770158, 1.4100565479310943 ], [ 0.976837090480382, 0.9777504435203919, 0.9794252159399864, 0.9818636612917508, 0.9850635231698976, 0.9890180943407011, 0.9937163260262949, 0.9991429784835932, 1.0052788039306884, 1.0121007537534166, 1.0195822035781699, 1.027693191905634, 1.036400670179364, 1.04566876403559, 1.055459046747348, 1.065730826372505, 1.0764414478343245, 1.0875466102411648, 1.0990006984246545, 1.1107571262167137, 1.122768687648858, 1.1349879112311698, 1.1473674118583788, 1.1598602347191227, 1.1724201858084127, 1.1850021441786383, 1.1975623518093206, 1.2100586778310276, 1.2224508547194677, 1.2347006849177118, 1.2467722171053917, 1.2586318919907495, 1.2702486580472983, 1.281594058055172, 1.292642287648675, 1.3033702273299375, 1.3137574495987878, 1.3237862029847547, 1.3334413748604825, 1.3427104349763712, 1.3515833616910058, 1.3600525528860172, 1.368112723550479, 1.3757607920005812, 1.3829957566659519, 1.3898185653248896, 1.3962319786069348, 1.402240429502832, 1.4078498805294108, 1.4130676800911706 ], [ 0.9741044741465192, 0.9750366257851446, 0.9767428382473173, 0.9792255749512515, 0.982482670814041, 0.9865073933206053, 0.9912885557890128, 0.996810673356602, 1.0030541521135328, 1.0099955027673735, 1.0176075720230355, 1.025859787162105, 1.0347184116864705, 1.0441468119397512, 1.0541057360086765, 1.0645536067525778, 1.0754468305025036, 1.0867401219598811, 1.0983868443663711, 1.110339362412924, 1.1225494038867243, 1.134968424928857, 1.147547973108861, 1.1602400423385624, 1.1729974138974015, 1.1857739784296757, 1.198525034586969, 1.2112075609158373, 1.2237804585380165, 1.2362047630684518, 1.2484438250203789, 1.2604634586335735, 1.2722320596257322, 1.283720692813835, 1.2949031508953175, 1.305755985934348, 1.3162585152833044, 1.32639280379911, 1.336143624301365, 1.3454983982746063, 1.354447118847815, 1.3629822580955948, 1.3710986607002527, 1.3787934259938535, 1.3860657803645702, 1.3929169419624747, 1.3993499795757796, 1.4053696674695701, 1.4109823378853168, 1.416195732791761 ], [ 0.9718157491516184, 0.9727675698555358, 0.9745053592830621, 0.9770317990881514, 0.9803448283921541, 0.9844377066598833, 0.9892991307785614, 0.9949133962262791, 1.0012605921111022, 1.0083168209008453, 1.016054435620745, 1.024442289799714, 1.0334459980412303, 1.0430282073319828, 1.0531488807200426, 1.0637655955926264, 1.0748338584469528, 1.0863074369364336, 1.0981387083705663, 1.1102790220825576, 1.1226790714629402, 1.1352892702217499, 1.148060126714039, 1.1609426099684026, 1.1738885013388538, 1.1868507263490349, 1.1997836621863953, 1.2126434173093052, 1.2253880806489086, 1.2379779388447456, 1.250375660801177, 1.2625464495680299, 1.274458162129366, 1.2860813981378532, 1.2973895589748117, 1.3083588787667935, 1.3189684291674566, 1.3292000998357643, 1.3390385566221303, 1.348471179524037, 1.3574879824995003, 1.3660815172355614, 1.3742467629625927, 1.3819810043846892, 1.3892836997620348, 1.3961563411323854, 1.402602308595028, 1.4086267205015695, 1.4142362813033387, 1.419439128696037 ], [ 0.9699935971514655, 0.9709660626859957, 0.972735593786449, 0.9753050979782949, 0.9786726316392085, 0.9828314645542588, 0.9877702006234119, 0.9934729439474383, 0.9999194994070423, 1.0070855979774085, 1.0149431391456014, 1.023460445519776, 1.0326025275445674, 1.0423313586758753, 1.0526061630259944, 1.0633837181422623, 1.0746186752101532, 1.0862638977472496, 1.0982708180872212, 1.110589809008826, 1.1231705660864053, 1.1359624949822338, 1.1489150971083824, 1.1619783468817992, 1.175103054114952, 1.1882412058026564, 1.2013462825394472, 1.2143735458932419, 1.2272802941569827, 1.2400260849189206, 1.2525729237850625, 1.2648854193321217, 1.2769309049646804, 1.2886795288081903, 1.300104313109502, 1.3111811848606856, 1.3218889795315274, 1.3322094199099164, 1.3421270721226923, 1.3516292809537376, 1.3607060865991267, 1.3693501250058235, 1.377556513933286, 1.3853227268572295, 1.3926484568013433, 1.3995354721351865, 1.4059874663137768, 1.412009903455776, 1.4176098615625414, 1.4227958750698886 ], [ 0.9686599937451648, 0.9696541916333823, 0.9714556630102191, 0.9740675479777281, 0.9774880332135019, 0.9817104180920861, 0.9867232388295601, 0.9925104391903876, 0.9990515761812713, 1.0063220503820216, 1.0142933528707312, 1.022933323657633, 1.032206419615506, 1.0420739925505969, 1.0524945798640715, 1.063424210961334, 1.0748167321496644, 1.086624151410027, 1.0987970024757867, 1.1112847255046945, 1.1240360596705699, 1.1369994415135667, 1.1501234020274644, 1.1633569552543397, 1.1766499715229344, 1.1899535292662935, 1.2032202404236394, 1.216404545617285, 1.2294629764735068, 1.2423543835395217, 1.2550401291862503, 1.2674842456583613, 1.279653559040695, 1.2915177803699938, 1.3030495654557264, 1.3142245452092642, 1.3250213284403156, 1.3354214791841093, 1.345409470688299, 1.3549726182270967, 1.3641009929295305, 1.3727873188137376, 1.381026855212069, 1.388817266752655, 1.3961584830314422, 1.4030525500630473, 1.409503475537799, 1.415517069834921, 1.421100784647471, 1.4262635509635726 ], [ 0.9678360299976043, 0.9688531652931185, 0.97068681555801, 0.9733403590421019, 0.9768121255576059, 0.9810954640826868, 0.9861788701588927, 0.9920461609014846, 0.9986766853295086, 1.0060455590576691, 1.0141239148996346, 1.0228791641460726, 1.0322752666237065, 1.0422730105323894, 1.0528303050217631, 1.0639024892306788, 1.0754426610393326, 1.0874020272774487, 1.0997302749660756, 1.1123759607950068, 1.125286913876018, 1.1384106451816565, 1.1516947561500908, 1.165087338731468, 1.1785373595767223, 1.1919950219635451, 1.2054121002311993, 1.2187422427848895, 1.2319412409957613, 1.2449672624716142, 1.2577810481549525, 1.2703460735012977, 1.2826286746076663, 1.2945981406196827, 1.3062267740728324, 1.3174899210480906, 1.328365973170414, 1.338836343572931, 1.3488854190070416, 1.3585004903114202, 1.3676716634690926, 1.3763917534857428, 1.3846561633158474, 1.392462750046102, 1.3998116805164913, 1.4067052785164835, 1.4131478656353678, 1.4191455977702032, 1.4247062992014343, 1.4298392960349613 ], [ 0.9675417295309878, 0.9685831296554184, 0.9704492433159548, 0.973143691144948, 0.9766649585004433, 0.9810064645125094, 0.9861566925721199, 0.9920993693194744, 0.9988136790864429, 1.006274502209912, 1.0144526683632997, 1.0233152195499502, 1.032825681039226, 1.042944341671345, 1.0536285470901405, 1.0648330102766346, 1.0765101432106152, 1.0886104118020266, 1.101082713822849, 1.1138747769346262, 1.1269335715200983, 1.1402057312429186, 1.1536379732625723, 1.1671775098397834, 1.1807724435679736, 1.194372139470474, 1.207927568500791, 1.2213916183844924, 1.2347193690981964, 1.247868331496907, 1.2607986486245788, 1.2734732600605054, 1.285858030276953, 1.2979218424372259, 1.3096366593799789, 1.320977553747267, 1.3319227093494557, 1.3424533959434428, 1.3525539196496428, 1.3622115512605297, 1.3714164347069164, 1.3801614779517857, 1.3884422285764537, 1.3962567363094889, 1.4036054047231874, 1.410490834283257, 1.4169176588821744, 1.4228923779138032, 1.4284231858549468, 1.4335198012086103 ], [ 0.9677958634434776, 0.9688629818091039, 0.9707618946466101, 0.9734964676771016, 0.9770653535747391, 0.9814620624780301, 0.9866750954487729, 0.9926881271184742, 0.9994802236825275, 1.0070260840139889, 1.0152962946515478, 1.0242575932264304, 1.0338731388531135, 1.0441027914298842, 1.0549034041070158, 1.0662291340412844, 1.0780317759169655, 1.0902611208165158, 1.1028653403294153, 1.1157913928568302, 1.1289854464333724, 1.1423933104385837, 1.1559608675097943, 1.169634496803411, 1.1833614803452441, 1.197090385342645, 1.2107714167638985, 1.2243567360121828, 1.2378007429737756, 1.25106032000226, 1.264095037463493, 1.2768673213013064, 1.2893425837084298, 1.301489318432664, 1.3132791625514728, 1.3246869267450556, 1.3356905962195538, 1.3462713045039199, 1.3564132823845974, 1.3661037842642862, 1.3753329942424666, 1.3840939142192914, 1.3923822363219867, 1.4001962019422034, 1.4075364496516996, 1.4144058542291504, 1.4208093589799462, 1.4267538034613265, 1.4322477486355343, 1.4373013013635412 ], [ 0.9686157654911991, 0.9697101836012042, 0.971642287190686, 0.9744161880785347, 0.9780307171801221, 0.9824794965846988, 0.987751075919751, 0.9938291183540486, 1.0006926215531122, 1.008316160692702, 1.0166701439078119, 1.0257210747154404, 1.035431820264499, 1.0457618879859656, 1.0566677157157167, 1.0681029812624805, 1.0800189366367257, 1.0923647700089003, 1.1050879954431703, 1.1181348671873437, 1.1314508123875258, 1.144980873974253, 1.158670154348948, 1.1724642503796814, 1.1863096709236454, 1.2001542293738972, 1.2139474053098605, 1.2276406709819394, 1.2411877799107411, 1.2545450162282434, 1.2676714044868616, 1.280528880510396, 1.2930824244825958, 1.305300157902696, 1.3171534063242678, 1.3286167299739338, 1.339667924453191, 1.3502879937866301, 1.360461098112231, 1.370174478326943, 1.3794183600107293, 1.3881858389576538, 1.396472750643412, 1.4042775259529026, 1.4116010354758486, 1.418446424649497, 1.424818941981635, 1.4307257625218313, 1.436175808662053, 1.4411795702390524 ], [ 0.9700171500338144, 0.9711405777292659, 0.973106322691527, 0.9759187420201516, 0.979576854782895, 0.9840744158548015, 0.989400055194195, 0.9955374669283896, 1.0024656326531936, 1.0101590653643264, 1.018588064045743, 1.027718973493683, 1.0375144486596364, 1.047933726835871, 1.0589329137005004, 1.0704652901664506, 1.082481646073326, 1.094930644319046, 1.1077592156288731, 1.120912980516943, 1.1343366917807878, 1.1479746885677402, 1.1617713518879107, 1.1756715513949263, 1.1896210741031854, 1.2035670271596746, 1.217458208533794, 1.23124544127554, 1.2448818686413317, 1.258323208795511, 1.2715279689248502, 1.2844576194590798, 1.2970767297048698, 1.3093530666186806, 1.3212576587123201, 1.33276482724705, 1.3438521869632105, 1.3545006186405069, 1.3646942158086042, 1.3744202079412857, 1.3836688624768712, 1.3924333680153216, 1.4007097010477336, 1.4084964785740064, 1.415794798955446, 1.4226080733266948, 1.4289418498516948, 1.434803633048061, 1.4402027003211046, 1.4451499177418845 ], [ 0.9720139351572774, 0.9731682086647158, 0.9751681061849632, 0.978018227386277, 0.9817177882819121, 0.9862606971317824, 0.9916356967149687, 0.9978265562529463, 1.0048122964046242, 1.0125674330460894, 1.0210622295455014, 1.0302629522380289, 1.0401321289332248, 1.0506288146677625, 1.0617088718063636, 1.0733252725318034, 1.085428430675699, 1.097966567055341, 1.110886108652676, 1.1241321179072028, 1.137648744851738, 1.1513796923346202, 1.165268683376163, 1.1792599197451248, 1.1932985218541827, 1.2073309417131626, 1.2213053426012026, 1.2351719410471718, 1.2488833084548345, 1.2623946311754903, 1.2756639289852685, 1.288652232781935, 1.3013237229186065, 1.3136458299907845, 1.325589300140879, 1.33712822708706, 1.3482400531586047, 1.3589055416563398, 1.369108722874012, 1.3788368161268891, 1.3880801301437098, 1.3968319441892074, 1.4050883722952308, 1.4128482129855118, 1.4201127868777854, 1.4268857645322266, 1.4331729868825536, 1.4389822805316657, 1.4443232701148985, 1.44920718982954 ], [ 0.9746180731164289, 0.9758051505462995, 0.9778397716522562, 0.9807267740808974, 0.9844655784631848, 0.9890502667865828, 0.9944697278236676, 1.000707851665109, 1.0077437557144684, 1.015552027143877, 1.0241029712645076, 1.0333628607501568, 1.0432941862337566, 1.0538559135302248, 1.0650037558217427, 1.076690470068855, 1.088866185598169, 1.1014787696344077, 1.1144742302303836, 1.127797152517797, 1.1413911603068787, 1.1551993923937205, 1.1691649817253138, 1.1832315257296306, 1.197343537324539, 1.2114468679703476, 1.2254890962416438, 1.2394198774669252, 1.2531912518271138, 1.266757909822495, 1.280077415190726, 1.293110386212815, 1.305820636930228, 1.3181752801735718, 1.3301447945287719, 1.3417030574894755, 1.3528273471039152, 1.3634983144496804, 1.3736999292806231, 1.3834194011981795, 1.392647078710729, 1.40137632855998, 1.4096033977108438, 1.4173272604162765, 1.4245494527759748, 1.4312738972017842, 1.4375067191780497, 1.4432560586574232, 1.448531878358886, 1.453345771133331 ], [ 0.9778393897574837, 0.9790613437162846, 0.9811313157919549, 0.9840543752718911, 0.9878301540985501, 0.9924529282135045, 0.9979117663535436, 1.004190726952372, 1.0112690843598016, 1.019121568673361, 1.0277186084650363, 1.037026571708245, 1.0470080062677258, 1.0576218864045759, 1.068823875011822, 1.0805666121856152, 1.0928000391592883, 1.1054717629951551, 1.118527462575539, 1.1319113313959774, 1.1455665483965, 1.159435765217983, 1.1734615970709952, 1.1875871047103865, 1.2017562564358963, 1.2159143611197778, 1.2300084655707388, 1.2439877117614422, 1.2578036513806472, 1.2714105167349767, 1.2847654482106863, 1.297828679351269, 1.310563681173066, 1.3229372676945341, 1.3349196648570345, 1.3464845451179754, 1.357609030041221, 1.368273663224537, 1.3784623559088374, 1.3881623076208607, 1.3973639042144423, 1.4060605956964312, 1.4142487562482975, 1.4219275288786215, 1.4290986571588977, 1.4357663064987232, 1.4419368774008696, 1.447618813096588, 1.452822403893525, 1.4575595904707983 ], [ 0.9816854338732588, 0.9829444408863144, 0.9850504409182423, 0.9880087270920479, 0.9918191487154434, 0.9964761961539256, 1.0019691532069446, 1.0082822960666549, 1.015395118853765, 1.0232825693614171, 1.031915284239678, 1.041259819453909, 1.0512788783913345, 1.0619315454234308, 1.0731735361529038, 1.0849574763944345, 1.0972332200538304, 1.109948211938733, 1.1230478960929968, 1.1364761646640704, 1.1501758376596884, 1.1640891609302721, 1.1781583085473524, 1.1923258762323388, 1.2065353541618729, 1.2207315698016776, 1.2348610939316882, 1.2488726053860513, 1.2627172120505057, 1.276348727261825, 1.289723901945367, 1.3028026136588584, 1.31554801425421, 1.3279266381975723, 1.3399084737667561, 1.3514669994287005, 1.362579187729293, 1.373225479033198, 1.3833897274517046, 1.3930591213029904, 1.4022240804661283, 1.4108781330172429, 1.4190177735698677, 1.4266423057758166, 1.4337536714708756, 1.4403562689641303, 1.4464567629639937, 1.452063888602463, 1.4571882519575683, 1.461842129380332 ], [ 0.9861613365227169, 0.9874596630256696, 0.9896024071514725, 0.9925950770501583, 0.996437745396308, 1.0011251383308204, 1.0066467915413966, 1.0129872508043252, 1.0201262957207717, 1.028039169699535, 1.0366968055333048, 1.0460660431179756, 1.0561098428744669, 1.0667875041785606, 1.0780549016492278, 1.0898647528626046, 1.1021669288296332, 1.1149088139034113, 1.1280357157145322, 1.1414913195794636, 1.1552181767814875, 1.1691582129461768, 1.183253241626164, 1.1974454688987688, 1.2116779767169017, 1.2258951753343144, 1.240043217840155, 1.2540703723364857, 1.2679273493887084, 1.2815675840119294, 1.2949474726481094, 1.3080265664039514, 1.32076772233897, 1.333137214896426, 1.3451048097260767, 1.3566438022130007, 1.367731023043188, 1.3783468131335281, 1.388474970250567, 1.398102669649274, 1.4072203610840825, 1.4158216445787173, 1.4239031273844078, 1.4314642646013944, 1.4385071859784098, 1.445036511431115, 1.4510591578256136, 1.4565841395509513, 1.4616223653502627, 1.4661864337911437 ], [ 0.9912696792556541, 0.992609664006842, 0.9947898930779925, 0.9978160805188707, 1.0016885292090922, 1.0064022242685373, 1.0119469927376468, 1.0183077049334863, 1.025464494961622, 1.033392983003314, 1.042064489050907, 1.0514462355648955, 1.0615015439613193, 1.0721900358444127, 1.0834678535235813, 1.0952879149324057, 1.1076002154641915, 1.120352183998126, 1.1334890936717652, 1.146954521218894, 1.1606908432568364, 1.174639754589354, 1.1887427925667835, 1.2029418524601478, 1.2171796810208386, 1.2314003382360632, 1.2455496202031644, 1.2595754386741616, 1.2734281549870359, 1.2870608677574569, 1.3004296548922731, 1.3134937712824029, 1.3262158040278602, 1.3385617873266509, 1.3505012792946482, 1.362007403032322, 1.3730568542588206, 1.3836298778239289, 1.3937102154023924, 1.4032850266832877, 1.4123447863929688, 1.4208831595321791, 1.428896857261234, 1.436385475924324, 1.4433513217565812, 1.4497992238564272, 1.455736338022854, 1.4611719440451962, 1.466117238986675, 1.4705851289192169 ], [ 0.9970103690167514, 0.9983944019149433, 1.0006128630137026, 1.0036716637511471, 1.007571346115596, 1.0123071805977568, 1.0178693289350869, 1.024243045041594, 1.0314088904426266, 1.039342946622984, 1.0480170145413643, 1.0573987999188301, 1.067452090692526, 1.078136939219187, 1.0894098654650677, 1.1012240978297927, 1.1135298652588608, 1.1262747484814666, 1.1394040908375984, 1.1528614618422912, 1.1665891608240722, 1.1805287445362296, 1.1946215617177143, 1.2088092787348914, 1.2230343829319748, 1.2372406534098976, 1.251373592055436, 1.265380810389832, 1.2792123700309834, 1.2928210762388002, 1.3061627251939132, 1.3191963064371088, 1.3318841623690432, 1.3441921069669316, 1.356089505991713, 1.3675493209937086, 1.3785481194195444, 1.3890660531073395, 1.3990868074494438, 1.408597523512082, 1.417588695432476, 1.4260540454644273, 1.4339903791074635, 1.4413974228244488, 1.4482776469186867, 1.4546360761941073, 1.4604800910519495, 1.4658192216764285, 1.4706649379241912, 1.4750304374544234 ], [ 1.0033805164160434, 1.0048110138824886, 1.0070684380606258, 1.0101588910805426, 1.0140831665908188, 1.018836851732061, 1.0244104917054209, 1.0307897883453174, 1.037955808068811, 1.0458851817016166, 1.0545502872928203, 1.0639194158441814, 1.0739569279017203, 1.0846234152504415, 1.09587588558216, 1.1076679882312517, 1.1199502956937573, 1.132670649264418, 1.1457745691193357, 1.1592057213003524, 1.1729064278948296, 1.1868182031667374, 1.200882297588549, 1.2150402331193597, 1.229234315845497, 1.2434081154314545, 1.2575069041055662, 1.2714780507584622, 1.2852713680083758, 1.2988394117764905, 1.3121377340885332, 1.3251250905784326, 1.3377636046222774, 1.3500188902695234, 1.3618601362400478, 1.373260153278584, 1.3841953871449368, 1.3946458994981992, 1.4045953189245455, 1.4140307643705423, 1.4229427432809238, 1.4313250267987458, 1.4391745044613293, 1.4464910209084096, 1.453277197199375, 1.4595382394035745, 1.465281737171153, 1.4705174550028468, 1.4752571189089205, 1.4795142010757611 ], [ 1.010374313275976, 1.0118536905769777, 1.014150767518525, 1.0172718334905653, 1.0212179519044418, 1.0259850647163478, 1.0315641565330675, 1.0379414479584543, 1.045098592976691, 1.053012863338784, 1.061657312189614, 1.0710009182939564, 1.0810087203453174, 1.091641957146729, 1.1028582330195085, 1.1146117278345198, 1.1268534673205168, 1.1395316624016223, 1.1525921177219818, 1.165978701132927, 1.179633859438845, 1.1934991620808542, 1.2075158537494846, 1.2216253985439356, 1.2357700013202209, 1.2498930954195557, 1.2639397893993576, 1.2778572683349372, 1.2915951475792071, 1.305105778567968, 1.3183445074249964, 1.3312698878671072, 1.3438438503466061, 1.3560318295935883, 1.3678028528110384, 1.3791295907902414, 1.3899883741950279, 1.400359177240143, 1.4102255709799483, 1.4195746484387255, 1.428396923856527, 1.4366862083923875, 1.444439464713695, 1.4516566429973807, 1.4583405009640016, 1.4644964106482983, 1.4701321546677946, 1.4752577147747328, 1.4798850554584737, 1.4840279053007346 ], [ 1.0179829052093978, 1.0195135463513678, 1.0218508971957003, 1.0250014358634068, 1.0289665213014743, 1.033742497486297, 1.0393208533340506, 1.0456884067621084, 1.0528274876749733, 1.0607161037199782, 1.0693280823673337, 1.0786331920931331, 1.0885972535347925, 1.0991822577379335, 1.1103465121047884, 1.122044834530434, 1.13422881216325, 1.1468471338696191, 1.1598459963748324, 1.1731695752229387, 1.186760544946427, 1.2005606291568824, 1.2145111606902494, 1.228553633771178, 1.2426302334068562, 1.2566843309557352, 1.2706609383780945, 1.2845071166980289, 1.298172336561984, 1.3116087904899323, 1.3247716575792012, 1.337619322158913, 1.3501135483212678, 1.3622196124730985, 1.3739063961351494, 1.385146441226094, 1.3959159700457406, 1.4061948721466555, 1.4159666602743628, 1.4252183975740318, 1.4339405983097513, 1.4421271044191173, 1.4497749403246358, 1.4568841485343311, 1.4634576086751256, 1.4695008427011538, 1.4750218090925165, 1.4800306888973296, 1.4845396664625021, 1.4885627076413543 ], [ 1.0261942558297816, 1.0277784819396643, 1.0301566321046567, 1.0333353812510495, 1.0373164194364677, 1.0420965509477873, 1.0476678444204637, 1.054017802153857, 1.0611295241125192, 1.0689818517178138, 1.07754948633378, 1.0868030864429377, 1.0967093554554543, 1.1072311382678164, 1.118327548128282, 1.1299541451325046, 1.1420631833862644, 1.1546039361527445, 1.1675230987758356, 1.1807652599770713, 1.194273425149942, 1.2079895715454445, 1.2218552147548374, 1.2358119678908641, 1.249802078290644, 1.2637689304454083, 1.2776575075266388, 1.2914148069621405, 1.3049902079019304, 1.3183357901371087, 1.3314066052016682, 1.3441609011246187, 1.356560302726685, 1.3685699495718273, 1.3801585937666574, 1.3912986598090296, 1.4019662686631453, 1.4121412282122463, 1.4218069922312582, 1.4309505900416846, 1.4395625290645826, 1.4476366725724596, 1.4551700950514623, 1.46216291771048, 1.4686181268012408, 1.4745413775288783, 1.4799407864220384, 1.484826715083273, 1.4892115482445527, 1.4931094690033273 ], [ 1.0349930014591797, 1.036633038843955, 1.0390523932960234, 1.0422579527642295, 1.0462517856078781, 1.0510312273554494, 1.056589013203221, 1.0629134256060673, 1.0699884340503631, 1.0777938136132523, 1.08630523833079, 1.0954943541348432, 1.1053288438880562, 1.1157725031954668, 1.1267853491380597, 1.1383237838087263, 1.1503408300984472, 1.1627864492046294, 1.175607939502285, 1.1887504069550066, 1.202157290101852, 1.2157709188835577, 1.2295330861413554, 1.2433856127285317, 1.257270890717489, 1.2711323931686136, 1.2849151426639873, 1.2985661339386227, 1.3120347083547506, 1.325272879703564, 1.3382356119958376, 1.3508810506486457, 1.3631707089095746, 1.3750696115819365, 1.3865463982018014, 1.397573387828307, 1.40812660758555, 1.418185787067923, 1.4277343207122035, 1.4367592002615899, 1.445250919504858, 1.4532033535669573, 1.4606136151493379, 1.4674818902582145, 1.4738112561030874, 1.4796074839808058, 1.4848788300670517, 1.489635817103933, 1.4938910099886091, 1.4976587882269246 ], [ 1.0443602992477556, 1.0460582485651193, 1.0485190724811255, 1.0517498973794486, 1.0557532297560503, 1.060527020506835, 1.0660647695168288, 1.072355643079223, 1.0793845837659104, 1.0871324008145282, 1.0955758375802092, 1.1046876208372667, 1.114436504393129, 1.1247873257501042, 1.1357010981698301, 1.1471351602987467, 1.1590434010313453, 1.1713765691690314, 1.184082667416538, 1.1971074206266044, 1.2103948009525267, 1.223887588755653, 1.2375279477019967, 1.251257994638394, 1.2650203484390943, 1.2787586460487455, 1.2924180177245486, 1.3059455166396698, 1.3192905004460582, 1.3324049641535494, 1.3452438248781762, 1.3577651597765203, 1.3699303989339044, 1.3817044752103758, 1.3930559331461259, 1.4039569990449543, 1.4143836143340736, 1.4243154342725721, 1.4337357940723185, 1.4426316445179475, 1.4509934592344598, 1.4588151158514215, 1.466093753445956, 1.4728296088014214, 1.4790258341797697, 1.4846882994568733, 1.48982538159435, 1.4944477445041695, 1.4985681123913683, 1.50220103962819 ], [ 1.0542736776295747, 1.056031485736161, 1.0585338937232822, 1.0617883011462643, 1.0657977247704828, 1.0705608271424634, 1.0760719805673957, 1.0823213447140243, 1.0892949408237285, 1.0969747115850925, 1.1053385627274819, 1.114360390129136, 1.1240101040613986, 1.1342536688342375, 1.1450531800471926, 1.156367001627901, 1.1681499804026818, 1.1803537477908268, 1.1929271081346964, 1.2058165034821713, 1.218966537333848, 1.2323205360152434, 1.2458211258935907, 1.2594108067975651, 1.2730325055896623, 1.2866300978751342, 1.3001488896146334, 1.313536053580625, 1.3267410180535626, 1.33971580693755, 1.3524153316992344, 1.364797636326313, 1.3768240969795114, 1.3884595782703528, 1.3996725482111645, 1.410435153910928, 1.4207232600750321, 1.4305164523420784, 1.4397980074816912, 1.4485548325004847, 1.4567773747678459, 1.464459505380411, 1.471598378128167, 1.4781942665944112, 1.4842503821005981, 1.489772675376936, 1.4947696249825495, 1.4992520155982285, 1.5032327093573445, 1.5067264133578608 ], [ 1.0647069057939589, 1.066526341786739, 1.069070298551952, 1.0723464915845002, 1.0763585299955976, 1.0811058932235573, 1.0865839397317159, 1.0927839344895902, 1.0996930820915174, 1.1072945545773927, 1.1155675080769214, 1.1244870898629347, 1.1340244457780966, 1.1441467453361094, 1.1548172462415212, 1.1659954203213447, 1.177637158545236, 1.189695064721375, 1.2021188374254423, 1.2148557300602854, 1.2278510716426325, 1.2410488270220268, 1.2543921747242883, 1.2678240826662452, 1.2812878655041402, 1.29472771135837, 1.3080891694129109, 1.3213195930574417, 1.3343685357124544, 1.3471880982908573, 1.3597332285108494, 1.3719619731063555, 1.3838356844954367, 1.3953191837560048, 1.4063808818948007, 1.416992861436753, 1.4271309203529614, 1.4367745803218663, 1.4459070613078788, 1.4545152244639492, 1.4625894854308368, 1.4701237002187606, 1.4771150260116463, 1.483563759418129, 1.4894731548900597, 1.4948492262184887, 1.4997005341791871, 1.5040379635162187, 1.507874492508721, 1.5112249583532371 ], [ 1.0756299074653795, 1.077512544107633, 1.0800978784613102, 1.0833939895782776, 1.0874051660440192, 1.0921318126409265, 1.0975703880784715, 1.1037133721278714, 1.1105492529413121, 1.1180625221083766, 1.1262336679051586, 1.1350391648241582, 1.1444514669301542, 1.154439020968973, 1.1649663202725473, 1.1759940210944393, 1.1874791388707324, 1.199375333955235, 1.211633286500392, 1.2242011506245165, 1.2370250707628065, 1.250049739172843, 1.263218972941527, 1.2764762907491634, 1.289765473023354, 1.303031092990686, 1.3162190098281645, 1.3292768182654304, 1.3421542514723372, 1.3548035359130495, 1.367179698154207, 1.3792408244952572, 1.390948274849277, 1.4022668526300324, 1.4131649325660722, 1.4236145484215685, 1.4335914426028806, 1.4430750796077576, 1.4520486252617635, 1.46049889370662, 1.4684162641719716, 1.4757945696798642, 1.4826309599956704, 1.4889257413377772, 1.4946821955729748, 1.4999063818336318, 1.5046069236745276, 1.5087947850216339, 1.5124830382363033, 1.5156866276158216 ], [ 1.0870087519433167, 1.088955952998951, 1.0915823851628785, 1.0948965381890001, 1.0989034646983635, 1.1036045982047797, 1.1089976046173105, 1.115076279769509, 1.1218304871923774, 1.129246120312328, 1.1373050740781627, 1.145985219439283, 1.1552603851891894, 1.1651003614285453, 1.1754709448124523, 1.1863340467155703, 1.1976478815203215, 1.2093672444973544, 1.2214438791117825, 1.2338269242734612, 1.2464634249182098, 1.2592988853546208, 1.2722778440470683, 1.2853444502173272, 1.2984430258297512, 1.3115186002478123, 1.324517408449179, 1.3373873467962258, 1.3500783828473741, 1.362542917576179, 1.3747360997234512, 1.3866160929461282, 1.3981442970416413, 1.409285524900298, 1.420008137037103, 1.430284135634552, 1.4400892200369286, 1.4494028056161075, 1.4582080079136288, 1.4664915939806251, 1.4742439029032255, 1.4814587376228532, 1.4881332303346855, 1.4942676839606228, 1.4998653924260932, 1.5049324426994142, 1.5094775017546196, 1.5135115917714534, 1.517047856972493, 1.5201013255055447 ], [ 1.0988057592042355, 1.1008186721941131, 1.1034858515930939, 1.1068162372720798, 1.1108157179657652, 1.1154868440725576, 1.120828579912109, 1.1268361241895528, 1.133500795429138, 1.140809961358273, 1.1487469902986893, 1.1572912124679777, 1.166417892279581, 1.1760982240312754, 1.1862993701245772, 1.1969845623065531, 1.2081132827284906, 1.2196415341461468, 1.2315221992737182, 1.2437054802828593, 1.2561394024727763, 1.268770362176847, 1.2815436980505612, 1.2944042663618887, 1.3072970038474534, 1.3201674652265247, 1.3329623259380592, 1.3456298437170993, 1.3581202751115398, 1.3703862449563715, 1.3823830682375469, 1.3940690247810965, 1.4054055878810394, 1.4163576084063871, 1.4268934561655515, 1.436985120410883, 1.446608271386036, 1.4557422847997112, 1.464370231090329, 1.472478831358357, 1.480058381907138, 1.4871026494580046, 1.4936087392881803, 1.4995769387675602, 1.5050105390218391, 1.5099156376996627, 1.5143009260443268, 1.5181774636423595, 1.521558444322988, 1.524458956701711 ], [ 1.1109797523656224, 1.1130593050481186, 1.1157668525169244, 1.119111808140365, 1.1231009454209981, 1.1277379938571657, 1.133023283068902, 1.138953481159344, 1.1455214256925246, 1.152716019791046, 1.1605221636239038, 1.1689207032900106, 1.1778883946037173, 1.1873978921886412, 1.1974177818478322, 1.2079126758856666, 1.2188433876094464, 1.2301671940917294, 1.2418381873606046, 1.2538077055326133, 1.266024828658039, 1.2784369201050332, 1.290990193228922, 1.3036302842900993, 1.3163028152516443, 1.328953933387378, 1.3415308179492353, 1.3539821471153373, 1.3662585209104443, 1.3783128377379803, 1.3901006236369566, 1.4015803144510979, 1.41271349184465, 1.4234650745850144, 1.4338034667941, 1.4437006650014836, 1.4531323258645532, 1.4620777964028262, 1.4705201085698112, 1.4784459399921748, 1.4858455427670438, 1.4927126423355124, 1.4990443086416867, 1.5048408020284643, 1.5101053965912663, 1.5148441839821976, 1.5190658609010605, 1.5227815037007142, 1.5260043336517903, 1.5287494764422345 ], [ 1.1234864768846138, 1.1256333746846365, 1.1283809202555286, 1.131739000094231, 1.1357152878337429, 1.1403147190640448, 1.1455390241347414, 1.1513863821062311, 1.1578511953988233, 1.1649239509721745, 1.1725911306327106, 1.1808351467571043, 1.1896342974179626, 1.198962749238029, 1.2087905645643162, 1.2190837915883903, 1.2298046328703232, 1.2409117009628319, 1.252360361391708, 1.264103155034327, 1.2760902854675729, 1.2882701529638834, 1.3005899155847511, 1.3129960587698497, 1.3254349571913175, 1.3378534156862967, 1.3501991792185661, 1.3624214046944323, 1.3744710899012023, 1.386301456810169, 1.397868288018924, 1.409130216255626, 1.4200489676891532, 1.4305895603383512, 1.4407204592027136, 1.450413689897032, 1.459644912617519, 1.4683934582496296, 1.4766423283983316, 1.4843781611209654, 1.491591164199984, 1.4982750179216426, 1.50442674952619, 1.5100465817511015, 1.5151377581777616, 1.519706348384382, 1.5237610361732823, 1.5273128943512475, 1.5303751496752098, 1.5329629416174522 ], [ 1.1362791810175759, 1.1384939021766114, 1.1412811086556003, 1.1446511309317093, 1.1486125185486664, 1.1531713991992256, 1.1583309035639888, 1.1640907352945444, 1.1704468873459113, 1.177391465065392, 1.184912572167716, 1.1929942309063153, 1.201616327142805, 1.2107545864495342, 1.2203805961856784, 1.2304618908220626, 1.2409621149464927, 1.2518412720799548, 1.2630560595423654, 1.2745602818964905, 1.2863053293565991, 1.298240703745042, 1.3103145732232864, 1.3224743377091583, 1.3346671889572668, 1.3468406520490426, 1.3589430979751222, 1.370924219750043, 1.3827354669019236, 1.3943304351712635, 1.405665209842324, 1.4166986623530882, 1.427392700728225, 1.4377124749958798, 1.4476265391281815, 1.457106971236352, 1.4661294538093197, 1.474673315767947, 1.4827215380708147, 1.4902607245990778, 1.4972810401002263, 1.5037761171004742, 1.5097429339027966, 1.5151816660578143, 1.520095514002285, 1.5244905098736161, 1.5283753067956658, 1.5317609541611898, 1.5346606625860286, 1.537089562263708 ], [ 1.1493093206930214, 1.151592106539237, 1.154418671099942, 1.1577997304120269, 1.1617446455003717, 1.1662606805670823, 1.1713523296827177, 1.1770208058494305, 1.183263696876588, 1.1900747457541403, 1.1974437074153366, 1.2053562494510084, 1.2137938845685454, 1.2227339386075047, 1.232149567064455, 1.2420098356935145, 1.2522798782926612, 1.2629211390258552, 1.2738916993624678, 1.285146682571488, 1.2966387229458094, 1.308318483260035, 1.3201352025120001, 1.3320372564360585, 1.3439727150372411, 1.3558898838809361, 1.3677378185920044, 1.3794668046406104, 1.391028796840097, 1.4023778149821995, 1.4134702936755212, 1.4242653857495973, 1.4347252195632902, 1.444815111241781, 1.4545037332971515, 1.4637632413100927, 1.4725693604216235, 1.480901433366721, 1.4887424317383375, 1.4960789321531003, 1.5029010590370935, 1.5092023958806113, 1.5149798670258359, 1.5202335923354535, 1.5249667174166102, 1.529185222409323, 1.5328977126567305, 1.536115194824198, 1.5388508422000724, 1.5411197529762366 ], [ 1.1625273238891862, 1.1648781634117826, 1.1677437945767222, 1.1711352360639053, 1.1750625615060555, 1.1795340793770623, 1.1845555767484672, 1.1901297329053702, 1.1962557128825388, 1.202928899666339, 1.2101407157097976, 1.2178784991865357, 1.2261254203743248, 1.2348604395418417, 1.2440583169478256, 1.253689688431591, 1.2637212180699362, 1.2741158342383427, 1.284833048837837, 1.295829352926064, 1.3070586766560888, 1.3184728979292486, 1.3300223826551723, 1.3416565397283, 1.3533243752987738, 1.364975033116355, 1.3765583102179795, 1.3880251397054022, 1.399328034638999, 1.4104214890717437, 1.4212623339326347, 1.4318100468357822, 1.442027015945105, 1.4518787587795166, 1.461334097326408, 1.4703652910856035, 1.478948129750313, 1.4870619872140622, 1.4946898385411482, 1.501818241512004, 1.5084372843961733, 1.514540501736771, 1.5201247601527856, 1.525190116463592, 1.5297396507848473, 1.5337792776006356, 1.5373175381460273, 1.5403653777031054, 1.5429359115952674, 1.5450441837415883 ], [ 1.1758833368853565, 1.1783019472088907, 1.181206321366258, 1.184607682364345, 1.1885166941305476, 1.1929425900782162, 1.1978923527203802, 1.2033700595393861, 1.209376413317844, 1.2159084209106812, 1.222959173215659, 1.2305176914880105, 1.2385688236393535, 1.247093189424204, 1.2560671824734981, 1.2654630402173195, 1.275248991238624, 1.2853894851536187, 1.2958455042868953, 1.3065749505525692, 1.317533096085456, 1.3286730828852817, 1.339946455203488, 1.3513037084290727, 1.3626948394262377, 1.3740698851991016, 1.3853794390197585, 1.3965751354737217, 1.4076100980758905, 1.4184393450951494, 1.429020150947562, 1.439312361950512, 1.449278666358666, 1.4588848194256883, 1.468099824770261, 1.476896073610565, 1.485249443528373, 1.4931393584051886, 1.500548811113247, 1.5074643505087417, 1.5138760343103532, 1.5197773495778204, 1.5251651027353017, 1.5300392813959403, 1.5344028906069835, 1.5382617665109417, 1.5416243707681185, 1.5445015693735884, 1.5469063996989942, 1.5488538296780598 ], [ 1.1893278848259974, 1.1918136912079023, 1.1947563985200889, 1.1981673313992856, 1.2020576118058992, 1.206437263623429, 1.2113143482964803, 1.2166942525764184, 1.2225791566190336, 1.2289676554176625, 1.235854491687531, 1.2432303670086686, 1.2510818139253632, 1.2593911255579633, 1.2681363478533745, 1.2772913428152728, 1.2868259300756637, 1.2967061104553428, 1.3068943701189801, 1.317350058769906, 1.328029830962077, 1.3388881365786884, 1.3498777450135986, 1.3609502874656674, 1.3720568027067654, 1.3831482733421658, 1.394176141614046, 1.405092795952276, 1.4158520215853656, 1.426409410485674, 1.4367227276726182, 1.446752232388998, 1.4564609538644642, 1.4658149222687498, 1.4747833560417876, 1.4833388071036822, 1.4914572655563583, 1.4991182254684943, 1.5063047132676062, 1.5130032802185434, 1.519203960498085, 1.5249001965076932, 1.5300887333039868, 1.5347694843515234, 1.5389453711830259, 1.5426221399480464, 1.5458081582007563, 1.548514195583382, 1.5507531922742288, 1.5525400191690981 ], [ 1.2028124088741023, 1.2053645285653447, 1.2083450203040975, 1.2117652133526746, 1.2156365581808275, 1.2199697312763849, 1.224773746197217, 1.2300551942098852, 1.235817653506739, 1.2420612516865597, 1.2487823476776625, 1.255973303417338, 1.2636223279865155, 1.2717133887311174, 1.2802261916608244, 1.2891362366342514, 1.2984149523498476, 1.3080299131828794, 1.3179451356616545, 1.3281214479237557, 1.3385169216446198, 1.3490873531864171, 1.359786779259866, 1.370568012151019, 1.381383180300683, 1.392184261437291, 1.4029235972743006, 1.413554380770782, 1.4240311089644613, 1.4343099963146067, 1.4443493452602256, 1.4541098722416232, 1.4635549886970933, 1.472651037496378, 1.4813674859043153, 1.489677076512487, 1.4975559376965635, 1.5049836551353186, 1.5119433058516223, 1.5184214561827671, 1.5244081251130706, 1.5298967145352593, 1.5348839082520276, 1.5393695418672393, 1.543356446113576, 1.5468502665781472, 1.5498592631760009, 1.5523940930446192, 1.5544675807593065, 1.556094479880253 ], [ 1.2162896788248272, 1.2189069122882787, 1.2219244596046184, 1.2253535703183105, 1.2292059059175486, 1.2334926635581125, 1.2382236794413646, 1.2434066340070578, 1.2490464080555606, 1.2551445874518057, 1.261699092492471, 1.2687039073179907, 1.2761488930776725, 1.284019677877111, 1.2922976231673444, 1.3009598692847901, 1.3099794627675032, 1.319325565787373, 1.328963744562411, 1.338856329859044, 1.3489628393706192, 1.3592404493191388, 1.369644501263578, 1.3801290297804099, 1.3906472972361636, 1.4011523230636351, 1.4115973965545285, 1.4219365640053014, 1.4321250829610657, 1.4421198381891938, 1.451879715791554, 1.4613659334496913, 1.4705423261184856, 1.4793755874898744, 1.4878354682236135, 1.4958949323129032, 1.5035302730828415, 1.510721190296679, 1.5174508297620335, 1.5237057867689483, 1.529476074713419, 1.5347550603951259, 1.5395393677305083, 1.5438287519727747, 1.5476259469436617, 1.5509364882139993, 1.5537685155762018, 1.5561325584909418, 1.558041308430848, 1.559509382165385 ], [ 1.2297141080484228, 1.2323949391698552, 1.2354486084990797, 1.2388862172585158, 1.2427195372912307, 1.24696016616397, 1.2516186363137123, 1.2567035962607893, 1.262221121415668, 1.2681741649316847, 1.2745621354183174, 1.2813805830855067, 1.288620980004958, 1.296270586685592, 1.3043124023886548, 1.3127251992919848, 1.3214836408057664, 1.3305584826643098, 1.339916852657961, 1.3495226017800197, 1.3593367167541752, 1.3693177817849715, 1.3794224761290248, 1.389606093724733, 1.3998230715248328, 1.4100275141732006, 1.4201737040755478, 1.4302165875804902, 1.4401122297913143, 1.4498182323678301, 1.459294110455149, 1.4685016264953266, 1.4774050800484644, 1.4859715538056562, 1.494171116690901, 1.5019769853440712, 1.509365645416803, 1.5163169340894356, 1.522814085128586, 1.5288437377387578, 1.534395910480424, 1.5394639416644202, 1.5440443978921854, 1.5481369527735516, 1.55174423828168, 1.5548716716530309, 1.557527261162329, 1.5597213944564958, 1.5614666133846515, 1.5627773793927253 ], [ 1.2430420082370612, 1.2457846132030097, 1.248873258333648, 1.2523188433672663, 1.256133167335962, 1.2603281218078477, 1.2649148155390209, 1.2699027422484939, 1.2752990551311152, 1.2811079700499648, 1.2873302948233731, 1.2939630729599954, 1.3009993303213985, 1.308427916811188, 1.3162334388241095, 1.3243962803131333, 1.3328927106427968, 1.3416950762070816, 1.3507720706584965, 1.3600890761149511, 1.3696085653892944, 1.3792905534792055, 1.3890930854482297, 1.398972747457177, 1.4088851879966375, 1.418785637201523, 1.428629413363031, 1.4383724072724793, 1.4479715367324353, 1.4573851653567629, 1.466573481550691, 1.4754988352050973, 1.4841260310504034, 1.492422578713855, 1.5003589002731368, 1.5079084965158678, 1.5150480732636868, 1.521757629096137, 1.5280205057171452, 1.5338234021366886, 1.5391563538580528, 1.5440126784013528, 1.5483888887609578, 1.5522845767673301, 1.5557022687648725, 1.5586472564800111, 1.5611274063900855, 1.5631529512708582, 1.5647362678651493, 1.5658916447559201 ], [ 1.25623181572639, 1.2590340788892154, 1.2621563461056786, 1.265609275467954, 1.2694046253731353, 1.2735544882546952, 1.278070437143015, 1.2829626891511623, 1.2882393531381195, 1.2939057929608329, 1.2999641134309967, 1.3064127641801015, 1.3132462532842175, 1.3204549633532823, 1.3280250647438225, 1.335938521956538, 1.3441731895419822, 1.3527029929935994, 1.3614981884955781, 1.3705256934473495, 1.3797494778105792, 1.3891310048206358, 1.3986297086463426, 1.4082034962230983, 1.4178092606909205, 1.427403394559876, 1.4369422918067511, 1.4463828294902468, 1.4556828210732498, 1.4648014353710272, 1.4736995767976548, 1.4823402242405102, 1.490688727334673, 1.498713060042317, 1.506384032220427, 1.5136754602962275, 1.5205642983279872, 1.527030730707388, 1.5330582276656255, 1.5386335646735074, 1.5437468068440006, 1.5483912595896343, 1.5525633870610442, 1.5562627002754152, 1.5594916172962332, 1.5622552983005966, 1.5645614588190868, 1.5664201648118845, 1.5678436135198814, 1.5688459041789635 ], [ 1.2692443067283228, 1.272103841256679, 1.2752581825552347, 1.2787177166293862, 1.2824941052959173, 1.2865995598636675, 1.291046013396626, 1.2958442875033387, 1.3010033223278605, 1.306529508330567, 1.312426135279385, 1.3186929601253894, 1.3253258892893172, 1.3323167692658588, 1.3396532797506553, 1.3473189240662844, 1.35529311172451, 1.3635513273171909, 1.3720653787146775, 1.380803716050652, 1.3897318114878674, 1.398812588535331, 1.4080068888797341, 1.4172739643661754, 1.426571981910708, 1.435858529705029, 1.445091114023311, 1.4542276372023015, 1.4632268488728908, 1.472048764193337, 1.4806550445649358, 1.4890093379727631, 1.4970775775571208, 1.5048282381809353, 1.5122325515605457, 1.5192646809803323, 1.5259018567795626, 1.5321244737824822, 1.5379161517498425, 1.5432637598590904, 1.5481574062408767, 1.5525903937478598, 1.556559143412178, 1.5600630874388668, 1.5631045340445762, 1.5656885069360358, 1.5678225626814482, 1.5695165896165149, 1.570782592210616, 1.571634464976102 ], [ 1.282042803915526, 1.284956975169757, 1.2881416649347006, 1.2916069632758242, 1.2953643878268923, 1.2994261953456723, 1.3038045816820445, 1.3085108579905564, 1.31355467149765, 1.3189433143602283, 1.3246811427196192, 1.3307691133966821, 1.33720443746888, 1.3439803462794173, 1.3510859641928106, 1.3585062821045566, 1.3662222254517065, 1.3742108098874082, 1.3824453768437317, 1.3908959000573324, 1.399529352976275, 1.408310125990162, 1.41720048176159, 1.4261610366518458, 1.4351512563434028, 1.4441299542503556, 1.4530557821466257, 1.461887703594759, 1.4705854421773987, 1.4791098981462316, 1.4874235288041842, 1.4954906895930988, 1.5032779343328153, 1.5107542742351114, 1.5178913961366467, 1.5246638408629913, 1.5310491428142454, 1.5370279318520488, 1.5425839984794654, 1.5477043232379861, 1.55237907127061, 1.5566015531532786, 1.5603681533834808, 1.563678228312576, 1.5665339757779502, 1.5689402791839253, 1.5709045292469401, 1.5724364270166498, 1.5735477720759357, 1.574252239987283 ], [ 1.2945933665829197, 1.2975593166407347, 1.3007724685020143, 1.3042425965720985, 1.3079810321765724, 1.3120000103859535, 1.3163118986221258, 1.3209283871640018, 1.3258597081778898, 1.3311139297993657, 1.336696352426821, 1.3426090195661362, 1.3488503460040064, 1.3554148607755578, 1.3622930598155625, 1.3694713620125318, 1.3769321617203532, 1.384653970142708, 1.3926116372254185, 1.4007766447967251, 1.4091174607997043, 1.4175999436938815, 1.4261877855688996, 1.434842982275681, 1.4435263189687295, 1.4521978598732805, 1.4608174318379958, 1.4693450922929499, 1.4777415735708361, 1.4859686971026813, 1.4939897526642933, 1.5017698394913248, 1.509276167554812, 1.5164783184761044, 1.5233484663938388, 1.5298615595768286, 1.535995463766728, 1.5417310682332988, 1.5470523554447806, 1.551946435195517, 1.556403544063912, 1.5604170112328726, 1.5639831919969343, 1.56710137068332, 1.5697736351889546, 1.572004725833536, 1.573801861700747, 1.575174548041447, 1.5761343686099656, 1.5766947669751763 ], [ 1.3068649524492355, 1.3098796247609896, 1.3131192068698418, 1.316593140314531, 1.3203125315525748, 1.3242895315353287, 1.3285365933505489, 1.3330656809036112, 1.3378874926780902, 1.3430107484914597, 1.3484415699730496, 1.3541829710610762, 1.360234464503544, 1.3665917838593193, 1.3732467168136027, 1.380187043653197, 1.3873965736383738, 1.394855271223059, 1.402539463352682, 1.4104221183386745, 1.4184731861054773, 1.4266599890054121, 1.4349476519734667, 1.4432995606038026, 1.4516778358079976, 1.4600438140838161, 1.468358523095816, 1.4765831432474097, 1.484679447188244, 1.4926102106945474, 1.5003395899835337, 1.5078334621403113, 1.5150597268000965, 1.5219885684167558, 1.5285926792902873, 1.5348474440189106, 1.5407310862443713, 1.5462247785708825, 1.5513127164695018, 1.5559821569294583, 1.5602234226570775, 1.5640298727884676, 1.567397841379028, 1.5703265453395625, 1.5728179639665096, 1.5748766927145512, 1.5765097743348115, 1.5777265109071288, 1.578538260596481, 1.578958223139454 ], [ 1.3188295399218541, 1.3218897035364772, 1.32515355173297, 1.3286301776234877, 1.3323304268028264, 1.3362663075430754, 1.3404502776647793, 1.3448944745207705, 1.3496099489802351, 1.354605951478044, 1.359889303145382, 1.3654638713702483, 1.3713301585619977, 1.3774850056338053, 1.3839214071759955, 1.3906284326259963, 1.3975912461843993, 1.4047912172354178, 1.412206112283468, 1.4198103587726878, 1.427575370581734, 1.4354699245092442, 1.4434605767305209, 1.4515121080577114, 1.4595879869111907, 1.4676508392407395, 1.4756629152478669, 1.4835865436703202, 1.491384565586382, 1.4990207411311811, 1.506460124093754, 1.5136694009478866, 1.5206171923149892, 1.527274316038461, 1.5336140118938952, 1.5396121284627005, 1.5452472729143707, 1.550500924470419, 1.5553575122698335, 1.5598044583188113, 1.5638321862568034, 1.5674340968435772, 1.5706065113729766, 1.5733485846278774, 1.5756621894691665, 1.5775517756525477, 1.579024205942349, 1.5800885729982372, 1.5807560008150636, 1.58103943467615 ], [ 1.3304622032790243, 1.3335644763965955, 1.3368503055385756, 1.3403284211702815, 1.3440093742988706, 1.3479049756235302, 1.3520276117836343, 1.356389499187851, 1.3610019328326026, 1.365874577404066, 1.3710148349214384, 1.3764273104999936, 1.3821133873446263, 1.3880709143970114, 1.3942940048984955, 1.400772940884913, 1.4074941766517541, 1.4144404329974702, 1.4215908732211489, 1.4289213512248493, 1.4364047215681974, 1.4440112009276913, 1.4517087701430889, 1.4594636059185173, 1.467240531321687, 1.4750034745276481, 1.4827159258186022, 1.4903413837023938, 1.4978437821470754, 1.5051878923045101, 1.5123396936205806, 1.5192667107728834, 1.5259383142937253, 1.5323259839032293, 1.5384035344207307, 1.5441473046350795, 1.5495363097480712, 1.5545523580523175, 1.559180132470534, 1.5634072375623649, 1.5672242126662463, 1.5706245120240228, 1.5736044530406277, 1.5761631342403182, 1.5783023249577137, 1.5800263293005867, 1.58134182739484, 1.58225769732812, 1.5827848215140736, 1.5829358813825998 ], [ 1.3417411378204784, 1.3448820106055264, 1.3481874247086396, 1.3516657351125936, 1.355327166935958, 1.359183282292271, 1.3632463260642067, 1.3675285056450706, 1.3720412584188493, 1.376794552843195, 1.3817962578053817, 1.387051603345834, 1.3925627457461307, 1.3983284421428062, 1.404343834262682, 1.4106003371777107, 1.4170856266245404, 1.4237837169543723, 1.4306751208210562, 1.4377370810567804, 1.444943864705031, 1.4522671088296308, 1.4596762074894336, 1.467138729176719, 1.4746208540934915, 1.4820878209217434, 1.4895043732705313, 1.4968351967834341, 1.504045338967744, 1.5111006051231168, 1.5179679252159297, 1.52461568804041, 1.5310140403884296, 1.5371351500955874, 1.5429534326691035, 1.5484457417233024, 1.5535915236994213, 1.5583729374155315, 1.5627749389801808, 1.5667853326014114, 1.570394787898025, 1.5735968245083272, 1.57638776509909, 1.5787666582855262, 1.5807351734462252, 1.5822974699110584, 1.5834600434693162, 1.5842315535488254, 1.5846226347219066, 1.584645696379697 ], [ 1.3526476362910966, 1.3558234929580029, 1.359145994871112, 1.3626231102986415, 1.3662647099680458, 1.3700820606992725, 1.3740872008340108, 1.3782922475417063, 1.382708686092581, 1.3873466850766154, 1.3922144720104443, 1.397317793341226, 1.4026594733062177, 1.4082390783397094, 1.414052687934981, 1.4200927688427725, 1.426348146819539, 1.432804068418631, 1.4394423442109887, 1.4462415640931472, 1.453177374844415, 1.4602228097560956, 1.4673486599449292, 1.474523876883266, 1.4817159957527655, 1.4888915694931442, 1.4960166039124334, 1.5030569849820534, 1.509978890464176, 1.516749179276073, 1.5233357534046026, 1.5297078886240247, 1.5358365316080063, 1.5416945621452123, 1.54725701999636, 1.5525012964574803, 1.5574072909633556, 1.5619575331584024, 1.566137270874949, 1.5699345244782368, 1.5733401081280076, 1.5763476187035528, 1.5789533934489317, 1.5811564378007015, 1.5829583253280735, 1.584363072202701, 1.585376989078323, 1.5860085136594007, 1.5862680275412648, 1.586167661091216 ] ], "zauto": true, "zmax": 1.5862680275412648, "zmin": -1.5862680275412648 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.10083268858045095, 0.09908548231377723, 0.09768204808838465, 0.09662579871404353, 0.09591451168011667, 0.09554081420785646, 0.09549293354719131, 0.09575561148186455, 0.09631106679119644, 0.09713989690725926, 0.09822183610240495, 0.09953632394133732, 0.10106287516061446, 0.10278127311671434, 0.10467162922016941, 0.10671435939778443, 0.10889012714834286, 0.11117979412415772, 0.1135644067080455, 0.1160252337421243, 0.11854385862253246, 0.12110231973148314, 0.1236832871397576, 0.12627026054787735, 0.12884777301005335, 0.1314015863873663, 0.1339188669814579, 0.13638833278310067, 0.13880036675942273, 0.1411470932881174, 0.1434224170578587, 0.14562202543377065, 0.1477433564554023, 0.14978553536062716, 0.15174928290520512, 0.15363679887498746, 0.1554516241623355, 0.15719848468502004, 0.15888312033291171, 0.1605121020839786, 0.16209264046431673, 0.16363238864357538, 0.16513924364320268, 0.16662114935839617, 0.1680859053095675, 0.16954098519145264, 0.17099336932261033, 0.1724493949665647, 0.17391462816407777, 0.1753937601700706 ], [ 0.09765945615797436, 0.09591869177256127, 0.09453736722350431, 0.09351715883788853, 0.0928535180869069, 0.09253634820040686, 0.09255098828707475, 0.09287936888659913, 0.09350118825155393, 0.09439497425853528, 0.09553893535306998, 0.09691155317785868, 0.09849191724911356, 0.10025983930797563, 0.10219580750967563, 0.10428084831671473, 0.10649635952575741, 0.10882396529211286, 0.11124542747645691, 0.1137426306696223, 0.11629764340254471, 0.11889284678391893, 0.12151111461811119, 0.12413602569067836, 0.1267520886568053, 0.1293449619180634, 0.13190165411876223, 0.13441069466399838, 0.13686226738276214, 0.13924830376006608, 0.14156253484849424, 0.14380050298475294, 0.1459595358169804, 0.14803868598569803, 0.15003864021376043, 0.1519616016729299, 0.15381114942353047, 0.1555920785701337, 0.15731022462079772, 0.158972275437294, 0.16058557415194122, 0.16215791651178235, 0.16369734627868984, 0.16521195253035229, 0.16670967292243724, 0.16819810712793568, 0.16968434470592106, 0.17117481151601943, 0.1726751384493687, 0.1741900556762215 ], [ 0.09452422350754798, 0.09279517099334728, 0.09144197157351634, 0.0904642667908611, 0.08985481490611832, 0.08960040180682753, 0.08968310587435017, 0.09008173628009303, 0.09077325233091024, 0.09173399910347389, 0.09294064947850263, 0.09437080753462594, 0.0960032874072616, 0.09781812508023638, 0.09979640444653051, 0.10191998461895331, 0.10417120704525261, 0.10653264368099638, 0.10898692628308942, 0.11151667587551106, 0.11410453344756886, 0.11673327954785022, 0.11938602209117968, 0.12204642801107238, 0.12469897444943848, 0.12732919784126548, 0.1299239234087504, 0.13247146228876036, 0.13496176809000196, 0.13738654867689862, 0.1397393321897436, 0.14201548868444266, 0.14421221036965232, 0.14632845435683453, 0.14836485226954538, 0.15032359113477073, 0.152208269841569, 0.15402373521975415, 0.15577590155741058, 0.157471557206585, 0.159118161859463, 0.16072363812329266, 0.1622961611664454, 0.16384395041354127, 0.16537506748095399, 0.16689722470183077, 0.16841760862719868, 0.16994272274959696, 0.1714782533372627, 0.17302896167296555 ], [ 0.09143057397256833, 0.08971849065506025, 0.08839946303250158, 0.08747077150982839, 0.0869220800669065, 0.08673663217118982, 0.08689285044708525, 0.08736610363379031, 0.08813039876488528, 0.08915980140212182, 0.09042946275776377, 0.09191621583386891, 0.09359877400429308, 0.09545761416928816, 0.09747465042639608, 0.0996328063995135, 0.10191558085715861, 0.1043066784518635, 0.10678975106842763, 0.10934826989107373, 0.1119655269703651, 0.1146247494541224, 0.11730930015700568, 0.12000293423611724, 0.12269008226834979, 0.1253561335943476, 0.12798769904833301, 0.13057283800354105, 0.13310124021203293, 0.13556435770246023, 0.13795548578468433, 0.140269794959177, 0.14250431733348112, 0.1446578921690214, 0.1467310756071079, 0.14872601963861828, 0.1506463251542265, 0.15249687357989297, 0.15428364127285643, 0.15601350060115274, 0.1576940114972651, 0.15933320727584646, 0.16093937862062707, 0.16252085983680847, 0.16408582167450264, 0.1656420751876075, 0.1671968911308867, 0.16875683925420656, 0.17032765148274961, 0.17191411235658374 ], [ 0.08838164644074141, 0.08669170883907246, 0.08541286566623597, 0.08453968053676861, 0.08405828702463143, 0.08394792956507006, 0.08418295977256256, 0.08473498192402026, 0.08557484726666681, 0.08667426590520523, 0.08800690770842795, 0.08954896810670462, 0.09127925814052197, 0.09317893067489982, 0.09523097656943048, 0.0974196217548719, 0.09972973648317811, 0.102146339058094, 0.10465424446085768, 0.10723787829332071, 0.10988125163836858, 0.11256807453188293, 0.11528197512976877, 0.1180067876338234, 0.12072687321294222, 0.12342744283531996, 0.12609485748287144, 0.12871688830463082, 0.13128292592108365, 0.13378413374285295, 0.13621354456596346, 0.13856610283874946, 0.14083865699677717, 0.14302990734162965, 0.14514031533008798, 0.14717198006568216, 0.14912848744052257, 0.1510147369214803, 0.1528367505322653, 0.15460146823462967, 0.15631653370434512, 0.1579900744433737, 0.15963048025111123, 0.16124618425128884, 0.1628454508743796, 0.16443617535430158, 0.16602569933748537, 0.16762064705561175, 0.16922678613296188, 0.1708489164646503 ], [ 0.08538011528475202, 0.08371735150160962, 0.08248460795122006, 0.08167334518862565, 0.08126569399289872, 0.08123641199461087, 0.08155534690840016, 0.08219001386284087, 0.0831079194015236, 0.08427836689274726, 0.08567361368050523, 0.08726937808715982, 0.08904478911630298, 0.09098192574322668, 0.09306511024135831, 0.09528011040276282, 0.09761337865895703, 0.10005142048713801, 0.1025803467886168, 0.1051856301527666, 0.10785205648181224, 0.11056384319549303, 0.11330488352858867, 0.11605907242181977, 0.11881067151623573, 0.12154467677733667, 0.12424716035289911, 0.12690556681352852, 0.1295089518186681, 0.13204815784744856, 0.13451592667841927, 0.13690695181740736, 0.1392178762483795, 0.14144724198700667, 0.14359539823677564, 0.1456643747492604, 0.14765772650106523, 0.14958035520145885, 0.1514383125716572, 0.15323858987954744, 0.1549888979218885, 0.15669744153212808, 0.15837269273565022, 0.16002316682792092, 0.16165720584678397, 0.1632827740685826, 0.16490727019814536, 0.1665373607739189, 0.16817883892076968, 0.1698365119317342 ], [ 0.08242817854563964, 0.08079740385583084, 0.07961651913105379, 0.07887346350538559, 0.07854585494010166, 0.07860344574415536, 0.07901113199289674, 0.07973201875396849, 0.08073009811875699, 0.08197224336795998, 0.08342939775443257, 0.0850769887963534, 0.08689470271219471, 0.08886580580668944, 0.09097621005383487, 0.0932134620564436, 0.09556579974048017, 0.09802137857881198, 0.10056772553521189, 0.10319143927611224, 0.10587812304257807, 0.10861251390227612, 0.11137875932177345, 0.11416078812142617, 0.11694272593210679, 0.11970931287458819, 0.1224462910210206, 0.12514073939640202, 0.1277813435429129, 0.13035859428355115, 0.13286491603356126, 0.13529472889229535, 0.13764445106456435, 0.1399124492489972, 0.14209894483881205, 0.1442058834215219, 0.14623677439972751, 0.14819650678885843, 0.15009114652730512, 0.1519277200566799, 0.1537139885462773, 0.155458216957204, 0.15716894214443047, 0.1588547443267304, 0.16052402644175082, 0.1621848060610658, 0.16384452458189, 0.16550987826258265, 0.16718667527398956, 0.1688797222739405 ], [ 0.07952755424235484, 0.07793331265730885, 0.07680983986089604, 0.07614110134766387, 0.07589965288997509, 0.07604969247744965, 0.07655070473393585, 0.07736107182519578, 0.07844112489962582, 0.07975531412009895, 0.08127339671249134, 0.08297071930977434, 0.08482777972957652, 0.086829299268756, 0.08896303677968267, 0.09121854765631662, 0.09358604755968485, 0.09605549119247302, 0.0986159269892385, 0.10125514405318145, 0.10395959170126855, 0.10671452680775931, 0.1095043302952323, 0.11231293051234278, 0.11512427557217945, 0.11792280618381373, 0.12069389236557833, 0.12342420948200744, 0.12610203981269613, 0.12871749455346657, 0.13126265753763353, 0.1337316561910033, 0.13612066764616643, 0.13842786896334122, 0.14065334045341923, 0.14279893053955556, 0.144868089723052, 0.14686568026264513, 0.14879776729305777, 0.15067139640043728, 0.15249436219055554, 0.15427497213880229, 0.15602180997084955, 0.15774350293159178, 0.15944849747823372, 0.16114484809021726, 0.1628400239325657, 0.1645407379602541, 0.16625280265212966, 0.16798101588806533 ], [ 0.0766794845259242, 0.07512599905612513, 0.07406524678753094, 0.07347673125960008, 0.0733273550292205, 0.07357518215346885, 0.07417381644240954, 0.075076616301196, 0.07624013205694145, 0.07762642937467908, 0.07920423597254422, 0.08094904783282329, 0.08284243927970626, 0.08487085564543906, 0.08702415388848345, 0.08929411701777865, 0.09167311628091412, 0.0941530388837639, 0.09672454395358353, 0.09937666005533612, 0.1020966976762582, 0.10487042231171038, 0.10768241888046788, 0.11051657499742769, 0.11335661649657666, 0.11618664020937161, 0.11899160315018592, 0.12175774137502522, 0.12447290417089865, 0.12712679905181343, 0.12971115009164433, 0.13221977664911, 0.13464860199003909, 0.1369956022083738, 0.1392607056844227, 0.1414456525176223, 0.14355382226361876, 0.14559003713745172, 0.147560346785185, 0.14947179987971787, 0.15133220721259777, 0.15314990063663522, 0.15493349213034668, 0.15669163734077424, 0.15843280813060598, 0.1601650788118581, 0.16189593079514425, 0.1636320802366441, 0.16537933286428277, 0.1671424694832806 ], [ 0.07388474742951598, 0.07237588152563604, 0.07138289033712687, 0.07088028806527821, 0.07082868814902048, 0.07117940966089105, 0.0718796987035248, 0.07287760434065663, 0.07412580524611, 0.07558405302046917, 0.07722022849217727, 0.07901022327950975, 0.08093695841989713, 0.08298886839813835, 0.085158148793314, 0.0874390140342199, 0.08982615160329332, 0.09231349676766527, 0.09489339162070515, 0.09755613799893989, 0.10028990987523966, 0.10308096028814556, 0.10591404188013356, 0.10877295747870329, 0.11164116482697913, 0.11450237365770284, 0.11734109002933332, 0.12014307922508258, 0.12289573264393784, 0.1255883350878502, 0.12821223654305358, 0.13076093731869107, 0.13323009782453138, 0.1356174849744434, 0.13792286677290405, 0.1401478655567894, 0.1422957789912565, 0.14437137652057586, 0.14638067772857144, 0.1483307180732499, 0.15022930677231922, 0.15208478122911476, 0.15390576226169225, 0.1557009144609544, 0.1574787161647803, 0.15924724369166549, 0.1610139745279065, 0.16278561401909392, 0.16456794971709396, 0.16636573684957556 ], [ 0.07114367627718082, 0.0696829084947739, 0.06876244485985576, 0.06835123974528066, 0.06840293216476097, 0.06886145188751448, 0.06966720417611687, 0.07076266097555965, 0.07209656894874973, 0.07362646688784323, 0.07531959402398762, 0.07715249490520017, 0.07910970715246952, 0.08118191022731583, 0.08336386359061329, 0.08565239844634938, 0.08804465972271784, 0.0905367275191879, 0.09312268220694309, 0.09579411838766053, 0.0985400646925891, 0.10134723291230242, 0.10420050284571604, 0.10708354734428709, 0.10997951181225434, 0.11287167933054648, 0.11574407217240407, 0.11858195932917982, 0.12137225562519942, 0.12410381014064269, 0.12676758994652043, 0.12935677008594043, 0.131866743042928, 0.13429506138207808, 0.13664132648988958, 0.13890703493929576, 0.14109539233316468, 0.14321110283959246, 0.14526014119176378, 0.1472495127895818, 0.1491870067492726, 0.15108094629175886, 0.1529399406929919, 0.15477264306178987, 0.15658751836478876, 0.1583926262757171, 0.16019542348150903, 0.16200258993967923, 0.16381988318532784, 0.16565202410299254 ], [ 0.06845618747737098, 0.06704660078396633, 0.06620317050972896, 0.06588867205774242, 0.06604902899987664, 0.06662010106912825, 0.06753496373259775, 0.0687302635591877, 0.0701507857905812, 0.07175198648480013, 0.07350068696124036, 0.07537434740813168, 0.07735938572948205, 0.07944896762703375, 0.0816406222357249, 0.08393396149869808, 0.08632870794139855, 0.08882316411498345, 0.09141318777911212, 0.09409167318313434, 0.09684848607900026, 0.09967076342381284, 0.10254347047053276, 0.10545010694009557, 0.10837346619505986, 0.1112963714238392, 0.11420233561981324, 0.11707611364539014, 0.11990413253585994, 0.12267479948624264, 0.12537869577100794, 0.128008669850981, 0.1305598450284168, 0.13302955711578576, 0.13541723645258158, 0.13772424683339365, 0.13995369193030407, 0.14211019789400178, 0.14419967918096938, 0.14622909337448117, 0.14820618987650067, 0.15013925682797022, 0.15203687041000188, 0.15390765070270543, 0.15576002842705336, 0.15760202705495768, 0.15944106483377884, 0.16128378114001818, 0.163135891186787, 0.16500207243106596 ], [ 0.06582181849669103, 0.06446610484206079, 0.0637039868982912, 0.06349138571555327, 0.06376570408878185, 0.06445400982888731, 0.0654815533441255, 0.06677892811850153, 0.06828695923513856, 0.06995917616135472, 0.07176221953901477, 0.07367472745675453, 0.0756852497998839, 0.07778966016775146, 0.0799884398547889, 0.08228412166995899, 0.08467910380457083, 0.08717397005526804, 0.08976638000378637, 0.0924505243231435, 0.0952170828559675, 0.09805358298331715, 0.10094503633780864, 0.10387473201503898, 0.10682507945568438, 0.10977841781242904, 0.11271773485584578, 0.11562726279849703, 0.11849293822885124, 0.12130272773931408, 0.12404683007047249, 0.1267177705691135, 0.12931040556965331, 0.1318218540012033, 0.13425137196011064, 0.1366001838225884, 0.13887128116072375, 0.14106919856506303, 0.14319977364424008, 0.14526989705333593, 0.14728725741859708, 0.1492600854482734, 0.15119690128180874, 0.1531062691390746, 0.15499656347668309, 0.15687575102151533, 0.15875119311929267, 0.1606294727123744, 0.16251624987881666, 0.16441614919405426 ], [ 0.06323977930729247, 0.0619402591366626, 0.06126355969336004, 0.06115800575464439, 0.06155159820481371, 0.062361843390056605, 0.06350566386168081, 0.0649073935174564, 0.06650392856770039, 0.06824705098765324, 0.07010346646522733, 0.07205324693096732, 0.07408730830005315, 0.07620442937910743, 0.07840819934812422, 0.08070418618495254, 0.08309753925386619, 0.08559116452798309, 0.08818453540544803, 0.09087312890865695, 0.09364841439918851, 0.09649827807230806, 0.09940774577921042, 0.10235986814159942, 0.10533665009063176, 0.10831993451968255, 0.11129217971097623, 0.11423709747108221, 0.11714014067940343, 0.11998884437947346, 0.12277303410350966, 0.12548491995562133, 0.12811909640143368, 0.13067246692183548, 0.13314411064883197, 0.13553510551655354, 0.13784831980770015, 0.1400881815540871, 0.14226043322726667, 0.14437187760564796, 0.1464301196358113, 0.14844330847730966, 0.15041988365612238, 0.15236832925064783, 0.1542969401784711, 0.15621360481975216, 0.1581256082880672, 0.16003946054464815, 0.1619607531795179, 0.1638940480231781 ], [ 0.06070902250538328, 0.05946767784916789, 0.058880402924377774, 0.05888710400913249, 0.05940540823275056, 0.06034243501111345, 0.061606267148107796, 0.06311479449135636, 0.064801045183992, 0.06661525274044865, 0.06852443719957461, 0.07051034834291388, 0.07256647918969646, 0.07469468232180747, 0.07690178067774825, 0.079196464289355, 0.08158668661980163, 0.08407770039487984, 0.08667079524238394, 0.08936272151854074, 0.09214571656420356, 0.09500800173163998, 0.09793459651583887, 0.10090829906996948, 0.10391070404620749, 0.10692316050899885, 0.10992760659280766, 0.11290724788752564, 0.11584707023278654, 0.118734193964684, 0.12155808642112173, 0.12431065409268124, 0.1269862367479965, 0.12958152452716507, 0.1320954164424463, 0.13452883570369056, 0.1368845142886226, 0.1391667565005874, 0.14138118905384542, 0.14353450355777878, 0.14563419612901252, 0.14768830819073792, 0.1497051722347029, 0.1516931663138206, 0.1536604811791662, 0.155614904148286, 0.1575636238744203, 0.15951306008055588, 0.1614687219606976, 0.16343509830408814 ], [ 0.0582283395281529, 0.057046858190813655, 0.05655300171670056, 0.0566773372448626, 0.057326036770668005, 0.05839494164702669, 0.05978277279068891, 0.06140081534395039, 0.06317831998479405, 0.06506418827788327, 0.06702600308067459, 0.06904741895508201, 0.07112468922534873, 0.07326287604456448, 0.07547212934990195, 0.0777643194078598, 0.08015023445529607, 0.08263748411771327, 0.08522917041852392, 0.08792330549043707, 0.09071288116355639, 0.09358644340041249, 0.09652900121667468, 0.09952310439731342, 0.10254994977690528, 0.10559041218120495, 0.10862593416792433, 0.11163924208464797, 0.11461488152364822, 0.11753958243610543, 0.12040247400773121, 0.12319517361576231, 0.12591177456916278, 0.12854875540242325, 0.1311048303986604, 0.13358075755146434, 0.135979116837496, 0.13830406874962575, 0.14056110067224215, 0.14275676690686948, 0.14489842695316946, 0.14699398594981913, 0.14905164088382744, 0.1510796361678877, 0.15308603233512394, 0.15507849178008265, 0.15706408556516124, 0.15904912521511158, 0.16103902307221796, 0.16303818415293161 ], [ 0.05579649280188118, 0.05467632003424972, 0.05427996233183725, 0.054527605288916585, 0.05531275184471082, 0.05651899797641894, 0.058035170690822924, 0.05976581726905858, 0.06163653305183445, 0.06359512018608963, 0.06560996830617834, 0.06766684206512463, 0.06976490600791317, 0.07191253121798441, 0.07412325272907543, 0.07641214945552106, 0.07879285338677967, 0.08127532894431991, 0.08386448407145322, 0.08655958723053021, 0.08935438450142451, 0.09223775424837007, 0.09519471213538583, 0.09820758581676729, 0.10125720810834729, 0.10432401847808787, 0.10738900492923989, 0.1104344547701363, 0.11344451009078779, 0.11640554164280459, 0.119306364615299, 0.12213832356035442, 0.12489527348019497, 0.1275734815261534, 0.13017147011195926, 0.1326898183358376, 0.13513093494018766, 0.13749881288710925, 0.139798773111892, 0.14203720315506613, 0.14422129512421494, 0.14635878671664113, 0.14845770873393302, 0.1505261425139778, 0.15257199086197498, 0.15460276624829158, 0.1566254001384562, 0.15864607723245835, 0.16067009805179322, 0.16270177269655595 ], [ 0.05341239600267112, 0.05235478890374954, 0.05206019845903348, 0.052437235109766035, 0.05336535922232196, 0.054714867948124454, 0.056364155935885625, 0.05821093367807285, 0.060177298614329876, 0.06221020183440356, 0.06427907638555429, 0.06637197682015912, 0.06849109362904267, 0.07064816645112004, 0.07286013610745416, 0.07514528789557463, 0.07752008548902334, 0.0799968359798159, 0.08258224772257333, 0.08527685075846037, 0.08807516346575404, 0.0909664276925286, 0.09393570854606222, 0.09696516350128884, 0.10003531908749218, 0.10312623920256636, 0.10621851550771805, 0.10929404972432791, 0.11233662661832372, 0.1153322949008071, 0.11826958292302035, 0.12113957927621427, 0.12393590750189648, 0.12665462090991036, 0.12929403930350897, 0.13185454507383368, 0.13433835215101747, 0.1367492579412431, 0.1390923857354578, 0.14137392314434635, 0.14360086083387044, 0.14578073510788597, 0.14792137758841162, 0.1500306752469206, 0.15211634420428868, 0.15418572091012187, 0.15624557441559106, 0.15830194337274203, 0.1603600010648185, 0.16242395117157377 ], [ 0.051075356577230314, 0.05008143534296967, 0.049893164288268274, 0.05040619780860249, 0.051484390378791836, 0.052983593515746844, 0.054771233218289105, 0.056738129380833086, 0.058803080484723026, 0.06091245182220264, 0.06303694711477983, 0.06516706181588172, 0.067308087475371, 0.06947514926121198, 0.07168857505137681, 0.07396982278126074, 0.0763381553014414, 0.07880820227156532, 0.08138847119721797, 0.08408077376412913, 0.08688044143511924, 0.08977713818306478, 0.09275605069672885, 0.09579924676496113, 0.0988870301824711, 0.10199917095601427, 0.10511594001716026, 0.10821891980731806, 0.11129159255733327, 0.11431972698124893, 0.11729159353106738, 0.1201980410232999, 0.1230324658667539, 0.1257907012731314, 0.12847084910037532, 0.1310730722362719, 0.13359936117022697, 0.13605328486046395, 0.1384397332554566, 0.14076465684739592, 0.1430348073403669, 0.14525748279252776, 0.14744028030796977, 0.14959085936961014, 0.15171671907861553, 0.15382499276515516, 0.1559222635427687, 0.15801440430216387, 0.16010644532014454, 0.16220247207326857 ], [ 0.04878539581395838, 0.04785618481957589, 0.0477791454683831, 0.04843536531453361, 0.04967130859272088, 0.051327139842585294, 0.053258798402737506, 0.055350220811455526, 0.057517155555368675, 0.059705666204370816, 0.061887943372564536, 0.0640570426659321, 0.06622138919031711, 0.06839946545413796, 0.07061492652201501, 0.07289233703289645, 0.0752537065137384, 0.07771596071275749, 0.08028941185009127, 0.08297719133816543, 0.08577551063120144, 0.08867454516516557, 0.0916597072568008, 0.09471308585027254, 0.09781487238245314, 0.1009446468111091, 0.10408245202442017, 0.10720962958141816, 0.110309421531713, 0.11336736232673983, 0.11637149400320407, 0.1193124399128443, 0.12218337003369988, 0.12497988643921601, 0.12769985226898586, 0.13034318242921272, 0.13291160973739366, 0.13540843652992154, 0.13783827892227443, 0.14020680890104203, 0.1425204981334613, 0.14478636667335787, 0.1470117394790891, 0.14920401369189756, 0.15137043980815937, 0.15351792008328363, 0.15565282761389623, 0.15778084946994353, 0.1599068569335632, 0.1620348053276791 ], [ 0.046543661489822426, 0.045680112024565483, 0.04571961794480435, 0.04652681156731275, 0.04792873337768383, 0.04974853462022016, 0.051830194469259065, 0.05405085562995324, 0.05632352556843246, 0.05859427081695073, 0.06083697207333425, 0.06304732964266274, 0.06523688936831021, 0.0674274156860925, 0.06964578849547877, 0.07191958042474006, 0.07427347535955954, 0.076726663183232, 0.07929127469785005, 0.08197181894868154, 0.0847654822407579, 0.08766307308070917, 0.09065036647640169, 0.09370961426638565, 0.09682103272869678, 0.09996413730326328, 0.10311885176758881, 0.1062663662326744, 0.10938975131984487, 0.11247435545853789, 0.11550802116413239, 0.11848115771840861, 0.12138670483043851, 0.12422001683770614, 0.12697869132077644, 0.12966236055670985, 0.13227245950397631, 0.13481198019071594, 0.1372852194940842, 0.1396975252796525, 0.14205504459439877, 0.144364476928759, 0.14663283532795157, 0.14886721818647264, 0.15107459475609308, 0.1532616076048678, 0.1554343953713271, 0.15759843908026872, 0.15975843497299072, 0.16191819623972048 ], [ 0.044352945660004306, 0.04355593088603953, 0.04371768105326874, 0.04468415839798806, 0.046260679037153175, 0.04825199607116258, 0.0504897379753762, 0.052844451019412694, 0.05522678022026781, 0.057583120432636734, 0.059889229283840446, 0.062143498152382126, 0.06436053294602957, 0.06656525582785779, 0.06878762584418868, 0.0710580917025678, 0.07340391935324485, 0.07584652536958367, 0.07839988134186594, 0.08106995167080677, 0.08385502017687657, 0.08674668194823233, 0.0897312441396477, 0.09279129324692834, 0.09590723333513311, 0.09905866134132492, 0.10222550585381524, 0.10538890476578759, 0.1085318312526411, 0.11163949740785255, 0.11469957360074705, 0.11770226273754077, 0.12064026524125102, 0.12350866506300504, 0.12630476095756213, 0.12902786152408477, 0.13167905760128953, 0.13426098169250214, 0.13677756118361564, 0.13923377011153468, 0.14163538300021616, 0.14398873364406164, 0.14630048151855543, 0.14857738857574745, 0.15082610938960314, 0.1530529978233159, 0.15526393349050893, 0.15746417119636663, 0.15965821622710788, 0.1618497277953041 ], [ 0.04221831442552924, 0.04148858579237988, 0.041778564137686006, 0.04291295849872848, 0.04467279633606527, 0.04684303984302474, 0.04924271066699782, 0.05173609105908083, 0.05423191779519435, 0.056677256211576744, 0.05904990547263672, 0.061350951694497724, 0.06359794979169177, 0.06581880566292025, 0.06804636823412887, 0.07031379703390332, 0.07265082729878769, 0.07508105828506689, 0.07762033126714359, 0.0802761614214599, 0.08304807813248588, 0.08592864593625811, 0.08890490346299369, 0.09195997127912503, 0.09507462778216202, 0.09822871602705463, 0.10140230672825624, 0.10457659326811179, 0.10773452952432677, 0.11086124155169337, 0.11394425279795373, 0.1169735633324098, 0.11994161979527851, 0.12284320688280898, 0.1256752847839485, 0.12843679102537298, 0.13112842013423456, 0.13375239055664837, 0.1363122053573473, 0.1388124112564339, 0.1412583593709067, 0.14365597044394177, 0.14601150718739173, 0.14833135646710274, 0.15062182427774765, 0.1528889466567651, 0.15513831977417575, 0.15737495233447515, 0.15960314309861026, 0.16182638577145664 ], [ 0.040147845989735, 0.03948593900013424, 0.03991019425822123, 0.04122109635267445, 0.04317259737092068, 0.0455285499899274, 0.04809530955365017, 0.05073138506035166, 0.05334413297577323, 0.0558816376726498, 0.058323872513012055, 0.060674573214502446, 0.0629540796334938, 0.06519305724223015, 0.06742701249148855, 0.06969161734752616, 0.07201894227705388, 0.07443471652281097, 0.07695668323609944, 0.07959401716623625, 0.0823476619092157, 0.08521135887971593, 0.08817310295091252, 0.09121677197802548, 0.09432372568031305, 0.09747423399282679, 0.10064865862916206, 0.10382836334166513, 0.10699636415282622, 0.11013775145301108, 0.11323992456676582, 0.11629268003181231, 0.11928819080350711, 0.12222090742911046, 0.1250874056039685, 0.12788619840014226, 0.13061752632422652, 0.13328313437063974, 0.13588604235469592, 0.13843031290035068, 0.1409208203394252, 0.1433630232591346, 0.14576274332605188, 0.14812595314675076, 0.15045857614969402, 0.152766301666302, 0.15505441845654916, 0.15732766980130358, 0.15959013293709892, 0.1618451250376719 ], [ 0.03815345581710782, 0.03755953207810795, 0.038123795125766254, 0.03961917283595256, 0.041769633701387275, 0.04431679482854414, 0.04705454859362375, 0.049836291131915206, 0.05256858516235886, 0.05520086967875187, 0.0577153785422178, 0.060118395273435175, 0.06243282489770167, 0.06469181845789318, 0.06693326581915644, 0.06919512059957318, 0.07151163222691666, 0.07391059552308198, 0.07641168604060476, 0.07902585392457681, 0.08175563924585198, 0.08459618541421673, 0.08753668754813898, 0.0905620226259924, 0.09365435507160935, 0.09679457564962568, 0.09996349550450054, 0.10314276958764344, 0.10631556016859313, 0.10946697222212605, 0.11258430142465783, 0.11565713616775915, 0.11867735087148508, 0.1216390215684729, 0.12453828796380285, 0.12737317996543843, 0.1301434215160806, 0.13285022059134122, 0.13549605141220242, 0.13808443309682306, 0.1406197079480637, 0.14310682213010975, 0.1455511114336398, 0.14795809498957307, 0.15033328001918897, 0.15268198088542972, 0.1550091557492625, 0.15731926398003906, 0.15961614709485308, 0.1619029354135149 ], [ 0.03625176009136776, 0.035725372910028134, 0.036434463272991144, 0.038120821377005516, 0.04047558865736563, 0.043217366449810016, 0.04612810715505672, 0.049056912764231, 0.051910164232068, 0.05463894797391391, 0.05722777908151364, 0.05968532102107376, 0.06203676592620252, 0.06431742771098978, 0.06656726603474111, 0.06882625432163791, 0.07113064162204101, 0.07351020863389605, 0.07598658604370054, 0.07857261430867168, 0.08127261710463261, 0.08408337404868366, 0.08699553606707952, 0.08999523340019151, 0.0930656701553394, 0.0961885617084323, 0.09934533450878236, 0.1025180603507187, 0.10569013411108259, 0.10884672558612642, 0.11197504541545494, 0.11506446599147153, 0.11810653421732431, 0.12109490666887346, 0.12402523092924454, 0.12689499065097878, 0.12970332677190602, 0.13245084342032615, 0.13513940433276334, 0.1377719239011051, 0.1403521560475474, 0.14288448377244498, 0.1453737122263112, 0.14782486834549374, 0.15024301031682943, 0.15263305028876847, 0.15499959374697325, 0.15734679877495336, 0.15967825800861374, 0.16199690547879383 ], [ 0.03446488653486903, 0.03400466081211118, 0.034861636209437386, 0.03674288532614582, 0.03930423933486929, 0.04224102499055979, 0.04532412532995961, 0.048399280715528736, 0.05137327352091737, 0.054199047758463674, 0.056863331993737, 0.05937692561707278, 0.06176696947733932, 0.06407057105103264, 0.06632940985122357, 0.06858518826157514, 0.07087595203620538, 0.07323336906535784, 0.07568103344739997, 0.07823378113454757, 0.08089790155174986, 0.08367204409535768, 0.08654857390678507, 0.08951513378605958, 0.09255620872036226, 0.0956545486258575, 0.0987923663447345, 0.10195227989767189, 0.1051180051635297, 0.10827482735345934, 0.11140988957352845, 0.11451233811961149, 0.11757336039430748, 0.1205861451928031, 0.12354578842363595, 0.12644916121215283, 0.12929475231786447, 0.13208249304228284, 0.1348135702428046, 0.13749023151268103, 0.14011558580227626, 0.14269340250633725, 0.1452279121127456, 0.14772361172187246, 0.1501850789621705, 0.15261679794458186, 0.15502300084839926, 0.15740752847907769, 0.15977371267749782, 0.16212428280857866 ], [ 0.03282107971182528, 0.03242430688854638, 0.03342932975271364, 0.03550537131034738, 0.038271245313452225, 0.04139943663590618, 0.04465095372351059, 0.04786913705098651, 0.050961650943971495, 0.053883377820185895, 0.056623079309232646, 0.05919336113570692, 0.06162291322704796, 0.06395022386793327, 0.06621831027451441, 0.06847028676907652, 0.07074576941159687, 0.07307819235887655, 0.07549310047161016, 0.07800741175576345, 0.08062954839654699, 0.08336025230913621, 0.08619385486306719, 0.08911976822876207, 0.09212399990120193, 0.0951905464505993, 0.0983025810455447, 0.10144339996456758, 0.10459713037793626, 0.10774922438649094, 0.11088677491891323, 0.11399869105993198, 0.11707576709962361, 0.12011067378559621, 0.1230978938264136, 0.12603361778675923, 0.1289156117026519, 0.1317430641991775, 0.13451641853928273, 0.13723719366778456, 0.13990779768959044, 0.14253133708719043, 0.1451114251213952, 0.14765199309412458, 0.15015710834986157, 0.15263080296160067, 0.15507691693298853, 0.15749895942787825, 0.15989999101552746, 0.16228252922002218 ], [ 0.03135486312980117, 0.03101703336255402, 0.032165981827896754, 0.0344310869883693, 0.037393731811242975, 0.04070480716038455, 0.04411687382568434, 0.04747174120442816, 0.05067824748129993, 0.05369311737209948, 0.05650683075274942, 0.05913337762930251, 0.06160253703752106, 0.06395372622510949, 0.06623089070256452, 0.06847821712104794, 0.07073664289771672, 0.07304122293996873, 0.07541941373398812, 0.07789027516716218, 0.08046450446523865, 0.08314513805086295, 0.0859287099269598, 0.08880664816579051, 0.09176671881392479, 0.09479437519655805, 0.09787392503155276, 0.10098947632992765, 0.10412565956418815, 0.10726814664520487, 0.11040399859203637, 0.11352187651385628, 0.11661214788910114, 0.1196669148273024, 0.12267998496923306, 0.1256468001164825, 0.12856433318383062, 0.13143096081850955, 0.13424631695044392, 0.13701113141141316, 0.13972705732495966, 0.14239649096576654, 0.1450223879965997, 0.14760808024060476, 0.15015709731401256, 0.15267299745107957, 0.15515921165922225, 0.15761890493846972, 0.16005485770074185, 0.1624693697648908 ], [ 0.03010642237223246, 0.029820753919258338, 0.031103709010323128, 0.033544880177323995, 0.0366896548344919, 0.04016942766744403, 0.04372981151553587, 0.04721171747922017, 0.05052517698501141, 0.05362844415547066, 0.056513252843297765, 0.05919446033352043, 0.06170241784897541, 0.06407698627984584, 0.06636260843857447, 0.06860418538010785, 0.07084370625547383, 0.0731176755496709, 0.07545539169552802, 0.07787808296743655, 0.08039883089129223, 0.0830231386693096, 0.08574995507623293, 0.08857295274850703, 0.09148188067915715, 0.09446385265020261, 0.09750448265221928, 0.10058882393108538, 0.10370210366880393, 0.10683026843633499, 0.10996036757043151, 0.11308080520518139, 0.11618148985237609, 0.11925390580600542, 0.1222911251887942, 0.12528777439024075, 0.12823996459250955, 0.13114519323301035, 0.13400222152590022, 0.13681093233174577, 0.13957217245046655, 0.14228758355511373, 0.14495942626468608, 0.14759040211001817, 0.15018347826907485, 0.15274171987536597, 0.15526813441228401, 0.15776553220279285, 0.16023640631526764, 0.16268283437456532 ], [ 0.029119806811924005, 0.028876886240728802, 0.030276785558752958, 0.03287242766291874, 0.03617696239051809, 0.039805161556671215, 0.04349706758315653, 0.04709295824082649, 0.05050374253479595, 0.0536886515951524, 0.056640055369366164, 0.05937307004223049, 0.06191805151911458, 0.06431479244101014, 0.06660778660966785, 0.06884227809017499, 0.07106102030371012, 0.0733017708873251, 0.07559556782361275, 0.07796579639545614, 0.08042799226146198, 0.082990260497619, 0.0856541448739238, 0.08841576632019735, 0.09126706359212382, 0.09419700372117375, 0.09719267315116152, 0.10024020219227885, 0.10332550896399433, 0.10643487177818534, 0.10955535141780727, 0.11267508918621232, 0.11578350566956033, 0.11887142137792965, 0.12193111572428206, 0.12495633640023117, 0.12794226775109188, 0.13088546443106192, 0.1337837553395765, 0.13663612236337883, 0.13944255849333917, 0.14220391018803363, 0.1449217092070972, 0.1475979993880147, 0.1502351639003566, 0.1528357583403157, 0.1554023546216348, 0.157937399998971, 0.16044309476634688, 0.16292129125712118 ], [ 0.028439617590033297, 0.028227316894268856, 0.02971923750215037, 0.03243858553762466, 0.03587259587639657, 0.03962290824704291, 0.04342508424796326, 0.047118587718624066, 0.05061453381737956, 0.053872341708490444, 0.05688425594921212, 0.05966496266919592, 0.062244214056400224, 0.0646612042446626, 0.06696002313888923, 0.06918587824460046, 0.07138198565285177, 0.07358713634956252, 0.07583397257290815, 0.0781479850591591, 0.08054718981508116, 0.08304238612047533, 0.08563785475994404, 0.08833233749237691, 0.09112014646316138, 0.09399227929375908, 0.0969374522359785, 0.09994300079890317, 0.102995628197687, 0.10608200384087926, 0.10918922675056143, 0.11230517396613661, 0.11541875400162768, 0.11852008263111839, 0.12160059450403829, 0.12465310054998441, 0.12767179844668444, 0.1306522417727463, 0.13359127274162128, 0.1364869233651143, 0.13933829023812858, 0.14214538861487935, 0.1449089918654167, 0.14763046263281673, 0.15031158199034628, 0.15295438260719565, 0.15556099138875754, 0.15813348630307703, 0.16067377119211057, 0.1631834713536763 ], [ 0.02810620477820627, 0.02791005007160491, 0.02946165605706493, 0.03226541575669792, 0.035791408179945416, 0.039632080507566274, 0.0435192578761681, 0.04729098060725878, 0.05085757981922329, 0.05417767133815769, 0.05724249525544054, 0.060065556716158035, 0.06267536807114449, 0.065109985856875, 0.06741263980673926, 0.0696281187518972, 0.07179979013629778, 0.07396723829671924, 0.07616454323432789, 0.07841920935518562, 0.08075171371790074, 0.08317559583093545, 0.08569797259726547, 0.08832034270754925, 0.09103954702057937, 0.09384877117843045, 0.09673850630582895, 0.09969741521754817, 0.10271307908656342, 0.10577261979827304, 0.10886320561238802, 0.11197245342824418, 0.11508874189388398, 0.11820144789177409, 0.12130111627359284, 0.12437957023636281, 0.12742996801024356, 0.13044681070861552, 0.13342590614232264, 0.13636429386040175, 0.13926013736530407, 0.1421125901197556, 0.1449216424438594, 0.14768795659719214, 0.15041269721658043, 0.1530973638475856, 0.15574363160856391, 0.1583532051198438, 0.16092768978356264, 0.16346848337900477 ], [ 0.02815009126806904, 0.02795416840333825, 0.02952767511081754, 0.03237013759570739, 0.035945110092615216, 0.03984013333410801, 0.04378380070234517, 0.047611821626881316, 0.05123253437727938, 0.05460262406017533, 0.05771137163185193, 0.06057031465957107, 0.06320607847675519, 0.06565504500781798, 0.06795913379315818, 0.07016233623011439, 0.07230785503705224, 0.07443581193057368, 0.07658153026495353, 0.07877439804448068, 0.08103728882919091, 0.083386480561503, 0.08583197940317439, 0.08837813657458853, 0.0910244442102768, 0.09376640925810464, 0.09659642694281537, 0.0995046008756051, 0.10247948021263768, 0.105508702173677, 0.10857953976333197, 0.11167936038908871, 0.114796002828166, 0.11791807943535218, 0.12103520910173113, 0.12413818526669722, 0.1272190827374919, 0.13027130726222622, 0.13328959256431278, 0.13626995060269312, 0.1392095818965098, 0.14210675362733283, 0.14496065377002368, 0.14777122964587974, 0.15053901904162956, 0.1532649814400719, 0.15595033603180755, 0.15859641210206066, 0.16120451619207882, 0.1637758191955473 ], [ 0.028587107485335363, 0.028375394159533836, 0.029930902599481148, 0.03276337600411967, 0.03634138951568908, 0.040252187717019716, 0.04422165307726555, 0.04808219006503547, 0.051738870671812126, 0.055145279709165204, 0.05828776452096461, 0.06117510597804873, 0.0638314040398523, 0.0662908433575282, 0.0685935976491112, 0.07078249160360546, 0.07290024768492392, 0.07498725799065671, 0.07707987136895711, 0.07920919460528954, 0.08140039006187724, 0.08367242484265192, 0.08603820012933092, 0.08850497193624902, 0.09107496980599362, 0.09374612726413899, 0.09651285351894846, 0.09936679510155269, 0.10229755454228218, 0.10529334791450776, 0.10834159305513333, 0.11142942584316917, 0.11454414428224599, 0.1176735807223994, 0.1208064025931731, 0.12393234229409893, 0.1270423577334379, 0.1301287264002837, 0.13318507757185796, 0.1362063690033475, 0.13918881595884705, 0.14212978153627412, 0.14502763782614142, 0.14788160751374513, 0.15069159513472613, 0.15345801640812246, 0.15618163299764362, 0.1588633987914294, 0.16150432243640875, 0.16410534949696304 ], [ 0.029415951422675276, 0.029173756962790013, 0.030673202386284144, 0.03344811573296778, 0.03698336182260323, 0.04087080001777111, 0.044834452720490206, 0.048702657205115345, 0.05237606434351687, 0.055804057309591974, 0.058969120523483666, 0.06187652461463348, 0.06454723707600686, 0.06701275045672236, 0.06931108003640486, 0.07148353031961549, 0.07357203403468583, 0.07561698098849641, 0.07765550944823654, 0.0797202501114708, 0.0818385068533734, 0.08403184111598735, 0.08631600757634192, 0.08870117439732747, 0.09119235545354586, 0.09378998474885665, 0.09649057269368008, 0.09928739669878348, 0.10217119145343227, 0.10513081502973709, 0.10815387462348029, 0.11122730047553972, 0.11433785918665164, 0.11747259931049314, 0.12061922366921282, 0.12376638478651136, 0.12690390229066778, 0.1300229039333038, 0.13311589469063714, 0.13617676094506892, 0.13920071874274356, 0.14218421645143242, 0.14512480277142661, 0.148020971029713, 0.1508719901157839, 0.15367773142191216, 0.15643849986220032, 0.15915487558526184, 0.16182757147138055, 0.16445731000395544 ], [ 0.030619135974032326, 0.030334261619649253, 0.031744904470933956, 0.03441965438763346, 0.0378694806789841, 0.04169592639095993, 0.0456225730192688, 0.049473391074305, 0.05314375129339026, 0.056577913528385024, 0.05975368245089582, 0.0626721405800659, 0.06535057089069454, 0.0678173210613998, 0.07010786728256281, 0.07226166259971768, 0.07431955209403819, 0.07632165041915644, 0.07830563657982847, 0.08030544566696016, 0.08235034078632938, 0.08446434053760402, 0.08666596570566994, 0.08896825868419467, 0.09137902357582296, 0.09390123467372356, 0.0965335651539998, 0.09927099439108465, 0.10210545936206333, 0.10502652171080279, 0.10802202662749774, 0.1110787329600495, 0.1141828965548873, 0.11732079143838532, 0.12047915658509309, 0.12364555981538451, 0.1268086746431175, 0.12995847028000207, 0.13308631907803511, 0.13618502910505548, 0.13924881208288584, 0.14227319849580508, 0.14525491233995388, 0.14819171785226817, 0.1510822497926991, 0.15392583762931736, 0.15672233245689712, 0.15947194380984614, 0.16217509182863027, 0.1648322785978855 ], [ 0.03216689074706676, 0.031830257525034815, 0.033126871702016995, 0.035666590303455835, 0.03899395575680906, 0.04272511055453144, 0.04658524088123211, 0.05039426725133207, 0.05404185223727217, 0.057466485368361846, 0.06064064868399906, 0.06356067265998817, 0.06623968208773957, 0.06870248326416141, 0.07098167355325766, 0.07311455178750087, 0.07514059443588504, 0.07709937331548283, 0.07902885253791328, 0.08096403314511187, 0.08293592544876977, 0.08497082981198885, 0.08708990242726125, 0.08930897750706225, 0.09163861343008273, 0.09408432853585459, 0.09664699215738969, 0.09932333734661351, 0.10210656281390851, 0.10498699247391614, 0.1079527617542014, 0.11099050093848556, 0.11408598784432655, 0.11722474547183012, 0.12039256496287394, 0.12357593997875475, 0.12676240488597762, 0.12994077529859538, 0.13310129499648593, 0.13623569762936985, 0.13933719473706696, 0.14240040346068986, 0.14542122801275817, 0.14839670871850105, 0.15132485146628946, 0.15420444893737142, 0.1570349032241011, 0.15981605755786749, 0.16254804298348996, 0.16523114403288636 ], [ 0.0340225014995415, 0.0336282271393031, 0.034793736760896754, 0.037172591142355244, 0.04034760782432446, 0.04395388167508859, 0.04772073228872683, 0.05146498337612596, 0.05507065943769778, 0.05847017103542647, 0.0616302562267412, 0.06454207572137485, 0.06721422166361138, 0.06966763184490433, 0.07193173442469974, 0.07404140576851105, 0.07603449476899034, 0.07794977296697521, 0.07982523245694528, 0.08169668861282398, 0.08359666277003627, 0.08555352825701228, 0.08759090613992128, 0.08972729737641195, 0.09197593702052365, 0.09434485404742751, 0.09683711725379245, 0.09945124356346, 0.10218174027334939, 0.10501974804031973, 0.10795374771430351, 0.11097029242740351, 0.11405472730859177, 0.11719186296274588, 0.1203665750445458, 0.12356431006791016, 0.1267714860200816, 0.12997578443482663, 0.13316633757448484, 0.13633381982508067, 0.13947045616400255, 0.14256996268854477, 0.14562743491761057, 0.1486391991909106, 0.15160264129534018, 0.15451602472739176, 0.15737830899075161, 0.16018897621804223, 0.16294787233660452, 0.16565506707052488 ], [ 0.036147428602996974, 0.03569251058867223, 0.036717379396791386, 0.03891850455088836, 0.04191898909302632, 0.04537630111461684, 0.049026624141710266, 0.0526851690327756, 0.05623088139563264, 0.05959014622110167, 0.06272378553810196, 0.06561754146271234, 0.06827521446625294, 0.07071362704554378, 0.07295880449095507, 0.07504297228035463, 0.07700211931763926, 0.07887397427990568, 0.08069630370767882, 0.08250547806330018, 0.08433527504357324, 0.08621590398612453, 0.08817324469660288, 0.09022829994124361, 0.09239686342415321, 0.09468940399410747, 0.09711116194508045, 0.0996624450628352, 0.1023391017908805, 0.1051331384104654, 0.10803343848731277, 0.11102653772512497, 0.11409740672474956, 0.11723019799670029, 0.12040892110000251, 0.12361801963094138, 0.12684283444712602, 0.13006994763972998, 0.13328741039102332, 0.136484864449293, 0.13965357138907936, 0.1427863662600683, 0.14587755298932537, 0.1489227583804304, 0.15191876013485395, 0.15486330234439347, 0.15775490964403893, 0.1605927088828138, 0.1633762649178967, 0.16610543506762798 ], [ 0.038505153024813284, 0.03798896216149737, 0.03886988249070977, 0.040884362167372026, 0.0436955501726495, 0.04698556260552061, 0.05050006307774285, 0.05405447558007742, 0.05752364020176993, 0.06082831506542723, 0.06392348877420628, 0.06678941571244437, 0.06942497116522824, 0.07184270366510337, 0.074065064381664, 0.07612144369594719, 0.07804576854263759, 0.07987450104316943, 0.08164493683218552, 0.08339373981450066, 0.08515567650981141, 0.0869625326594959, 0.08884220991681331, 0.09081801173830961, 0.0929081342700731, 0.09512537892897674, 0.09747709790325268, 0.09996537251188263, 0.10258740919940107, 0.10533612183062932, 0.10820085507440864, 0.11116819463928537, 0.11422280736913688, 0.11734825773791671, 0.12052775590910049, 0.12374480433285123, 0.1269837227653535, 0.13023004382812936, 0.13347078155116787, 0.13669458314007635, 0.13989177936645303, 0.1430543517488357, 0.14617583550511226, 0.14925117661157464, 0.15227655966800135, 0.15524922104129701, 0.15816725925650785, 0.16102945205601465, 0.1638350871173244, 0.16658381121226523 ], [ 0.0410634566770169, 0.04048720024295135, 0.041225579290521834, 0.04305095851833666, 0.045664656738314095, 0.04877454386602707, 0.0521380041755001, 0.05557262677514751, 0.05895041601973857, 0.06218719699280903, 0.06523244613454957, 0.06806103896124331, 0.0706669206570266, 0.07305829920142079, 0.07525394640857337, 0.0772802807306587, 0.07916899865850179, 0.08095509436926535, 0.08267515948547723, 0.08436589212660393, 0.08606277264892005, 0.087798886590287, 0.08960389513533844, 0.09150316961329359, 0.09351711745803067, 0.09566073064211147, 0.09794338254884856, 0.10036888593004349, 0.10293580532812392, 0.10563799595476385, 0.10846532185445995, 0.11140449290173972, 0.1144399548594795, 0.11755476952078867, 0.12073143138058, 0.12395258087450489, 0.12720158931759626, 0.13046300501477862, 0.1337228620756107, 0.1369688625042421, 0.14019044805538874, 0.14337878147880528, 0.14652665766481343, 0.14962836445276775, 0.15267951102746197, 0.15567683936559626, 0.1586180314589394, 0.1615015222872283, 0.16432632591397286, 0.16709187973926018 ], [ 0.04379534869596035, 0.04316159060159549, 0.04376215122679988, 0.04540086709546399, 0.047814328673879254, 0.050736228821557657, 0.05393737813115296, 0.05723941336716916, 0.060512935501918726, 0.06366975346360805, 0.06665435821117652, 0.06943652014635336, 0.07200537414701702, 0.07436481301553538, 0.07652989125206511, 0.0785239677066017, 0.0803763756337827, 0.08212046491695775, 0.08379190581401513, 0.08542717824098074, 0.08706219915109732, 0.0887310659663953, 0.09046491738340776, 0.09229093328276203, 0.09423151047045285, 0.09630365762559898, 0.09851864902446404, 0.10088196225732775, 0.10339350267540949, 0.10604809122748594, 0.10883616808526007, 0.1117446467748068, 0.11475784529062229, 0.11785842231544003, 0.12102825652682249, 0.12424922208485112, 0.1275038305165936, 0.13077572558751052, 0.1340500315289422, 0.13731356528788044, 0.14055493017662857, 0.14376451183029995, 0.1469343983812011, 0.1500582459350281, 0.15313110842361946, 0.15614924823388146, 0.1591099410650434, 0.16201128552317676, 0.16485202520474485, 0.16763138855920692 ], [ 0.046679038749156805, 0.045991307224114, 0.046460944021592454, 0.047918909207374925, 0.05013365775597647, 0.052863957384984187, 0.055895161998580786, 0.05905462300677548, 0.06221300612004757, 0.06527916277941158, 0.06819328584845691, 0.07092045700125851, 0.07344523519100161, 0.07576731133224252, 0.0778980507953808, 0.07985771463843891, 0.0816731770056292, 0.0833759942306161, 0.08500071657015129, 0.08658336408863296, 0.0881600157703746, 0.08976548737765094, 0.09143209940361859, 0.09318856025846518, 0.09505900849334266, 0.09706226767270393, 0.09921136551398084, 0.10151335440722534, 0.1039694456850255, 0.10657544001123623, 0.10932240732929072, 0.11219754779163825, 0.11518515370993965, 0.11826759268828949, 0.12142624199023609, 0.12464232048036736, 0.12789758338103, 0.1311748633444751, 0.13445845676950705, 0.13773436583447393, 0.14099041424253517, 0.14421625864246293, 0.14740331884451296, 0.15054464909681473, 0.1536347705434005, 0.1566694821309979, 0.15964566409945935, 0.1625610850790256, 0.16541422091892546, 0.16820409079839277 ], [ 0.04969734667082731, 0.04895982791579215, 0.0493067422665346, 0.05059218296933504, 0.052612928973160444, 0.05515149979241558, 0.05800834968088471, 0.06101790825007864, 0.06405230534009017, 0.06701855593097085, 0.06985335279805314, 0.0725176194240286, 0.07499167269021549, 0.07727119529611524, 0.07936395441258376, 0.08128712348459737, 0.08306505888282167, 0.08472740261102242, 0.08630740743682691, 0.08784040622823878, 0.08936237274043743, 0.0909085474780733, 0.0925121294995764, 0.09420306129678475, 0.09600695561494185, 0.09794422587577073, 0.10002948200582631, 0.10227123953774246, 0.10467196378170757, 0.10722843783275166, 0.10993241022502902, 0.11277145196701475, 0.11572993810178732, 0.11879006722508356, 0.12193284189353952, 0.12513894990911006, 0.1283895068098093, 0.1316666398143752, 0.13495391042134663, 0.13823658560591603, 0.14150177590299673, 0.1447384631082047, 0.14793744169226905, 0.151091197194649, 0.15419374263364735, 0.1572404309799983, 0.1602277584581239, 0.1631531701854317, 0.16601487663897307, 0.16881168676682376 ], [ 0.05283684687705502, 0.052054150290727255, 0.052287230242066364, 0.05340979300381588, 0.05524351263620359, 0.05759298387189829, 0.060273837603842625, 0.06312860668521493, 0.0660321404292511, 0.06889073103747696, 0.07163842976818525, 0.07423261489791062, 0.07664977593693349, 0.07888185107605444, 0.08093315756073498, 0.0828178373032949, 0.08455770682761128, 0.08618040222884114, 0.08771772436216571, 0.08920410896351946, 0.09067516890636168, 0.09216628118346652, 0.09371121888718041, 0.0953408562901861, 0.09708199920013114, 0.09895640817185707, 0.1009800845111157, 0.10316287618000786, 0.10550843418117531, 0.1080145148952282, 0.11067358767029496, 0.11347367730497439, 0.11639935336608585, 0.11943277451761898, 0.12255470474067554, 0.12574543568261612, 0.12898557075543762, 0.13225664787844912, 0.13554159605481822, 0.1388250348331812, 0.14209343486329043, 0.14533516271001934, 0.14854043471897302, 0.1517012039847481, 0.1548110022195101, 0.1578647552437506, 0.16085858742857473, 0.16378962705396308, 0.16665582142648339, 0.1694557678446865 ], [ 0.05608694743305766, 0.05526392599744419, 0.05539231829596488, 0.05636241530536161, 0.05801760992148815, 0.06018272148019158, 0.06268825403894478, 0.06538553536039299, 0.06815319961963684, 0.07089786702473225, 0.07355182054107112, 0.0760695564748042, 0.07842421190520465, 0.08060430184526533, 0.08261089216780786, 0.0844551915512278, 0.08615648970299469, 0.08774035451992647, 0.08923700499004708, 0.09067978985372234, 0.09210372097947209, 0.09354403405294814, 0.09503477646070195, 0.09660745076506372, 0.09828976779269046, 0.10010458085228102, 0.10206907703284027, 0.10419429016799675, 0.10648497380734621, 0.10893983632269832, 0.11155210179258616, 0.11431032771179549, 0.11719939001977996, 0.12020154001252167, 0.123297445242391, 0.12646714369724854, 0.1296908625108269, 0.13294967472752434, 0.13622598704514438, 0.13950386632109668, 0.14276922256928368, 0.14600987167126908, 0.14921550297821914, 0.15237757639425267, 0.1554891713199579, 0.15854480673110652, 0.16154024821180235, 0.16447231432066967, 0.16733869147330077, 0.1701377637029592 ], [ 0.05943902433004412, 0.058580636256883825, 0.058613459510919286, 0.05944180599073775, 0.060927930500391754, 0.06291498501450989, 0.0652477658173662, 0.06778678517322197, 0.07041531716387434, 0.0730412579541884, 0.07559597102733664, 0.07803175372435166, 0.08031890469671389, 0.08244288105550841, 0.0844017377953078, 0.08620388615161047, 0.08786613486343074, 0.08941195009496944, 0.09086986436617735, 0.09227197182111031, 0.0936524622048945, 0.09504616727441484, 0.09648711954914967, 0.09800715171442988, 0.09963459138544584, 0.1013931248971468, 0.10330091002402363, 0.10537000779258776, 0.10760617820306907, 0.11000904825743045, 0.1125726208522295, 0.11528605831619339, 0.11813465136366212, 0.1211008761474805, 0.12416544817091933, 0.12730829836950616, 0.1305094187286942, 0.13374954766437622, 0.1370106856181875, 0.14027644702697079, 0.14353226549895612, 0.14676547508337426, 0.14996529285243107, 0.15312272765549342, 0.15623043780546744, 0.15928255738803374, 0.16227450741620872, 0.16520280457532444, 0.1680648770619862, 0.17085889415266545 ], [ 0.06288567534298112, 0.061996876687641, 0.06194303398690533, 0.06264033116149301, 0.06396736585247095, 0.06578377968071873, 0.0679478944387857, 0.07032953958555521, 0.07281727319463754, 0.07532108752560861, 0.07777222015637339, 0.08012144511211626, 0.08233675517541016, 0.08440094459597434, 0.08630933073876408, 0.08806769511420881, 0.08969044115533535, 0.09119892738114399, 0.09261992094975859, 0.09398411774797229, 0.09532468623575849, 0.09667581097964441, 0.09807123634284255, 0.09954283841122402, 0.1011192796629207, 0.10282482066200935, 0.10467837071058748, 0.1066928512903845, 0.10887492213284222, 0.11122508393280481, 0.1137381314630713, 0.11640389470337409, 0.1192081806383421, 0.12213381825386437, 0.12516171365903903, 0.12827183775628342, 0.13144409054969264, 0.13465900920322055, 0.13789830769397088, 0.14114525227057165, 0.14438488825279353, 0.14760414032058872, 0.1507918111987857, 0.15393850357890548, 0.15703648820274915, 0.1600795380622061, 0.1630627452428492, 0.165982333466553, 0.168835476131316, 0.17162012675309168 ], [ 0.06642012056070615, 0.06550578168556379, 0.0653738415754698, 0.06595056556286023, 0.06712870265114157, 0.06878264625009528, 0.07078336691899875, 0.07300993697288277, 0.07535664476900321, 0.07773625902353296, 0.08008060752880783, 0.08233958658916837, 0.08447941540524502, 0.08648063620875023, 0.08833612513696293, 0.09004922744784818, 0.09163204313055649, 0.09310384306566645, 0.0944895756729598, 0.09581841998092842, 0.09712234830932827, 0.09843467766728031, 0.09978861146563602, 0.10121579939994678, 0.10274496916860308, 0.10440070365288517, 0.10620244581373568, 0.10816380698931868, 0.11029223194467061, 0.11258903946433788, 0.11504981746198484, 0.11766511489236761, 0.12042134641640262, 0.12330181382982404, 0.12628775086931807, 0.12935931209815282, 0.13249644740329133, 0.1356796263882022, 0.13889039785237806, 0.14211178635476931, 0.14532853973282767, 0.14852724859811314, 0.15169636204619855, 0.15482612410791, 0.15790845380302937, 0.16093678885065896, 0.16390590975973443, 0.166811757599338, 0.1696512555083758, 0.17242214110823528 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.51383 (SEM: 0)
x1: 0.683048
x2: 0.650143
x3: 0.119252
x4: 0.288837
x5: 0.56801
x6: 0.991039", "Arm 1_0
l2norm: 1.35792 (SEM: 0)
x1: 0.356336
x2: 0.978032
x3: 0.00764026
x4: 0.858375
x5: 0.0818928
x6: 0.129771", "Arm 2_0
l2norm: 1.30681 (SEM: 0)
x1: 0.441238
x2: 0.964615
x3: 0.162928
x4: 0.0989579
x5: 0.14974
x6: 0.723757", "Arm 3_0
l2norm: 1.39934 (SEM: 0)
x1: 0.619502
x2: 0.202555
x3: 0.289526
x4: 0.939453
x5: 0.721105
x6: 0.216677", "Arm 4_0
l2norm: 1.26307 (SEM: 0)
x1: 0.443013
x2: 0.879161
x3: 0.288397
x4: 0.497797
x5: 0.117522
x6: 0.530443", "Arm 5_0
l2norm: 1.65624 (SEM: 0)
x1: 0.728372
x2: 0.909787
x3: 0.556529
x4: 0.917842
x5: 0.422513
x6: 0.232883", "Arm 6_0
l2norm: 1.8131 (SEM: 0)
x1: 0.693003
x2: 0.649502
x3: 0.814413
x4: 0.856153
x5: 0.910842
x6: 0.399173", "Arm 7_0
l2norm: 1.61497 (SEM: 0)
x1: 0.942625
x2: 0.84833
x3: 0.677237
x4: 0.47833
x5: 0.558738
x6: 0.0171991", "Arm 8_0
l2norm: 0.586406 (SEM: 0)
x1: 0.235669
x2: 0.341075
x3: 0.00838903
x4: 0.355622
x5: 0.0523779
x6: 0.206685", "Arm 9_0
l2norm: 1.44923 (SEM: 0)
x1: 0.361175
x2: 0.30193
x3: 0.993517
x4: 0.268016
x5: 0.439813
x6: 0.791396", "Arm 10_0
l2norm: 1.08672 (SEM: 0)
x1: 0.0794026
x2: 0.839636
x3: 0.256346
x4: 0.107266
x5: 0.551899
x6: 0.29639", "Arm 11_0
l2norm: 1.42497 (SEM: 0)
x1: 0.125327
x2: 0.0114823
x3: 0.78728
x4: 0.751094
x5: 0.703226
x6: 0.579849", "Arm 12_0
l2norm: 1.12907 (SEM: 0)
x1: 0.291886
x2: 0.802048
x3: 7.1236e-17
x4: 0.720476
x5: 0.0649436
x6: 0.151729", "Arm 13_0
l2norm: 1.10304 (SEM: 0)
x1: 0.246646
x2: 0.761987
x3: 2.18696e-15
x4: 0.750669
x5: 0.013078
x6: 0.107559", "Arm 14_0
l2norm: 1.14053 (SEM: 0)
x1: 0.321154
x2: 0.825067
x3: 0
x4: 0.686749
x5: 0.112809
x6: 0.180487", "Arm 15_0
l2norm: 1.15065 (SEM: 0)
x1: 0.345251
x2: 0.873911
x3: 1.56621e-16
x4: 0.630584
x5: 0.118401
x6: 0.17155", "Arm 16_0
l2norm: 1.15374 (SEM: 0)
x1: 0.352053
x2: 0.914785
x3: 2.34788e-15
x4: 0.587442
x5: 0.0834193
x6: 0.135297", "Arm 17_0
l2norm: 1.16566 (SEM: 0)
x1: 0.364501
x2: 0.958507
x3: 2.49352e-14
x4: 0.542167
x5: 0.0514755
x6: 0.102869", "Arm 18_0
l2norm: 1.16509 (SEM: 0)
x1: 0.282416
x2: 0.98774
x3: 6.45181e-13
x4: 0.533095
x5: 0.0565007
x6: 0.121097", "Arm 19_0
l2norm: 1.13218 (SEM: 0)
x1: 0.395849
x2: 0.899791
x3: 3.14281e-11
x4: 0.554687
x5: 0.0424725
x6: 0.0777052", "Arm 20_0
l2norm: 1.12724 (SEM: 0)
x1: 0.447521
x2: 0.877813
x3: 2.36188e-14
x4: 0.544158
x5: 0.0296832
x6: 0.0534532", "Arm 21_0
l2norm: 1.10288 (SEM: 0)
x1: 0.399964
x2: 0.873553
x3: 0
x4: 0.536346
x5: 0.0711293
x6: 0.0235337", "Arm 22_0
l2norm: 1.08714 (SEM: 0)
x1: 0.396877
x2: 0.862816
x3: 8.46648e-12
x4: 0.527773
x5: 6.85574e-11
x6: 0.036893", "Arm 23_0
l2norm: 1.13817 (SEM: 0)
x1: 0.405402
x2: 0.894451
x3: 8.30012e-11
x4: 0.574774
x5: 0.0215146
x6: 0.0144279" ], "type": "scatter", "x": [ 0.11925201117992401, 0.007640259340405464, 0.1629277653992176, 0.28952589351683855, 0.2883969219401479, 0.5565289268270135, 0.8144130483269691, 0.677236714400351, 0.008389034308493137, 0.9935167049989104, 0.25634563248604536, 0.7872795229777694, 7.123596673981231e-17, 2.1869550976386297e-15, 0.0, 1.5662118856804687e-16, 2.3478785050554286e-15, 2.4935214389599742e-14, 6.451814563506176e-13, 3.14280592989116e-11, 2.3618821356695814e-14, 0.0, 8.4664801329966e-12, 8.300116154509034e-11 ], "xaxis": "x", "y": [ 0.2888374924659729, 0.8583754831925035, 0.09895786456763744, 0.9394533848389983, 0.4977974025532603, 0.9178418694064021, 0.856152692809701, 0.4783300841227174, 0.3556224452331662, 0.2680155858397484, 0.10726562794297934, 0.7510942639783025, 0.7204761433854828, 0.750669268727578, 0.6867494073517509, 0.6305838927601458, 0.5874423038212652, 0.5421674038768881, 0.5330948565566964, 0.554687009244554, 0.5441575153277599, 0.5363457267952791, 0.527772767231341, 0.5747742218616367 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.51383 (SEM: 0)
x1: 0.683048
x2: 0.650143
x3: 0.119252
x4: 0.288837
x5: 0.56801
x6: 0.991039", "Arm 1_0
l2norm: 1.35792 (SEM: 0)
x1: 0.356336
x2: 0.978032
x3: 0.00764026
x4: 0.858375
x5: 0.0818928
x6: 0.129771", "Arm 2_0
l2norm: 1.30681 (SEM: 0)
x1: 0.441238
x2: 0.964615
x3: 0.162928
x4: 0.0989579
x5: 0.14974
x6: 0.723757", "Arm 3_0
l2norm: 1.39934 (SEM: 0)
x1: 0.619502
x2: 0.202555
x3: 0.289526
x4: 0.939453
x5: 0.721105
x6: 0.216677", "Arm 4_0
l2norm: 1.26307 (SEM: 0)
x1: 0.443013
x2: 0.879161
x3: 0.288397
x4: 0.497797
x5: 0.117522
x6: 0.530443", "Arm 5_0
l2norm: 1.65624 (SEM: 0)
x1: 0.728372
x2: 0.909787
x3: 0.556529
x4: 0.917842
x5: 0.422513
x6: 0.232883", "Arm 6_0
l2norm: 1.8131 (SEM: 0)
x1: 0.693003
x2: 0.649502
x3: 0.814413
x4: 0.856153
x5: 0.910842
x6: 0.399173", "Arm 7_0
l2norm: 1.61497 (SEM: 0)
x1: 0.942625
x2: 0.84833
x3: 0.677237
x4: 0.47833
x5: 0.558738
x6: 0.0171991", "Arm 8_0
l2norm: 0.586406 (SEM: 0)
x1: 0.235669
x2: 0.341075
x3: 0.00838903
x4: 0.355622
x5: 0.0523779
x6: 0.206685", "Arm 9_0
l2norm: 1.44923 (SEM: 0)
x1: 0.361175
x2: 0.30193
x3: 0.993517
x4: 0.268016
x5: 0.439813
x6: 0.791396", "Arm 10_0
l2norm: 1.08672 (SEM: 0)
x1: 0.0794026
x2: 0.839636
x3: 0.256346
x4: 0.107266
x5: 0.551899
x6: 0.29639", "Arm 11_0
l2norm: 1.42497 (SEM: 0)
x1: 0.125327
x2: 0.0114823
x3: 0.78728
x4: 0.751094
x5: 0.703226
x6: 0.579849", "Arm 12_0
l2norm: 1.12907 (SEM: 0)
x1: 0.291886
x2: 0.802048
x3: 7.1236e-17
x4: 0.720476
x5: 0.0649436
x6: 0.151729", "Arm 13_0
l2norm: 1.10304 (SEM: 0)
x1: 0.246646
x2: 0.761987
x3: 2.18696e-15
x4: 0.750669
x5: 0.013078
x6: 0.107559", "Arm 14_0
l2norm: 1.14053 (SEM: 0)
x1: 0.321154
x2: 0.825067
x3: 0
x4: 0.686749
x5: 0.112809
x6: 0.180487", "Arm 15_0
l2norm: 1.15065 (SEM: 0)
x1: 0.345251
x2: 0.873911
x3: 1.56621e-16
x4: 0.630584
x5: 0.118401
x6: 0.17155", "Arm 16_0
l2norm: 1.15374 (SEM: 0)
x1: 0.352053
x2: 0.914785
x3: 2.34788e-15
x4: 0.587442
x5: 0.0834193
x6: 0.135297", "Arm 17_0
l2norm: 1.16566 (SEM: 0)
x1: 0.364501
x2: 0.958507
x3: 2.49352e-14
x4: 0.542167
x5: 0.0514755
x6: 0.102869", "Arm 18_0
l2norm: 1.16509 (SEM: 0)
x1: 0.282416
x2: 0.98774
x3: 6.45181e-13
x4: 0.533095
x5: 0.0565007
x6: 0.121097", "Arm 19_0
l2norm: 1.13218 (SEM: 0)
x1: 0.395849
x2: 0.899791
x3: 3.14281e-11
x4: 0.554687
x5: 0.0424725
x6: 0.0777052", "Arm 20_0
l2norm: 1.12724 (SEM: 0)
x1: 0.447521
x2: 0.877813
x3: 2.36188e-14
x4: 0.544158
x5: 0.0296832
x6: 0.0534532", "Arm 21_0
l2norm: 1.10288 (SEM: 0)
x1: 0.399964
x2: 0.873553
x3: 0
x4: 0.536346
x5: 0.0711293
x6: 0.0235337", "Arm 22_0
l2norm: 1.08714 (SEM: 0)
x1: 0.396877
x2: 0.862816
x3: 8.46648e-12
x4: 0.527773
x5: 6.85574e-11
x6: 0.036893", "Arm 23_0
l2norm: 1.13817 (SEM: 0)
x1: 0.405402
x2: 0.894451
x3: 8.30012e-11
x4: 0.574774
x5: 0.0215146
x6: 0.0144279" ], "type": "scatter", "x": [ 0.11925201117992401, 0.007640259340405464, 0.1629277653992176, 0.28952589351683855, 0.2883969219401479, 0.5565289268270135, 0.8144130483269691, 0.677236714400351, 0.008389034308493137, 0.9935167049989104, 0.25634563248604536, 0.7872795229777694, 7.123596673981231e-17, 2.1869550976386297e-15, 0.0, 1.5662118856804687e-16, 2.3478785050554286e-15, 2.4935214389599742e-14, 6.451814563506176e-13, 3.14280592989116e-11, 2.3618821356695814e-14, 0.0, 8.4664801329966e-12, 8.300116154509034e-11 ], "xaxis": "x2", "y": [ 0.2888374924659729, 0.8583754831925035, 0.09895786456763744, 0.9394533848389983, 0.4977974025532603, 0.9178418694064021, 0.856152692809701, 0.4783300841227174, 0.3556224452331662, 0.2680155858397484, 0.10726562794297934, 0.7510942639783025, 0.7204761433854828, 0.750669268727578, 0.6867494073517509, 0.6305838927601458, 0.5874423038212652, 0.5421674038768881, 0.5330948565566964, 0.554687009244554, 0.5441575153277599, 0.5363457267952791, 0.527772767231341, 0.5747742218616367 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "l2norm" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "id": "d7d4cc80", "metadata": { "papermill": { "duration": 0.066771, "end_time": "2024-05-02T22:15:27.285833", "exception": false, "start_time": "2024-05-02T22:15:27.219062", "status": "completed" }, "tags": [] }, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "id": "25bfcc90", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:27.419964Z", "iopub.status.busy": "2024-05-02T22:15:27.419422Z", "iopub.status.idle": "2024-05-02T22:15:27.479427Z", "shell.execute_reply": "2024-05-02T22:15:27.478766Z" }, "papermill": { "duration": 0.128749, "end_time": "2024-05-02T22:15:27.480905", "exception": false, "start_time": "2024-05-02T22:15:27.352156", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, null, null, null, null, null, null, null, -0.20523106531356283, -0.20523106531356283, -0.20523106531356283, -0.20523106531356283, -1.5908059641304817, -1.5908059641304817, -1.7751283754201903, -2.197644949431944, -2.5544535525359584, -2.673859739678621, -2.673859739678621, -2.992557320215285, -2.992557320215285, -3.026364766357434, -3.026364766357434, -3.051730960435295, -3.0739833723062806 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.683047890663147
x2: 0.6501427292823792
x3: 0.11925201117992401
x4: 0.2888374924659729
x5: 0.5680100321769714
x6: 0.9910388588905334", "
Parameterization:
x1: 0.3563357926905155
x2: 0.9780319770798087
x3: 0.007640259340405464
x4: 0.8583754831925035
x5: 0.08189281448721886
x6: 0.12977131735533476", "
Parameterization:
x1: 0.44123843405395746
x2: 0.964614593423903
x3: 0.1629277653992176
x4: 0.09895786456763744
x5: 0.14974014461040497
x6: 0.7237574532628059", "
Parameterization:
x1: 0.6195022044703364
x2: 0.20255481638014317
x3: 0.28952589351683855
x4: 0.9394533848389983
x5: 0.7211052514612675
x6: 0.2166774719953537", "
Parameterization:
x1: 0.4430128764361143
x2: 0.8791612721979618
x3: 0.2883969219401479
x4: 0.4977974025532603
x5: 0.11752180568873882
x6: 0.5304426336660981", "
Parameterization:
x1: 0.7283716881647706
x2: 0.909786757081747
x3: 0.5565289268270135
x4: 0.9178418694064021
x5: 0.42251278925687075
x6: 0.23288250621408224", "
Parameterization:
x1: 0.6930027222260833
x2: 0.6495023537427187
x3: 0.8144130483269691
x4: 0.856152692809701
x5: 0.9108415311202407
x6: 0.3991732206195593", "
Parameterization:
x1: 0.9426247421652079
x2: 0.848329939879477
x3: 0.677236714400351
x4: 0.4783300841227174
x5: 0.558738105930388
x6: 0.017199051566421986", "
Parameterization:
x1: 0.23566909786313772
x2: 0.3410754641517997
x3: 0.008389034308493137
x4: 0.3556224452331662
x5: 0.05237793084233999
x6: 0.2066850308328867", "
Parameterization:
x1: 0.36117489263415337
x2: 0.30192967411130667
x3: 0.9935167049989104
x4: 0.2680155858397484
x5: 0.4398134285584092
x6: 0.7913956139236689", "
Parameterization:
x1: 0.07940262276679277
x2: 0.8396363509818912
x3: 0.25634563248604536
x4: 0.10726562794297934
x5: 0.5518986321985722
x6: 0.29639024194329977", "
Parameterization:
x1: 0.12532732635736465
x2: 0.011482344940304756
x3: 0.7872795229777694
x4: 0.7510942639783025
x5: 0.7032264461740851
x6: 0.5798493726179004", "
Parameterization:
x1: 0.2918858754281117
x2: 0.8020475529581593
x3: 7.123596673981231e-17
x4: 0.7204761433854828
x5: 0.06494359961555977
x6: 0.15172910151036076", "
Parameterization:
x1: 0.24664562790136724
x2: 0.7619869222759237
x3: 2.1869550976386297e-15
x4: 0.750669268727578
x5: 0.01307801308926167
x6: 0.10755945584388678", "
Parameterization:
x1: 0.3211538053896731
x2: 0.8250669691445406
x3: 0.0
x4: 0.6867494073517509
x5: 0.11280903677167249
x6: 0.18048695073824544", "
Parameterization:
x1: 0.3452510063185415
x2: 0.8739114444113665
x3: 1.5662118856804687e-16
x4: 0.6305838927601458
x5: 0.11840122759942318
x6: 0.17154995409818544", "
Parameterization:
x1: 0.3520527990780777
x2: 0.9147847678173355
x3: 2.3478785050554286e-15
x4: 0.5874423038212652
x5: 0.08341927229213991
x6: 0.13529702037128394", "
Parameterization:
x1: 0.3645013604473095
x2: 0.9585065762264698
x3: 2.4935214389599742e-14
x4: 0.5421674038768881
x5: 0.05147546467101192
x6: 0.10286852112821047", "
Parameterization:
x1: 0.28241633395889637
x2: 0.987739840448971
x3: 6.451814563506176e-13
x4: 0.5330948565566964
x5: 0.05650074244612024
x6: 0.12109706231227681", "
Parameterization:
x1: 0.39584867123770423
x2: 0.8997906984526503
x3: 3.14280592989116e-11
x4: 0.554687009244554
x5: 0.042472531698897205
x6: 0.07770519833400591", "
Parameterization:
x1: 0.44752063878526455
x2: 0.8778132257058378
x3: 2.3618821356695814e-14
x4: 0.5441575153277599
x5: 0.029683181508233743
x6: 0.05345324448726907", "
Parameterization:
x1: 0.3999636756068057
x2: 0.873553303418696
x3: 0.0
x4: 0.5363457267952791
x5: 0.07112925348856868
x6: 0.02353366020622767", "
Parameterization:
x1: 0.39687664002075385
x2: 0.8628164856862732
x3: 8.4664801329966e-12
x4: 0.527772767231341
x5: 6.855735289994853e-11
x6: 0.03689304509394686", "
Parameterization:
x1: 0.40540241577826924
x2: 0.8944508109996436
x3: 8.300116154509034e-11
x4: 0.5747742218616367
x5: 0.02151462501435716
x6: 0.014427914932599123", "
Parameterization:
x1: 0.40584802343161164
x2: 0.8884679320386826
x3: 0.04810614742342431
x4: 0.5595286786399037
x5: 0.032061937072302774
x6: 0.021988965574096745" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, null, null, null, null, null, null, null, -0.20523106531356283, -0.20523106531356283, -0.20523106531356283, -0.20523106531356283, -1.5908059641304817, -1.5908059641304817, -1.7751283754201903, -2.197644949431944, -2.5544535525359584, -2.673859739678621, -2.673859739678621, -2.992557320215285, -2.992557320215285, -3.026364766357434, -3.026364766357434, -3.051730960435295, -3.0739833723062806 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, null, null, null, null, null, null, null, -0.20523106531356283, -0.20523106531356283, -0.20523106531356283, -0.20523106531356283, -1.5908059641304817, -1.5908059641304817, -1.7751283754201903, -2.197644949431944, -2.5544535525359584, -2.673859739678621, -2.673859739678621, -2.992557320215285, -2.992557320215285, -3.026364766357434, -3.026364766357434, -3.051730960435295, -3.0739833723062806 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Best objective found vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(\n", " ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)\n", ") # Objective_optimum is optional." ] }, { "cell_type": "markdown", "id": "bc63ceff", "metadata": { "papermill": { "duration": 0.069171, "end_time": "2024-05-02T22:15:27.620352", "exception": false, "start_time": "2024-05-02T22:15:27.551181", "status": "completed" }, "tags": [] }, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "id": "d9945b9b", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:27.761553Z", "iopub.status.busy": "2024-05-02T22:15:27.761282Z", "iopub.status.idle": "2024-05-02T22:15:27.791437Z", "shell.execute_reply": "2024-05-02T22:15:27.790875Z" }, "papermill": { "duration": 0.102433, "end_time": "2024-05-02T22:15:27.792861", "exception": false, "start_time": "2024-05-02T22:15:27.690428", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:27] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "id": "10548d2d", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:27.937081Z", "iopub.status.busy": "2024-05-02T22:15:27.936552Z", "iopub.status.idle": "2024-05-02T22:15:28.053612Z", "shell.execute_reply": "2024-05-02T22:15:28.052964Z" }, "papermill": { "duration": 0.190916, "end_time": "2024-05-02T22:15:28.055127", "exception": false, "start_time": "2024-05-02T22:15:27.864211", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:28] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = (\n", " AxClient.load_from_json_file()\n", ") # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "id": "8c6bba20", "metadata": { "papermill": { "duration": 0.071083, "end_time": "2024-05-02T22:15:28.198145", "exception": false, "start_time": "2024-05-02T22:15:28.127062", "status": "completed" }, "tags": [] }, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "id": "d913be98", "metadata": { "papermill": { "duration": 0.071384, "end_time": "2024-05-02T22:15:28.341264", "exception": false, "start_time": "2024-05-02T22:15:28.269880", "status": "completed" }, "tags": [] }, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "id": "db5c7564", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:28.486187Z", "iopub.status.busy": "2024-05-02T22:15:28.485899Z", "iopub.status.idle": "2024-05-02T22:15:28.496343Z", "shell.execute_reply": "2024-05-02T22:15:28.495697Z" }, "papermill": { "duration": 0.084716, "end_time": "2024-05-02T22:15:28.497757", "exception": false, "start_time": "2024-05-02T22:15:28.413041", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:28] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "id": "ae04bb0f", "metadata": { "papermill": { "duration": 0.071004, "end_time": "2024-05-02T22:15:28.640376", "exception": false, "start_time": "2024-05-02T22:15:28.569372", "status": "completed" }, "tags": [] }, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "id": "84bc697f", "metadata": { "papermill": { "duration": 0.071369, "end_time": "2024-05-02T22:15:28.783040", "exception": false, "start_time": "2024-05-02T22:15:28.711671", "status": "completed" }, "tags": [] }, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "id": "8b6256ef", "metadata": { "papermill": { "duration": 0.071994, "end_time": "2024-05-02T22:15:28.926741", "exception": false, "start_time": "2024-05-02T22:15:28.854747", "status": "completed" }, "tags": [] }, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "id": "ce87b8d5", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:29.072444Z", "iopub.status.busy": "2024-05-02T22:15:29.072148Z", "iopub.status.idle": "2024-05-02T22:15:38.725561Z", "shell.execute_reply": "2024-05-02T22:15:38.724850Z" }, "papermill": { "duration": 9.728575, "end_time": "2024-05-02T22:15:38.727251", "exception": false, "start_time": "2024-05-02T22:15:28.998676", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:38] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.405855, 'x2': 0.860032, 'x3': 0.036723, 'x4': 0.57853, 'x5': 0.039543, 'x6': 0.030323} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:38] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "id": "aaf3246b", "metadata": { "papermill": { "duration": 0.070299, "end_time": "2024-05-02T22:15:38.907596", "exception": false, "start_time": "2024-05-02T22:15:38.837297", "status": "completed" }, "tags": [] }, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "id": "33242519", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:39.051983Z", "iopub.status.busy": "2024-05-02T22:15:39.051498Z", "iopub.status.idle": "2024-05-02T22:15:39.057374Z", "shell.execute_reply": "2024-05-02T22:15:39.056863Z" }, "papermill": { "duration": 0.078855, "end_time": "2024-05-02T22:15:39.058595", "exception": false, "start_time": "2024-05-02T22:15:38.979740", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.core.experiment: Attached custom parameterizations [{'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}] as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(\n", " parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9}\n", ")" ] }, { "cell_type": "markdown", "id": "346b3588", "metadata": { "papermill": { "duration": 0.071956, "end_time": "2024-05-02T22:15:39.201135", "exception": false, "start_time": "2024-05-02T22:15:39.129179", "status": "completed" }, "tags": [] }, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "id": "5a3ce31a", "metadata": { "papermill": { "duration": 0.07045, "end_time": "2024-05-02T22:15:39.342978", "exception": false, "start_time": "2024-05-02T22:15:39.272528", "status": "completed" }, "tags": [] }, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "id": "64c91538", "metadata": { "papermill": { "duration": 0.070805, "end_time": "2024-05-02T22:15:39.484487", "exception": false, "start_time": "2024-05-02T22:15:39.413682", "status": "completed" }, "tags": [] }, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "id": "b7c1f8e5", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:39.628497Z", "iopub.status.busy": "2024-05-02T22:15:39.628025Z", "iopub.status.idle": "2024-05-02T22:15:39.638117Z", "shell.execute_reply": "2024-05-02T22:15:39.637498Z" }, "papermill": { "duration": 0.084453, "end_time": "2024-05-02T22:15:39.640557", "exception": false, "start_time": "2024-05-02T22:15:39.556104", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 05-02 22:15:39] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 5 trials, BoTorch for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "id": "0468b013", "metadata": { "execution": { "iopub.execute_input": "2024-05-02T22:15:39.784562Z", "iopub.status.busy": "2024-05-02T22:15:39.784069Z", "iopub.status.idle": "2024-05-02T22:15:39.788635Z", "shell.execute_reply": "2024-05-02T22:15:39.787989Z" }, "papermill": { "duration": 0.077371, "end_time": "2024-05-02T22:15:39.789957", "exception": false, "start_time": "2024-05-02T22:15:39.712586", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.10.14" }, "papermill": { "default_parameters": {}, "duration": 131.061068, "end_time": "2024-05-02T22:15:42.046199", "environment_variables": {}, "exception": null, "input_path": "/tmp/tmp.J4Ip05By14/Ax-main/tutorials/gpei_hartmann_service.ipynb", "output_path": "/tmp/tmp.J4Ip05By14/Ax-main/tutorials/gpei_hartmann_service.ipynb", "parameters": {}, "start_time": "2024-05-02T22:13:30.985131", "version": "2.6.0" } }, "nbformat": 4, "nbformat_minor": 5 }