A/B test significance from visitors and conversions - lift, z-score, p-value, confidenc…
A/B test significance from visitors and conversions - lift, z-score, p-value, confidence interval, winner and the sample size needed per variant
by Saylor Innovations Knowledge Base · verified provider · updated 2026-10-26
What it does
A/B test significance from visitors and conversions - lift, z-score, p-value, confidence interval, winner and the sample size needed per variant
Tags: ab test significance calculator · is variant b better than a · conversion rate lift p value · sample size for an ab test · confidence interval
Use with an agent
- Discover. Agents find this listing with
GET https://bazaar.saylorinnovations.com/discovery/search?query=…, the MCP toolsearch_resources, or/discovery/resources. - Inspect. Fetch
/resources/saylorinnovations-api-math-ab-test.jsonfor the price and payment options. - Pay. Call
GET https://saylorinnovations.com/api/math/ab-test. The provider answers402with its payment requirements. An x402 client signs one of the options below and retries withPAYMENT-SIGNATURE. - Execute. The provider returns
200with the data. Agent Bazaar is not in the request path and never sees your payment.
For humans
You don't need an account or an API key; you need a wallet holding a small amount of USDC or USDT or SOL on Base, Polygon, Arbitrum One, Solana, and an x402-capable client (see the examples below). Call the endpoint unpaid first to see exactly what it asks for.
Pricing & payment
- Price
- $0.01 / request
- Protocol
- x402 v2
- Auth
- No account or API key. Pay per request.
- Networks
- Base, Polygon, Arbitrum One, Solana
x402 payment requirements
| Scheme | Network | Asset | Amount | Pay to | Timeout |
|---|---|---|---|---|---|
| exact | Base eip155:8453 | USDC | $0.01 | 0xA2A8dF0f7CaaBEa4e120a2568118f141569fc8aa | 120s |
| exact | Polygon eip155:137 | USDC | $0.01 | 0xA2A8dF0f7CaaBEa4e120a2568118f141569fc8aa | 120s |
| exact | Arbitrum One eip155:42161 | USDC | $0.01 | 0xA2A8dF0f7CaaBEa4e120a2568118f141569fc8aa | 120s |
| exact | Solana solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp | USDC | $0.01 | 7LSjfrJf8fNsB8VA9u7N3WEn25smQLpob3SvyUvXacy7 | 120s |
| exact | Solana solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp | USDT | $0.01 | 7LSjfrJf8fNsB8VA9u7N3WEn25smQLpob3SvyUvXacy7 | 120s |
| exact | Solana solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp | SOL | $0.01 | 7LSjfrJf8fNsB8VA9u7N3WEn25smQLpob3SvyUvXacy7 | 120s |
accepts[] (raw JSON)
[
{
"scheme": "exact",
"network": "eip155:8453",
"payTo": "0xA2A8dF0f7CaaBEa4e120a2568118f141569fc8aa",
"asset": "0x833589fCD6eDb6E08f4c7C32D4f71b54bdA02913",
"amount": "10000",
"amountUsd": 0.01,
"maxTimeoutSeconds": 120
},
{
"scheme": "exact",
"network": "eip155:137",
"payTo": "0xA2A8dF0f7CaaBEa4e120a2568118f141569fc8aa",
"asset": "0x3c499c542cEF5E3811e1192ce70d8cC03d5c3359",
"amount": "10000",
"amountUsd": 0.01,
"maxTimeoutSeconds": 120
},
{
"scheme": "exact",
"network": "eip155:42161",
"payTo": "0xA2A8dF0f7CaaBEa4e120a2568118f141569fc8aa",
"asset": "0xaf88d065e77c8cC2239327C5EDb3A432268e5831",
"amount": "10000",
"amountUsd": 0.01,
"maxTimeoutSeconds": 120
},
{
"scheme": "exact",
"network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
"payTo": "7LSjfrJf8fNsB8VA9u7N3WEn25smQLpob3SvyUvXacy7",
"asset": "EPjFWdd5AufqSSqeM2qN1xzybapC8G4wEGGkZwyTDt1v",
"amount": "10000",
"amountUsd": 0.01,
"maxTimeoutSeconds": 120
},
{
"scheme": "exact",
"network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
"payTo": "7LSjfrJf8fNsB8VA9u7N3WEn25smQLpob3SvyUvXacy7",
"asset": "Es9vMFrzaCERmJfrF4H2FYD4KCoNkY11McCe8BenwNYB",
"amount": "10000",
"amountUsd": 0.01,
"maxTimeoutSeconds": 120
},
{
"scheme": "exact",
"network": "solana:5eykt4UsFv8P8NJdTREpY1vzqKqZKvdp",
"payTo": "7LSjfrJf8fNsB8VA9u7N3WEn25smQLpob3SvyUvXacy7",
"asset": "So11111111111111111111111111111111111111112",
"amount": "95830",
"amountUsd": 0.01,
"maxTimeoutSeconds": 120
}
]Schemas
Output schema (JSON Schema)
{
"type": "object",
"properties": {
"variant_a": {
"type": "object",
"properties": {
"visitors": {
"description": "Visitors in variant A",
"type": [
"number",
"null"
]
},
"conversions": {
"description": "Conversions in variant A",
"type": [
"number",
"null"
]
},
"conversion_rate_percent": {
"type": [
"number",
"null"
],
"description": "Conversion rate, as a percentage"
}
},
"description": "Variant a"
},
"variant_b": {
"type": "object",
"properties": {
"visitors": {
"description": "Visitors in variant B",
"type": [
"number",
"null"
]
},
"conversions": {
"description": "Conversions in variant B",
"type": [
"number",
"null"
]
},
"conversion_rate_percent": {
"type": [
"number",
"null"
],
"description": "Conversion rate, as a percentage"
}
},
"description": "Variant b"
},
"relative_lift_percent": {
"type": [
"number",
"null"
],
"description": "Relative lift, as a percentage"
},
"z_score": {
"type": "number",
"description": "Z score"
},
"p_value": {
"type": "number",
"description": "P value"
},
"significant": {
"type": "boolean",
"description": "True when the p-value is below alpha"
},
"winner": {
"type": "string",
"description": "Better variant when significant, otherwise null"
},
"confidence_interval_difference": {
"type": "object",
"description": "Confidence interval difference"
},
"sample_size_per_variant_to_detect_observed_effect": {
"type": [
"number",
"null"
],
"description": "Sample size per variant to detect observed effect"
},
"advice": {
"type": "string",
"description": "The advice text"
},
"note": {
"type": "string",
"description": "Caveat or context for reading the result"
},
"source": {
"type": "string",
"description": "Data source the values come from"
},
"alpha": {
"description": "Significance threshold used",
"type": [
"number",
"null"
]
},
"underpowered": {
"description": "True when the sample is too small to detect the observed lift reliably",
"type": [
"boolean",
"null"
]
},
"absolute_difference_points": {
"type": [
"number",
"null"
],
"description": "Absolute difference points"
},
"probability_b_beats_a_approx": {
"type": [
"number",
"null"
],
"description": "Probability b beats a approx"
},
"current_sample_per_variant": {
"type": [
"number",
"null"
],
"description": "Current sample per variant"
}
},
"required": [
"variant_a",
"variant_b",
"p_value",
"significant"
]
}Example shape — generated from the schema, not a captured live response
{
"variant_a": {
"visitors": 0,
"conversions": 0,
"conversion_rate_percent": 0
},
"variant_b": {
"visitors": 0,
"conversions": 0,
"conversion_rate_percent": 0
},
"relative_lift_percent": 0,
"z_score": 0,
"p_value": 0,
"significant": true,
"winner": "string",
"confidence_interval_difference": {},
"sample_size_per_variant_to_detect_observed_effect": 0,
"advice": "string",
"note": "string",
"source": "string",
"alpha": 0,
"underpowered": true,
"absolute_difference_points": 0,
"probability_b_beats_a_approx": 0,
"current_sample_per_variant": 0
}Examples
curl "https://saylorinnovations.com/api/math/ab-test"
# -> 402 Payment Required, accepts[] lists how to pay
# retry with a PAYMENT-SIGNATURE (or PAYMENT header) once paidconst res = await fetch("https://saylorinnovations.com/api/math/ab-test");
if (res.status === 402) {
const { accepts } = await res.json();
// pay one of accepts[] via an x402 client, then retry with the payment header
}import httpx
res = httpx.get("https://saylorinnovations.com/api/math/ab-test")
if res.status_code == 402:
accepts = res.json()["accepts"]
# pay one of accepts[] via an x402 client, then retry with the payment headerDetails
- Provider
- Saylor Innovations Knowledge Base
- Endpoint
- https://saylorinnovations.com/api/math/ab-test
- Side effects
- Paid calls settle the advertised payment; see the provider contract for execution behavior.
- Machine-readable
/resources/saylorinnovations-api-math-ab-test.json