Performance & cost
This session
- Delivery time · median
- —
- Live model compute
- —
- Live input tokens
- 0
- Est. cost · USD
- $0.00
Bypass examples to measure live inference. Uses your quota.
Measurement details · 0 successful requests
- Successful requests
- 0
Run an example for free to see its measurements.
Model compute is the average per measured request. Delivery time is the median browser time for successful requests, including queue, network, and retries. Cached delivery speed is not inference speed. Model compute can exceed browser time when one request processes many inputs.
Tokens come from response headers. Inference costs use $0.04 per million input tokens, before plan credits. The estimate includes live and recorded tokens at the same rate; cached examples are not charged again. Missing usage is unavailable or a partial total (≥). Demo resets keep these totals; reload to start a new session.
Pick a question and hit Rerank.
Build with the SDKTypeScript · Python · dm1
One request from this demo. Copy it into your app.
Uses your MS_API_KEY and quota. Keep the key on your server.
npm install @cloudraker/milliseconds
export MS_API_KEY="your-api-key"import { DecisionMachine } from "@cloudraker/milliseconds";
// Run on your server; reads MS_API_KEY from the environment.
const dm = new DecisionMachine();
const { result, usage } = await dm.yesNo(
[
"Engineers receive an on-call stipend of $500 per primary week and $250 per secondary week, paid with the following month's salary. If you are paged and work outside business hours for more than two hours in a night, you take the following morning off; if you handle a SEV1 overnight, you take the whole next day off. This time off is not deducted from vacation.",
"The default quota for Ledger API is 600 requests per minute with a burst allowance of 100. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Media Transcoder is 300 requests per minute with a burst allowance of 50. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Notify Hub is 1200 requests per minute with a burst allowance of 300. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Order Service is 900 requests per minute with a burst allowance of 200. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Search Index is 2000 requests per minute with a burst allowance of 500. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Webhook Relay is 10000 requests per minute with a burst allowance of 2000. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"**TranscoderStorageCost** fires when output bucket size grew more than 20% in a week. Likely cause: a customer generating many renditions or the lifecycle rule for deleted jobs not running. Remediation: check that the S3 lifecycle rule deleting outputs of canceled jobs is active and look at the top uploaders by bytes.",
"Each service has a primary and secondary on-call rotation of one week each, handing off on Tuesdays at 10:00 local time. Rotations are managed in PagerDuty; swap shifts by creating an override rather than editing the schedule. A rotation must have at least four people; teams smaller than that share a rotation with a neighboring team.",
"`POST /v1/flags/{key}/kill` — Immediately serves the flag's off variation to everyone in an environment, bypassing all rules. Parameters: `environment` (string) — which environment.",
"The notice period for resignation is four weeks for individual contributors up to E4 and eight weeks for E5 and above and for managers, unless your local contract specifies otherwise. Notice is given in writing to your manager and people-ops. The company may agree to a shorter period or place you on garden leave at full pay.",
"A test that fails and then passes on retry without a code change is flaky. Flaky tests are quarantined by adding the `@flaky` tag, which moves them to a non-blocking job, and a ticket is opened against the owning team with a two-week deadline. A quarantined test that is not fixed within two weeks is deleted, not left in quarantine forever.",
"Request vacation in Workday at least two weeks ahead for absences of a week or longer, and at least two working days ahead for shorter absences. Managers approve within three working days and may only decline for a documented coverage reason, in which case they must propose alternative dates. Post your absence in the team calendar once approved.",
"Local development for Auth Gateway uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up Redis in Docker; they take about 6 minutes.",
"Local development for Billing Engine uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 6 minutes.",
"Local development for Media Transcoder uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 4 minutes.",
"Local development for Search Index uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up OpenSearch in Docker; they take about 6 minutes.",
"Local development for Webhook Relay uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 4 minutes.",
"Local development for Audit Log uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up append-only in Docker; they take about 9 minutes.",
"Adding an index on a table over 1 million rows must use `CREATE INDEX CONCURRENTLY`; adding a NOT NULL column with a default must be split into add-nullable, backfill in batches of 10,000, then set NOT NULL. The migration linter rejects statements that take an ACCESS EXCLUSIVE lock on large tables.",
"The company observes the public holidays of the country where you are employed, plus two company-wide days off: the Friday after the annual kickoff in February and the last working day before the end-of-year freeze. If a public holiday falls on a weekend, the following Monday is taken instead.",
"Tier 1 databases take continuous WAL backups with point-in-time recovery to any second in the last 35 days, plus a daily snapshot retained for 1 year. Restore drills run quarterly; the last drill restored the ledger database in 41 minutes. To request a restore, page the data platform on-call — do not attempt it yourself.",
"Wrap any user-visible behavior change in a feature flag so that shipping code and enabling behavior are separate decisions. Flags are created in the Flagship console and default to off in every environment. Roll out by percentage of users, by organization ID, or by internal-staff-only, in that order of caution.",
"A deploy freeze is in effect from the last business day before a public holiday until the first business day after, and during the annual end-of-year freeze from December 20 to January 3. During a freeze, only fixes for SEV1 and SEV2 incidents may be deployed, and they require sign-off from the incident commander in the incident channel.",
"Recent changes to Billing Engine: 2026.08.2 — subscription changes can take effect at period end with proration; 2026.06.1 — invoice PDFs via `format=pdf` with signed URLs; 2026.02.3 — usage events accepted up to 72 hours late instead of 24. Breaking changes are announced 12 months ahead through the deprecation policy.",
"**InventoryRedisMiss** fires when hot SKU cache hit rate below 90%. Likely cause: Redis was flushed or a large catalog import created many new SKUs. Remediation: warm the cache with `invctl cache warm --top 10000`; the service reads through to PostgreSQL on a miss so this is a latency problem, not a correctness problem.",
"People-ops invites everyone who leaves voluntarily to an exit interview in their final week. It is optional and confidential; themes are shared with leadership quarterly in aggregate without attribution. Alumni are welcome to reapply and are eligible for the referral program for former colleagues.",
"Tell your manager and people-ops at least 8 weeks before you expect to start parental leave so that coverage can be arranged, though we understand arrivals are unpredictable. People-ops will send a leave plan template; the plan is for your team's benefit and can be changed at any time.",
"At handoff, the outgoing primary posts a summary in the team channel covering open alerts, anything silenced, and risky changes scheduled for the coming week. The incoming primary confirms they have the PagerDuty app installed with critical alerts enabled and that their phone will bypass do-not-disturb for it.",
"Promotions are decided in the March and September calibration sessions. To be considered, your manager submits a promotion packet showing you have operated at the next level for at least two quarters, with evidence linked to the level guide. You will hear the outcome, including the reasoning if declined, within a week of calibration.",
"Aim for many fast unit tests, a moderate number of integration tests that exercise real databases and queues in containers, and a small set of end-to-end tests against staging. End-to-end tests are owned by the platform QA guild and must complete within 20 minutes total, so new ones must replace or merge with an existing one.",
"Operational feature flags for Webhook Relay, managed in Flagship and tagged `ops`: `delivery.timeout_seconds` (default 10) — how long to wait for a customer endpoint to respond; `endpoint.auto_disable_hours` (default 24) — disable an endpoint after this many hours of continuous failure. Flipping an ops flag takes effect within 10 seconds and is logged to the audit log."
],
"This passage answers the question: having a baby soon, how many weeks can I take off",
{
"when_true": "The passage states the specific information the question asks for.",
"when_false": "The passage is about something else, or only shares words with the question."
}
).withUsage();
console.log(result);
console.log({ inputTokens: usage.inputTokens, modelMs: usage.inferenceMs });pip install cloudraker-milliseconds
export MS_API_KEY="your-api-key"from milliseconds import DecisionMachine
# Reads MS_API_KEY from the environment.
dm = DecisionMachine()
result = dm.yes_no(
[
"Engineers receive an on-call stipend of $500 per primary week and $250 per secondary week, paid with the following month's salary. If you are paged and work outside business hours for more than two hours in a night, you take the following morning off; if you handle a SEV1 overnight, you take the whole next day off. This time off is not deducted from vacation.",
"The default quota for Ledger API is 600 requests per minute with a burst allowance of 100. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Media Transcoder is 300 requests per minute with a burst allowance of 50. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Notify Hub is 1200 requests per minute with a burst allowance of 300. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Order Service is 900 requests per minute with a burst allowance of 200. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Search Index is 2000 requests per minute with a burst allowance of 500. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Webhook Relay is 10000 requests per minute with a burst allowance of 2000. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"**TranscoderStorageCost** fires when output bucket size grew more than 20% in a week. Likely cause: a customer generating many renditions or the lifecycle rule for deleted jobs not running. Remediation: check that the S3 lifecycle rule deleting outputs of canceled jobs is active and look at the top uploaders by bytes.",
"Each service has a primary and secondary on-call rotation of one week each, handing off on Tuesdays at 10:00 local time. Rotations are managed in PagerDuty; swap shifts by creating an override rather than editing the schedule. A rotation must have at least four people; teams smaller than that share a rotation with a neighboring team.",
"`POST /v1/flags/{key}/kill` — Immediately serves the flag's off variation to everyone in an environment, bypassing all rules. Parameters: `environment` (string) — which environment.",
"The notice period for resignation is four weeks for individual contributors up to E4 and eight weeks for E5 and above and for managers, unless your local contract specifies otherwise. Notice is given in writing to your manager and people-ops. The company may agree to a shorter period or place you on garden leave at full pay.",
"A test that fails and then passes on retry without a code change is flaky. Flaky tests are quarantined by adding the `@flaky` tag, which moves them to a non-blocking job, and a ticket is opened against the owning team with a two-week deadline. A quarantined test that is not fixed within two weeks is deleted, not left in quarantine forever.",
"Request vacation in Workday at least two weeks ahead for absences of a week or longer, and at least two working days ahead for shorter absences. Managers approve within three working days and may only decline for a documented coverage reason, in which case they must propose alternative dates. Post your absence in the team calendar once approved.",
"Local development for Auth Gateway uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up Redis in Docker; they take about 6 minutes.",
"Local development for Billing Engine uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 6 minutes.",
"Local development for Media Transcoder uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 4 minutes.",
"Local development for Search Index uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up OpenSearch in Docker; they take about 6 minutes.",
"Local development for Webhook Relay uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 4 minutes.",
"Local development for Audit Log uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up append-only in Docker; they take about 9 minutes.",
"Adding an index on a table over 1 million rows must use `CREATE INDEX CONCURRENTLY`; adding a NOT NULL column with a default must be split into add-nullable, backfill in batches of 10,000, then set NOT NULL. The migration linter rejects statements that take an ACCESS EXCLUSIVE lock on large tables.",
"The company observes the public holidays of the country where you are employed, plus two company-wide days off: the Friday after the annual kickoff in February and the last working day before the end-of-year freeze. If a public holiday falls on a weekend, the following Monday is taken instead.",
"Tier 1 databases take continuous WAL backups with point-in-time recovery to any second in the last 35 days, plus a daily snapshot retained for 1 year. Restore drills run quarterly; the last drill restored the ledger database in 41 minutes. To request a restore, page the data platform on-call — do not attempt it yourself.",
"Wrap any user-visible behavior change in a feature flag so that shipping code and enabling behavior are separate decisions. Flags are created in the Flagship console and default to off in every environment. Roll out by percentage of users, by organization ID, or by internal-staff-only, in that order of caution.",
"A deploy freeze is in effect from the last business day before a public holiday until the first business day after, and during the annual end-of-year freeze from December 20 to January 3. During a freeze, only fixes for SEV1 and SEV2 incidents may be deployed, and they require sign-off from the incident commander in the incident channel.",
"Recent changes to Billing Engine: 2026.08.2 — subscription changes can take effect at period end with proration; 2026.06.1 — invoice PDFs via `format=pdf` with signed URLs; 2026.02.3 — usage events accepted up to 72 hours late instead of 24. Breaking changes are announced 12 months ahead through the deprecation policy.",
"**InventoryRedisMiss** fires when hot SKU cache hit rate below 90%. Likely cause: Redis was flushed or a large catalog import created many new SKUs. Remediation: warm the cache with `invctl cache warm --top 10000`; the service reads through to PostgreSQL on a miss so this is a latency problem, not a correctness problem.",
"People-ops invites everyone who leaves voluntarily to an exit interview in their final week. It is optional and confidential; themes are shared with leadership quarterly in aggregate without attribution. Alumni are welcome to reapply and are eligible for the referral program for former colleagues.",
"Tell your manager and people-ops at least 8 weeks before you expect to start parental leave so that coverage can be arranged, though we understand arrivals are unpredictable. People-ops will send a leave plan template; the plan is for your team's benefit and can be changed at any time.",
"At handoff, the outgoing primary posts a summary in the team channel covering open alerts, anything silenced, and risky changes scheduled for the coming week. The incoming primary confirms they have the PagerDuty app installed with critical alerts enabled and that their phone will bypass do-not-disturb for it.",
"Promotions are decided in the March and September calibration sessions. To be considered, your manager submits a promotion packet showing you have operated at the next level for at least two quarters, with evidence linked to the level guide. You will hear the outcome, including the reasoning if declined, within a week of calibration.",
"Aim for many fast unit tests, a moderate number of integration tests that exercise real databases and queues in containers, and a small set of end-to-end tests against staging. End-to-end tests are owned by the platform QA guild and must complete within 20 minutes total, so new ones must replace or merge with an existing one.",
"Operational feature flags for Webhook Relay, managed in Flagship and tagged `ops`: `delivery.timeout_seconds` (default 10) — how long to wait for a customer endpoint to respond; `endpoint.auto_disable_hours` (default 24) — disable an endpoint after this many hours of continuous failure. Flipping an ops flag takes effect within 10 seconds and is logged to the audit log."
],
"This passage answers the question: having a baby soon, how many weeks can I take off",
when_true="The passage states the specific information the question asks for.",
when_false="The passage is about something else, or only shares words with the question."
)
print(result)npm install -g @cloudraker/milliseconds
export MS_API_KEY="your-api-key"# Reads MS_API_KEY. JSON on stdin supplies the complete request.
dm1 yes-no --json --usage <<'DM1_REQUEST'
{
"texts": [
"Engineers receive an on-call stipend of $500 per primary week and $250 per secondary week, paid with the following month's salary. If you are paged and work outside business hours for more than two hours in a night, you take the following morning off; if you handle a SEV1 overnight, you take the whole next day off. This time off is not deducted from vacation.",
"The default quota for Ledger API is 600 requests per minute with a burst allowance of 100. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Media Transcoder is 300 requests per minute with a burst allowance of 50. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Notify Hub is 1200 requests per minute with a burst allowance of 300. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Order Service is 900 requests per minute with a burst allowance of 200. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Search Index is 2000 requests per minute with a burst allowance of 500. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"The default quota for Webhook Relay is 10000 requests per minute with a burst allowance of 2000. When the quota is exhausted the service responds 429 Too Many Requests and sets `Retry-After`; clients should back off exponentially with jitter rather than retrying immediately. The remaining quota is reported on every response in `X-RateLimit-Remaining`.",
"**TranscoderStorageCost** fires when output bucket size grew more than 20% in a week. Likely cause: a customer generating many renditions or the lifecycle rule for deleted jobs not running. Remediation: check that the S3 lifecycle rule deleting outputs of canceled jobs is active and look at the top uploaders by bytes.",
"Each service has a primary and secondary on-call rotation of one week each, handing off on Tuesdays at 10:00 local time. Rotations are managed in PagerDuty; swap shifts by creating an override rather than editing the schedule. A rotation must have at least four people; teams smaller than that share a rotation with a neighboring team.",
"`POST /v1/flags/{key}/kill` — Immediately serves the flag's off variation to everyone in an environment, bypassing all rules. Parameters: `environment` (string) — which environment.",
"The notice period for resignation is four weeks for individual contributors up to E4 and eight weeks for E5 and above and for managers, unless your local contract specifies otherwise. Notice is given in writing to your manager and people-ops. The company may agree to a shorter period or place you on garden leave at full pay.",
"A test that fails and then passes on retry without a code change is flaky. Flaky tests are quarantined by adding the `@flaky` tag, which moves them to a non-blocking job, and a ticket is opened against the owning team with a two-week deadline. A quarantined test that is not fixed within two weeks is deleted, not left in quarantine forever.",
"Request vacation in Workday at least two weeks ahead for absences of a week or longer, and at least two working days ahead for shorter absences. Managers approve within three working days and may only decline for a documented coverage reason, in which case they must propose alternative dates. Post your absence in the team calendar once approved.",
"Local development for Auth Gateway uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up Redis in Docker; they take about 6 minutes.",
"Local development for Billing Engine uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 6 minutes.",
"Local development for Media Transcoder uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 4 minutes.",
"Local development for Search Index uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up OpenSearch in Docker; they take about 6 minutes.",
"Local development for Webhook Relay uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up PostgreSQL in Docker; they take about 4 minutes.",
"Local development for Audit Log uses the devcontainer in the repo: open it in your editor and run `make dev`. The service listens on http://localhost:8080 with the sandbox credentials pre-configured. Integration tests run with `make test-integration` and spin up append-only in Docker; they take about 9 minutes.",
"Adding an index on a table over 1 million rows must use `CREATE INDEX CONCURRENTLY`; adding a NOT NULL column with a default must be split into add-nullable, backfill in batches of 10,000, then set NOT NULL. The migration linter rejects statements that take an ACCESS EXCLUSIVE lock on large tables.",
"The company observes the public holidays of the country where you are employed, plus two company-wide days off: the Friday after the annual kickoff in February and the last working day before the end-of-year freeze. If a public holiday falls on a weekend, the following Monday is taken instead.",
"Tier 1 databases take continuous WAL backups with point-in-time recovery to any second in the last 35 days, plus a daily snapshot retained for 1 year. Restore drills run quarterly; the last drill restored the ledger database in 41 minutes. To request a restore, page the data platform on-call — do not attempt it yourself.",
"Wrap any user-visible behavior change in a feature flag so that shipping code and enabling behavior are separate decisions. Flags are created in the Flagship console and default to off in every environment. Roll out by percentage of users, by organization ID, or by internal-staff-only, in that order of caution.",
"A deploy freeze is in effect from the last business day before a public holiday until the first business day after, and during the annual end-of-year freeze from December 20 to January 3. During a freeze, only fixes for SEV1 and SEV2 incidents may be deployed, and they require sign-off from the incident commander in the incident channel.",
"Recent changes to Billing Engine: 2026.08.2 — subscription changes can take effect at period end with proration; 2026.06.1 — invoice PDFs via `format=pdf` with signed URLs; 2026.02.3 — usage events accepted up to 72 hours late instead of 24. Breaking changes are announced 12 months ahead through the deprecation policy.",
"**InventoryRedisMiss** fires when hot SKU cache hit rate below 90%. Likely cause: Redis was flushed or a large catalog import created many new SKUs. Remediation: warm the cache with `invctl cache warm --top 10000`; the service reads through to PostgreSQL on a miss so this is a latency problem, not a correctness problem.",
"People-ops invites everyone who leaves voluntarily to an exit interview in their final week. It is optional and confidential; themes are shared with leadership quarterly in aggregate without attribution. Alumni are welcome to reapply and are eligible for the referral program for former colleagues.",
"Tell your manager and people-ops at least 8 weeks before you expect to start parental leave so that coverage can be arranged, though we understand arrivals are unpredictable. People-ops will send a leave plan template; the plan is for your team's benefit and can be changed at any time.",
"At handoff, the outgoing primary posts a summary in the team channel covering open alerts, anything silenced, and risky changes scheduled for the coming week. The incoming primary confirms they have the PagerDuty app installed with critical alerts enabled and that their phone will bypass do-not-disturb for it.",
"Promotions are decided in the March and September calibration sessions. To be considered, your manager submits a promotion packet showing you have operated at the next level for at least two quarters, with evidence linked to the level guide. You will hear the outcome, including the reasoning if declined, within a week of calibration.",
"Aim for many fast unit tests, a moderate number of integration tests that exercise real databases and queues in containers, and a small set of end-to-end tests against staging. End-to-end tests are owned by the platform QA guild and must complete within 20 minutes total, so new ones must replace or merge with an existing one.",
"Operational feature flags for Webhook Relay, managed in Flagship and tagged `ops`: `delivery.timeout_seconds` (default 10) — how long to wait for a customer endpoint to respond; `endpoint.auto_disable_hours` (default 24) — disable an endpoint after this many hours of continuous failure. Flipping an ops flag takes effect within 10 seconds and is logged to the audit log."
],
"statement": "This passage answers the question: having a baby soon, how many weeks can I take off",
"when_true": "The passage states the specific information the question asks for.",
"when_false": "The passage is about something else, or only shares words with the question."
}
DM1_REQUESTUnder the hood How it works & limitations
API calls/yes-no
How it works
A local search index retrieves candidate passages from a fictional company handbook. The model scores whether each passage answers the question and orders the candidates by that score.
Demo scope
The handbook is synthetic, and the demo returns passages rather than generating an answer. It can only rank retrieved candidates. Low answer probability means you should inspect the source before relying on it.
Inspired by the work of dabit3.