Operational health

Errors and reliability

Track server exceptions and operational events that could make Aristotle unreliable, misleading or unavailable for learners.

ok operations status
0 open error events
0 open events
0 resolved events
0 events recorded
no backup evidence
no restore drill evidence
no smoke check evidence
no load check evidence
no failure-mode evidence
no preflight evidence
no rehearsal evidence

Operations sign-off campaign

Target release campaign control

Coordinate operational checks, target-environment controls, production-owner review and the returned validation decision.

Open reviewer dispatch
7 internal items open
8 target items open
Open owner acceptance

Internal operational evidence

Refresh backup, restore, smoke, load, failure-mode, preflight and rehearsal evidence.

open 7 open

Target environment controls

Configure the named environment, HTTPS production URL, monitoring, alerting, backup storage and incident owner.

open 8 open

Production owner acceptance

Complete internal evidence before requesting production-owner acceptance.

open 15 open

Campaign steps

  • Run or refresh operational checks until the internal evidence workstream is ready.
  • Configure target-environment ownership, HTTPS URL, monitoring, alerting and backup storage references.
  • Export the review work order and return template for the production operations owner.
  • Import returned review JSON only when the owner confirms packet review, gate scope and acceptance readiness.
  • Rerun the Definition of Done audit after the accepted production-operations validation record exists.

Launch pack

Target-environment release readiness

Use this coordinator view to separate local rehearsal evidence from target-environment monitoring, alerting, backup storage and production-owner acceptance.

Open internal evidence
Open target sign-off
Open owner acceptance
15 launch items open
not configured HTTPS production URL external monitoring human alert route external backup storage incident owner

The launch pack exposes only readiness booleans, counts, command names and route references. It omits learner answers, learner identity, monitoring URLs, alerting references and backup storage locations.

Required release loop

  • Learning-data backup: A release backup exists, is stored outside the web process and has object-count evidence.
  • Restore drill: The latest backup can be deserialized and counted without overwriting live learner data.
  • Learner-facing smoke check: Core learner, curriculum, safety, readiness and operations routes pass against the intended release build.
  • Adaptive-learning load check: Synthetic learner traffic stays within the configured response-time threshold.
  • Failure-mode harness: Invalid routes, unreviewed teaching, blocked concepts, safety input and shallow answers fail safely.
  • Production preflight: Target deployment settings pass security, host, HTTPS, cookie, HSTS, database and expert-review-gate checks.
  • Full operations rehearsal: Backup, restore, smoke, load and failure-mode steps pass in one release-context rehearsal.
  • No unresolved production-impacting events: Every open error or critical operational event is resolved or explicitly risk-accepted before sign-off.

Production acceptance rules

  • Internal operational evidence: All backup, restore, smoke, load, failure-mode, preflight, rehearsal and open-error checks are passing.
  • Target environment sign-off: Environment, HTTPS production URL, monitoring, alerting, backup storage and incident owner are configured for the named release target.
  • Production owner acceptance: A production operations owner accepts the evidence in the validation registry with no open handoff items.
  • External or real-world attestation: Reviewer confirms the evidence is target-environment or real-world evidence and not synthetic-only.

Next actions

  • Run a learning-data backup and keep the generated backup path with the release evidence.
  • Verify the latest backup can be deserialized without writing over live learner data.
  • Run the learner-facing route smoke check against the intended release build.
  • Run the adaptive-learning load check and confirm response timings stay within the release threshold.
  • Set ARISTOTLE_DEPLOYMENT_ENVIRONMENT to the named target environment this evidence applies to.
  • Set ARISTOTLE_PRODUCTION_URL to the HTTPS learner-facing URL and rerun smoke/preflight checks.
  • Add ARISTOTLE_MONITORING_DASHBOARD_URL for the external uptime, error-rate and latency dashboard.
  • Add ARISTOTLE_ALERTING_ROUTE_REFERENCE for the human alert route used during learner-impacting incidents.

Operations reviewer work order

Production owner assignment

Use this packet when asking the production operations owner to inspect release evidence, target-environment controls and the validation record without exposing learner data or internal infrastructure references.

Open internal evidence
7 internal items open
8 target items open
Open owner acceptance

Return protocol

  • Inspect internal operational evidence: Confirm backup, restore, smoke, load, failure-mode, production preflight, operations rehearsal and open-error evidence are current for the release.
  • Inspect target-environment sign-off: Confirm the named deployment, HTTPS learner URL, monitoring, alerting, backup storage and incident/runbook owner exist outside the local app.
  • Inspect the release loop: Check that operational checks were run in the intended release context and rerun them after deployment, database or curriculum-trust changes.
  • Return a production-owner decision: Return accept, changes_requested or reject with reviewer identity, role, attestation reference, review notes and any required release changes.
  • Accept validation evidence only after review: A production operations validation record counts only when the owner accepts it with target-environment or real-world attestation and no open handoff items.

Trust boundary

This work order coordinates production-owner review. It does not itself prove deployment readiness, external monitoring, backup retrieval or incident ownership; those claims require accepted validation evidence from the target release context.

The work order includes readiness counts, command names, route references, open-item keys and validation draft summaries only. It omits learner answers, learner identity, monitoring URLs, alerting references, backup storage references and production URLs.

Reviewer return checklist

Accepted production-operations returns must confirm target-environment evidence, not local-only rehearsal, EYFS through A-Level scope, packet review, release-scope match and production-owner acceptance readiness.

Production operations owner

production_operations EYFS through A-Level All MVP subjects
  • reviewer_confirmed_external_or_real_world
  • reviewer_confirmed_not_synthetic_only
  • reviewer_confirmed_age_scope_reviewed
  • reviewer_confirmed_work_order_and_pack_reviewed
  • reviewer_confirmed_scope_matches_gate
  • reviewer_confirmed_ready_for_acceptance
  • target_environment_reviewed - Production owner confirms the evidence came from the target release environment, not only a local rehearsal.
  • monitoring_backup_smoke_load_reviewed - Production owner confirms monitoring, backup, restore, smoke and load evidence was reviewed.
  • release_risk_accepted - Production owner confirms release risk and rollback ownership are acceptable for the submitted production claim.
  • Work order: /operations/review-work-order.json
  • Evidence: /operations/signoff-campaign.json /operations/launch-pack.json /operations/evidence.json /operations/review-work-order.json /operations/
  • Review brief: /validation/review-request/production_operations/
  • Return template: /validation/review-return-template.json?request=production_operations
  • Registry: /validation/?request=production_operations#record-evidence

Learning-data backup

Run a learning-data backup and keep the generated backup path with the release evidence.

open internal evidence

Backup restore drill

Verify the latest backup can be deserialized without writing over live learner data.

open internal evidence

Production smoke check

Run the learner-facing route smoke check against the intended release build.

open internal evidence

Adaptive learning load check

Run the adaptive-learning load check and confirm response timings stay within the release threshold.

open internal evidence

Failure-mode harness

Run the failure-mode harness so production-trust, safety and invalid-route protections are recorded.

open internal evidence

Production deployment preflight

Run production preflight using the target deployment settings before release sign-off.

open internal evidence

Full operations rehearsal

Run the full operations rehearsal after backup, restore, smoke, load and failure-mode checks are healthy.

open internal evidence

No open error or critical operational events

Evidence is currently present; rerun this check when the release, data store or deployment settings change.

ready internal evidence

Named production environment is configured

Set ARISTOTLE_DEPLOYMENT_ENVIRONMENT to the named target environment this evidence applies to.

open target environment

Production URL is configured and HTTPS

Set ARISTOTLE_PRODUCTION_URL to the HTTPS learner-facing URL and rerun smoke/preflight checks.

open target environment

External monitoring dashboard reference exists

Add ARISTOTLE_MONITORING_DASHBOARD_URL for the external uptime, error-rate and latency dashboard.

open target environment

Alerting route reference exists

Add ARISTOTLE_ALERTING_ROUTE_REFERENCE for the human alert route used during learner-impacting incidents.

open target environment

External backup storage reference exists

Add ARISTOTLE_BACKUP_STORAGE_REFERENCE for backup storage outside the web process.

open target environment

Incident/runbook owner is configured

Add ARISTOTLE_INCIDENT_RUNBOOK_OWNER so incidents, restore decisions and learner communication have ownership.

open target environment

Latest production preflight passed

Run production preflight with production-like settings and clear every failed deployment check.

open target environment

Latest operations rehearsal passed

Run the full operations rehearsal in the target release context and resolve any failed step.

open target environment

Deployment sign-off checklist

Target environment readiness

These checks separate local rehearsal evidence from production ownership, monitoring, alerting and backup storage that must exist before the operations gate can be accepted.

Open deployment sign-off
8 open sign-off items
Open production acceptance

Named production environment is configured

Operations owner confirms which deployment this evidence applies to.

open missing

Production URL is configured and HTTPS

Operations owner verifies smoke checks and monitoring target the real learner-facing URL.

open missing

External monitoring dashboard reference exists

Operations owner verifies uptime, error rate and latency monitoring outside the app.

open missing

Alerting route reference exists

Operations owner verifies alerts reach a responsible human for learner-impacting failures.

open missing

External backup storage reference exists

Operations owner verifies backups are stored outside the web process and can be retrieved.

open missing

Incident/runbook owner is configured

Operations owner confirms who handles incidents, restore decisions and learner communication.

open missing

Latest production preflight passed

Operations owner verifies deployment settings meet production security requirements.

open missing

Latest operations rehearsal passed

Operations owner verifies backup, restore, smoke, load and failure-mode checks run as a release rehearsal.

open missing

Production handoff

Operations owner worklist

Run a learning-data backup and keep the generated backup path with the release evidence.

Open internal evidence
7 internal items open
8 deployment items open
Open owner acceptance

Commands to refresh open evidence

python manage.py backup_learning_data --json python manage.py verify_backup_restore --json --fail-on-error python manage.py run_production_smoke --json --fail-on-error python manage.py run_learning_load_check --json --fail-on-warning python manage.py run_failure_mode_checks --json --fail-on-error python manage.py run_production_preflight --json --fail-on-error python manage.py run_operations_rehearsal --json --fail-on-error

Learning-data backup

Run a learning-data backup and keep the generated backup path with the release evidence.

internal evidence A resolved backup_learning_data operational event with object counts and a backup path.

Backup restore drill

Verify the latest backup can be deserialized without writing over live learner data.

internal evidence A resolved verify_backup_restore event with restored object counts.

Production smoke check

Run the learner-facing route smoke check against the intended release build.

internal evidence A resolved run_production_smoke event with zero failed routes.

Adaptive learning load check

Run the adaptive-learning load check and confirm response timings stay within the release threshold.

internal evidence A resolved run_learning_load_check event with timing metrics under the configured thresho…

Failure-mode harness

Run the failure-mode harness so production-trust, safety and invalid-route protections are recorded.

internal evidence A resolved run_failure_mode_checks event with zero failures.

Production deployment preflight

Run production preflight using the target deployment settings before release sign-off.

internal evidence A resolved run_production_preflight event with zero failed deployment checks.

Full operations rehearsal

Run the full operations rehearsal after backup, restore, smoke, load and failure-mode checks are healthy.

internal evidence A resolved run_operations_rehearsal event with zero failed steps.

Named production environment is configured

Set ARISTOTLE_DEPLOYMENT_ENVIRONMENT to the named target environment this evidence applies to.

deployment sign-off The target environment name is recorded in deployment settings.

Production URL is configured and HTTPS

Set ARISTOTLE_PRODUCTION_URL to the HTTPS learner-facing URL and rerun smoke/preflight checks.

deployment sign-off The evidence pack names the HTTPS production URL used by monitoring and smoke checks.

External monitoring dashboard reference exists

Add ARISTOTLE_MONITORING_DASHBOARD_URL for the external uptime, error-rate and latency dashboard.

deployment sign-off A monitoring dashboard outside the app is linked for the production owner.

Alerting route reference exists

Add ARISTOTLE_ALERTING_ROUTE_REFERENCE for the human alert route used during learner-impacting incidents.

deployment sign-off A named alerting route reaches an accountable human.

External backup storage reference exists

Add ARISTOTLE_BACKUP_STORAGE_REFERENCE for backup storage outside the web process.

deployment sign-off External backup storage is named and retrievable for restore drills.

Incident/runbook owner is configured

Add ARISTOTLE_INCIDENT_RUNBOOK_OWNER so incidents, restore decisions and learner communication have ownership.

deployment sign-off The incident/runbook owner is named in the release evidence.

Latest production preflight passed

Run production preflight with production-like settings and clear every failed deployment check.

deployment sign-off The latest production preflight event is resolved with zero failures.

Latest operations rehearsal passed

Run the full operations rehearsal in the target release context and resolve any failed step.

deployment sign-off The latest operations rehearsal event is resolved with zero failed steps.

Validation draft

Production operations evidence record

Create a non-counting draft in the validation registry from the current operational evidence pack. A production owner still needs to accept it before it counts toward readiness.

1/8 checks passing
7 checks open
Open external acceptance state
Open deployment checklist

Production operations evidence pack

This draft does not count toward production readiness until accepted in the validation registry. 7 operational check(s) and 8 deployment sign-off item(s) are still open before this pack is ready for external operations acceptance.

Sign in to draft production operations validation evidence.

Production checks

Backup, restore, smoke and load evidence

Latest backup

No backup event recorded yet.

Latest restore drill

No restore drill event recorded yet.

Latest smoke check

No smoke check event recorded yet.

Latest load check

No load check event recorded yet.

Latest failure-mode check

No failure-mode event recorded yet.

Latest production preflight

No production preflight event recorded yet.

Latest operations rehearsal

No full rehearsal event recorded yet.

Incident trail

Open and recent events

No operational events have been recorded yet.