m6/org/openalice-canary

openalice-canary

**Behavioral E2E canary for the OpenAlice product surface.** Tests *real behavior* against the live stack and asserts **outcomes, not status codes** — because `compiles` + `returns 200` ≠ `works` (see `openalice-agent-lite/docs/BUG_CATEGORIES.md`).

Features
0
Status
·unknown
Last activity
24d ago
Branch
main

Architecture rating

F21d ago
docsD

README present with clear purpose statement referencing BUG_CATEGORIES.md; manifest valid and descriptive (100/100); but 8 missing docstrings across only 3 files, no inline architecture notes, no @feature annotations (features=20/100), no env var documentation despite 9 undeclared vars

consistencyF

Manifest present and valid (100/100 in Atlas); follows shared eval contract for result JSON; but 17 missing type hints, 8 missing docstrings, 1 god module, and 9 undeclared env vars show poor adoption of project conventions; Atlas drift score 10/100 confirms significant divergence from substrate norms

reliabilityF

5 bare/broad excepts suppress real failures; no evidence of graceful shutdown, timeouts, retries, or idempotency; max cyclomatic complexity 13 in a god module suggests monolithic error-prone flow; FLEET_LOOP_THRESHOLD/FLEET_RESTART_THRESHOLD env vars hint at restart logic but undeclared and unvalidated

securityF

9 undeclared env vars (CANARY_ORIGIN, CANARY_PROMPT, etc.) with no .env schema or secret-handling layer; no authn/authz on the canary itself; 5 bare/broad excepts risk swallowing injection or SSRF errors silently; no evidence of input sanitization on CANARY_PROMPT before use

observabilityF

5 console.log statements are the only output mechanism; no structured logging, no metrics export, no tracing, no health probe (Atlas confirms 'no https endpoint in manifest exposes', up=false); canary result JSON is the sole observable artifact

data layerF

No database, no migrations, no schema; writes a flat JSON file to /home/blal/shared/eval/canary.json with no FK constraints, no tenant isolation, no GDPR controls; eval_history.py likely appends without rotation beyond EVAL_GZIP_AGE_DAYS env var

testingF

Zero test files detected in repo structure; the canary IS a test harness for other services but has no tests for its own logic (fleet_scan, eval_history, prompt handling); complexity-13 god module and 3 source files with no self-test coverage

source · auto-grader-2026-06-27

Ecosystem manifest

.atlas-deps.yml

Behavioral E2E canary — tests real product behavior against the live stack (outcomes, not 200s) and writes a result-JSON per the shared eval contract for Atlas to ingest. Shared eval-infra; Embed pack first.

Runtime deps
Exposes
  • file: /home/blal/shared/eval/canary.json
Env drift · manifest ⇄ code

Atlas grepped the repo's source for env reads (rust env::var · ts process.env · py os.environ · shell $VAR) and diffed against the manifest's consumes_env. Two lists below: stale declarations and undeclared reads.

Code reads, manifest omits
  • CANARY_EVAL_DIR
  • CANARY_NO_LLM
  • CANARY_ORIGIN
  • CANARY_PROMPT
  • CANARY_VERSION
  • CANARY_WIDGET
  • EVAL_GZIP_AGE_DAYS
  • FLEET_LOOP_THRESHOLD
  • FLEET_RESTART_THRESHOLD
Observed reads: 9 · declared: 0

Code composition

tokei · loc
541loc
  • Python100.0%
  • Python100.0%· 541
Language% codecodecommentsblanksfiles
Python100.0%54137863
Markdown0.0%069211

Telemetry ribbon · last 90 days

5 events
MAYJUNJUL2026-06-24 · lifecycle · first scan — repo indexed2026-06-24 · commit · new commit e04548b → bb57ecd2026-06-24 · commit · new commit bb57ecd → 040594e2026-07-16 · kind · kind reclassified · library → service2026-07-17 · kind · kind reclassified · service → libraryNOW
commitmanifestlifecyclekind

No @feature annotations recorded in this repo yet.