overseer 1.0.0 copy "overseer: ^1.0.0" to clipboard
overseer: ^1.0.0 copied to clipboard

A human-in-the-loop testing framework for manually verifying backend artifacts like videos, audio, and AI output.

1.0.0 #

  • Initial Release of the overseer hitl-testing package!
  • MatrixEngine: Parse parameter permutations (mode: permutations and mode: list) from YAML tests.
  • ExecutionWrapper: Safely run user-defined asynchronous generation callbacks with robust error-wrapping.
  • InteractivePrompter: Terminal-based CLI prompting UI. Includes OS-native auto-opening of artifacts (start/open/xdg-open), and hot-retry support (r).
  • Reporter: Generates formatted Markdown reports documenting parameters, retry counts, and final checklist verdicts cleanly.
  • Session Locking: Auto-persisting .overseer.lock capabilities so users can quit mid-session (q) and seamlessly resume.
1
likes
140
points
4
downloads

Documentation

API reference

Publisher

unverified uploader

Weekly Downloads

A human-in-the-loop testing framework for manually verifying backend artifacts like videos, audio, and AI output.

Repository (GitHub)
View/report issues

License

Apache-2.0 (license)

Dependencies

ansi_styles, path, yaml

More

Packages that depend on overseer