Plugin Eval

plugin-eval

Evaluate Codex skills and plugins from chat with a beginner-friendly start command, local-first reports, token budget explanations, and guided benchmarking.

Install

Start a new Codex session after installation to use the plugin

Category: Developer Tools
Author: OpenAI Codex
GitHub: openai/plugins
Website: openai.com

Good for

Evaluate Codex skills
Generate local reports
Explain token budgets
Run benchmarking

Getting started

Install Node.js 20 or higher
Clone the project folder
Run `node ./scripts/plugin-eval.js --help`
Use `plugin-eval start` to begin evaluation

Before you install

Requires Node.js 20 or higher, project is private, recommended to install from local clone.

Summarized by AI from the project docs; check the official docs before relying on it.

Similar tools

Build iOS AppsCodex · Developer Tools
Build iOS apps with workflows for App Intents, SwiftUI UI work, Simulator mirroring in the Codex in-app browser, performance profiling, leak investigation, and simulator debugging.
Build macOS AppsCodex · Developer Tools
Build, run, test, debug, instrument, and implement local macOS apps using Xcode, SwiftUI, AppKit interop, unified logging, and shell-first desktop workflows.
Build Web AppsCodex · Developer Tools
Build web apps with frontend asset design, browser testing, UI components, payments, and database guidance.
Build Web Data VisualizationCodex · Developer Tools
Design, critique, implement, test, and export web data visualizations in Codex, including charts, maps, dashboards, Gantt, UML, scrollytelling, reports, slides, mobile views, shareable state, and advanced WebGL concepts.
CircleCICodex · Developer Tools
Build, test, and deploy any application