Free VS Code testing plugin · Team FeatureDashboard

Test every coding-agent change for free! Track every feature to release.

The free CodeMD plugin maps call paths, shows the impact of each change, and runs the relevant tests before you commit—free with CodeMD or using your existing coding-agent subscription. Results roll up into one dashboard of feature progress, test coverage, and release readiness.

Analysis runs locally. Tests run in an isolated copy of your workspace. On codemd.dev, tests run in your repository's own GitHub Actions, never on our servers.

CodeMD system flow from the VS Code plugin through developer testing workflows to the unified CodeMD dashboard
Uncommitted edits
3 functions changed · not yet committed
Safe to commit
calculate_invoice_total()billing/invoice.py
4 relevant tests✓ Passed
apply_discount()billing/discounts.py
2 relevant tests✓ Passed
format_receipt()billing/receipts.py
3 relevant tests✓ Passed
✓ 9 relevant tests passed

How it works

Three steps, all inside VS Code.

1

Change your code

Edit as usual, by hand or with your coding agent. CodeMD sees which functions you changed.

2

CodeMD finds the relevant tests

It follows your code's call graph from each changed function to the existing tests that exercise it.

3

It runs them before you commit

Those tests run in an isolated copy of your workspace. You see pass or fail, and which changed functions have no tests.

On codemd.dev, tests run in your own GitHub Actions

GitHub Actions is GitHub's own cloud machines running your workflow. Your code never runs on CodeMD's servers.

1

GitHub starts a temporary machine

For each test run, GitHub spins up a fresh machine, runs the steps it's given, and then throws the machine away.

2

CodeMD tells it what to run

On its own codemd-test-runs branch, CodeMD writes the steps: set up your language, install your dependencies, and run the tests for the functions you changed. Your other branches and workflows aren't touched.

3

The results come back to you

GitHub runs the tests and returns the results. CodeMD reads pass or fail, and whether each test reached your changed code, and shows them on the Testboard.

Secure by design

The run gets a read-only token and none of your repository's secrets: CodeMD leaves out any setup step that would use one.

Free to run

Running tests uses no CodeMD AI credits. GitHub Actions minutes are free for public repositories; private repositories use the minutes included in your GitHub plan.

You stay in control

Tests run only in repositories where you install the CodeMD GitHub App, and only when someone with write access asks.

Your team's testing, in one view

Testboard brings together your repository's test runs from the website and the CodeMD VS Code plugin. See tests executed, pass rates, whether tests reached their target functions, bugs caught before commit, and security ship blockers.

Example CodeMD Testboard showing a 30-day view with security ship blockers, 109 runs, 57 tests executed, a 78.9% pass rate, 100% coverage confirmed, two bugs caught before commit, and daily test charts.
An example repository's last 30 days. Your team's Testboard shows your own repository's results. Select the image to view it at full size.

Why run only the relevant tests?

The full suite is slow

So it often doesn't get run before a commit. A focused set of tests runs in seconds.

Skipping tests is risky

Especially with AI-written code. CodeMD checks the code you actually touched.

You keep your tests

CodeMD uses the tests you already have. Your source files are never modified.

Finds relevant tests for Python, JavaScript/TypeScript, Java, Kotlin, C#, Go and Rust; runs existing tests directly for Python, Go, Java, Kotlin and C#. Creates missing tests for Python, JavaScript/TypeScript, Java, Kotlin, C#, Go and Rust.

Know before you commit.

Install the free VS Code extension and run the tests that matter for your next change.