Risk Call-Path Testing · VS Code + GitHub PR Checks

Test the risky paths each pull request changes.

CodeMD adds a missing layer to your test portfolio: it follows changes through the call graph, creates focused tests for uncovered paths, runs the impacted tests in GitHub Actions, and checks for new paths from outside input to sensitive operations.

Keep your unit, integration, and end-to-end tests. CodeMD adds change-aware call-path coverage around them. Both tools are free to start, with no CI configuration needed.

Step 1 · In VS Code · Free

Create

CodeMD maps the call paths your change touches and creates tests aimed at them, then runs them in an isolated copy of your workspace.

# after your coding agent edits order.py
Changed: apply_discount()
Callers:  checkout(), cart_total()
+ test_apply_discount_call_path
+ test_checkout_contract
✓ 2 created · 2 passed
Step 2 · On GitHub

Prove

Open the pull request. CodeMD finds the tests that call the change through the call graph and runs them in your repository's GitHub Actions.

# checks on acme/shop #482
CodeMD Call-Path Security   ✓ no new paths
CodeMD Impacted Tests       ✓ 16 passed
Changed lines executed: 41 of 41

Illustration. Names and numbers are examples.

A test layer built around change risk.

Traditional suites test what teams remembered to specify. CodeMD also asks which call paths this change can affect, which of those paths are risky, and whether a test actually exercised the changed code.

1

Map the changed call paths

Use Claude Code, Codex, Copilot or your own hands. CodeMD connects each changed function to its callers, tests, and risk.

2

Create the missing tests

In VS Code, create and run focused call-path, contract, multi-caller, replay, and new-function tests before you commit.

3

Execute and secure the PR

On GitHub, CodeMD runs impacted tests, confirms changed-line execution, and detects new input-to-sensitive-operation paths.

Create tests for the paths most likely to be missed.

These are focused additions to your existing suite. Each test targets changed code, a real caller, or a risky call chain instead of adding generic coverage.

VS Code · Free

Free CodeMD plugin

Maps your call graph and creates the tests your agent didn't write.

  • Finds and runs the existing tests that cover the change
  • Creates new tests with Claude Code, Codex, or free with local Ollama
  • Runs tests in an isolated copy of your workspace
  • Files real failures and security findings on a Bugs tab
Test types

Seven kinds of test

Pick what the change needs.

  • New-Function
  • Call-Path
  • Call-Chain
  • Contract
  • Multi-Caller
  • Highest-Risk Direct-Caller
  • Replay (free)

Local-first: your code is analysed on your machine. AI-powered steps use the assistant you connect.

Execute the right tests and security checks on every PR.

Reviewers see which impacted tests ran, whether they reached the changed lines, and whether the change introduced a new risky call path.

Free + Pro

CodeMD Impacted Tests

A change can break something several calls away from the line you edited. This check finds the tests that reach it and runs them in your own GitHub Actions, so a bug is more likely to surface before your customers see it.

  • Can mean less waiting on CI and fewer Actions minutes than running the whole suite
  • Includes the tests you created and committed, so they keep paying off
  • Checks each test actually ran the changed lines, so a pass says more
  • Free for existing tests (10 checks an hour); Pro adds AI test commands, AI-written tests and 20 an hour
  • Your code doesn't run on CodeMD's servers
Free

CodeMD Call-Path Security

AI-written code can quietly open a door an attacker may find or expose customer data. This check fails the PR when a change opens a new path from outside input to risky code, so you can fix it before it ships.

  • Looks for commands on your server, SQL built from text, eval, HTML written into a page, files served from a variable path, redirects, file writes and outbound requests, which helps lower the chance of an attacker getting in
  • Flags personal data (passwords and keys, IDs, health, payment, contact, location) that outside input can reach, which helps you catch a possible leak before it becomes a breach
  • Shows the whole path, so a reviewer can judge it quickly
  • Only flags what this change added, so you aren't buried in old issues
  • Mark checked paths "Verified safe"

Coming next: tests created in VS Code handed to PR Checks automatically, with no commit step in between.

Then see it all in one dashboard.

Every check across every pull request rolls up into your My checks dashboard: what's open, what's covered, and which endpoints are exposed.

codemd.dev/prchecks
acme/shopupdated just now · last 30 days
12pushes checked (last 24 h)
92%passed both checks
1new security issue today
0code bugs open
96%tests passed today (118 run)
88%changed lines tests ran (target 80%)

Needs attention: unsafe or high-impact security issues

FunctionImpactAI reviewWhyFound
export_orders
orders/export.py:42
highunsafePOST /orders/export reaches a shell command2 h ago
render_invoice
billing/pdf.py:88
mediumunsurecustomer-supplied name reaches a file write1 d ago

An illustration of the dashboard. Names and numbers are examples. Open your own →

The gap this fills in a test portfolio.

Most teams have valuable test suites, but those suites do not automatically adapt their scope to every code change. CodeMD adds that change-aware layer.

Risk-aware test selection

Run the tests connected to changed code through the call graph, including tests several calls away.

Tests for uncovered change paths

Create focused tests when changed functions, callers, contracts, or call chains are not adequately exercised.

Security reachability on the PR

Detect newly introduced paths from outside input to shell commands, file writes, eval, and outbound requests.

Free to start.

Add local risk call-path analysis, test creation, and the security PR check for free. Impacted Tests runs your existing tests on every PR for free; Pro adds AI test commands, AI-written tests and higher limits.

Free

$0 forever
  • VS Code plugin: call graph, test discovery, test creation
  • CodeMD Call-Path Security on every PR
  • CodeMD Impacted Tests for your existing tests
  • Unlimited public repositories

Install the plugin

Pro

$4.99 per developer / month
  • Everything in Free
  • Impacted Tests with AI test commands and AI-written tests
  • AI verdict inside the security check
  • 30-day free trial

See Pro

Add risk call-path testing to your test portfolio.

Create the missing tests locally. Execute the impacted tests and security checks on every GitHub pull request.

Both are free to start. No CI configuration needed.