Connect GitHub
Checking your GitHub connection…
CodeMD only reads repositories you choose. The testboard shows runs for repositories GitHub lists for your account.
Testboard
Every test run for this repository, by commit: run on the website (on CodeMD's server or in the repository's own GitHub Actions) or in the CodeMD VS Code plugin.
No test runs recorded for this repository yet
Runs appear here as soon as tests run in either place:
- On /analyze, open a commit and use Run tests, Run CodeVal (Free) Tests or a generate button. These run on CodeMD's server or in your repository's GitHub Actions.
- In the CodeMD VS Code plugin, run or generate tests, then run Codemd: Push Test Runs to GitHub (the status bar shows how many runs are waiting; choose Push Automatically to push them with each product-metrics publish from then on). The plugin records each run's test name, function, result, coverage and time (never code or output) on the repository's
codemd-metricsbranch, and this page reads them from there.
Tests executed per day
Green segment: tests that appeared in a run for the first time
Show as table
Pass rate
Executed tests that passed, per day with runsCoverage confirmed
Executed tests that were shown to run their target functionFlaky tests
Result flipped between runs of the same codeSlowest tests
Average time of single-test runsRecent commits
What was tested for each commit in this periodHow each number is defined
- Run
- One test job: a single function's test, a bulk run of a commit's at-risk functions, or a re-run after an AI fix. Generating a test is not a run.
- Coverage confirmed
- The test ran and coverage showed it executed the target function's code. A test can pass without this.
- First seen in a run
- A test that appears in no earlier stored run (website or plugin, last 90 days). It does not mean the test never ran in CI.
- Caught before commit
- A test failed, then a later run of it passed. A signal, not a confirmed bug.
- Flaky
- A test whose result flipped between runs of the same code (same commit on the website; same function and test contents in the plugin).
- Changed lines run
- Of the lines a commit changed that coverage tracked, how many the tests ran. Shown for runs on GitHub Actions, where the coverage reports are measured.
- Changed functions tested
- Functions changed in a commit that have a passing, coverage-confirmed test run at that commit.
Test execution log
Newest first. “First seen” counts tests that had not appeared in any earlier run.Tests created automatically
Generated on the website or by the CodeMD plugin in this period, newest first. Generated tests start in the git-ignored.codemd/generated_tests/; one counts as kept once a file with its name is committed to the default branch.