Skip to content

WIP: Add challenge-premise red-team review prompt - #6274

Draft
rugpanov wants to merge 1 commit into
mainfrom
add-challenge-premise-prompt
Draft

WIP: Add challenge-premise red-team review prompt#6274
rugpanov wants to merge 1 commit into
mainfrom
add-challenge-premise-prompt

Conversation

@rugpanov

Copy link
Copy Markdown
Contributor

Summary

Adds .agent/prompts/challenge-premise.md — a reusable prompt for red-teaming a change that rests on a load-bearing assumption (a claim about how a tool, API, the repo, or the codebase behaves).

Why

Content-focused reviews verify that a change is built correctly but rarely question whether its premise is true. A recent change was proposed on the assumption that "Claude Code can't discover .agent/rules/" — every correctness reviewer approved it, yet the premise was false (the repo already wires those rules to Claude via a .claude/rules symlink). A red-team prompt run with this framing caught it in one pass. This codifies that prompt so it's reusable instead of retyped.

What

The prompt asks the reviewer to assume the implementation is correct and instead: state the load-bearing assumption, try to disprove it with repo config/docs, explain what makes the change redundant or worse than the status quo, and identify the simplest alternative.

Matches the existing .agent/prompts/outdated-agent-rules.md style (plain prose, no frontmatter). Prompts are invoked on demand, so no .claude/rules or .cursor/rules symlink is needed.

Notes

  • Docs-only addition to AI-assistant tooling; no CLI behavior change, so no .nextchanges/ fragment.

This pull request and its description were written by Isaac.

Add .agent/prompts/challenge-premise.md, a reusable prompt for red-teaming a
change that rests on a load-bearing assumption: state the assumption, try to
disprove it with repo config/docs, and check whether the repo already solves
the problem another way. Runs alongside the normal correctness review.

Matches the existing .agent/prompts/outdated-agent-rules.md style (plain prose,
no frontmatter). Prompts are invoked on demand, so no rules/cursor symlink.

Co-authored-by: Isaac
@github-actions

Copy link
Copy Markdown
Contributor

Waiting for approval

Based on git history, these people are best suited to review:

  • @janniklasrose -- recent work in .agent/prompts/

Eligible reviewers: @andrewnester, @anton-107, @denik, @lennartkats-db, @pietern, @rclarey, @renaudhartert-db, @shreyas-goenka, @simonfaltum

Suggestions based on git history. See OWNERS for ownership rules.

@rugpanov
rugpanov marked this pull request as draft August 14, 2026 11:21
@rugpanov rugpanov changed the title Add challenge-premise red-team review prompt WIP: Add challenge-premise red-team review prompt Aug 14, 2026
@eng-dev-ecosystem-bot

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 97d8a52

Run: 31795390487

Env 🟨​KNOWN 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
💚​ aws linux 4 4 286 1144 3:48
💚​ aws windows 4 4 288 1142 3:01
🟨​ azure linux 3 1 4 285 1144 7:30
🟨​ azure windows 3 1 4 287 1142 6:35
💚​ gcp linux 1 5 286 1144 4:07
💚​ gcp windows 1 5 288 1142 3:10
8 interesting tests: 4 SKIP, 3 KNOWN, 1 RECOVERED
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestFetchRepositoryInfoAPI_FromRepo 💚​R 💚​R 🟨​K 🟨​K 🙈​S 🙈​S
🟨​ TestFetchRepositoryInfoAPI_FromRepo/root 💚​R 💚​R 🟨​K 🟨​K
🟨​ TestFetchRepositoryInfoAPI_FromRepo/subdir 💚​R 💚​R 🟨​K 🟨​K

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants