The Five-Step Method for Writing SOTA Summaries

Hatem Rabeh

Written by HATEM RABEH, MD, MSc Ing

Your Clinical Evaluation Expert And Partner

in
S

You have finished your literature search. Hundreds of papers, guidelines, and reports sit in your reference manager. Now you need to convert this into a SOTA summary that reviewers will accept. Where do you start? Most people start writing and hope structure emerges. It does not. Here is a method that works.

After years of writing and reviewing SOTA sections, I developed a five-step method that consistently produces summaries reviewers accept. The method forces synthesis instead of summarization. It creates structure that answers the questions reviewers actually ask. And it connects directly to the acceptance criteria you will need later.

Step 1: Clinical Context

Start with six lines. That is your constraint. In those six lines, summarize the clinical condition, the care setting, the end-users, and the patient population. Ground every statement in 2-3 high-quality sources or clinical guidelines.

This constraint forces you to identify what matters most. You cannot include everything, so you must decide what the reviewer absolutely needs to understand about the clinical context. This decision process is the synthesis that literature dumps lack.

The clinical context sets the stage for everything that follows. A reviewer who understands the condition, the setting, and the population is prepared to evaluate whether your device makes sense.

Key Insight
Six lines is a forcing function. If you cannot summarize the clinical context in six lines, you do not understand it well enough to write an effective SOTA.

Step 2: Comparators and Benchmarks

List the currently used tools and methods for addressing this clinical need. For each comparator, document reported performance metrics and any known safety or usability limitations. Consolidate everything into a single reference table.

This table becomes your benchmark. When you later claim your device performs at a certain level, reviewers will compare against this table. When you argue your device addresses unmet needs, they will check this table to verify those needs exist.

Be comprehensive but focused. Include established devices, emerging technologies, and non-device alternatives like clinical judgment or wait-and-see approaches. The goal is a complete picture of how this clinical need is currently addressed.

Five-Step SOTA Method

1
Step 1: Clinical Context
2
Step 2: Comparators & Benchmarks
3
Step 3: Device Implications
4
Step 4: Gaps & Uncertainties
5
Step 5: Acceptance Criteria

Step 3: Device Implications

Now translate your findings into implications for your device. From your benchmark analysis, extract minimum acceptable performance thresholds. Identify areas where your device needs heightened performance due to risk considerations. Note workflow-compatible timelines and usability requirements.

This step is where SOTA connects to your clinical evaluation strategy. The benchmarks become the targets. The gaps become the opportunities. The limitations of current approaches inform what your device needs to do differently.

Common Mistake
Stopping at Step 2. Many SOTA sections present excellent benchmark data but never explain what that data means for the device being evaluated. Implication is where synthesis happens.

Step 4: Gaps and Uncertainties

Document what you do not know. Identify underrepresented populations in the literature. Note insufficient external validation evidence for certain claims. Flag weak reference standards that limit the strength of published performance data.

For each gap, link to a planned activity in your Clinical Evaluation Plan. Gaps without plans are problems. Gaps with plans are acknowledged limitations being addressed.

This step demonstrates intellectual honesty. No SOTA is complete. No evidence base is perfect. Acknowledging limitations strengthens your evaluation because it shows you understand the boundaries of current knowledge.

Step 5: Acceptance Criteria

Define the performance targets your device must meet based on everything above. Specify the datasets and analytical methods you will use to verify these targets. Establish monitoring protocols for detecting performance drift over time.

Your acceptance criteria should trace directly to your benchmark analysis. If you claim sensitivity of 90%, the SOTA should show that 90% is appropriate given current alternatives. If you claim faster results, the SOTA should define what speed the market currently achieves.

Key Insight
Acceptance criteria defined without SOTA analysis are arbitrary. Criteria derived from SOTA analysis are defensible. Reviewers know the difference.

Putting It Together

The five steps create a complete SOTA narrative:

Here is the clinical problem (Step 1). Here is how it is currently addressed (Step 2). Here is what that means for our device (Step 3). Here is what we do not know yet (Step 4). Here is what we will demonstrate (Step 5).

This narrative answers every question a reviewer will ask about your clinical context. It provides the foundation for every claim you will make in your clinical evaluation. And it creates clear traceability from evidence to conclusions.

In the next post, we will dive deeper into Step 5: how to set acceptance criteria that are both rigorous and achievable.

Peace,
Hatem
Your Clinical Evaluation Partner

Frequently Asked Questions

Can the five-step method be applied to any device type?

Yes. The method works for implants, diagnostics, software, and everything in between. The content of each step changes based on the device and clinical context, but the structure remains consistent.

How do I handle limited literature for novel devices?

Focus Step 2 on how the clinical need is currently addressed without devices. Document non-device alternatives, clinical judgment approaches, and the consequences of unmet need. Step 4 becomes especially important for documenting evidence gaps.

Should acceptance criteria always match or exceed benchmarks?

Not necessarily. Criteria should be clinically appropriate for the intended use. Sometimes matching is sufficient. Sometimes exceeding is necessary. The key is that criteria are justified by the SOTA analysis and the device’s specific claims.

Series: State of the Art Mastery

Part 2 of 5

Coming Soon

Setting Acceptance Criteria From Your SOTA Analysis

Need Expert Help with Your Clinical Evaluation?

Get personalized guidance on MDR compliance, CER writing, and Notified Body preparation.

Peace, Hatem

Your Clinical Evaluation Partner

Follow me for more insights and practical advice.

References:
– MDCG 2020-6: Sufficient Clinical Evidence
– MDCG 2020-1: Guidance on Clinical Evaluation for Medical Device Software
– MEDDEV 2.7/1 Rev 4