The over-engineered protocol problem.
A sponsor recently asked us to revise a quote on a pre-pivotal validation study. The protocol had grown in scope by a factor of three. We quoted it as written. Then we told them the truth.
A sponsor recently sent us a revised request for quotation on a pre-pivotal biomarker validation study. The original design was simple — a single-visit collection of samples from pre-diagnosed pediatric subjects, with bulk frozen shipment to the sponsor's central lab. The revision turned that design into something different. Universal application of a specialist diagnostic assessment that takes a half-day per subject. Re-diagnosis on enrollment. A central adjudication panel. Controlled-ambient real-time international shipping within seven days of collection. The validation had become a small pivotal trial.
We quoted it as written. The number was between $1.9 million and $2.25 million, against an original quote in the range of $700,000 to $900,000. The timeline extended from six months to nine, possibly twelve. We told the sponsor we were happy to execute the study they had described. Then we told them what we actually thought, which is that the study they had described was the wrong study to run.
The revised protocol had been written in the language of regulatory rigor — and most of it sounded right. Universal specialist assessment removes diagnostic ambiguity. Central adjudication strengthens the reference standard. Real-time shipping preserves sample integrity. Each addition, defended individually, made sense. The problem was that none of those defenses asked the prior question: what is this validation for?
The job of a pre-pivotal validation is narrow. It exists to confirm the assay performs against intended-use samples at scale, to surface the operational issues that will appear in the pivotal, and to produce a clean dataset that anchors a pre-submission to FDA. It is not the pivotal trial. It is not a substitute for the pivotal trial. It is the scaffolding that makes the pivotal trial possible — and good scaffolding is sized to its load, not over-built against a load that is not coming.
What was happening in the revised protocol, on a closer read, was that someone — a regulatory consultant, a clinical advisor, a member of the team who had recently come from a different sponsor — had imported the reference standards from a prior cleared submission and applied them universally, without asking whether the prior submission's drivers applied here. The cleared submission they were working from had targeted a difficult diagnostic age band and had needed the universal specialist assessment to support an early-diagnosis claim. The current study targeted a wider age band with a different claim. The driver did not transfer. Neither did the procedural overhead that came with it.
This pattern recurs. Sponsors do not over-engineer because they want to spend more money or move more slowly. They over-engineer because they are hedging — usually well-intentionedly — against regulatory risk they cannot precisely characterize. The instinct is, "if a similar prior study did all these things, we should do all these things." The instinct is wrong, but it is reasonable. The fix is not to lecture the sponsor about scope. The fix is to ask, requirement by requirement, what scientific work each one is actually doing on this study, and to remove the ones that are doing none.
We pulled U.S. claims data. The specialist assessment in question, we found, is performed on a small share of patients with the relevant diagnosis in routine clinical care — well below the rate at which the protocol would have to perform it to enroll on schedule. Requiring it universally would have collapsed the eligible patient pool. The protocol, as written, was unenrollable, and the over-engineering was not just an additional cost. It was the load-bearing failure mode of the entire study.
This is the part that sponsors find counterintuitive. The conservative protocol, written to hedge against regulatory risk, produces a worse regulatory profile, not a better one. A validation that fails to enroll is a validation whose data is thin, whose timelines slip, and whose pivotal — designed against the validation that did get done — inherits the same recruitment failure mode at a larger scale. The hedge does not protect against regulatory risk. It transfers regulatory risk into recruitment risk, where it is harder to see and more expensive to fix.
The right move at the validation stage is the one that sounds least like rigor. Strip the protocol back to the core question. Run a pre-submission with FDA before the validation locks, not after, and let the agency's actual concerns — not the team's imagined ones — drive the design. Accept that the pivotal will need the procedural infrastructure the validation does not. Build the validation against what is enrollable in the patient population the assay is meant to serve, anchored to U.S. claims utilization rather than to hedged prior-submission analogues.
The sponsor in this case has a real choice to make. They can run the protocol as drafted, at the higher cost and longer timeline, and produce a smaller validation dataset than the protocol intended because the eligible pool will not support it. Or they can pull the protocol back, run a pre-submission, and produce a larger, faster validation that earns FDA's input on the pivotal before any of the pivotal-grade infrastructure has been built. The regulatory profile is stronger under the second path, not the first.
None of this is a critique of the sponsor. They acted in good faith on advice that defended every individual addition to the protocol on its own merits. The trap is that a protocol can be conservative on every individual axis and unenrollable on the whole — and that the unenrollable whole is invariably worse for the regulatory pathway than the smaller, sharper alternative. The CRO's job is to surface that trap before the contract is signed, not after the recruitment numbers come in.
Disclosures & references
- This piece reflects our experience across more than 300 IVD studies since 2011. The specific engagement that prompted it is not named.
- U.S. claims data referenced reflects standard medical claims analytics for the relevant indication and procedure codes. Specific utilization figures have been generalized to protect both commercial and patient confidentiality.
- "Pre-submission" refers to the FDA Q-submission program (Q-Sub), under which sponsors can request agency feedback on study design, regulatory pathway, and submission content prior to formal filing.
- This piece is opinion. It does not constitute regulatory advice. Sponsors should consult their own regulatory counsel before making study-design decisions.