PDA answered the U.S. FDA’s Center for Drug Evaluation and Research (CDER) call for help in identifying quality metrics that can be used for the Center’s new drug quality enforcement initiative by connecting people, science, and regulation.

That call came in a February 2013 Federal Register announcement in which FDA explained how it intends to implement Sec. 1003 of the Food and Drug Administration Safety and Innovation Act (FDASIA) of 2012 (1). Sec. 1003 of the new law amends the Federal Food, Drug, and Cosmetic Act by requiring the Agency to form a task force to develop and implement a strategic plan for enhancing its response to preventing and mitigating drug shortages.

As part of this strategy, FDA explained its intention to address the major underlying causes of drug and biological product shortages, which over the last several years have largely resulted from quality-related manufacturing shutdowns.

FDA, therefore, is seeking new ideas to encourage high-quality manufacturing and to facilitate expansion of manufacturing capacity (see the sidebar for more details from the Federal Register announcement). To help with the former, FDA requested input on how drug companies currently employ manufacturing quality metrics. 
In response to that Federal Register announcement, PDA formed an 11-member volunteer task force. This group issued comments to FDA on March 13 that included a discussion of 15 quality metrics commonly used by manufacturers, as well as answers to other questions posed in the announcement (2).

Most importantly, the comments team informed FDA that it would be willing to facilitate dialogue between the Agency and industry on the subject of manufacturing and product quality metrics. Over the next several months, the PDA Pharmaceutical Quality Metrics Committee worked with CDER officials to develop an interactive conference and to summarize the dialogue in a Points to Consider (PtC) document.

On Dec. 9–10, 2013, over 300 industry experts on drug product quality and manufacturing, representing 150 companies, assembled to participate in the 2013 PDA Pharmaceutical Quality Metrics Conference in Bethesda, Md. The attendees covered a wide range of functional responsibilities such as quality, engineering, manufacturing, technical services and regulatory affairs. Virtually every sector of the industry, both domestic and overseas, was present, including generics, OTC, CMOs, and pharmaceutical and biotech companies that manufacture large and small molecule APIs and drug products.

This strong showing of support for the FDA initiative was well-received by CDER Director Janet Woodcock, who took the podium in the closing session to thank PDA and discuss the need to press forward with the metrics initiative.

“This is really important,” Woodcock said. “We are having an ongoing dialogue about this issue of metrics. I was able to come and listen to the report-out from the polls and breakout sessions. I was very intrigued by both the engagement and what people actually said about what is going on. It gave me a lot of hope that we can really make this happen.”

Feedback gained during the interactive workshop, which afforded attendees the opportunity to vote on metrics categories they deemed useful and suggest metrics not presented in advance by the PDA Pharmaceutical Quality Metrics Committee, assisted the in the completion of the PtC document, which PDA submitted to the FDA on Dec. 19, 2013 (3).

In closing the conference, PDA President Richard Johnson assured participants that the feedback received greatly helped the committee refine the PtC. “Whatever the team was thinking before the meeting, I can assure you it is different today,” he said. “If it was easy, we wouldn’t need a meeting.”

The PtC expresses PDA’s overall support of FDA’s effort to use quality metrics as important tools:

PDA recognizes FDA’s intent is to establish metrics with clinical relevance to patients which will also move towards a more proactive quality assessment model for companies. PDA also understands the objective is to move organizations from assessing primarily against compliance standards to assessment based on quality performance against established clinically relevant specifications and driving continual improvement.

Drawing from the discussions at the metrics workshop, the committee outlined many important factors that “must be balanced” for FDA to achieve its objectives. For instance, identifying and defining “leading metrics” (harder to define but more useful) versus “lagging metrics” (more commonly used today). The committee envisions a time in the future when industry would more widely adopt leading indicators, demonstrating a commitment to the ICH Q10 principle of continuous improvement. Use of leading indicators is necessary to improve prediction and mitigation of potential drug shortages especially in increasingly complex manufacturing process and supply chain environments, the committee wrote.

The committee recommends specific metrics for FDA collection, broken down as trend metrics per product and trend metrics per site. The former includes confirmed product quality complaint rate by product and batch reject rate by product. The latter includes confirmed OOS rate (drug substance and drug product) by site.

The document also highlights useful site and product-specific metrics identified at the conference as important, but difficult to compare. Process capability and CAPA effectiveness rate are examples of these.

The PtC includes advice on comparing metrics. Data trends of metrics are more reliable predictors of potential risk than single values, the team wrote. They provided examples to support their claim. 
The document also includes a section on “direct comparison metrics”—in acknowledgement of FDA’s request for absolute value and trends of metrics appropriate for direct comparison between products and manufacturing sites. If the Agency takes that approach, the team recommends limiting it to two product metrics and one site metric reported annually.

In the conclusion, the team warns against just comparing numbers in order to achieve FDA’s goal of objective measures of product quality, site operations quality, and site systems performance. The conclusion also warns against unintended consequences of metrics collections.

The committee also suggests in the PtC document possible additional activities PDA could pursue in 2014 to help FDA develop the pharmaceutical quality metrics program. They also suggest that FDA could consider offering companies that demonstrate a commitment to quality performance “preferred opportunities,” such as “preferred handling” of postapproval changes to submissions that enhance system/process capabilities and less frequent inspections.

Johnson pledged that PDA “will invite and try to work with other organizations in the coming year to harmonize specifically some definitions of some of these metrics so as we move forward at least that is not a barrier.”

Finally, Johnson indicated that PDA is considering a follow-up Pharmaceutical Quality Metrics Conference in 2014.

References

1. Department of Health and Human Services, Food and Drug Administration. Food and Drug Administration Drug Shortages Task Force and Strategic Plan; Request for Comments; Federal Register, 2013, 78(29), 9928-9929. www.gpo.gov (accessed January 6, 2014)
2. PDA Comments on FDA Drug Shortages Strategic Plan Docket No. FDA-2013-N-0124; Parenteral Drug Association, Inc.: March 13, 2013. www.pda.org/Science-and-Regulatory-Affairs/RAQAB/Regulatory-Comments-Resources/2013-PDA-Regulatory-Comments/Final-Submission-of-PDA-Comments-on-FDAs-Draft-Drug-Shortages-Strategic-Plan-March-13-2013.aspx (accessed January 6, 2014)
3. PDA Points to Consider: Pharmaceutical Quality Metrics; Parenteral Drug Association, Inc.: Dec 19, 2013. www.pda.org/pdf-1/PDA-Pharmaceutical-Quality-Metrics.aspx (accessed January 6, 2014)