Those who have been reading this blog know that I like to analyze collections of documents at FDA to discern, using natural language processing, whether, for example, the agency takes more time to address certain topics than others. This month, continuing the analysis I started in my October post regarding device-related citizens petitions, I used topic modeling on the citizens petitions to see which topics are most frequent, and whether there are significant differences in the amount of time it takes for FDA to make a decision based on the topic.

Discerning the Topics

As you probably ...

Our latest focus is trying to bring data to bear on common questions we get asked by clients.  Last month the topic was: how well does my device need to perform to get premarket clearance from FDA?  This month it is: how big does my sample size need to be for any necessary clinical trial for premarket clearance? 

To date, our typical answer has been, it depends.[1]  We then explain that it’s not really a regulatory question, but a question for a statistician that is driven by the design of the clinical trial.  And the design of the clinical trial is driven by the question the clinical trial is trying ...

On October 31, 2023, FDA hosted a webinar to address some of the frequently asked questions the agency has received since the September 29, 2023 release of its proposed rule on laboratory developed tests (“LDTs”). The materials from the webinar are available on FDA’s CDRH Learn webpage. Importantly, FDA announced during the webinar that the agency does not currently plan to extend the comment period for the proposed rule beyond the standard 60-day timeframe, and therefore, comments are still due on Monday December 4, 2023. In both the preamble to the proposed rule and stated ...

This month I wanted to take a data-driven look at FDA’s treatment of citizen petitions, and specifically as a starting point how quickly the agency resolves those petitions.  Make no mistake, I have an interest in this topic.  Over the more than 35 years I have been practicing law, I have filed multiple petitions including a 1995 petition that successfully caused FDA to adopt Good Guidance Practices.  But more recently, specifically on February 6, 2023, I filed a citizen petition asking FDA to rescind its final guidance on Clinical Decision Support Software.[1]  On August 5, 2023, when we ...

In a last minute push before an anticipated government shutdown, FDA put down its marker for moving forward toward regulation of lab developed tests (“LDTs”). Unlike past proposals from FDA and Capitol Hill, FDA has taken a simple approach: laboratories that make LDTs for clinical use are manufacturing in vitro diagnostic medical devices (“IVDs”) for commercial distribution, and as such must eventually comply with FDA’s already-established IVD requirements. The FDA zeitgeist boils down to this: It doesn’t matter if the lab is large or small, for profit or ...

It’s common for a client to show up at my door and explain that they have performance data on a medical device they have been testing, and for the client to ask me if the performance they found is adequate to obtain FDA clearance through the 510(k) process. I often respond, very helpfully, “it depends.” But for some reason clients aren’t completely satisfied by that.

I then volunteer that a general rule of thumb is 95%, but that this is just a rule of thumb. For Class II medical devices undergoing review through the 510(k) process, the legal standard is that the applicant must show that ...

Introduction

Hardly a day goes by when we don’t see some media report of health care providers experimenting with machine learning, and more recently with generative AI, in the context of patient care. The allure is obvious. But the question is, to what extent do health care providers need to worry about FDA requirements as they use AI?

As discussed in our June Insight, earlier this year FDA publicly announced its development of a proposed rule that would expressly define laboratory developed tests (“LDTs”) as medical devices and subject them to the agency’s regulatory authority. Such a rule would be FDA’s first comprehensive attempt to impose its authority over LDTs since its 2014 draft guidance, which FDA ultimately chose not to finalize, and comes after several failed congressional legislative attempts to do the same.

Recently Colleen and Brad had a debate about whether Medical Device Reports (“MDRs”) tend to trail recalls, or whether MDRs tend to lead to recalls. Both Colleen and Brad have decades of experience in FDA regulation, but we have different impressions on that topic, so we decided to inform the debate with a systematic look at the data. While we can both claim some evidence in support of our respective theses based on the analysis, Brad must admit that Colleen’s thesis that MDRs tend to lag recalls has the stronger evidence. We are no longer friends. At the same time, the actual data didn’t really fit either of our predictions well, so we decided to invite James onto the team to help us figure out what was really going on. He has the unfair advantage of not having made any prior predictions, so he doesn’t have any position he needs to defend.

Introduction

Let’s say FDA proposed a guidance document that would change the definition of “low cholesterol” for health claims.  Now let’s say that when FDA finalized the guidance, instead of addressing that topic, FDA banned Beluga caviar.  If you are interested in Beluga caviar, would you think you had adequate opportunity to comment?  Would you care if FDA argued that Beluga caviar was high in cholesterol so the two documents were related?

It is certainly easy, when writing code to accomplish some data science task, to start taking the data on face value.  In my mind, the data can simply become what they claim to be.  But it’s good to step back and remember the real world in which these data are collected, and how skeptical we need to be regarding their meaning.  I thought this month might be an opportunity to show how two different FDA databases produce quite different results when they should be the same.

Over the spring and summer, I did a series of posts on extracting quality information from FDA enforcement initiatives like warning letters, recalls, and inspections.  But obviously FDA enforcement actions are not the only potential sources of quality data that FDA maintains.  FDA has what is now a massive data set on Medical Device Reports (or “MDRs”) that can be mined for quality data.  Medical device companies can, in effect, learn from the experiences of their competitors about what types of things can go wrong with medical devices.

The problem, of course, is that the interesting data in MDRs is in what a data scientist would call unstructured data, in this case English language text describing a product problem, where the information or insights cannot be easily extracted given the sheer volume of the reports.  In calendar year 2021, for example, FDA received almost 2 million MDRs.  It just isn’t feasible for a human to read all of them.

That’s where a form of machine learning, natural language processing, or more specifically topic modeling, comes in.  I used topic modeling last November for a post about major trends over the course of a decade in MDRs.  Now I want to show how the same topic modeling can be used to find more specific experiences with specific types of medical devices to inform quality improvement.

A private equity client asked us recently to assess a rumor that FDA was on the warpath in enforcing the 510(k) requirement on medical devices from a particular region.  Such a government initiative would significantly deter investments in the companies doing the importing.  Turns out, the agency was not.  The FDA’s recent activities in the region were well within their historical norms.

But the project got us thinking, what does the agency’s enormous database on import actions tell us about the agency’s enforcement priorities more generally?  There are literally thousands of ways to slice and dice the import data set for insights, but we picked just one as an example.  We wanted to assess, globally, over the last 20 years, in which therapeutic areas has FDA been enforcing the 510(k) requirement most often?

Recalls have always been a bit of a double-edged sword.  Obviously, companies hate recalls because a recall means their products are defective in some manner, potentially putting users at risk and damaging the brand.  They are also expensive to execute.  But a lack of recalls can also be a problem, if the underlying quality issues still exist but the companies are simply not conducting recalls.  Recalls are necessary and appropriate in the face of quality problems.

Thus, in terms of metrics, medical device companies should not adopt as a goal reducing recalls, as that will lead to behavior that could put users at risk by leaving bad products on the market.  Instead, the goal should be to reduce the underlying quality problems that might trigger the need for recall.

What are those underlying quality problems?  To help medical device manufacturers focus on the types of quality problems that might force them to conduct a recall, we have used the FDA recall database to identify the most common root causes sorted by the clinical area for the medical device.

Overview

In this month’s post, in the medical device realm I explore what kinds of inspection citations most often precede a warning letter.  In this exercise, I do not try to prove causation.  I am simply exploring correlation.  But with that caveat in mind, I think it’s still informative to see what types of inspectional citations, in a high percentage of cases, will precede a warning letter.  And, as I’ve said before, joining two different data sets – in this case inspectional data with warning letter data – might just reveal new insights.

On February 15, 2019, the U.S. Food and Drug Administration (“FDA”) finalized two guidance documents regarding regenerative medicine therapies (see FDA’s announcement here). This development comes nearly 14 months after FDA issued both guidance documents in draft form, which also coincided with FDA’s announcement of a new comprehensive regenerative medicine policy framework intended to spur innovation and efficient access to new regenerative medicine products.

FDA Commissioner Scott Gottlieb remarked that the finalization of regenerative therapy guidance ...

On October 18, 2018, the FDA published Content of Premarket Submissions for Management of Cybersecurity in Medical Devices.  This guidance outlined recommendations for cybersecurity device design and labeling as well as important documents that should be included in premarket approval submissions.  This guidance comes at a critical time as the healthcare industry is a prime target for hackers.  On January 22, 2019, the U.S. Department of Homeland Security Industrial Control System Cyber Emergency Team (US-CERT) issued another advisory regarding medical device ...

The federal government entered into a partial shutdown at midnight on Saturday, December 22, 2018. The implications of the ongoing shutdown are far-reaching, but its impact on the Food and Drug Administration (“FDA”) is of particular concern to members of FDA-regulated industries and those with a role in ensuring the public health. Thousands of FDA employees considered non-essential were furloughed and, consequently, routine regulatory and compliance activities at FDA were put on hold. On his Twitter account (@SGottliebFDA), Scott Gottlieb, M.D., Commissioner of the FDA ...

On December 7, 2018, the U.S. Food and Drug Administration (“FDA”) published a proposed rule (“Proposed Rule”) that, if finalized, would clarify the de novo classification process for medical devices, including (1) the format and contents of a de novo request and (2) the criteria for accepting or denying a de novo request. FDA intends to “enhance regulatory clarity and predictability... [and] provide a regulatory framework that sets clear standards, expectations and processes for de novo classification” through this proposed rulemaking.[1]

FDA regulates medical ...

The Federal Trade Commission ("FTC") and the Antitrust Division of the Department of Justice ("Antitrust Division") released their respective year-end reviews highlighted by aggressive enforcement in the health care industry. The FTC, in particular, indicated that 47% of its enforcement actions during calendar year 2016 took place in the health care industry (including pharmaceuticals and medical devices). Of note were successful challenges to hospital mergers in Pennsylvania (Penn State Hershey Medical Center and Pinnacle Health System), and Illinois (Advocate Health ...

On May 17, 2016, FDA issued Draft Guidance for Industry on Use of Electronic Health Record Data in Clinical Investigations ("Draft Guidance").  This Draft Guidance builds on prior FDA guidance on Computerized Systems Used in Clinical Investigations and Electronic Source Data in Clinical Investigations, and provides information on FDA's expectations for the use of Electronic Health Record ("EHR") data to clinical investigators, research institutions and sponsors of clinical research on drugs, biologics, medical devices and combination products conducted under an ...

The Food and Drug Administration ("FDA") recently announced that it will be hosting a public workshop on October 21 and 22, 2014, in Arlington, Virginia, entitled "Collaborative Approaches for Medical Device and Healthcare Cybersecurity."

Officials from FDA, the Department of Health and Human Services ("HHS"), and the Department of Homeland Security ("DHS") will bring together medical device manufacturers, insurers, cybersecurity researchers, trade organizations, government officials, and other stakeholders to discuss the numerous challenges faced in medical device ...

by Wendy C. Goldstein and Kathleen A. Peterson

On December 27, 2011, the U.S. Food & Drug Administration ("FDA"), Office of Prescription Drug Promotion ("OPDP") (formerly the Division of Drug Marketing, Advertising, and Communications) released a new draft guidance document titled "Guidance for Industry on Responding to Unsolicited Requests for Off-Label Information About Prescription Drugs and Medical Devices" (the "Draft Guidance"). The OPDP will accept comments on the Draft Guidance through March 29, 2011.

The FDA has a longstanding policy of permitting ...