K Number
K031943
Date Cleared
2003-08-06

(43 days)

Product Code
Regulation Number
866.1645
Reference & Predicate Devices
Predicate For
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

The BD Phoenix™ Automated Microbiology System is intended for the rapid identification and in vitro antimicrobial susceptibility testing of isolates from pure culture of most aerobic and facultative anaerobic Gram-negative and Gram-positive bacteria of human origin.

The BD Phoenix™ Automated Microbiology System is intended for in vitro quantitative determination of antimicrobial susceptibility by minimal inhibitory concentration (MIC) of most Gram-negative acrobic and facultative anaerobic bacteria isolates from pure culture for Enterobacteriaceae and Non-Enterobacteriaceae and most Gram-positive bacteria isolates from pure culture belonging to the genera Staphylococcus and Enterococcus.

This premarket notification is for the antimicrobial agent cephalothin at concentrations of 1-64 ug/mL to Gram-negative ID/AST or AST only Phoenix panels. cephalothin has been shown to be active in vitro against most strains of microorganisms listed below, as described in the FDA-approved package insert for this antimicrobial agent.

Device Description

The BD Phoenix Automated Microbiology System (Phoenix System) is an automated system for the rapid identification (ID) and antimicrobial susceptibility testing (AST) of clinically relevant bacterial isolates. The system includes the following components:

  • BD Phoenix instrument and software.
  • BD Phoenix panels containing biochemicals for organism ID testing and antimicrobial agents . for AST determinations.
  • BD Phoenix ID Broth used for performing ID tests and preparing AST Broth inoculum. .
  • BD Phoenix AST Broth used for performing AST tests only.
  • . BD Phoenix AST Indicator solution added to the AST Broth to aid in bacterial growth determination.

The Phoenix panel is a sealed and self-inoculating molded polystyrene tray with 136 micro-wells containing dried reagents. Organisms for susceptibility testing must be a pure culture and preliminarily identified as a Gram-negative or Gram-positive isolate. For each isolation equivalent to a 0.5 McFarland standard is prepared in Phoenix ID Broth.

The Phoenix AST method is a broth based microdilution test. The Phoenix System utilizes a redox indicator for the detection of organism growth in the presence of an antimicrobial agent. Measurements of changes to the indicator as well as bacterial turbidity are used in the determination of bacterial growth. Each AST panel configuration contains several antimicrobial agents with a wide range of two-fold doubling dilution concentrations.

The instrument houses the panels where they are continuously incubated at a nominal temperature of 35°C. The instrument takes readings of the panels every 20 minutes. The readings are interpreted to give an identification of the isolate, minimum inhibitory concentration (MIC) values and category interpretations, S, I, or R (sensitive, intermediate, or resistant).

AI/ML Overview

Here's a breakdown of the acceptance criteria and study information for the BD Phoenix™ Automated Microbiology System for Cephalothin, based on the provided 510(k) summary:

1. Table of Acceptance Criteria and Reported Device Performance

The study compares the BD Phoenix™ System's performance to the NCCLS reference broth microdilution method. The acceptance criteria are implicitly based on the FDA Draft guidance document, "Guidance on Review Criteria for Assessment of Antimicrobial Susceptibility Devices", March 8, 2000, which requires demonstration of "substantially equivalent performance". The key metrics are Essential Agreement (EA) and Category Agreement (CA). While specific numerical thresholds for acceptance (e.g., >90% EA and CA) aren't explicitly stated in the summary, these are typical industry standards for demonstrating substantial equivalence.

Metric (Acceptance Criteria)Reported Device Performance (Cephalothin - Gram-negative Organisms)
Essential Agreement (EA)95.9% (on 1206 isolates)
Category Agreement (CA)82.8% (on 1206 isolates)
Intra-site reproducibility>90%
Inter-site reproducibility>95%

2. Sample size used for the test set and the data provenance

  • Sample Size for Test Set: 1206 isolates (combining clinical, stock, and challenge isolates).
  • Data Provenance: The isolates were tested "across multiple geographically diverse sites across the United States". This indicates prospective data collection from clinical settings, supplemented by stock and challenge isolates.

3. Number of experts used to establish the ground truth for the test set and the qualifications of those experts

The ground truth was established by the NCCLS reference broth microdilution method. This is a standardized laboratory procedure, not an expert consensus. Therefore, the concept of "number of experts" and "qualifications of experts" as typically applied to image analysis or diagnostic interpretation does not directly apply here. The experts involved would be laboratory personnel skilled in performing and interpreting the NCCLS method accurately.

4. Adjudication method for the test set

Not applicable. The ground truth is established by a standardized reference method (NCCLS broth microdilution), not through human interpretation requiring adjudication.

5. If a multi reader multi case (MRMC) comparative effectiveness study was done, If so, what was the effect size of how much human readers improve with AI vs without AI assistance

No, an MRMC comparative effectiveness study was not done. This device is an automated system for antimicrobial susceptibility testing, not an AI-assisted diagnostic tool that relies on human readers. The comparison is between an automated system and a reference laboratory method, not between human readers with and without AI assistance.

6. If a standalone (i.e. algorithm only without human-in-the-loop performance) was done

Yes, this was a standalone study. The BD Phoenix™ Automated Microbiology System is itself an automated system ("algorithm only") that performs the susceptibility testing and provides interpretations (MIC values and S, I, or R categories) without direct human intervention in the interpretation phase for each reading. Its performance was compared directly to a "reference method" (NCCLS).

7. The type of ground truth used

The ground truth used was the NCCLS reference broth microdilution method. This is a widely accepted, standardized laboratory method for determining antimicrobial susceptibility.

8. The sample size for the training set

The document does not specify the sample size for a training set. This is a premarket notification (510(k)) that focuses on demonstrating substantial equivalence to a predicate device, rather than the internal development and training of the algorithm itself. It's common for 510(k) summaries to focus on validation rather than the details of initial development.

9. How the ground truth for the training set was established

Not specified, as the training set details are not provided. However, given the nature of the device, it's highly probable that any internal training or development would have relied on established reference methods (like NCCLS) or internal challenge strains with known susceptibility profiles.

{0}------------------------------------------------

510(K) SUMMARY

AUG 0 6 2003

SUBMITTED BY:Becton, Dickinson and Company7 Loveton CircleSparks, MD 21152Phone: (410) 316-4287Fax: 410-316-4499
CONTACT NAME:Monica Evelyn GiguereRegulatory Affairs Specialist
DATE PREPARED:June 20, 2003
DEVICE TRADE NAME:BD Phoenix™ Automated Microbiology System -Cephalothin 1-64 µg/mL /
DEVICE COMMON NAME:Antimicrobial susceptibility test system-short incubation
DEVICE CLASSIFICATION:Fully Automated Short-Term Incubation Cycle AntimicrobialSusceptibility Device, 21 CFR 866.1645
PREDICATE DEVICES:VITEK® System (PMA No. N50510) and BD Phoenix™Automated Microbiology System with Gatifloxacin (K020321May 23, 2002), Ofloxacin (K020323, April 14, 2002), andLevofloxacin (K020322, March 27, 2002).
INTENDED USE:The BD Phoenix™ Automated Microbiology System isintended for the rapid identification and in vitro antimicrobialsusceptibility testing of isolates from pure culture of mostaerobic and facultative anaerobic Gram-negative and Gram-positive bacteria of human origin.

DEVICE DESCRIPTION:

The BD Phoenix Automated Microbiology System (Phoenix System) is an automated system for the rapid identification (ID) and antimicrobial susceptibility testing (AST) of clinically relevant bacterial isolates. The system includes the following components:

  • BD Phoenix instrument and software.
  • BD Phoenix panels containing biochemicals for organism ID testing and antimicrobial agents . for AST determinations.
  • BD Phoenix ID Broth used for performing ID tests and preparing AST Broth inoculum. .
  • BD Phoenix AST Broth used for performing AST tests only.
  • . BD Phoenix AST Indicator solution added to the AST Broth to aid in bacterial growth determination.

{1}------------------------------------------------

The Phoenix panel is a sealed and self-inoculating molded polystyrene tray with 136 micro-wells containing dried reagents. Organisms for susceptibility testing must be a pure culture and preliminarily identified as a Gram-negative or Gram-positive isolate. For each isolation equivalent to a 0.5 McFarland standard is prepared in Phoenix ID Broth.

The Phoenix AST method is a broth based microdilution test. The Phoenix System utilizes a redox indicator for the detection of organism growth in the presence of an antimicrobial agent. Measurements of changes to the indicator as well as bacterial turbidity are used in the determination of bacterial growth. Each AST panel configuration contains several antimicrobial agents with a wide range of two-fold doubling dilution concentrations.

The instrument houses the panels where they are continuously incubated at a nominal temperature of 35°C. The instrument takes readings of the panels every 20 minutes. The readings are interpreted to give an identification of the isolate, minimum inhibitory concentration (MIC) values and category interpretations, S, I, or R (sensitive, intermediate, or resistant).

DEVICE COMPARISON:

The BD Phoenix™ Automated Microbiology System demonstrated substantially equivalent performance when compared with the NCCLS reference broth microdilution method. This premarket notification provides data supporting the use of the BD Phoenix™ Automated Microbiology System Gram-negative ID/AST or AST only Phoenix panels with this antimicrobial agent.

SUMMARY OF SUBSTANTIAL EQUIVALENCE TESTING:

The BD Phoenix™ Automated Microbiology System has demonstrated substantially equivalent performance when compared to the NCCLS reference broth microdilution method (AST panels prepared according to NCCLS M7). The system has been evaluated as defined in the FDA Draft guidance document, "Guidance on Review Criteria for Assessment of Antimicrobial Susceptibility Devices", March 8, 2000.

Site Reproducibility

Intra- and inter-site reproducibility of this antimicrobial agent in the BD Phoenix System was evaluated at three sites using a panel of Gram-negative isolates. Each site tested the isolates in triplicate on three different days using one lot of Gram-negative Phoenix panels containing this antimicrobial agent and associated reagents.

The results of the study demonstrate for the this antimicrobial agent there was an overall intra-site reproducibility of greater than 90% and an overall inter-site reproducibility greater than 95% for the Gram-negative isolates tested.

{2}------------------------------------------------

Clinical Studies

Clinical, stock and challenge isolates were tested across multiple geographically diverse sites across the United States to demonstrate the performance of the Phoenix antimicrobial susceptibility test with the Gram-negative Phoenix panel format containing this antimicrobial agent. Phoenix System results for Challenge set isolates were compared to the expected results. Phoenix System results for clinical isolates were compared to the results obtained from the NCCLS reference broth microdilution method.

The performance of the Phoenix System was assessed by calculating Essential Agreement (EA) and Category Agreement (CA) to expected/reference results for all isolates tested. Essential Agreement (EA) occurs when the BD Phoenix™ Automated Microbiology System agrees exactly or within + one two-fold dilution to the reference result. Category Agreement (CA) occurs when the BD Phoenix™ Automated Microbiology System agrees with the reference method with respect to the FDA categorical interpretive criteria (susceptible, intermediate, and resistant).

Table 1 summarizes the performance for the isolates tested in this study.

Table 1: Performance of BD Phoenix System for Gram-negative Organisms by Drug

AntimicrobialConcentrationEA (n)EA (%)CA (n)CA (%)
Cephalothin1-64 $µg/mL$120695.9120682.8

Conclusions Drawn from Substantial Equivalence Studies

The data collected from the substantial equivalence studies demonstrate that testing on the BD Phoenix™ Automated Microbiology System with this antimicrobial agent is substantially equivalent as outlined in the FDA draft guidance document, "Guidance on Review Criteria for Assessment of Antimicrobial Susceptibility Devices", March 8, 2000. Technological characteristics of this system are substantially equivalent to those used in the VITEK® system, which received approval by the FDA under PMA number N50510 and BD Phoenix™ Automated Microbiology System with Gatifloxacin (K020321, May 23, 2002), Ofloxacin (K020323, April 14, 2002), and Levofloxacin (K020322, March 27, 2002).

{3}------------------------------------------------

DEPARTMENT OF HEALTH & HUMAN SERVICES

Image /page/3/Picture/1 description: The image shows an abstract drawing with a combination of straight and curved lines. On the right side of the image, there are four thick, dark lines that are mostly straight but have a slight curve at the bottom. To the left of these lines, there is a cluster of small, dark dots that appear to be scattered randomly. The overall composition is simple, with a focus on the contrast between the structured lines and the scattered dots.

Public Health Service

AUG - 6 2003

od and Drug Administr 2098 Gaither Road Rockville MD 20850

Ms. Monica Evelyn Giguere Regulatory Affairs Specialist BD Diagnostics Systems Becton, Dickinson and Company 7 Loveton Circle Sparks, MD 21152

Re: K031943

Trade/Device Name: BD Phoenix™ Automated Microbiology System Cephalothin (1-64 ug/ml) Regulation Number: 21 CFR 866.1645 Regulation Name: Fully Automated Short-Term Incubation Cycle Antimicrobial Susceptibility Devices Regulatory Class: Class II Product Code: LON Dated: June 20, 2003 Received: June 24, 2003

Dear Ms. Giguere:

We have reviewed your Section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food, Drug, and Cosmetic Act (Act) that do not require approval of a premarket approval application (PMA), You may, therefore, market the device, subject to the general controls provisions of the Act. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration.

If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to such additional controls. Existing major regulations affecting your device can be found in Title 21. Code of Federal Regulations (CFR). Parts 800 to 895. In addition, FDA may publish further announcements concerning your device in the Federal Register.

Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements. including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Parts 801 and 809); and good manufacturing practice requirements as set forth in the quality systems (QS) regulation (21 CFR Part 820).

{4}------------------------------------------------

Page 2 -

This letter will allow you to begin marketing your device as described in your Section 510(k) premarket notification. The FDA finding of substantial equivalence of your device to a legally marketed predicate device results in a classification for your device and thus, permits your device to proceed to the market.

If you desire specific information about the application of labeling requirements to your device, or questions on the promotion and advertising of your device, please contact the Office of In Vitro Diagnostic Device Evaluation and Safety at (301) 594-3084. Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21CFR Part 807.97). Other general information on your responsibilities under the Act may be obtained from the Division of Small Manufacturers, International and Consumer Assistance at its toll-free number (800) 638-2041 or (301) 443-6597 or at its Internet address http://www.fda.gov/cdrh/dsma/dsmamain.html.

Sincerely yours.

Steven Sutman

Steven I. Gutman, M.D., M.B.A. Director Office of In Vitro Diagnostic Device Evaluation and Safety Center for Devices and Radiological Health

Enclosure

{5}------------------------------------------------

Page 1 of 1

510(k) Number: 1031943

Device Name: BD PhoenixTM Automated Microbiology System for use with the antimicrobial agent cephalothin ( 1-64 ug/mL) - Gram-negative ID/AST or AST only Phoenix panels.

Indications for Use:

The BD Phoenix™ Automated Microbiology System is intended for in vitro quantitative determination of antimicrobial susceptibility by minimal inhibitory concentration (MIC) of most Gram-negative acrobic and facultative anaerobic bacteria isolates from pure culture for Enterobacteriaceae and Non-Enterobacteriaceae and most Gram-positive bacteria isolates from pure culture belonging to the genera Staphylococcus and Enterococcus.

This premarket notification is for the antimicrobial agent cephalothin at concentrations of 1-64 ug/mL to Gram-negative ID/AST or AST only Phoenix panels. cephalothin has been shown to be active in vitro against most strains of microorganisms listed below, as described in the FDA-approved package insert for this antimicrobial agent.

Active In Vitro and in Clinical Infections Against:

Escherichia coli Klebsiella pneumoniae Proteus mirabilis

Active In Vitro Against:

(PLEASE DO NOT WRITE BELOW THIS LINE-CONTINUE ON ANOTHER PAGE IF NEEDED)

Concurrence of CDRH, Office of Device Evaluation (ODE)

Noyalt 8/5/03
Division Sign-Off

sion Sign

Office of In Vitro Diagnostic Device Evaluation and Safety

Over-the-Counter Use

Prescription Use (Per 21 CFR 801.109)

K031943 210(k)

BD Diagnostic Systems Becton, Dickinson and Company

Page 9

§ 866.1645 Fully automated short-term incubation cycle antimicrobial susceptibility system.

(a)
Identification. A fully automated short-term incubation cycle antimicrobial susceptibility system is a device that incorporates concentrations of antimicrobial agents into a system for the purpose of determining in vitro susceptibility of bacterial pathogens isolated from clinical specimens. Test results obtained from short-term (less than 16 hours) incubation are used to determine the antimicrobial agent of choice to treat bacterial diseases.(b)
Classification. Class II (special controls). The special control for this device is FDA's guidance document entitled “Class II Special Controls Guidance Document: Antimicrobial Susceptibility Test (AST) Systems; Guidance for Industry and FDA.”