K Number
K241837
Device Name
Limbus Contour
Manufacturer
Date Cleared
2024-10-09

(106 days)

Product Code
Regulation Number
892.2050
Reference & Predicate Devices
Predicate For
N/A
AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
Intended Use

Limbus Contour is a software-only medical device intended for use by trained radiation oncologists, dosimetrists and physicists to derive optimal contours for input to radiation treatment planning.

Supported image modalities are Computed Tomography and Magnetic Resonance. The Limbus Contour Software assists in the following scenarios:

Operates in conjunction with radiation treatment planning systems or DICOM viewing systems to load, save, and display medical images and contours for treatment evaluation and treatment planning.

Creation, transformation, and modification of contours for applications including, but not limited to: transferring contours to radiotherapy treatment planning systems, aiding adaptive therapy and archiving contours for patient follow-up.

Localization and definition of healthy anatomical structures.

Limbus Contour is not intended for use with digital mammography.

Device Description

Limbus Contour is a stand-alone software medical device. It is a single purposes cross-platform application for automatic contouring (segmentation) of CT/MRI DICOM images via pre-trained and expert curated machine learning models. The software is intended to be used by trained medical professionals to derive contours for input to radiation treatment planning. The Limbus Contour software segments normal tissues using machine learning models and further post-processing on machine learning model prediction outputs. Limbus Contour does not display or store DICOM images and relies on existing radiotherapy treatment planning systems (TPS) and DICOM image viewers for display and modification of generated segmentations. Limbus Contour interfaces with the user's operating system (importing DICOM image .dcm files and exporting segmented DICOM RT-Structure Set .dcm files).

AI/ML Overview

Here's a summary of the acceptance criteria and the study details for the Limbus Contour device, based on the provided FDA 510(k) submission information:


1. Acceptance Criteria and Reported Device Performance

The acceptance criterion for each contoured structure is that the Limbus DSC (Dice Similarity Coefficient) lower 95% confidence edge must be greater than or equal to the "Test DSC Threshold," which is derived from the mean minus the standard deviation of reference model DSCs from published machine learning autosegmentation models.

StructureLimbus Mean DSCLimbus DSC Std DevNumber of ScansLimbus DSC lower 95% conf edgeTest DSC ThresholdResult
A_Aorta0.9090950.0455771100.876493370.81Passed
A_Aorta_Base0.9795880.0286193100.959116410.81Passed
A_Aorta_I0.9380160.10304303100.864308580.81Passed
A_Celiac0.7815020.27272084100.586422820.26Passed
A_LAD0.6927660.06590144100.645626220.26Passed
A_Mesenteric_S0.8572570.14185425100.755787630.26Passed
A_Pulmonary0.9018670.03499015100.876838290.85Passed
Applicator_Cylinder (beta)0.801117330.33037573150.608162740.374Passed
Applicator_Ring (beta)0.9638630.07306595100.91159840.374Passed
Atrium_L0.9770440.0180652100.964121830.79Passed
Atrium_R0.9784510.01852677100.965198670.78Passed
Bladder0.966012380.05220935210.940241380.935Passed
Bladder (MRI)0.9635180.01177413100.955095880.88Passed
Bladder_CBCT0.9591730.04229406100.928919750.91Passed
Bladder_HDR0.9311670.06094679100.887571320.56674243Passed
Bladder_HDR (MRI)0.8968830.13171833100.802663930.79Passed
Bone Marrow_Pelvic0.9954140.00407252100.99250090.805Passed
Bone_Hyoid0.854114170.04163051120.826930150.77Passed
Bone_Illium_L0.98880750.01103973120.981598740.76Passed
Bone_Illium_R0.990588330.00575056120.986833320.76Passed
Bone_Ischium_L0.9389850.01573502100.927729630.76Passed
Bone_Ischium_R0.939230.01613541100.927688220.76Passed
Bone_Mandible0.940247690.01266685130.932300940.922Passed
Bone_Pelvic0.983830.00511637100.980170220.929Passed
Bowel0.907432170.06592406230.876338460.74Passed
Bowel_Bag0.939794780.03659061230.922536470.752Passed
Bowel_Bag_Extend0.9715760.01582803200.96357020.752Passed
Bowel_Bag_Full0.96799850.01354157200.96114920.752Passed
Bowel_Bag_Superior0.936864550.09357214110.87304660.752Passed
Bowel_Extend0.9416820.03040818200.926301590.74Passed
Bowel_Full0.923513810.03444493210.906511480.74Passed
Bowel_HDR0.8413680.05558462100.801607920.2008343Passed
Bowel_HDR (MRI)0.558318180.24969816110.388019370.31Passed
Bowel_Superior0.902142730.03756911110.876519890.74Passed
BrachialPlex_L0.6916050.10786794100.614446280.39Passed
BrachialPlex_R0.6938090.11005989100.615082370.39Passed
Brain0.9922050.00251205160.990784440.988Passed
Brainstem0.903346880.03859191160.881523150.695Passed
Brainstem (MRI)0.9255260.02877815100.904940780.725Passed
Breast_Implant_L0.9928840.00662727100.988143460.865Passed
Breast_Implant_R0.9736630.03491225100.948690010.865Passed
Breast_L0.9545140.02763163100.93474890.726Passed
Breast_R0.939520910.04383671110.909623450.7345Passed
Bronchus0.8395150.06515951100.792905930.76Passed
CW2cm_L0.9989550.00118886100.99810460.72Passed
CW2cm_R0.9993760.00101477100.998650130.72Passed
Canal_Anal0.875960950.13633659210.8086640.803Passed
Canal_Anal_HDR0.9428910.04773688100.908744460.56167132Passed
Canal_Anal_HDR (MRI)0.6102950.35031087100.359715110.31Passed
Carina101010.77Passed
CaudaEquina0.8820980.06633305100.834649490.722Passed
Cavity_Oral0.9131130.0386665100.885454580.8Passed
Cerebellum0.9832190.01399611100.973207480.83Passed
Chestwall_L0.959070910.00299448110.957028620.72Passed
Chestwall_R0.959571820.00327572110.957337720.72Passed
Clavicle_L0.980143750.01256694160.973037150.93Passed
Clavicle_R0.9815650.01013648160.975832820.93Passed
Cochlea_L0.7023110.10183115100.629470450.533Passed
Cochlea_R0.6867580.14712802100.581516270.545Passed
Colon_Sigmoid0.816253810.15924956210.737646810.704Passed
Colon_Sigmoid_HDR0.8655050.12156688100.778547340.30928644Passed
Colon_Sigmoid_HDR (MRI)0.7530360.15966944100.63882330.47Passed
Cornea_L0.961831820.06990272110.914156860.489Passed
Cornea_L (MRI)0.9137180.03513108100.888588480.489Passed
Cornea_R0.969347270.05299966110.933200510.498Passed
Cornea_R (MRI)0.9272230.02302511100.910752970.498Passed
Duodenum0.8284330.18461132100.696379190.649Passed
ESTRO_LN_Ax_IP_L0.9845520.0225043100.968454510.79Passed
ESTRO_LN_Ax_IP_R0.9888010.01830441100.975707730.796Passed
ESTRO_LN_Ax_L1_L0.9971220.00681545100.992246860.66Passed
ESTRO_LN_Ax_L1_R0.9675030.01693458100.955389570.66Passed
ESTRO_LN_Ax_L2+IP_Fill_L0.9929860.01314147100.983585820.73Passed
ESTRO_LN_Ax_L2+IP_Fill_R0.9942060.01093726100.98638250.73Passed
ESTRO_LN_Ax_L2_L0.9951920.01077199100.987486720.73Passed
ESTRO_LN_Ax_L2_R0.9973520.00448639100.994142860.73Passed
ESTRO_LN_Ax_L3_L0.9933820.00884358100.987056120.51Passed
ESTRO_LN_Ax_L3_R0.9921490.01468854100.981642180.51Passed
ESTRO_LN_IMN_L0.9805970.02745317100.960959550.39Passed
ESTRO_LN_IMN_L_Expand0.9820790.05662552100.941574360.39Passed
ESTRO_LN_IMN_R0.9744020.04214952100.944252140.39Passed
ESTRO_LN_IMN_R_Expand0.9778520.06968747100.928004050.39Passed
ESTRO_LN_Sclav_L0.975860.03136266100.953426060.7Passed
ESTRO_LN_Sclav_R0.987350.02268151100.971125750.7Passed
Esophagus0.837410830.02651585120.820096430.67Passed
Eye_L0.935118240.03324782170.916877960.894Passed
Eye_L (MRI)0.9503370.01463563100.939868030.847Passed
Eye_R0.941917060.03257919170.924043610.902Passed
Eye_R (MRI)0.9396660.03581356100.91404830.849Passed
Femur_Head_L0.9612990.00888921100.954940490.93Passed
Femur_Head_L (MRI)0.9381620.04781144100.903962140.77Passed
Femur_Head_L_CBCT0.9779390.01378171100.968080850.88Passed
Femur_Head_R0.9613810.01105991100.953469760.937Passed
Femur_Head_R (MRI)0.9485860.02852155100.928184330.77Passed
Femur_Head_R_CBCT0.9896670.01081208100.981933040.88Passed
Gallbladder0.9464220.05882969100.90434070.809Passed
GInd Lacrimal L0.765745380.0785035130.716494970.489Passed
Glnd_Lacrimal_R0.734740770.09508335130.675088720.498Passed
Glnd_Submand_L0.8381830.08845188100.774912730.725Passed
Glnd_Submand_R0.8826720.0245712100.865096050.595Passed
Glnd_Thyroid0.8405750.03434333100.816008970.716Passed
GreatVes0.9562810.01660489100.94440340.81Passed
Heart0.954888330.02805647120.936567930.89Passed
Heart+A_Pulm0.9956630.01079707100.987939770.89Passed
Hippocampus_L0.8974740.14363431100.794731350.45Passed
Hippocampus_L (MRI)0.8010920.07687695100.746101360.618Passed
Hippocampus_R0.8419330.23470004100.674050370.45Passed
Hippocampus_R (MRI)0.8042290.07348396100.751665390.618Passed
Humerus_L0.9815920.03366976100.957507780.93Passed
Humerus_R0.9838040.02794829100.963812390.93Passed
InternalAuditoryCanal_L0.7196630.27119782100.525673250.41Passed
InternalAuditoryCanal_R0.7783020.29907667100.56437030.41Passed
Kidney_L0.972110.0055787100.968119510.83Passed
Kidney_R0.9712350.00508737100.967595970.85Passed
LN_Ax_L1_L0.933470.03827463100.906091880.66Passed
LN_Ax_L1_R0.9573660.01855924100.944090440.66Passed
LN_Ax_L2_L0.7978470.03448156100.773182090.73Passed
LN_Ax_L2_R0.8366890.03793359100.809554830.73Passed
LN_Ax_L3_L0.8414690.02407574100.824247450.51Passed
LN_Ax_L3_R0.8332020.05413932100.794475760.51Passed
LN_Ax_Sclav_L0.8548590.07708553100.799719170.66Passed
LN_Ax_Sclav_R0.8393540.0636715100.793809320.66Passed
LN_IMN_L0.6810720.05716488100.640181550.39Passed
LN_IMN_L_Expand0.9741580.08171958100.91570340.39Passed
LN_IMN_R0.7546240.0588019100.712562580.39Passed
LN_IMN_R_Expand0.9692350.09728747100.899644570.39Passed
LN_Inguinal_L0.9877520.01196273100.979194970.779Passed
LN_Inguinal_R0.9758560.01828094100.962779510.779Passed
LN_Neck_IA0.880388180.10469436110.808984670.41Passed
LN_Neck_IA60.945973640.03537206110.921849230.896Passed
LN_Neck_IB_L0.9185530.02691603100.899299770.896Passed
LN_Neck_IB_R0.9162480.01954066100.902270420.896Passed
LN_Neck_III_L0.9243770.02716647100.904944630.752Passed
LN_Neck_III_R0.9038050.03651978100.877682140.775Passed
LN_Neck_II_L0.9214250.02096226100.906430540.894Passed
LN_Neck_II_R0.9199180.02031001100.90539010.894Passed
LN_Neck_IV_L0.8370670.10669372100.760748210.655Passed
LN_Neck_IV_R0.8134740.07643769100.758797570.655Passed
LN_Neck_L0.868750.04264226120.840905320.779Passed
LN_Neck_R0.868550.04499896120.839166430.779Passed
LN_Neck_VI0.938220830.07273804120.890724120.722Passed
LN_Neck_VIIAB_L0.7045620.14161814100.603261530.55Passed
LN_Neck_VIIAB_R0.6840870.15673354100.571974370.55Passed
LN_Neck_VIIA_L0.9736970.03639132100.947666030.54Passed
LN_Neck_VIIA_R0.9630450.0518865100.925930220.54Passed
LN_Neck_VIIB_L0.9794430.02540021100.961274050.69Passed
LN_Neck_VIIB_R0.97270.02326651100.95605730.71Passed
LN_Neck_V_L0.8996680.05719485100.858756110.785Passed
LN_Neck_V_R0.8551860.05671539100.814617070.775Passed
LN_Pelvics0.901693180.05091482220.8771390.779Passed
LN_Pelvics_CBCT0.9747420.04202674100.944679970.58Passed
LN_Sclav_L0.960930.05712461100.920068350.7Passed
LN_Sclav_R0.9584980.02948648100.937406110.7Passed
Larynx0.8987770.05827018100.857095920.77Passed
Lens_L0.782924710.08119035170.738382410.616Passed
Lens_R0.760474710.07902615170.717119730.449Passed
Lips0.8246960.14948194100.717770490.68Passed
Liver0.977733850.01147248130.97053640.92Passed
Lobe_Temporal_L0.9447440.07569022100.890602240.83Passed
Lobe_Temporal_R0.9484560.06837365100.899547840.83Passed
Lung_L0.9831150.00654768100.97843140.96Passed
Lung_R0.9836490.00652109100.978984410.96Passed
Mesorectum0.8279650.05209883100.790698330.779Passed
Musc_Constrict0.8690970.05737849100.828053760.61Passed
Musc_PecMinor_L0.8692590.04744788100.835319190.79Passed
Musc_PecMinor_R0.8635840.06177418100.819396490.796Passed
Musc_Sclmast_L0.9461170.02773018100.92628140.803Passed
Musc_Sclmast_R0.9452910.03302699100.921666560.803Passed
OpticChiasm0.659298820.1679447170.567161740.41Passed
OpticNrv_L0.825769410.06203798170.791734410.73Passed
OpticNrv_R0.828942940.06130553170.795309770.72Passed
Optics (MRI)0.7648460.05410538100.726144030.504Passed
Pancreas0.8843430.09900704100.813522550.769Passed
Parotid_L0.883520830.06794505120.839153860.778Passed
Parotid_R0.882816670.05035732120.849934190.803Passed
PelvisVessels0.9149980.02637213100.896133820.26Passed
PenileBulb0.848508180.04605243110.817099560.705Passed
PenileBulb (MRI)0.732310.27283179100.537151450.46Passed
Pericardium0.9848280.0185493100.971559550.8688Passed
Pericardium+A_Pulm0.9949730.01235765100.986133480.89Passed
Pituitary0.750418670.15158537150.661885860.41Passed
Prostate0.9340930.02193268100.918404390.88Passed
Prostate (MRI)0.9151640.03096645100.893013480.8Passed
ProstateBed0.746913330.1454049150.66199020.5Passed
ProstateFiducials (beta)0.614220.24931989100.435879680.41Passed
Prostate_CBCT0.9612690.04241179100.930931540.79Passed
PubicSymphys0.9437430.02100908100.928715050.76Passed
PubicSymphys (MRI)0.7795850.11210947100.699392290.54Passed
Rectum0.886817620.08654191210.844099760.803Passed
Rectum (MRI)0.9346190.02030278100.920096280.77Passed
Rectum_CBCT0.9631030.02896341100.942385260.87Passed
Rectum_HDR0.9185530.09535355100.850345920.56167132Passed
Rectum_HDR (MRI)0.7810.15188698100.672354150.58Passed
Retina_L0.907613640.1929304110.77603150.489Passed
Retina_L (MRI)0.9532710.04079533100.924089810.489Passed
Retina_R0.911916360.1905022110.781990310.498Passed
Retina_R (MRI)0.928540.05520214100.889053510.498Passed
Ribs_L0.944735450.00563264110.940893890.81Passed
Ribs_R0.946216360.00495204110.942838980.81Passed
Sacrum0.970124380.01642714160.960834830.82Passed
Sacrum (MRI)0.9666320.04786265100.93239550.77Passed
SeminalVes0.821480.16089309100.706392020.5Passed
SeminalVes (MRI)0.8339950.05384245100.795481110.39Passed
SeminalVes_CBCT0.9046530.05295257100.866775650.621Passed
SpaceOARVue (beta)0.8669340.0421535100.83678130.5Passed
SpinalCanal0.89717650.06232767200.865651250.722Passed
SpinalCord0.877886790.06353613280.85072650.722Passed
Spleen0.982384290.00724712140.978003070.958Passed
Sternum0.9685060.00927831100.961869160.8Passed
Stomach0.923538180.04262548110.894466810.64Passed
Trachea0.9001950.04891354100.865206790.77Passed
Urethra_HDR0.688980.26984128100.495960590.26Passed
Urethra_HDR (MRI)0.5584330.30664371100.339088550.26Passed
Uterus+Cervix0.9238760.07561527100.869787850.8525Passed
VB_C10.8711190.09654266100.802061340.389Passed
VB_C20.8904650.08375338100.830555610.389Passed
VB_C30.8829840.07768781100.827413350.389Passed
VB_C40.8476070.13488571100.751122280.389Passed
VB_C50.7358880.25082081100.556474070.389Passed
VB_C60.6623130.36427326100.401745710.389Passed
VB_C70.6867720.36426675100.426209370.389Passed
VB_L10.73970.36842487120.499124770.389Passed
VB_L20.853538180.3119903110.640754980.389Passed
VB_L30.891392730.29651247110.689165690.389Passed
VB_L40.889308180.29491517110.688170530.389Passed
VB_L50.9717610.01978041100.957611930.389Passed
VB_T010.7494990.20357809100.603878130.389Passed
VB_T020.9008610.10665309100.824571270.389Passed
VB_T030.8468450.23384828100.679571640.389Passed
VB_T040.8710650.16033768100.75637430.389Passed
VB_T050.8681840.10527773100.792878080.389Passed
VB_T060.8565860.1735606100.732436850.389Passed
VB_T070.8952070.09111821100.830029490.389Passed
VB_T080.909462730.09927246110.841757060.389Passed
VB_T090.8952330.19379417100.756610630.389Passed
VB_T100.851806920.25673522130.690739990.389Passed
VB_T110.905435380.17253913130.797190220.389Passed
VB_T120.734660770.38432697130.493547120.389Passed
VBs0.9844480.01042268100.976992580.579Passed
V_Venacava_l0.953667860.05427303140.920857370.72Passed
V_Venacava_S0.8512190.0503676100.815190690.8Passed
Vagina0.8973410.06081143100.853842150.665Passed
Ventricle_L0.9511440.00689877100.946209260.9Passed
Ventricle_R0.9807840.01685223100.968729480.8Passed
Wire_Breast_L (beta)0.7502450.28619472100.545527850.39Passed
Wire_Breast_R (beta)0.8960530.15011288100.788676180.39Passed

All listed structures met their respective acceptance criteria by having their Limbus DSC lower 95% confidence edge exceed or meet the specified Test DSC Thresholds.

2. Sample Sizes Used for the Test Set and Data Provenance

  • Test Set Sample Size: For each structure, a set of at least 10 patient scans was used for initial performance testing. Some structures had larger test sets, as indicated in the table (e.g., Bladder with 21 scans, Bowel with 23 scans, SpinalCord with 28 scans).
  • Data Provenance: The test scans were randomly selected from a total pool of patient scans that contained the relevant structure. This pool was selected to reflect the general population of patients receiving radiation treatments. The data provenance details are further described in the "Training and Validation Datasets" section for the training data, implying a similar origin for the test data (multiple clinical sites and countries).

3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

  • Number of Experts: The ground truth contours were from "multiple experts at multiple institutions." The exact number is not explicitly stated.
  • Qualifications of Experts: The ground truth contours were all reviewed by a "board certified radiation oncologist" to ensure consistency with established standards and guidelines for contouring and proper labeling.

4. Adjudication Method for the Test Set

The document does not explicitly describe a specific adjudication method like "2+1" or "3+1" for the ground truth contours in the test set. It states that the ground truth contours were from "multiple experts at multiple institutions" and reviewed by "a board certified radiation oncologist." This implies a form of consensus or expert review process, though the specific protocol for resolving discrepancies (if any) is not detailed.

5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done

No, a multi-reader multi-case (MRMC) comparative effectiveness study was not explicitly mentioned as being performed for this submission. The performance data is focused on the standalone algorithm's accuracy (Dice Similarity Coefficient) against expert-generated ground truth.

6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

Yes, a standalone performance study was done. The "Automatic Contouring - Validation Test" as described is a benchtop performance test where the software's outputs are compared to expert-generated ground truth without human intervention in the contouring process of the device itself.

7. The Type of Ground Truth Used

The ground truth used was expert consensus contours. These were human-generated contours reviewed by a board-certified radiation oncologist to ensure they conformed to clinical trial guidelines and established standards.

8. The Sample Size for the Training Set

The total number of unique scans included in training datasets exceeds 10,000 scans. The table provided in the document details the number of training and validation scans for each individual structure model, with training scan counts ranging from tens to over a thousand for each structure.

9. How the Ground Truth for the Training Set Was Established

The ground truth for the training set was established through:

  • Human-generated contours from a variety of anonymized and pseudo-anonymized datasets.
  • These datasets were collected from publicly available clinical trials and the company's clinical and research partners.
  • The training dataset ground truth contours were reviewed and edited by in-house clinicians and radiation oncologists to ensure consistency with established standards and guidelines for contouring (e.g., RTOG 1106, RTOG 0848, EMBRACE II, DAHANCA, NRG, ESTRO, ACROP, EPTN).
  • To minimize bias, training data included scans from multiple clinical sites, countries (United States, Canada, United Kingdom, France, Germany, Italy, Netherlands, Switzerland, Australia, New Zealand, Singapore), and different makes/models of imaging devices (GE, Siemens, Phillips, Toshiba, Elekta).
  • The scans and ground truth contours were from the general patient population receiving radiotherapy, with no restrictions based on age, ethnicity, race, gender, or disease states.

{0}------------------------------------------------

October 9, 2024

Image /page/0/Picture/1 description: The image contains the logo of the U.S. Food and Drug Administration (FDA). On the left is the Department of Health & Human Services logo. To the right of that is the FDA logo, which consists of a blue square with the letters "FDA" in white, followed by the words "U.S. FOOD & DRUG ADMINISTRATION" in blue.

Limbus AI Inc. Jonathan Giambattista Director - Software 2431 Glamis Place Regina, SK S4N3K9 Canada

Re: K241837

Trade/Device Name: Limbus Contour Regulation Number: 21 CFR 892.2050 Regulation Name: Medical Image Management And Processing System Regulatory Class: Class II Product Code: QKB Dated: July 15, 2024 Received: July 15, 2024

Dear Jonathan Giambattista:

We have reviewed your section 510(k) premarket notification of intent to market the device referenced above and have determined the device is substantially equivalent (for the indications for use stated in the enclosure) to legally marketed predicate devices marketed in interstate commerce prior to May 28, 1976, the enactment date of the Medical Device Amendments, or to devices that have been reclassified in accordance with the provisions of the Federal Food. Drug. and Cosmetic Act (that do not require approval of a premarket approval application (PMA). You may, therefore, market the device, subject to the general controls provisions of the Act. Although this letter refers to your product as a device, please be aware that some cleared products may instead be combination products. The 510(k) Premarket Notification Database available at https://www.accessdata.fda.gov/scripts/cdrh/cfdocs/cfpmn/pmn.cfm identifies combination product submissions. The general controls provisions of the Act include requirements for annual registration, listing of devices, good manufacturing practice, labeling, and prohibitions against misbranding and adulteration. Please note: CDRH does not evaluate information related to contract liability warranties. We remind you, however, that device labeling must be truthful and not misleading.

If your device is classified (see above) into either class II (Special Controls) or class III (PMA), it may be subject to additional controls. Existing major regulations affecting your device can be found in the Code of Federal Regulations, Title 21, Parts 800 to 898. In addition, FDA may publish further announcements concerning your device in the Federal Register.

Additional information about changes that may require a new premarket notification are provided in the FDA guidance documents entitled "Deciding When to Submit a 510(k) for a Change to an Existing Device"

{1}------------------------------------------------

(https://www.fda.gov/media/99812/download) and "Deciding When to Submit a 510(k) for a Software Change to an Existing Device" (https://www.fda.gov/media/99785/download).

Your device is also subject to, among other requirements, the Quality System (QS) regulation (21 CFR Part 820), which includes, but is not limited to, 21 CFR 820.30, Design controls; 21 CFR 820.90, Nonconforming product; and 21 CFR 820.100, Corrective and preventive action. Please note that regardless of whether a change requires premarket review, the QS regulation requires device manufacturers to review and approve changes to device design and production (21 CFR 820.30 and 21 CFR 820.70) and document changes and approvals in the device master record (21 CFR 820.181).

Please be advised that FDA's issuance of a substantial equivalence determination does not mean that FDA has made a determination that your device complies with other requirements of the Act or any Federal statutes and regulations administered by other Federal agencies. You must comply with all the Act's requirements, including, but not limited to: registration and listing (21 CFR Part 807); labeling (21 CFR Part 801); medical device reporting of medical device-related adverse events) (21 CFR Part 803) for devices or postmarketing safety reporting (21 CFR Part 4, Subpart B) for combination products (see https://www.fda.gov/combination-products/guidance-regulatory-information/postmarketing-safety-reportingcombination-products); good manufacturing practice requirements as set forth in the quality systems (OS) regulation (21 CFR Part 820) for devices or current good manufacturing practices (21 CFR Part 4, Subpart A) for combination products; and, if applicable, the electronic product radiation control provisions (Sections 531-542 of the Act); 21 CFR Parts 1000-1050.

All medical devices, including Class I and unclassified devices and combination product device constituent parts are required to be in compliance with the final Unique Device Identification System rule ("UDI Rule"). The UDI Rule requires, among other things, that a device bear a unique device identifier (UDI) on its label and package (21 CFR 801.20(a)) unless an exception or alternative applies (21 CFR 801.20(b)) and that the dates on the device label be formatted in accordance with 21 CFR 801.18. The UDI Rule (21 CFR 830.300(a) and 830.320(b)) also requires that certain information be submitted to the Global Unique Device Identification Database (GUDID) (21 CFR Part 830 Subpart E). For additional information on these requirements, please see the UDI System webpage at https://www.fda.gov/medical-device-advicecomprehensive-regulatory-assistance/unique-device-identification-system-udi-system.

Also, please note the regulation entitled, "Misbranding by reference to premarket notification" (21 CFR 807.97). For questions regarding the reporting of adverse events under the MDR regulation (21 CFR Part 803), please go to https://www.fda.gov/medical-device-safety/medical-device-reportingmdr-how-report-medical-device-problems.

For comprehensive regulatory information about medical devices and radiation-emitting products, including information about labeling regulations, please see Device Advice (https://www.fda.gov/medicaldevices/device-advice-comprehensive-regulatory-assistance) and CDRH Learn (https://www.fda.gov/training-and-continuing-education/cdrh-learn). Additionally, you may contact the Division of Industry and Consumer Education (DICE) to ask a question about a specific regulatory topic. See the DICE website (https://www.fda.gov/medical-device-advice-comprehensive-regulatory

{2}------------------------------------------------

assistance/contact-us-division-industry-and-consumer-education-dice) for more information or contact DICE by email (DICE@fda.hhs.gov) or phone (1-800-638-2041 or 301-796-7100).

Sincerely,

Locoa Werchner

Lora D. Weidner, Ph.D. Assistant Director Radiation Therapy Team DHT8C: Division of Radiological Imaging and Radiation Therapy Devices OHT8: Office of Radiological Health Office of Product Evaluation and Quality Center for Devices and Radiological Health

Enclosure

{3}------------------------------------------------

Indications for Use

Submission Number (if known)

K241837

Device Name

Limbus Contour

Indications for Use (Describe)

Limbus Contour is a software-only medical device intended for use by trained radiation oncologists, dosimetrists and physicists to derive optimal contours for input to radiation treatment planning.

Supported image modalities are Computed Tomography and Magnetic Resonance. The Limbus Contour Software assists in the following scenarios:

Operates in conjunction with radiation treatment planning systems or DICOM viewing systems to load, save, and display medical images and contours for treatment evaluation and treatment planning.

Creation, transformation, and modification of contours for applications including, but not limited to: transferring contours to radiotherapy treatment planning systems, aiding adaptive therapy and archiving contours for patient follow-up.

Localization and definition of healthy anatomical structures.

Limbus Contour is not intended for use with digital mammography.

Type of Use (Select one or both, as applicable)

Prescription Use (Part 21 CFR 801 Subpart D)

Over-The-Counter Use (21 CFR 801 Subpart C)

CONTINUE ON A SEPARATE PAGE IF NEEDED.

This section applies only to requirements of the Paperwork Reduction Act of 1995.

DO NOT SEND YOUR COMPLETED FORM TO THE PRA STAFF EMAIL ADDRESS BELOW.

The burden time for this collection of information is estimated to average 79 hours per response, including the time to review instructions, search existing data sources, gather and maintain the data needed and complete and review the collection of information. Send comments regarding this burden estimate or any other aspect of this information collection, including suggestions for reducing this burden, to:

Department of Health and Human Services Food and Drug Administration Office of Chief Information Officer Paperwork Reduction Act (PRA) Staff PRAStaff(@fda.hhs.gov

"An agency may not conduct or sponsor, and a person is not required to respond to, a collection of information unless it displays a currently valid OMB number."

{4}------------------------------------------------

K241837

510(k) SUMMARY

This summary of 510(k) safety and effectiveness information is submitted in accordance with the requirements of 21 CFR §807.92:

SUBMITTER -Limbus Al Inc. 2431 Glamis Pl Regina, Saskatchewan, Canada, S4V1A5 Tel: 1-306-502-5982

Contact Person:Jon Giambattista
Date Prepared:October 9, 2024
II. DEVICE
Name of Device:Limbus Contour
Classification Name:Radiological Image Processing System
Regulation:21 CFR §892.2050
Regulatory Class:Class II
Product Classification Code:QKB

III. PREDICATE DEVICE

Predicate Manufacturer:Limbus AI, Inc.
Predicate Trade Name:Limbus Contour
Predicate 510(k):K230575

No reference devices were used in this submission.

IV. DEVICE DESCRIPTION

Limbus Contour is a stand-alone software medical device. It is a single purposes cross-platform application for automatic contouring (segmentation) of CT/MRI DICOM images via pre-trained and expert curated machine learning models. The software is intended to be used by trained medical professionals to derive contours for input to radiation treatment planning. The Limbus Contour software segments normal tissues using machine learning models and further post-processing on machine learning model prediction outputs. Limbus Contour does not display or store DICOM images and relies on existing radiotherapy treatment planning systems (TPS) and DICOM image viewers for display and modification of generated segmentations. Limbus Contour interfaces with the user's operating system (importing DICOM image .dcm files and exporting segmented DICOM RT-Structure Set .dcm files).

V. INDICATIONS FOR USE

Limbus Contour is a software-only medical device intended for use by trained radiation oncologists, dosimetrists and physicists to derive optimal contours for input to radiation treatment planning.

Supported image modalities are Computed Tomography and Magnetic Resonance. The Limbus Contour Software assists in the following scenarios:

  • Operates in conjunction with radiation treatment planning systems to load, save, and ● display medical images and contours for treatment evaluation and treatment planning.
  • . Creation, transformation, and modification of contours for applications including, but not limited to: transferring contours to radiotherapy treatment planning systems, aiding adaptive therapy and archiving contours for patient follow-up.

{5}------------------------------------------------

  • . Localization and definition of anatomical structures.
    Limbus Contour is not intended for use with digital mammography.

VI. COMPARISON OF TECHNOLOGICAL CHARACTERISTICS WITH THE PREDICATE DEVICE

The following characteristics were compared between the subject device and the predicate device in order to demonstrate substantial equivalence:

  • Indications for Use The predicate and subject device are identical with the exception . that the predicate has support for MacOS while the subject device does not and the predicate has less structures for automatic contouring available.
  • . Materials – The predicate and subject device are software-only devices and do not inherently contain material.
  • Design - The predicate and subject device have equivalent designs.
  • . Energy Source – The predicate and subject device are software-only devices, powered by the computer system.
  • . Performance Testing – The predicate and subject device were both validated using an automatic contouring test to ensure the contours were accurate.
ItemLimbus Contour v1.8Limbus Contour v1.7 - K230575Similarities /Differences
ClassificationRegulation892.2050 - Medical imagemanagement and processingsystem892.2050 - Medical imagemanagement and processingsystemSame
Product CodeQKBLLZSimilar; Bothproduct codesrefer to thesame CFR892.2050 -Medical imagemanagementandprocessingsystem
Indications forUseLimbus Contour is a software onlymedical device intended for useby trained radiation oncologists,dosimetrists and physicists toderive optimal contours for inputto radiation treatment planning.Supported image modalities areComputed Tomography andMagnetic Resonance. The LimbusContour Software assists in thefollowingscenarios:• Operates in conjunction withradiation treatment planningsystems or DICOM viewingsystems to load, save, and displaymedical images and contours fortreatmentevaluation and treatment planning.• Creation, transformation, andmodification of contours forLimbus Contour is a software onlymedical device intended for useby trained radiation oncologists,dosimetrists and physicists toderive optimal contours for input toradiation treatment planning.Supported image modalities areComputed Tomography andMagnetic Resonance. The LimbusContour Software assists in thefollowingscenarios:• Operates in conjunction withradiation treatment planningsystems or DICOM viewingsystems to load, save, and displaymedical images and contours fortreatmentevaluation and treatment planning.• Creation, transformation, andmodification of contours forSame
ItemLimbus Contour v1.8Limbus Contour v1.7 - K230575Similarities /Differences
applications including, but notlimited to: transferring contours toradiotherapy treatment planningsystems, aiding adaptive therapyand archiving contours for patientfollow-up.• Localization and definition ofhealthy anatomical Structures.Limbus Contour is notintended for use with digitalmammography.applications including, but notlimited to: transferring contours toradiotherapy treatment planningsystems, aiding adaptive therapyand archiving contours for patientfollow-up.• Localization and definition ofhealthy anatomical Structures.Limbus Contour is notintended for use with digitalmammography.
Intended UserHealthcare providersHealthcare providersSame
MachineLearningAlgorithmLocked algorithm; Deep LearningmodelLocked algorithm; Deep LearningmodelSame
ContouringModesAutomaticAutomaticSame
SupportedImageModalitiesCT; MRCT; MRSame
CompatibleScanner ModelsNo Limitation on scanner model,DICOM 3.0 compliance required.No Limitation on scanner model,DICOM compliance required.Same
CompatibleTreatmentPlanningSystemNo Limitation on TPS modelNo Limitation on TPS modelSame
ResultVisualizationLimbus Contour has no datavisualization. Data processing isautomated and does not require userinteraction. A control interface isprovided for system administrationand configuration only.Visualization software must be usedto facilitate the review and edit of thegenerated contours.Limbus Contour has no datavisualization. Data processing isautomated and does not require userinteraction. A control interface isprovided for system administrationand configuration only.Visualization software must be usedto facilitate the review and edit of thegenerated contours.Same
StructuresAvailable forContouringCT Structures• A_Aorta• A_Aorta_I• A_Celiac• A_LAD• A_Mesenteric_S• A_Pulmonary• Bag_Bowel• Bag_Bowel_Extend• Bag_Bowel_Full• Bag_Bowel_S• Bladder• Body• Bone_HyoidCT Structures• A_Aorta• A_Aorta_Base• A_Aorta_I• A_Celiac• A_LAD• A_Mesenteric_S• A_Pulmonary• Atrium_L• Atrium_R• Bowel_Bag• Bowel_Bag_Extend• Bowel_Bag_Full• Bowel_Bag_SuperiorSimilar; Thesubject deviceadds newstructures forexistingsupportedimagemodalities(CT/MR)
ItemLimbus Contour v1.8Limbus Contour v1.7 - K230575Similarities / Differences
Bone_Ilium_L Bone_Ilium_R Bone_Ilium Bone_Mandible Bowel Bowel_Extend Bowel_Full Bowel_S BrachialPlex_L BrachialPlex_R BrachialPlexs Brain Brainstem Breast_L Breast_R Breasts Bronchus Canal_Anal CaudaEquina Cavity_Oral Chestwall_L Chestwall_R Chestwalls Clavicle_L Clavicle_R Cochlea_L Cochlea_R Colon_Sigmoid Cornea_L Cornea_R Duodenum Esophagus Eye_L Eye_R Eyes Femur_Head_L Femur_Head_R Femur_Heads Gallbladder Glnd_Lacrimal_L Glnd_Lacrimal_R Glnd_Submand_L Glnd_Submand_R Glnd_Thyroid GreatVes Heart Hippocampus_L Hippocampus_R Humerus_L Humerus_R Kidney_L Kidney_R Kidneys Larynx Lens_L Lens_R Lips LiverBowel Bowel_Extend Bowel_Full Bowel_Superior Bladder Body Body+Mask Bone_Hyoid Bone_Ilium_L Bone_Ilium_R Bone_Ilium Bone_Ischium_L Bone_Ischium_R Bone_Mandible Bone_Pelvic BoneMarrow_Pelvic BrachialPlex_L BrachialPlex_R BrachialPlexs Brain Brainstem Breast_Implant_L Breast_Implant_R Breast_L Breast_R Breasts Bronchus Canal_Anal Carina CaudaEquina Cavity_Oral Cerebellum Chestwall_L Chestwall_R Chestwall Clavicle_L Clavicle_R Cochlea_L Cochlea_R Colon_Sigmoid Cornea_L Cornea_R Duodenum Esophagus Eye_L Eye_R Eyes Femur_Head_L Femur_Head_R Femur_Heads Gallbladder Glnd_Lacrimal_L Glnd_Lacrimal_R Glnd_Submand_L Glnd_Submand_R Glnd_Thyroid GreatVes Heart
ItemLimbus Contour v1.8Limbus Contour v1.7 - K230575Similarities /Differences
LN_Ax_Sclav_R LN_Ax_L1_L LN_Ax_L1_R LN_Ax_L2_L LN_Ax_L2_R LN_Ax_L3_L LN_Ax_L3_R LN_Sclav_L LN_Sclav_R LN_IMN_L LN_IMN_R LN_Neck_L LN_Neck_R LN_Neck_234_L LN_Neck_234_R LN_Neck_2347AB_L LN_Neck_2347AB_R LN_Neck_IA LN_Neck_IA6 LN_Neck_IB_L LN_Neck_IB_R LN_Neck_II_L LN_Neck_II_R LN_Neck_III_L LN_Neck_III_R LN_Neck_IV_L LN_Neck_IV_R LN_Neck_V_L LN_Neck_V_R LN_Neck_VI LN_Neck_VIIAB_L LN_Neck_VIIAB_R LN_Pelvis Lung_L Lung_R Lungs Musc_Constrict Musc_PecMinor_L Musc_PecMinor_R Musc_Sclmast_L Musc_Sclmast_R OpticChiasm OpticNrv_L OpticNrv_R Pancreas Parotid_L Parotid_R PelvisVessels PenileBulb Pituitary Prostate Prostate+SeminalVes PubicSymphys Rectum Retina_L Retina_R Ribs_L Ribs_R RibsHippocampus_L Hippocampus_R Humerus_L Humerus_R InternalAuditoryCanal_L InternalAuditoryCanal_R Kidney_L Kidney_R Kidneys Larynx Lens_L Lens_R Lips Liver Lung_L Lung_R Lungs Mesorectum Musc_Constrict Musc_PecMinor_L Musc_PecMinor_R Musc_Sclmast_L Musc_Sclmast_R Optics OpticChiasm OpticNrv_L OpticNrv_R Pancreas Parotid_L Parotid_R PelvisVessels PenileBulb Pericardium Pericardium+A_Pulm Pituitary Prostate Prostate+SeminalVes ProstateBed PubicSymphys Rectum Retina_L Retina_R Ribs_L Ribs_R Ribs Sacrum SeminalVes Skin SpinalCanal SpinalCord Spleen Sternum Stomach Trachea Uterus+Cervix V_Venacava_I V_Venacava_S Vagina VB C1
ItemLimbus Contour v1.8Limbus Contour v1.7 - K230575Similarities / Differences
Sacrum SeminalVes Skin SpinalCanal SpinalCord Spleen Sternum Stomach Trachea Uterus_Cervix V_Venacava_l V_Venacava_S Vagina Ventricle_L MR Structures Brainstem Cornea_L Cornea_R Eye_L Eye_R Hippocampus_L Hippocampus_R Optics PenileBulb Prostate Retina_L Retina_R SeminalVesVB_C2 VB_C3 VB_C4 VB_C5 VB_C6 VB_C7 VB_L1 VB_L2 VB_L3 VB_L4 VB_L5 VB_T01 VB_T02 VB_T03 VB_T04 VB_T05 VB_T06 VB_T07 VB_T08 VB_T09 VB_T10 VB_T11 VB_T12 VBs Ventricle_L Ventricle_R Bladder_HDR Bowel_HDR Canal_Anal_HDR Colon_Sigmoid_HDR Rectum_HDR Urethra_HDR Bladder_CBCT Femur_Head_L_CBCT Femur_Head_R_CBCT LN_Pelvics_CBCT Prostate_CBCT Rectum_CBCT SeminalVes_CBCT MR Structures Bladder Brainstem Cornea_L Cornea_R Eye_L Eye_R Femur_Head_L Femur_Head_R Hippocampus_L Hippocampus_R Optics PenileBulb PubicSymphys Prostate Rectum Retina_L Retina_R
ItemLimbus Contour v1.8Limbus Contour v1.7 - K230575Similarities /Differences
• SeminalVes• Bladder_HDR• Bowel_HDR• Canal_Anal_HDR• Colon_Sigmoid_HDR• Rectum_HDR• Urethra_HDR
TrainingCharacteristicsand datasetsThe architecture for the neuralnetwork models used in our deviceborrows its primary structure fromthe U-Net (Ronneberger 2015) andResUNet (Diakogiannisa 2020). Weuse the Adamoptimization algorithm (Kingma2014) and the Sørensen-Dicecoefficient loss function (Sørensen1948) to train the network.The models are trained withexamples of medical images and thecorrespondinghuman-generated contours for theregion of interest. During training, animage is shown to the model, andthe model generates a contour. Thecontour generated by the model iscompared to the ground truthhuman-generated contour. The errorbetween the generated and groundtruth contours is used to adjust theparameters (weights) of the model.Backpropagation is the algorithmthat uses the error to adjust themodel parameters.The scans used in training andvalidating the models were collectedfrom a variety of anonymized andpseudo-anonymized datasets thatincluded human-generated contours.Datasets are from publicly availableclinical trials, and from thecompany's clinical and researchpartners.Anatomical segmentation accuracyinvestigation by Wong 2020demonstrated that Limbus Contouroutputs are highly comparable toexpert contours (for the evaluatedHead and Neck and Prostatetreatment sites). Specifically, forarchitecture for the neural networkmodels used in our device borrowsits primary structure from the U-Net(Ronneberger 2015) and ResUNet(Diakogiannisa 2020). We use theAdamoptimization algorithm (Kingma 2014)and the Sørensen-Dice coefficientloss function (Sørensen 1948) totrain the network.The models are trained withexamples of medical images and thecorrespondinghuman-generated contours for theregion of interest. During training, animage is shown to the model, and themodel generates a contour. Thecontour generated by the model iscompared to the ground truthhuman-generated contour. The errorbetween the generated and groundtruth contours is used to adjust theparameters (weights) of the model.Backpropagation is the algorithm thatuses the error to adjust the modelparameters.The scans used in training andvalidating the models were collectedfrom a variety of anonymized andpseudo-anonymized datasets thatincluded human-generated contours.Datasets are from publicly availableclinical trials, and from thecompany's clinical and researchpartners.Anatomical segmentation accuracyinvestigation by Wong 2020demonstrated that Limbus Contouroutputs are highly comparable toexpert contours (for the evaluatedHead and Neck and Prostatetreatment sites). Specifically, for mostSame
ItemLimbus Contour v1.8Limbus Contour v1.7 - K230575Similarities /Differences
most of the anatomical structuresexamined, the Dice Scores (DSC)between Limbus Contour and expertcontours were not significantlydifferent from the inter-observerexpert variability baselines.of the anatomical structuresexamined, the Dice Scores (DSC)between Limbus Contour and expertcontours were not significantlydifferent from the inter-observerexpert variability baselines.
The investigation by Wong, Huang,Wells et al., 2021 evaluatedimplementation of Limbus Contourprospectively at two Canadianinstitutions. Limbus Contour wasused to generate OAR and CTVs forall patients undergoing RT for acentral nervous system (CNS), headand neck (H&N), or prostate cancer.Automatic contours were generatedon approximately 551 eligible cases.203 surveys were collected on 27CNS, 54 H&N, and 93 prostate RTplans, resulting in an overall surveycompliance rate of 32%. Themajority of OAR automatic contoursrequired minimal edits subjectively(mean editing score ≤ 2) andobjectively (mean DSC and 95% HDwas ≥ 0.90 and ≤ 2.0 mm,respectively).Overall, thousands of total structureswere analyzed across allinvestigations covering all supportedanatomical sites to provide asubstantial sample of device outputsto draw conclusions that anatomicalstructure contour outputs offer goodgeometric alignment with expertcontours, require minimal editing,and significantly reduce the timeneeded for contouring.The investigation by Wong, Huang,Wells et al., 2021 evaluatedimplementation of Limbus Contourprospectively at two Canadianinstitutions. Limbus Contour wasused to generate OAR and CTVs forall patients undergoing RT for acentral nervous system (CNS), headand neck (H&N), or prostate cancer.Automatic contours were generatedon approximately 551 eligible cases.203 surveys were collected on 27CNS, 54 H&N, and 93 prostate RTplans, resulting in an overall surveycompliance rate of 32%. The majorityof OAR automatic contours requiredminimal edits subjectively (meanediting score ≤ 2) and objectively(mean DSC and 95% HD was ≥ 0.90and ≤ 2.0 mm, respectively).Overall, thousands of total structureswere analyzed across allinvestigations covering all supportedanatomical sites to provide asubstantial sample of device outputsto draw conclusions that anatomicalstructure contour outputs offer goodgeometric alignment with expertcontours, require minimal editing,and significantly reduce the timeneeded for contouring.
ComputerPlatform &OperatingSystemOperating System · Windows 10 /Windows Server 2016 and AboveHardware Requirements · 2 GHz orfaster multicore processor · 8 GB ofRAM · For GPU versions, a CUDAcapable NVIDIA GPU is requiredOperating System · Windows 10 /Windows Server 2016 and AboveHardware Requirements · 2 GHz orfaster multicore processor · 16 GBof RAM · For GPU versions, aCUDA capable NVIDIA GPU isrequiredSimilar;LimbusContour v1.8.0requires 16 GBof RAMinstead of 8GB to supportaddedstructures forautomaticcontouring
ItemLimbus Contour v1.8Limbus Contour v1.7 - K230575Similarities /Differences
Cloud-baseddeploymentNoNoSame
Locallydeployed (orinstalled)YesYesSame
Data TransferExported Limbus Contour DICOMRT-Structure Set files are importedinto the Treatment Planning Systemor DICOM Viewer throughinteractions with the File SystemExported Limbus Contour DICOMRT-Structure Set files are importedinto the Treatment Planning Systemor DICOM Viewer throughinteractions with the File SystemSame

{6}------------------------------------------------

{7}------------------------------------------------

{8}------------------------------------------------

{9}------------------------------------------------

{10}------------------------------------------------

{11}------------------------------------------------

{12}------------------------------------------------

Training and Validation Datasets

The scans used in training and validating the models were collected from a variety of anonymized and pseudo-anonymized datasets that included human-generated contours as ground truths.

Datasets are from publicly available clinical trials, and from the company's clinical and research partners. All data is acquired, stored, and managed in accordance with the company's dataset management procedure.

The fundamental criteria for including a dataset for training and validation is that the scans were generated for use in the course of radiotherapy treatment. Training dataset ground truth contours were reviewed and edited when necessary by our in-house clinicians and radiation oncologist to ensure consistency with established standards and guidelines for contouring.

To reduce bias in the training data, the following selection criteria are in place:

  • · Datasets from multiple clinical sites (institutions) are included
  • Datasets include clinical sites of multiple country origin. Including but not limited to: ●
    • United States о
    • Canada O
    • United Kingdom O
    • France O
    • O Germany
    • Italy O
    • Netherlands O
    • Switzerland O
    • O Australia
    • New Zealand O
    • O Singapore
  • Ground truth annotations are consistent with recognized consensus contouring ● guidelines (RTOG 1106, RTOG 0848, EMBRACE II, DAHANCA, NRG, ESTRO, ACROP, EPTN)
  • Datasets include different makes and models of imaging devices (CT/MR scans) ●

{13}------------------------------------------------

  • O Sampling data from many different institutions and countries ensures a variety of imaging devices are captured
  • O lmaging devices included in training datasets include the following manufacturers: GE, Siemens, Phillips, Toshiba, Elekta
  • All imaqing data was captured as part of standard clinic protocols for image о acquisition in the course of radiation treatment planning. All imaging data is DICOM format and conforms to the DICOM standard (version 3.0 and newer)
  • The scans and ground truth contours in the datasets are from the general population of patients receiving radiotherapy treatment. The datasets are not restricted on the basis of age, ethnicity, race, gender, or disease states. A mix of healthy patients with disease were used as training data.
    • O By sampling a large volume of data from a variety of institutions, countries, and including publically available datasets; a general population of patients receiving radiotherapy treatment is created. Multiple scan locations were used in the training data. For example, the scans used to train the parotid gland model were head and neck scans, while the scans used to train the bladder model were pelvic scans. The scans come from many different makes and models of imaging devices for both the CT and MRI scans.
    • O The total number of unique scans included in training datasets exceeds 10,000 scans.

The following table shows the number of patients used in the training and validation data for each model. For each model, the training and validation sets are kept completely separate from the testing sets.

StructureModalityBody siteNumber of training scansNumber of validation scans
Canal_AnalCTPelvis108450
Canal_Anal (Female)CTPelvis38343
Canal_Anal_HDRCTPelvis46649
Canal_Anal_HDRMRIPelvis30434
A_AortaCTThorax71550
A_Aorta_BaseCTThorax33137
A_Aorta_ICTAbdomen35240
Applicator_Cylinder (beta)CTPelvis21724
Applicator_Ring (beta)CTPelvis16319
BladderCTPelvis110550
Bladder_CBCTCTPelvis35639
Bladder (Female)CTPelvis37843
Bladder_HDRCTPelvis71249
Bladder_HDRMRIPelvis30334
BowelCTPelvis69750
Bowel_ExtendCTPelvis69750
Bowel_Extend (Female)CTPelvis69750
Bowel (Female)CTPelvis69750
Bowel_FullCTPelvis69750
Bowel_Full (Female)CTPelvis69750
Bowel_HDRCTPelvis68250
Bowel_HDRMRIPelvis30536
Bowel_SuperiorCTAbdomen45350
BladderMRIPelvis57950
Bowel_BagCTPelvis69750
Bowel_Bag_ExtendCTPelvis69750
Bowel_Bag_Extend (Female)CTPelvis69750
Bowel_Bag (Female)CTPelvis69750
Bowel_Bag_FullCTPelvis69750
Bowel_Bag_Full (Female)CTPelvis69750
Bowel_Bag_SuperiorCTAbdomen45350
BrainCTHead Neck45247
BrainstemCTHead Neck61450
BrainstemMRIHead Neck24127
BreastsCTThorax66050
Breast_LCTThorax66050
Wire_Breast_L (beta)CTThorax66050
Breast_RCTThorax66050
Wire_Breast_R (beta)CTThorax66050
LN_Ax_Sclav_LCTThorax34339
LN_Ax_Sclav_RCTThorax34339
LN_Ax_L1_LCTThorax34339
LN_Ax_L1_RCTThorax34339
LN_Ax_L2_LCTThorax34339
LN_Ax_L2_RCTThorax34339
LN_Ax_L3_LCTThorax34339
LN_Ax_L3_RCTThorax34339
LN_Sclav_LCTThorax34339
LN_Sclav_RCTThorax34339
A_CeliacCTThorax43544
CarinaCTThorax86550
CaudaEquinaCTPelvis66350
CerebellumCTHead Neck13516
ChestwallCTThorax22325
Chestwall_LCTThorax22325
CW2cm_LCTThorax22325
Chestwall_RCTThorax22325
CW2cm_RCTThorax22325
OpticChiasmCTHead Neck1254140
Clavicle_LCTHead Neck10412
Clavicle_RCTHead Neck10412
Cochlea_LCTHead Neck24829
Cochlea_RCTHead Neck24829
Musc_ConstrictCTHead Neck18621
Cornea_LCTHead Neck72950
Cornea_LMRIHead Neck19923
Cornea_RCTHead Neck72950
Cornea_RMRIHead Neck19923
Bone_lliumCTPelvis21424
Bone_Illium_LCTPelvis21424
Bone_Ilium_RCTPelvis21424
LN_Neck_LCTHead Neck37442
LN_Neck_RCTHead Neck37442
LN_Neck_IACTHead Neck11213
LN_Neck_IA6CTHead Neck11213
LN_Neck_VICTHead Neck11213
LN_Neck_234_LCTHead Neck67250
LN_Neck_234_RCTHead Neck67250
LN_Neck_2347AB_LCTHead Neck67250
LN_Neck_2347AB_RCTHead Neck67250
LN_Neck_IB_LCTHead Neck67250
LN_Neck_IB_RCTHead Neck67250
LN_Neck_II_LCTHead Neck67250
LN_Neck_II_RCTHead Neck67250
LN_Neck_III_LCTHead Neck67250
LN_Neck_III_RCTHead Neck67250
LN_Neck_IV_LCTHead Neck67250
LN_Neck_IV_RCTHead Neck67250
LN_Neck_V_LCTHead Neck67250
LN_Neck_V_RCTHead Neck67250
LN_Neck_VIIA_LCTHead Neck67250
LN_Neck_VIIA_RCTHead Neck67250
LN_Neck_VIIAB_LCTHead Neck67250
LN_Neck_VIIAB_RCTHead Neck67250
LN_Neck_VIIB_LCTHead Neck67250
LN_Neck_VIIB_RCTHead Neck67250
MesorectumCTPelvis30233
DuodenumCTAbdomen38237
EsophagusCTThorax164350
ESTRO_LN_IMN_LCTThorax40945
ESTRO_LN_IMN_RCTThorax40945
ESTRO_LN_IMN_L_ExpandCTThorax40945
ESTRO_LN_IMN_R_ExpandCTThorax40945
ESTRO_LN_Ax_IP_LCTThorax39544
ESTRO_LN_Ax_IP_RCTThorax39544
ESTRO_LN_Ax_L1_LCTThorax39544
ESTRO_LN_Ax_L1_RCTThorax39544
ESTRO_LN_Ax_L2+IP_Fill_LCTThorax39544
ESTRO_LN_Ax_L2+IP_Fill_RCTThorax39544
ESTRO_LN_Ax_L2_LCTThorax40445
ESTRO_LN_Ax_L2_RCTThorax40445
ESTRO_LN_Ax_L3_LCTThorax40445
ESTRO_LN_Ax_L3_RCTThorax40445
ESTRO_LN_Sclav_LCTThorax40945
ESTRO_LN_Sclav_RCTThorax40945
EyesCTHead Neck72950
Femur_HeadsCTPelvis51150
Femur_Head_LCTPelvis51150
Femur_Head_L_CBCTCTPelvis13917
Femur_Head_LMRIPelvis678
Femur_Head_RCTPelvis51150
Femur_Head_R_CBCTCTPelvis13917
Femur_Head_RMRIPelvis678
GallbladderCTAbdomen53950
Eye_LCTHead Neck72950
Eye_LMRIHead Neck19923
Eye_RCTHead Neck72950
Eye_RMRIHead Neck19923
GreatVesCTThorax71550
HeartCTThorax100050
Heart+A_PulmCTThorax334
Pericardium+A_PulmCTThorax334
Hippocampus_LCTHead Neck10412
Hippocampus_LMRIHead Neck14417
Hippocampus_RCTHead Neck10412
Hippocampus_RMRIHead Neck14417
Humerus_LCTThorax11413
Humerus_RCTThorax11413
InternalAuditoryCanal_LCTHead Neck25327
InternalAuditoryCanal_RCTHead Neck25327
LN_IMN_LCTThorax57450
LN_IMN_RCTThorax57450
LN_IMN_L_ExpandCTThorax57450
LN_IMN_R_ExpandCTThorax57450
Breast_Implant_LCTThorax759
Breast_Implant_RCTThorax759
LN_Inguinal_LCTPelvis28232
LN_Inguinal_RCTPelvis28232
Bone_Ischium_LCTPelvis23425
Bone_Ischium_RCTPelvis23425
V_Venacava_ICTThorax100050
KidneysCTAbdomen101850
Kidney_LCTAbdomen101850
Kidney_RCTAbdomen99950
Atrium_LCTThorax33137
A_LADCTThorax58850
Glnd_Lacrimal_LCTHead Neck28132
Glnd_Lacrimal_RCTHead Neck28132
LarynxCTHead Neck36530
Lens_LCTHead Neck67050
Lens_RCTHead Neck67050
LiverCTAbdomen100050
LipsCTHead Neck26530
Bone_HyoidCTHead Neck32635
Musc_PecMinor_LCTThorax39842
Musc_PecMinor_RCTThorax39842
SternumCTThorax26130
PubicSymphysCTPelvis54050
PubicSymphysMRIPelvis61749
LungsCTThorax57250
Lung_LCTThorax57250
Lung_RCTThorax56750
Ventricle_LCTThorax33137
Bone_MandibleCTHead Neck52150
OpticNrv_LCTHead Neck1254140
OpticNrv_RCTHead Neck1254140
OpticsCTHead Neck1254140
OpticsMRIHead Neck21424
Cavity_OralCTHead Neck24327
PancreasCTAbdomen76550
Parotid_LCTHead Neck68850
Parotid_RCTHead Neck68850
Bone_PelvicCTPelvis354
LN_PelvicsCTPelvis92150
LN_Pelvics_CBCTCTPelvis18924
BoneMarrow_PelvicCTPelvis354
PelvisVesselsCTPelvis92150
PenileBulbCTPelvis65750
PenileBulbMRIPelvis29334
PericardiumCTThorax22524
PituitaryCTHead Neck29533
BrachialPlexsCTThorax77450
BrachialPlex_LCTThorax77450
BrachialPlex_RCTThorax77450
ProstateCTPelvis88850
Prostate_CBCTCTPelvis26729
ProstateBedCTPelvis15016
ProstateFiducials (beta)CTPelvis88850
ProstateMRIPelvis169850
Prostate+SeminalVesCTPelvis90250
BronchusCTThorax86550
A_PulmonaryCTThorax67075
Atrium_RCTThorax33137
RectumCTPelvis108450
Rectum_CBCTCTPelvis36942
Rectum (Female)CTPelvis21524
Rectum_HDRCTPelvis33435
Rectum_HDRMRIPelvis30434
RectumMRIPelvis57150
Retina_LCTHead Neck72950
Retina_LMRIHead Neck19923
Retina_RCTHead Neck72950
Retina_RMRIHead Neck19923
RibsCTThorax8411
Ribs_LCTThorax8411
Ribs_RCTThorax8411
Ventricle_RCTThorax33137
SacrumCTPelvis19522
SacrumMRIPelvis33335
Musc_Sclmast_LCTHead Neck8610
Musc_Sclmast_RCTHead Neck8610
Colon_SigmoidCTPelvis49750
Colon_Sigmoid (Female)CTPelvis49750
Colon_Sigmoid_HDRCTPelvis49448
Colon_Sigmoid_HDRMRIPelvis24024
A_Mesenteric_SCTThorax42843
GInd_Submand_LCTHead Neck57350
GInd_Submand_RCTHead Neck57350
SpleenCTAbdomen13716
SeminalVesCTPelvis90250
SeminalVes_CBCTCTPelvis23526
SeminalVesMRIPelvis58950
V_Venacava_SCTThorax38443
SpaceOARVue (beta)CTPelvis365
SpinalCordCTHeadNeck/Thorax100049
SpinalCanalCTHeadNeck/Thorax100049
StomachCTAbdomen141450
Lobe_Temporal_LCTHead Neck21123
Lobe_Temporal_RCTHead Neck21123
GInd_ThyroidCTThorax68550
TracheaCTThorax86550
Urethra_HDRCTPelvis24425
Urethra_HDRMRIPelvis23624
Uterus+CervixCTPelvis36040
VaginaCTPelvis9511
VB_C1CTHead Neck13213
VB_C2CTHead Neck13213
VB_C3CTHead Neck13213
VB_C4CTHead Neck13213
VB_C5CTHead Neck13213
VB_C6CTHead Neck13213
VB_C7CTHead Neck13213
VB_L1CTPelvis21924
VB_L2CTPelvis21924
VB_L3CTPelvis21924
VB_L4CTPelvis21924
VB_L5CTPelvis21924
VB_T01CTThorax23026
VB_T02CTThorax23026
VB_T03CTThorax23026
VB_T04CTThorax23026
VB_T05CTThorax23026
VB_T06CTThorax23026
VB_T07CTThorax23026
VB_T08CTThorax23026
VB_T09CTThorax23026
VB_T10CTThorax23026
VB_T11CTThorax23026
VB_T12CTThorax23026
VBsCTAll26028

Models underwent additional final performance testing on a separate set of scans (see VII. PERFORMANCE DATA). Validation scans are used only to determine at what epoch to stop model training.

{14}------------------------------------------------

{15}------------------------------------------------

{16}------------------------------------------------

{17}------------------------------------------------

{18}------------------------------------------------

{19}------------------------------------------------

{20}------------------------------------------------

VII. PERFORMANCE DATA

The following performance data were provided in support of the substantial equivalence determination.

Sterilization & Shelf-life Testing

The subject device is a software-only device. Therefore sterilization and shelf-life are not applicable.

Biocompatibility

The subject device is a software-only device. There are no direct patient-contacting components of the subject device. Therefore, patient contact information is not needed for this device

Electrical safety and electromagnetic compatibility (EMC)

The subject device is a software-only device. It contains no electric components, generates no electrical emissions, and uses no electrical energy of any type; therefore, this section is not applicable.

Software Verification and Validation Testing

Software verification and validation testing were conducted as recommended by FDA's Guidance for Industry and FDA Staff, "Content of Premarket Submissions for Device Software Functions". The enhanced level of documentation was provided.

{21}------------------------------------------------

Two different types of verification testing were conducted to verify the software requirements: Manual and Automated. All tests passed, demonstrating that the software performance is in accordance with the stated software requirements.

Validation testing of the following functions of the Limbus Contour application demonstrated that the software meets user needs and intended uses and to support substantial equivalence:

  • · Automatic Contouring Validation Test (Benchtop performance testing)

Automatic Contouring - Validation Test

Each structure undergoes performance testing prior to release. The objective of the testing is to verify that the software outputs meet the input requirements and that the software can consistently and accurately fulfill its intended use by contouring images to a level deemed sufficient based on published data, and expert opinion. This is achieved through testing the system functionality with controlled test datasets of medical scans with manual segmentations of structures that have been previously treated clinically and reviewed by a medical expert.

For each structure, a set of at least 10 patient scans is used for testing. A single scan may be used to test multiple structures. These test scans are randomly selected from our total pool of patient scans that contain the structure and are not included in training or validation of the models. Our total pool of patient scans that contain the structures were selected to reflect the general population of patients receiving radiation treatments.

Each of the 10 scans selected randomly for performance testing is run through the Limbus Contour software: this constitutes a single trial. Note that the same scan may appear in the test set of multiple structures, but each scan need only be run through the software once. The output of each trial is a DICOM RT-Structure file generated by the software that may contain multiple structure contours. Structure contours will be generated for scans of the appropriate body site only. For example, for pelvic scans only pelvic structures (like BLADDER) will be generated (not thorax or head and neck structures).

Test inputs:

  • A patient test scan on the computer file system -
  • -User interaction to select, import, choose structures, and start-contouring the patient test scans listed above.

Test outputs:

  • A DICOM RT-Structure file written to the test computer file system (may contain multiple structure contours)
    Supplemental data required:

  • Each patient test scan has a corresponding DICOM RT-Structure file which contains ground truth contours for some structures. The ground truth contours are from multiple experts at multiple institutions. They have all been reviewed by a board certified radiation oncologist to ensure structures are labeled properly and contoured according to clinical trial guidelines.
    Contours generated by Limbus Contour are compared to ground truth expert contours using the Sørensen-Dice Similarity Coefficient (Dice Similarity Coefficient, or DSC, for short) (Sørensen 1948). DSC is a measurement of the volumetric overlap of two contours. It is widely used in medical imaging, and specifically for evaluating the performance of autoseqmentation approaches (Balagopal 2018, Cardenas 2018, Dong 2019, van Harten 2019, Nikolov 2018, Trullo 2017, Liang 2019, Ren 2018, Wong 2019, Wong 2020).

{22}------------------------------------------------

Mean DSC values and standard deviations from published machine learning autosegmention models as references for the pass/fail criteria for benchtop testing. For each structure, we compare the lower edge of the 95% confidence interval to the mean minus the standard deviation of the reference model's DSC. If the lower edge of the confidence interval is less than the reference mean minus the standard deviation, the test fails.

The table below includes the Test DSC threshold from the reference studies. Note that there is a wide range of mean DSC scores across structures: large, easily identifiable structures (e.g. lungs) will have higher DSC scores than small, hard-to-identify structures (e.g. lacrimal glands).

Limbus Mean DSC and DSC Std Dev and DSC lower 95% conf edge are compared with the Test DSC Threshold. Full testing results for all structures are provided in the table below:

StructureLimbusMean DSCLimbusDSC StdDevNumberof ScansLimbus DSClower 95% confedgeTest DSCThresholdResult
A_Aorta0.9090950.0455771100.876493370.81Passed
A_Aorta_Base0.9795880.0286193100.959116410.81Passed
A_Aorta_I0.9380160.10304303100.864308580.81Passed
A_Celiac0.7815020.27272084100.586422820.26Passed
A_LAD0.6927660.06590144100.645626220.26Passed
A_Mesenteric_S0.8572570.14185425100.755787630.26Passed
A_Pulmonary0.9018670.03499015100.876838290.85Passed
Applicator_Cylinder (beta)0.801117330.33037573150.608162740.374Passed
Applicator_Ring (beta)0.9638630.07306595100.91159840.374Passed
Atrium_L0.9770440.0180652100.964121830.79Passed
Atrium_R0.9784510.01852677100.965198670.78Passed
Bladder0.966012380.05220935210.940241380.935Passed
Bladder0.9635180.01177413100.955095880.88Passed
Bladder_CBCT0.9591730.04229406100.928919750.91Passed
Bladder_HDR0.9311670.06094679100.887571320.56674243Passed
Bladder_HDR0.8968830.13171833100.802663930.79Passed
Bone Marrow_Pelvic0.9954140.00407252100.99250090.805Passed
Bone_Hyoid0.854114170.04163051120.826930150.77Passed
Bone_Illium_L0.98880750.01103973120.981598740.76Passed
Bone_Illium_R0.990588330.00575056120.986833320.76Passed
Bone_Ischium_L0.9389850.01573502100.927729630.76Passed
Bone_Ischium_R0.939230.01613541100.927688220.76Passed
Bone_Mandible0.940247690.01266685130.932300940.922Passed
Bone_Pelvic0.983830.00511637100.980170220.929Passed
Bowel0.907432170.06592406230.876338460.74Passed
StructureLimbusMean DSCLimbusDSC StdDevNumberof ScansLimbus DSClower 95% confedgeTest DSCThresholdResult
Bowel_Bag0.939794780.03659061230.922536470.752Passed
Bowel_Bag_Extend0.9715760.01582803200.96357020.752Passed
Bowel_Bag_Full0.96799850.01354157200.96114920.752Passed
Bowel_Bag_Superior0.936864550.09357214110.87304660.752Passed
Bowel_Extend0.9416820.03040818200.926301590.74Passed
Bowel_Full0.923513810.03444493210.906511480.74Passed
Bowel_HDR0.8413680.05558462100.801607920.2008343Passed
Bowel_HDR0.558318180.24969816110.388019370.31Passed
Bowel_Superior0.902142730.03756911110.876519890.74Passed
BrachialPlex_L0.6916050.10786794100.614446280.39Passed
BrachialPlex_R0.6938090.11005989100.615082370.39Passed
Brain0.9922050.00251205160.990784440.988Passed
Brainstem0.903346880.03859191160.881523150.695Passed
Brainstem0.9255260.02877815100.904940780.725Passed
Breast_Implant_L0.9928840.00662727100.988143460.865Passed
Breast_Implant_R0.9736630.03491225100.948690010.865Passed
Breast_L0.9545140.02763163100.93474890.726Passed
Breast_R0.939520910.04383671110.909623450.7345Passed
Bronchus0.8395150.06515951100.792905930.76Passed
CW2cm_L0.9989550.00118886100.99810460.72Passed
CW2cm_R0.9993760.00101477100.998650130.72Passed
Canal_Anal0.875960950.13633659210.8086640.803Passed
Canal_Anal_HDR0.9428910.04773688100.908744460.56167132Passed
Canal_Anal_HDR0.6102950.35031087100.359715110.31Passed
Carina101010.77Passed
CaudaEquina0.8820980.06633305100.834649490.722Passed
Cavity_Oral0.9131130.0386665100.885454580.8Passed
Cerebellum0.9832190.01399611100.973207480.83Passed
Chestwall_L0.959070910.00299448110.957028620.72Passed
Chestwall_R0.959571820.00327572110.957337720.72Passed
Clavicle_L0.980143750.01256694160.973037150.93Passed
Clavicle_R0.9815650.01013648160.975832820.93Passed
Cochlea_L0.7023110.10183115100.629470450.533Passed
Cochlea_R0.6867580.14712802100.581516270.545Passed
Colon_Sigmoid0.816253810.15924956210.737646810.704Passed
Colon_Sigmoid_HDR0.8655050.12156688100.778547340.30928644Passed
StructureLimbus Mean DSCLimbus DSC Std DevNumber of ScansLimbus DSC lower 95% conf edgeTest DSC ThresholdResult
Colon_Sigmoid_HDR0.7530360.15966944100.63882330.47Passed
Cornea_L0.961831820.06990272110.914156860.489Passed
Cornea_L0.9137180.03513108100.888588480.489Passed
Cornea_R0.969347270.05299966110.933200510.498Passed
Cornea_R0.9272230.02302511100.910752970.498Passed
Duodenum0.8284330.18461132100.696379190.649Passed
ESTRO_LN_Ax_IP_L0.9845520.0225043100.968454510.79Passed
ESTRO_LN_Ax_IP_R0.9888010.01830441100.975707730.796Passed
ESTRO_LN_Ax_L1_L0.9971220.00681545100.992246860.66Passed
ESTRO_LN_Ax_L1_R0.9675030.01693458100.955389570.66Passed
ESTRO_LN_Ax_L2+IP_Fill_L0.9929860.01314147100.983585820.73Passed
ESTRO_LN_Ax_L2+IP_Fill_R0.9942060.01093726100.98638250.73Passed
ESTRO_LN_Ax_L2_L0.9951920.01077199100.987486720.73Passed
ESTRO_LN_Ax_L2_R0.9973520.00448639100.994142860.73Passed
ESTRO_LN_Ax_L3_L0.9933820.00884358100.987056120.51Passed
ESTRO_LN_Ax_L3_R0.9921490.01468854100.981642180.51Passed
ESTRO_LN_IMN_L0.9805970.02745317100.960959550.39Passed
ESTRO_LN_IMN_L_Expand0.9820790.05662552100.941574360.39Passed
ESTRO_LN_IMN_R0.9744020.04214952100.944252140.39Passed
ESTRO_LN_IMN_R_Expand0.9778520.06968747100.928004050.39Passed
ESTRO_LN_Sclav_L0.975860.03136266100.953426060.7Passed
ESTRO_LN_Sclav_R0.987350.02268151100.971125750.7Passed
Esophagus0.837410830.02651585120.820096430.67Passed
Eye_L0.935118240.03324782170.916877960.894Passed
Eye_L0.9503370.01463563100.939868030.847Passed
Eye_R0.941917060.03257919170.924043610.902Passed
Eye_R0.9396660.03581356100.91404830.849Passed
Femur_Head_L0.9612990.00888921100.954940490.93Passed
Femur_Head_L0.9381620.04781144100.903962140.77Passed
Femur_Head_L_CBCT0.9779390.01378171100.968080850.88Passed
Femur_Head_R0.9613810.01105991100.953469760.937Passed
Femur_Head_R0.9485860.02852155100.928184330.77Passed
Femur_Head_R_CBCT0.9896670.01081208100.981933040.88Passed
Gallbladder0.9464220.05882969100.90434070.809Passed
GInd Lacrimal L0.765745380.0785035130.716494970.489Passed
StructureLimbus Mean DSCLimbus DSC Std DevNumber of ScansLimbus DSC lower 95% conf edgeTest DSC ThresholdResult
Glnd_Lacrimal_R0.734740770.09508335130.675088720.498Passed
Glnd_Submand_L0.8381830.08845188100.774912730.725Passed
Glnd_Submand_R0.8826720.0245712100.865096050.595Passed
Glnd_Thyroid0.8405750.03434333100.816008970.716Passed
GreatVes0.9562810.01660489100.94440340.81Passed
Heart0.954888330.02805647120.936567930.89Passed
Heart+A_Pulm0.9956630.01079707100.987939770.89Passed
Hippocampus_L0.8974740.14363431100.794731350.45Passed
Hippocampus_L0.8010920.07687695100.746101360.618Passed
Hippocampus_R0.8419330.23470004100.674050370.45Passed
Hippocampus_R0.8042290.07348396100.751665390.618Passed
Humerus_L0.9815920.03366976100.957507780.93Passed
Humerus_R0.9838040.02794829100.963812390.93Passed
InternalAuditoryCanal_L0.7196630.27119782100.525673250.41Passed
InternalAuditoryCanal_R0.7783020.29907667100.56437030.41Passed
Kidney_L0.972110.0055787100.968119510.83Passed
Kidney_R0.9712350.00508737100.967595970.85Passed
LN_Ax_L1_L0.933470.03827463100.906091880.66Passed
LN_Ax_L1_R0.9573660.01855924100.944090440.66Passed
LN_Ax_L2_L0.7978470.03448156100.773182090.73Passed
LN_Ax_L2_R0.8366890.03793359100.809554830.73Passed
LN_Ax_L3_L0.8414690.02407574100.824247450.51Passed
LN_Ax_L3_R0.8332020.05413932100.794475760.51Passed
LN_Ax_Sclav_L0.8548590.07708553100.799719170.66Passed
LN_Ax_Sclav_R0.8393540.0636715100.793809320.66Passed
LN_IMN_L0.6810720.05716488100.640181550.39Passed
LN_IMN_L_Expand0.9741580.08171958100.91570340.39Passed
LN_IMN_R0.7546240.0588019100.712562580.39Passed
LN_IMN_R_Expand0.9692350.09728747100.899644570.39Passed
LN_Inguinal_L0.9877520.01196273100.979194970.779Passed
LN_Inguinal_R0.9758560.01828094100.962779510.779Passed
LN_Neck_IA0.880388180.10469436110.808984670.41Passed
LN_Neck_IA60.945973640.03537206110.921849230.896Passed
LN_Neck_IB_L0.9185530.02691603100.899299770.896Passed
LN_Neck_IB_R0.9162480.01954066100.902270420.896Passed
LN_Neck_III_L0.9243770.02716647100.904944630.752Passed
StructureLimbusMean DSCLimbusDSC StdDevNumberof ScansLimbus DSClower 95% confedgeTest DSCThresholdResult
LN_Neck_III_R0.9038050.03651978100.877682140.775Passed
LN_Neck_II_L0.9214250.02096226100.906430540.894Passed
LN_Neck_II_R0.9199180.02031001100.90539010.894Passed
LN_Neck_IV_L0.8370670.10669372100.760748210.655Passed
LN_Neck_IV_R0.8134740.07643769100.758797570.655Passed
LN_Neck_L0.868750.04264226120.840905320.779Passed
LN_Neck_R0.868550.04499896120.839166430.779Passed
LN_Neck_VI0.938220830.07273804120.890724120.722Passed
LN_Neck_VIIAB_L0.7045620.14161814100.603261530.55Passed
LN_Neck_VIIAB_R0.6840870.15673354100.571974370.55Passed
LN_Neck_VIIA_L0.9736970.03639132100.947666030.54Passed
LN_Neck_VIIA_R0.9630450.0518865100.925930220.54Passed
LN_Neck_VIIB_L0.9794430.02540021100.961274050.69Passed
LN_Neck_VIIB_R0.97270.02326651100.95605730.71Passed
LN_Neck_V_L0.8996680.05719485100.858756110.785Passed
LN_Neck_V_R0.8551860.05671539100.814617070.775Passed
LN_Pelvics0.901693180.05091482220.8771390.779Passed
LN_Pelvics_CBCT0.9747420.04202674100.944679970.58Passed
LN_Sclav_L0.960930.05712461100.920068350.7Passed
LN_Sclav_R0.9584980.02948648100.937406110.7Passed
Larynx0.8987770.05827018100.857095920.77Passed
Lens_L0.782924710.08119035170.738382410.616Passed
Lens_R0.760474710.07902615170.717119730.449Passed
Lips0.8246960.14948194100.717770490.68Passed
Liver0.977733850.01147248130.97053640.92Passed
Lobe_Temporal_L0.9447440.07569022100.890602240.83Passed
Lobe_Temporal_R0.9484560.06837365100.899547840.83Passed
Lung_L0.9831150.00654768100.97843140.96Passed
Lung_R0.9836490.00652109100.978984410.96Passed
Mesorectum0.8279650.05209883100.790698330.779Passed
Musc_Constrict0.8690970.05737849100.828053760.61Passed
Musc_PecMinor_L0.8692590.04744788100.835319190.79Passed
Musc_PecMinor_R0.8635840.06177418100.819396490.796Passed
Musc_Sclmast_L0.9461170.02773018100.92628140.803Passed
Musc_Sclmast_R0.9452910.03302699100.921666560.803Passed
OpticChiasm0.659298820.1679447170.567161740.41Passed
StructureLimbusMean DSCLimbusDSC StdDevNumberof ScansLimbus DSClower 95% confedgeTest DSCThresholdResult
OpticNrv_L0.825769410.06203798170.791734410.73Passed
OpticNrv_R0.828942940.06130553170.795309770.72Passed
Optics0.7648460.05410538100.726144030.504Passed
Pancreas0.8843430.09900704100.813522550.769Passed
Parotid_L0.883520830.06794505120.839153860.778Passed
Parotid_R0.882816670.05035732120.849934190.803Passed
PelvisVessels0.9149980.02637213100.896133820.26Passed
PenileBulb0.848508180.04605243110.817099560.705Passed
PenileBulb0.732310.27283179100.537151450.46Passed
Pericardium0.9848280.0185493100.971559550.8688Passed
Pericardium+A_Pulm0.9949730.01235765100.986133480.89Passed
Pituitary0.750418670.15158537150.661885860.41Passed
Prostate0.9340930.02193268100.918404390.88Passed
Prostate0.9151640.03096645100.893013480.8Passed
ProstateBed0.746913330.1454049150.66199020.5Passed
ProstateFiducials (beta)0.614220.24931989100.435879680.41Passed
Prostate_CBCT0.9612690.04241179100.930931540.79Passed
PubicSymphys0.9437430.02100908100.928715050.76Passed
PubicSymphys0.7795850.11210947100.699392290.54Passed
Rectum0.886817620.08654191210.844099760.803Passed
Rectum0.9346190.02030278100.920096280.77Passed
Rectum_CBCT0.9631030.02896341100.942385260.87Passed
Rectum_HDR0.9185530.09535355100.850345920.56167132Passed
Rectum_HDR0.7810.15188698100.672354150.58Passed
Retina_L0.907613640.1929304110.77603150.489Passed
Retina_L0.9532710.04079533100.924089810.489Passed
Retina_R0.911916360.1905022110.781990310.498Passed
Retina_R0.928540.05520214100.889053510.498Passed
Ribs_L0.944735450.00563264110.940893890.81Passed
Ribs_R0.946216360.00495204110.942838980.81Passed
Sacrum0.970124380.01642714160.960834830.82Passed
Sacrum0.9666320.04786265100.93239550.77Passed
SeminalVes0.821480.16089309100.706392020.5Passed
SeminalVes0.8339950.05384245100.795481110.39Passed
SeminalVes_CBCT0.9046530.05295257100.866775650.621Passed
SpaceOARVue (beta)0.8669340.0421535100.83678130.5Passed
StructureLimbusMean DSCLimbusDSC StdDevNumberof ScansLimbus DSClower 95% confedgeTest DSCThresholdResult
SpinalCanal0.89717650.06232767200.865651250.722Passed
SpinalCord0.877886790.06353613280.85072650.722Passed
Spleen0.982384290.00724712140.978003070.958Passed
Sternum0.9685060.00927831100.961869160.8Passed
Stomach0.923538180.04262548110.894466810.64Passed
Trachea0.9001950.04891354100.865206790.77Passed
Urethra_HDR0.688980.26984128100.495960590.26Passed
Urethra_HDR0.5584330.30664371100.339088550.26Passed
Uterus+Cervix0.9238760.07561527100.869787850.8525Passed
VB_C10.8711190.09654266100.802061340.389Passed
VB_C20.8904650.08375338100.830555610.389Passed
VB_C30.8829840.07768781100.827413350.389Passed
VB_C40.8476070.13488571100.751122280.389Passed
VB_C50.7358880.25082081100.556474070.389Passed
VB_C60.6623130.36427326100.401745710.389Passed
VB_C70.6867720.36426675100.426209370.389Passed
VB_L10.73970.36842487120.499124770.389Passed
VB_L20.853538180.3119903110.640754980.389Passed
VB_L30.891392730.29651247110.689165690.389Passed
VB_L40.889308180.29491517110.688170530.389Passed
VB_L50.9717610.01978041100.957611930.389Passed
VB_T010.7494990.20357809100.603878130.389Passed
VB_T020.9008610.10665309100.824571270.389Passed
VB_T030.8468450.23384828100.679571640.389Passed
VB_T040.8710650.16033768100.75637430.389Passed
VB_T050.8681840.10527773100.792878080.389Passed
VB_T060.8565860.1735606100.732436850.389Passed
VB_T070.8952070.09111821100.830029490.389Passed
VB_T080.909462730.09927246110.841757060.389Passed
VB_T090.8952330.19379417100.756610630.389Passed
VB_T100.851806920.25673522130.690739990.389Passed
VB_T110.905435380.17253913130.797190220.389Passed
VB_T120.734660770.38432697130.493547120.389Passed
VBs0.9844480.01042268100.976992580.579Passed
V_Venacava_l0.953667860.05427303140.920857370.72Passed
V_Venacava_S0.8512190.0503676100.815190690.8Passed
StructureLimbusMean DSCLimbusDSC Std DevNumberof ScansLimbus DSClower 95% conf edgeTest DSCThresholdResult
Vagina0.8973410.06081143100.853842150.665Passed
Ventricle_L0.9511440.00689877100.946209260.9Passed
Ventricle_R0.9807840.01685223100.968729480.8Passed
Wire_Breast_L (beta)0.7502450.28619472100.545527850.39Passed
Wire_Breast_R (beta)0.8960530.15011288100.788676180.39Passed

{23}------------------------------------------------

{24}------------------------------------------------

{25}------------------------------------------------

{26}------------------------------------------------

{27}------------------------------------------------

{28}------------------------------------------------

{29}------------------------------------------------

Mechanical and Acoustic Testing

Not Applicable (Standalone Software)

Animal Study

Animal performance testing was not required to demonstrate safety and effectiveness of the device.

Clinical Studies

Clinical testing was not required to demonstrate the safety and effectiveness of Limbus Contour. Instead, substantial equivalence is based upon benchtop performance testing.

VIII. CONCLUSIONS

The minor differences between the subject Limbus Contour software and the predicate Limbus Contour software do not constitute a different intended use. The technological characteristics of the Limbus Contour software are similar to those of the predicate Limbus Contour software.

Results of software verification and validation testing demonstrate that the Limbus Contour software performs in accordance with specifications and that the performance is comparable to that of the predicate device. Therefore, the Limbus Contour software can be found to be substantially equivalent to the predicate Limbus Contour software device.

§ 892.2050 Medical image management and processing system.

(a)
Identification. A medical image management and processing system is a device that provides one or more capabilities relating to the review and digital processing of medical images for the purposes of interpretation by a trained practitioner of disease detection, diagnosis, or patient management. The software components may provide advanced or complex image processing functions for image manipulation, enhancement, or quantification that are intended for use in the interpretation and analysis of medical images. Advanced image manipulation functions may include image segmentation, multimodality image registration, or 3D visualization. Complex quantitative functions may include semi-automated measurements or time-series measurements.(b)
Classification. Class II (special controls; voluntary standards—Digital Imaging and Communications in Medicine (DICOM) Std., Joint Photographic Experts Group (JPEG) Std., Society of Motion Picture and Television Engineers (SMPTE) Test Pattern).