Search Filters

Search Results

Found 1 results

510(k) Data Aggregation

    K Number
    K241837
    Device Name
    Limbus Contour
    Manufacturer
    Date Cleared
    2024-10-09

    (106 days)

    Product Code
    Regulation Number
    892.2050
    Reference & Predicate Devices
    Predicate For
    N/A
    AI/MLSaMDIVD (In Vitro Diagnostic)TherapeuticDiagnosticis PCCP AuthorizedThirdpartyExpeditedreview
    Intended Use

    Limbus Contour is a software-only medical device intended for use by trained radiation oncologists, dosimetrists and physicists to derive optimal contours for input to radiation treatment planning.

    Supported image modalities are Computed Tomography and Magnetic Resonance. The Limbus Contour Software assists in the following scenarios:

    Operates in conjunction with radiation treatment planning systems or DICOM viewing systems to load, save, and display medical images and contours for treatment evaluation and treatment planning.

    Creation, transformation, and modification of contours for applications including, but not limited to: transferring contours to radiotherapy treatment planning systems, aiding adaptive therapy and archiving contours for patient follow-up.

    Localization and definition of healthy anatomical structures.

    Limbus Contour is not intended for use with digital mammography.

    Device Description

    Limbus Contour is a stand-alone software medical device. It is a single purposes cross-platform application for automatic contouring (segmentation) of CT/MRI DICOM images via pre-trained and expert curated machine learning models. The software is intended to be used by trained medical professionals to derive contours for input to radiation treatment planning. The Limbus Contour software segments normal tissues using machine learning models and further post-processing on machine learning model prediction outputs. Limbus Contour does not display or store DICOM images and relies on existing radiotherapy treatment planning systems (TPS) and DICOM image viewers for display and modification of generated segmentations. Limbus Contour interfaces with the user's operating system (importing DICOM image .dcm files and exporting segmented DICOM RT-Structure Set .dcm files).

    AI/ML Overview

    Here's a summary of the acceptance criteria and the study details for the Limbus Contour device, based on the provided FDA 510(k) submission information:


    1. Acceptance Criteria and Reported Device Performance

    The acceptance criterion for each contoured structure is that the Limbus DSC (Dice Similarity Coefficient) lower 95% confidence edge must be greater than or equal to the "Test DSC Threshold," which is derived from the mean minus the standard deviation of reference model DSCs from published machine learning autosegmentation models.

    StructureLimbus Mean DSCLimbus DSC Std DevNumber of ScansLimbus DSC lower 95% conf edgeTest DSC ThresholdResult
    A_Aorta0.9090950.0455771100.876493370.81Passed
    A_Aorta_Base0.9795880.0286193100.959116410.81Passed
    A_Aorta_I0.9380160.10304303100.864308580.81Passed
    A_Celiac0.7815020.27272084100.586422820.26Passed
    A_LAD0.6927660.06590144100.645626220.26Passed
    A_Mesenteric_S0.8572570.14185425100.755787630.26Passed
    A_Pulmonary0.9018670.03499015100.876838290.85Passed
    Applicator_Cylinder (beta)0.801117330.33037573150.608162740.374Passed
    Applicator_Ring (beta)0.9638630.07306595100.91159840.374Passed
    Atrium_L0.9770440.0180652100.964121830.79Passed
    Atrium_R0.9784510.01852677100.965198670.78Passed
    Bladder0.966012380.05220935210.940241380.935Passed
    Bladder (MRI)0.9635180.01177413100.955095880.88Passed
    Bladder_CBCT0.9591730.04229406100.928919750.91Passed
    Bladder_HDR0.9311670.06094679100.887571320.56674243Passed
    Bladder_HDR (MRI)0.8968830.13171833100.802663930.79Passed
    Bone Marrow_Pelvic0.9954140.00407252100.99250090.805Passed
    Bone_Hyoid0.854114170.04163051120.826930150.77Passed
    Bone_Illium_L0.98880750.01103973120.981598740.76Passed
    Bone_Illium_R0.990588330.00575056120.986833320.76Passed
    Bone_Ischium_L0.9389850.01573502100.927729630.76Passed
    Bone_Ischium_R0.939230.01613541100.927688220.76Passed
    Bone_Mandible0.940247690.01266685130.932300940.922Passed
    Bone_Pelvic0.983830.00511637100.980170220.929Passed
    Bowel0.907432170.06592406230.876338460.74Passed
    Bowel_Bag0.939794780.03659061230.922536470.752Passed
    Bowel_Bag_Extend0.9715760.01582803200.96357020.752Passed
    Bowel_Bag_Full0.96799850.01354157200.96114920.752Passed
    Bowel_Bag_Superior0.936864550.09357214110.87304660.752Passed
    Bowel_Extend0.9416820.03040818200.926301590.74Passed
    Bowel_Full0.923513810.03444493210.906511480.74Passed
    Bowel_HDR0.8413680.05558462100.801607920.2008343Passed
    Bowel_HDR (MRI)0.558318180.24969816110.388019370.31Passed
    Bowel_Superior0.902142730.03756911110.876519890.74Passed
    BrachialPlex_L0.6916050.10786794100.614446280.39Passed
    BrachialPlex_R0.6938090.11005989100.615082370.39Passed
    Brain0.9922050.00251205160.990784440.988Passed
    Brainstem0.903346880.03859191160.881523150.695Passed
    Brainstem (MRI)0.9255260.02877815100.904940780.725Passed
    Breast_Implant_L0.9928840.00662727100.988143460.865Passed
    Breast_Implant_R0.9736630.03491225100.948690010.865Passed
    Breast_L0.9545140.02763163100.93474890.726Passed
    Breast_R0.939520910.04383671110.909623450.7345Passed
    Bronchus0.8395150.06515951100.792905930.76Passed
    CW2cm_L0.9989550.00118886100.99810460.72Passed
    CW2cm_R0.9993760.00101477100.998650130.72Passed
    Canal_Anal0.875960950.13633659210.8086640.803Passed
    Canal_Anal_HDR0.9428910.04773688100.908744460.56167132Passed
    Canal_Anal_HDR (MRI)0.6102950.35031087100.359715110.31Passed
    Carina101010.77Passed
    CaudaEquina0.8820980.06633305100.834649490.722Passed
    Cavity_Oral0.9131130.0386665100.885454580.8Passed
    Cerebellum0.9832190.01399611100.973207480.83Passed
    Chestwall_L0.959070910.00299448110.957028620.72Passed
    Chestwall_R0.959571820.00327572110.957337720.72Passed
    Clavicle_L0.980143750.01256694160.973037150.93Passed
    Clavicle_R0.9815650.01013648160.975832820.93Passed
    Cochlea_L0.7023110.10183115100.629470450.533Passed
    Cochlea_R0.6867580.14712802100.581516270.545Passed
    Colon_Sigmoid0.816253810.15924956210.737646810.704Passed
    Colon_Sigmoid_HDR0.8655050.12156688100.778547340.30928644Passed
    Colon_Sigmoid_HDR (MRI)0.7530360.15966944100.63882330.47Passed
    Cornea_L0.961831820.06990272110.914156860.489Passed
    Cornea_L (MRI)0.9137180.03513108100.888588480.489Passed
    Cornea_R0.969347270.05299966110.933200510.498Passed
    Cornea_R (MRI)0.9272230.02302511100.910752970.498Passed
    Duodenum0.8284330.18461132100.696379190.649Passed
    ESTRO_LN_Ax_IP_L0.9845520.0225043100.968454510.79Passed
    ESTRO_LN_Ax_IP_R0.9888010.01830441100.975707730.796Passed
    ESTRO_LN_Ax_L1_L0.9971220.00681545100.992246860.66Passed
    ESTRO_LN_Ax_L1_R0.9675030.01693458100.955389570.66Passed
    ESTRO_LN_Ax_L2+IP_Fill_L0.9929860.01314147100.983585820.73Passed
    ESTRO_LN_Ax_L2+IP_Fill_R0.9942060.01093726100.98638250.73Passed
    ESTRO_LN_Ax_L2_L0.9951920.01077199100.987486720.73Passed
    ESTRO_LN_Ax_L2_R0.9973520.00448639100.994142860.73Passed
    ESTRO_LN_Ax_L3_L0.9933820.00884358100.987056120.51Passed
    ESTRO_LN_Ax_L3_R0.9921490.01468854100.981642180.51Passed
    ESTRO_LN_IMN_L0.9805970.02745317100.960959550.39Passed
    ESTRO_LN_IMN_L_Expand0.9820790.05662552100.941574360.39Passed
    ESTRO_LN_IMN_R0.9744020.04214952100.944252140.39Passed
    ESTRO_LN_IMN_R_Expand0.9778520.06968747100.928004050.39Passed
    ESTRO_LN_Sclav_L0.975860.03136266100.953426060.7Passed
    ESTRO_LN_Sclav_R0.987350.02268151100.971125750.7Passed
    Esophagus0.837410830.02651585120.820096430.67Passed
    Eye_L0.935118240.03324782170.916877960.894Passed
    Eye_L (MRI)0.9503370.01463563100.939868030.847Passed
    Eye_R0.941917060.03257919170.924043610.902Passed
    Eye_R (MRI)0.9396660.03581356100.91404830.849Passed
    Femur_Head_L0.9612990.00888921100.954940490.93Passed
    Femur_Head_L (MRI)0.9381620.04781144100.903962140.77Passed
    Femur_Head_L_CBCT0.9779390.01378171100.968080850.88Passed
    Femur_Head_R0.9613810.01105991100.953469760.937Passed
    Femur_Head_R (MRI)0.9485860.02852155100.928184330.77Passed
    Femur_Head_R_CBCT0.9896670.01081208100.981933040.88Passed
    Gallbladder0.9464220.05882969100.90434070.809Passed
    GInd Lacrimal L0.765745380.0785035130.716494970.489Passed
    Glnd_Lacrimal_R0.734740770.09508335130.675088720.498Passed
    Glnd_Submand_L0.8381830.08845188100.774912730.725Passed
    Glnd_Submand_R0.8826720.0245712100.865096050.595Passed
    Glnd_Thyroid0.8405750.03434333100.816008970.716Passed
    GreatVes0.9562810.01660489100.94440340.81Passed
    Heart0.954888330.02805647120.936567930.89Passed
    Heart+A_Pulm0.9956630.01079707100.987939770.89Passed
    Hippocampus_L0.8974740.14363431100.794731350.45Passed
    Hippocampus_L (MRI)0.8010920.07687695100.746101360.618Passed
    Hippocampus_R0.8419330.23470004100.674050370.45Passed
    Hippocampus_R (MRI)0.8042290.07348396100.751665390.618Passed
    Humerus_L0.9815920.03366976100.957507780.93Passed
    Humerus_R0.9838040.02794829100.963812390.93Passed
    InternalAuditoryCanal_L0.7196630.27119782100.525673250.41Passed
    InternalAuditoryCanal_R0.7783020.29907667100.56437030.41Passed
    Kidney_L0.972110.0055787100.968119510.83Passed
    Kidney_R0.9712350.00508737100.967595970.85Passed
    LN_Ax_L1_L0.933470.03827463100.906091880.66Passed
    LN_Ax_L1_R0.9573660.01855924100.944090440.66Passed
    LN_Ax_L2_L0.7978470.03448156100.773182090.73Passed
    LN_Ax_L2_R0.8366890.03793359100.809554830.73Passed
    LN_Ax_L3_L0.8414690.02407574100.824247450.51Passed
    LN_Ax_L3_R0.8332020.05413932100.794475760.51Passed
    LN_Ax_Sclav_L0.8548590.07708553100.799719170.66Passed
    LN_Ax_Sclav_R0.8393540.0636715100.793809320.66Passed
    LN_IMN_L0.6810720.05716488100.640181550.39Passed
    LN_IMN_L_Expand0.9741580.08171958100.91570340.39Passed
    LN_IMN_R0.7546240.0588019100.712562580.39Passed
    LN_IMN_R_Expand0.9692350.09728747100.899644570.39Passed
    LN_Inguinal_L0.9877520.01196273100.979194970.779Passed
    LN_Inguinal_R0.9758560.01828094100.962779510.779Passed
    LN_Neck_IA0.880388180.10469436110.808984670.41Passed
    LN_Neck_IA60.945973640.03537206110.921849230.896Passed
    LN_Neck_IB_L0.9185530.02691603100.899299770.896Passed
    LN_Neck_IB_R0.9162480.01954066100.902270420.896Passed
    LN_Neck_III_L0.9243770.02716647100.904944630.752Passed
    LN_Neck_III_R0.9038050.03651978100.877682140.775Passed
    LN_Neck_II_L0.9214250.02096226100.906430540.894Passed
    LN_Neck_II_R0.9199180.02031001100.90539010.894Passed
    LN_Neck_IV_L0.8370670.10669372100.760748210.655Passed
    LN_Neck_IV_R0.8134740.07643769100.758797570.655Passed
    LN_Neck_L0.868750.04264226120.840905320.779Passed
    LN_Neck_R0.868550.04499896120.839166430.779Passed
    LN_Neck_VI0.938220830.07273804120.890724120.722Passed
    LN_Neck_VIIAB_L0.7045620.14161814100.603261530.55Passed
    LN_Neck_VIIAB_R0.6840870.15673354100.571974370.55Passed
    LN_Neck_VIIA_L0.9736970.03639132100.947666030.54Passed
    LN_Neck_VIIA_R0.9630450.0518865100.925930220.54Passed
    LN_Neck_VIIB_L0.9794430.02540021100.961274050.69Passed
    LN_Neck_VIIB_R0.97270.02326651100.95605730.71Passed
    LN_Neck_V_L0.8996680.05719485100.858756110.785Passed
    LN_Neck_V_R0.8551860.05671539100.814617070.775Passed
    LN_Pelvics0.901693180.05091482220.8771390.779Passed
    LN_Pelvics_CBCT0.9747420.04202674100.944679970.58Passed
    LN_Sclav_L0.960930.05712461100.920068350.7Passed
    LN_Sclav_R0.9584980.02948648100.937406110.7Passed
    Larynx0.8987770.05827018100.857095920.77Passed
    Lens_L0.782924710.08119035170.738382410.616Passed
    Lens_R0.760474710.07902615170.717119730.449Passed
    Lips0.8246960.14948194100.717770490.68Passed
    Liver0.977733850.01147248130.97053640.92Passed
    Lobe_Temporal_L0.9447440.07569022100.890602240.83Passed
    Lobe_Temporal_R0.9484560.06837365100.899547840.83Passed
    Lung_L0.9831150.00654768100.97843140.96Passed
    Lung_R0.9836490.00652109100.978984410.96Passed
    Mesorectum0.8279650.05209883100.790698330.779Passed
    Musc_Constrict0.8690970.05737849100.828053760.61Passed
    Musc_PecMinor_L0.8692590.04744788100.835319190.79Passed
    Musc_PecMinor_R0.8635840.06177418100.819396490.796Passed
    Musc_Sclmast_L0.9461170.02773018100.92628140.803Passed
    Musc_Sclmast_R0.9452910.03302699100.921666560.803Passed
    OpticChiasm0.659298820.1679447170.567161740.41Passed
    OpticNrv_L0.825769410.06203798170.791734410.73Passed
    OpticNrv_R0.828942940.06130553170.795309770.72Passed
    Optics (MRI)0.7648460.05410538100.726144030.504Passed
    Pancreas0.8843430.09900704100.813522550.769Passed
    Parotid_L0.883520830.06794505120.839153860.778Passed
    Parotid_R0.882816670.05035732120.849934190.803Passed
    PelvisVessels0.9149980.02637213100.896133820.26Passed
    PenileBulb0.848508180.04605243110.817099560.705Passed
    PenileBulb (MRI)0.732310.27283179100.537151450.46Passed
    Pericardium0.9848280.0185493100.971559550.8688Passed
    Pericardium+A_Pulm0.9949730.01235765100.986133480.89Passed
    Pituitary0.750418670.15158537150.661885860.41Passed
    Prostate0.9340930.02193268100.918404390.88Passed
    Prostate (MRI)0.9151640.03096645100.893013480.8Passed
    ProstateBed0.746913330.1454049150.66199020.5Passed
    ProstateFiducials (beta)0.614220.24931989100.435879680.41Passed
    Prostate_CBCT0.9612690.04241179100.930931540.79Passed
    PubicSymphys0.9437430.02100908100.928715050.76Passed
    PubicSymphys (MRI)0.7795850.11210947100.699392290.54Passed
    Rectum0.886817620.08654191210.844099760.803Passed
    Rectum (MRI)0.9346190.02030278100.920096280.77Passed
    Rectum_CBCT0.9631030.02896341100.942385260.87Passed
    Rectum_HDR0.9185530.09535355100.850345920.56167132Passed
    Rectum_HDR (MRI)0.7810.15188698100.672354150.58Passed
    Retina_L0.907613640.1929304110.77603150.489Passed
    Retina_L (MRI)0.9532710.04079533100.924089810.489Passed
    Retina_R0.911916360.1905022110.781990310.498Passed
    Retina_R (MRI)0.928540.05520214100.889053510.498Passed
    Ribs_L0.944735450.00563264110.940893890.81Passed
    Ribs_R0.946216360.00495204110.942838980.81Passed
    Sacrum0.970124380.01642714160.960834830.82Passed
    Sacrum (MRI)0.9666320.04786265100.93239550.77Passed
    SeminalVes0.821480.16089309100.706392020.5Passed
    SeminalVes (MRI)0.8339950.05384245100.795481110.39Passed
    SeminalVes_CBCT0.9046530.05295257100.866775650.621Passed
    SpaceOARVue (beta)0.8669340.0421535100.83678130.5Passed
    SpinalCanal0.89717650.06232767200.865651250.722Passed
    SpinalCord0.877886790.06353613280.85072650.722Passed
    Spleen0.982384290.00724712140.978003070.958Passed
    Sternum0.9685060.00927831100.961869160.8Passed
    Stomach0.923538180.04262548110.894466810.64Passed
    Trachea0.9001950.04891354100.865206790.77Passed
    Urethra_HDR0.688980.26984128100.495960590.26Passed
    Urethra_HDR (MRI)0.5584330.30664371100.339088550.26Passed
    Uterus+Cervix0.9238760.07561527100.869787850.8525Passed
    VB_C10.8711190.09654266100.802061340.389Passed
    VB_C20.8904650.08375338100.830555610.389Passed
    VB_C30.8829840.07768781100.827413350.389Passed
    VB_C40.8476070.13488571100.751122280.389Passed
    VB_C50.7358880.25082081100.556474070.389Passed
    VB_C60.6623130.36427326100.401745710.389Passed
    VB_C70.6867720.36426675100.426209370.389Passed
    VB_L10.73970.36842487120.499124770.389Passed
    VB_L20.853538180.3119903110.640754980.389Passed
    VB_L30.891392730.29651247110.689165690.389Passed
    VB_L40.889308180.29491517110.688170530.389Passed
    VB_L50.9717610.01978041100.957611930.389Passed
    VB_T010.7494990.20357809100.603878130.389Passed
    VB_T020.9008610.10665309100.824571270.389Passed
    VB_T030.8468450.23384828100.679571640.389Passed
    VB_T040.8710650.16033768100.75637430.389Passed
    VB_T050.8681840.10527773100.792878080.389Passed
    VB_T060.8565860.1735606100.732436850.389Passed
    VB_T070.8952070.09111821100.830029490.389Passed
    VB_T080.909462730.09927246110.841757060.389Passed
    VB_T090.8952330.19379417100.756610630.389Passed
    VB_T100.851806920.25673522130.690739990.389Passed
    VB_T110.905435380.17253913130.797190220.389Passed
    VB_T120.734660770.38432697130.493547120.389Passed
    VBs0.9844480.01042268100.976992580.579Passed
    V_Venacava_l0.953667860.05427303140.920857370.72Passed
    V_Venacava_S0.8512190.0503676100.815190690.8Passed
    Vagina0.8973410.06081143100.853842150.665Passed
    Ventricle_L0.9511440.00689877100.946209260.9Passed
    Ventricle_R0.9807840.01685223100.968729480.8Passed
    Wire_Breast_L (beta)0.7502450.28619472100.545527850.39Passed
    Wire_Breast_R (beta)0.8960530.15011288100.788676180.39Passed

    All listed structures met their respective acceptance criteria by having their Limbus DSC lower 95% confidence edge exceed or meet the specified Test DSC Thresholds.

    2. Sample Sizes Used for the Test Set and Data Provenance

    • Test Set Sample Size: For each structure, a set of at least 10 patient scans was used for initial performance testing. Some structures had larger test sets, as indicated in the table (e.g., Bladder with 21 scans, Bowel with 23 scans, SpinalCord with 28 scans).
    • Data Provenance: The test scans were randomly selected from a total pool of patient scans that contained the relevant structure. This pool was selected to reflect the general population of patients receiving radiation treatments. The data provenance details are further described in the "Training and Validation Datasets" section for the training data, implying a similar origin for the test data (multiple clinical sites and countries).

    3. Number of Experts Used to Establish the Ground Truth for the Test Set and Their Qualifications

    • Number of Experts: The ground truth contours were from "multiple experts at multiple institutions." The exact number is not explicitly stated.
    • Qualifications of Experts: The ground truth contours were all reviewed by a "board certified radiation oncologist" to ensure consistency with established standards and guidelines for contouring and proper labeling.

    4. Adjudication Method for the Test Set

    The document does not explicitly describe a specific adjudication method like "2+1" or "3+1" for the ground truth contours in the test set. It states that the ground truth contours were from "multiple experts at multiple institutions" and reviewed by "a board certified radiation oncologist." This implies a form of consensus or expert review process, though the specific protocol for resolving discrepancies (if any) is not detailed.

    5. If a Multi-Reader Multi-Case (MRMC) Comparative Effectiveness Study Was Done

    No, a multi-reader multi-case (MRMC) comparative effectiveness study was not explicitly mentioned as being performed for this submission. The performance data is focused on the standalone algorithm's accuracy (Dice Similarity Coefficient) against expert-generated ground truth.

    6. If a Standalone (i.e., algorithm only without human-in-the-loop performance) Was Done

    Yes, a standalone performance study was done. The "Automatic Contouring - Validation Test" as described is a benchtop performance test where the software's outputs are compared to expert-generated ground truth without human intervention in the contouring process of the device itself.

    7. The Type of Ground Truth Used

    The ground truth used was expert consensus contours. These were human-generated contours reviewed by a board-certified radiation oncologist to ensure they conformed to clinical trial guidelines and established standards.

    8. The Sample Size for the Training Set

    The total number of unique scans included in training datasets exceeds 10,000 scans. The table provided in the document details the number of training and validation scans for each individual structure model, with training scan counts ranging from tens to over a thousand for each structure.

    9. How the Ground Truth for the Training Set Was Established

    The ground truth for the training set was established through:

    • Human-generated contours from a variety of anonymized and pseudo-anonymized datasets.
    • These datasets were collected from publicly available clinical trials and the company's clinical and research partners.
    • The training dataset ground truth contours were reviewed and edited by in-house clinicians and radiation oncologists to ensure consistency with established standards and guidelines for contouring (e.g., RTOG 1106, RTOG 0848, EMBRACE II, DAHANCA, NRG, ESTRO, ACROP, EPTN).
    • To minimize bias, training data included scans from multiple clinical sites, countries (United States, Canada, United Kingdom, France, Germany, Italy, Netherlands, Switzerland, Australia, New Zealand, Singapore), and different makes/models of imaging devices (GE, Siemens, Phillips, Toshiba, Elekta).
    • The scans and ground truth contours were from the general patient population receiving radiotherapy, with no restrictions based on age, ethnicity, race, gender, or disease states.
    Ask a Question

    Ask a specific question about this device

    Page 1 of 1