Adaptive Radiation Therapy Lab

Text-guided and agentic AI segmentation of tumours for adaptive radiotherapy and automated response assessment

Institute:
Adaptive Radiation Therapy Lab https://lmu-art-lab.userweb.mwn.de/
Subject area:
AI in Radiation Therapy/Medical Physics
Number of open position:
1
Project title:
Text-guided and agentic AI segmentation of tumours for adaptive radiotherapy and automated response assessment
Project time plan:
Full Doctoral Study-Model: 48 months
Language requirements:
English
Academic requirements:
Candidates with a master’s degree in medical imaging technology, radiotherapy physics, medical physics, biomedical engineering or computer science and hands-on experience in deep learning for radiotherapy target delineation or medical image segmentation would be ideal. Prerequisites are good programming skills (Python, PyTorch, Linux/Git) and experience fine-tuning segmentation or promptable foundation models (e.g. SAM/SAM2, MedSAM2, nnInteractive). Experience with large language models for clinical text processing, multimodal (image plus clinical data) segmentation, and integrating AI models into clinical software such as 3D Slicer is highly desirable. Clinical radiotherapy experience (CT simulation, image guidance, contouring workflows) and first-author publications in the field are a strong advantage.

Project description:

Delineating tumours is a bottleneck in two closely related clinical tasks: defining target volumes for adaptive radiotherapy, and measuring tumour burden on diagnostic imaging to assess response to systemic therapy. In radiotherapy, gross and clinical target volumes are still contoured largely by hand, which is slow, varies between observers and limits online plan adaptation on platforms such as MR-linacs. In oncologic imaging, response is assessed with RECIST, which reduces each patient to the diameters of a few manually selected target lesions, discards most of the available volumetric information and suffers from considerable inter-reader variability. Promptable foundation models (e.g. SAM2, MedSAM2, nnInteractive) and vision-language models now make it possible to segment structures from clicks, boxes or free-text instructions (e.g. “all liver metastases” or “left neck nodal CTV”), and large language model based agents can combine such tools with clinical context extracted from radiology and pathology reports, prior imaging and contouring guidelines. These agents will also be designed to self-assess and iteratively refine their segmentations, quantify uncertainty, and identify cases requiring expert review. This project aims to develop text-guided and agentic segmentation methods for (1) radiotherapy target volumes on CT, CBCT and MRI, including MR-guided adaptive workflows, and (2) oncologic lesions on longitudinal diagnostic CT, PET/CT and MRI. For the latter, the agent will detect and segment lesions, match them across time points and derive volumetric response categories, providing an automated alternative to manual RECIST reading while flagging uncertain cases for review. Methods will be integrated into clinical contouring software for human-in-the-loop correction and validated against expert observers and clinical RECIST reads on retrospective cohorts from LMU University Hospital. The project builds on our lab’s work on interactive AI contouring, promptable foundation models for segmentation and tracking, and our experience organising international data challenges.

To applicants: Please send following initial application documents to LMU-CSC Office before 7th December:

  • Resume and Research Motivation Letter
  • Certificate of Proficiency in English, equivalent to IELTS Test Academic 6.5 (no module below 6) or TOEFL IBT 95, is required
  • Two letters of recommendation directly sent from your current Supervisors/Professors to LMU-CSC Office

Contact LMU-CSC Office: csc.international@lmu.de