Building RadScan AI: Autonomous Multimodal Radiology Triage on GCP Cloud Run & Vertex AI

Описание и применение

RadScan AI — это автономный помощник для радиологов, который использует GCP Cloud Run, Vertex AI Gemini и нейронную сеть CNN-BiGRU для анализа томографических снимков (DICOM). Система автоматически обнаруживает патологии, создает тепловые карты (Grad-CAM) и составляет отчеты менее чем за 3 секунды, сокращая время работы врача с 10–15 минут до 6 минут.

Задача

Radiologists face extreme burnout, evaluating 50+ volumetric MRI scans daily. Each scan contains 24 to 40 high-resolution DICOM slices. Manually inspecting every plane, checking ligament continuity across depth slices, and dictating repetitive clinical reports takes 10 to 15 minutes per study.

Результат

RadScan AI reduces radiology report drafting time from 10-15 minutes to under 3 seconds per study, saving approximately 6 minutes per scan. It achieves this by combining a 2.5D Volumetric CNN-BiGRU engine for pathology detection and Grad-CAM heatmaps for visual explanation, with Vertex AI Gemini for structured report generation.

Рабочий процесс

• Client (Next.js 14 Medical Workspace) uploads DICOM files via 1-Click Sample Buttons or upload interface.
• Frontend displays Multi-Planar Slice Slider and Grad-CAM Heatmap Opacity Layer.
• Backend Microservice (FastAPI on GCP Cloud Run L4 GPU) receives POST /api/v1/predict request.
• 2.5D Volumetric CNN-BiGRU Engine processes 24 parallel depth slices across Sagittal, Coronal, and Axial planes.
• Grad-CAM Heatmap Synthesizer generates visual heatmaps pinpointing lesion coordinates.
• Backend sends results to LLM Engine (Vertex AI Gemini 3.5 Flash) via POST /api/v1/report.
• Gemini generates structured DICOM reports in JSON format.
• Frontend displays the clinical report and interactive heatmap to the radiologist.

Доказательства

Manually inspecting every plane, checking ligament continuity across depth slices, and dictating repetitive clinical reports takes 10 to 15 minutes per study.

Источник

drafts structured DICOM reports in under 3 seconds—saving radiologists ~6 minutes per scan.

Источник

trained on 819,100 DICOMs / 530 GB data

Источник