CanopyOS: Open-Weight Vision for Outdoor Urban Greening Observations

说明与用途

CanopyOS 是一个移动优先的原型，利用开放权重的图像分割模型生成关于城市绿化的透明报告。它在本地处理照片，计算覆盖率和“绿色得分”，并提供谨慎的建议，不能替代实地测量。

问题

Can an open-weight vision model support a transparent first-pass observation of an outdoor scene while making the limits of that observation visible?

结果

The prototype successfully generated traceable reports for two openly licensed photographs, demonstrating that local inference can produce a Green Score and recommendation without sending data to a hosted AI provider.

工作流

• Take a photograph of an outdoor scene
• Upload or capture image in the app
• Run local inference with nvidia/segformer-b0-finetuned-ade-512-512
• Map ADE20K labels to vegetation, hard surfaces, buildings, and open ground
• Compute classified coverage and Green Score using the disclosed heuristic
• Display segmentation overlay, indicators, and recommendation in a report
• Store scan history privately and allow deletion

证据

CanopyOS runs the pinned nvidia/segformer-b0-finetuned-ade-512-512 model locally after its weights are downloaded.

来源

The report separately shows classified coverage, the fraction of the whole image represented by those four groups.

来源

Green Score = round(100 × (0.60 × vegetation_fraction + 0.25 × open_ground_fraction + 0.15 × tree_presence))

来源

The software validation record reports 30 passing Python unit/API tests and 12 passing Playwright desktop/mobile tests.

来源

The next evaluation is to photograph multiple current outdoor locations with permission, manually review their masks and recommendations, and record failure cases.

来源