NVIDIA-NeMo/Curator — Scalable data pre processing and curation toolkit for LLMs

Description and use

NVIDIA-NeMo/Curator: NVIDIA-NeMo/Curator helps add AI capability without starting from a blank model stack.. Use it for prototype AI features; build RAG or agent workflows. Medium: useful for prototypes or internal workflows, with dependency and maintenance checks before production.

Problem

NVIDIA-NeMo/Curator helps add AI capability without starting from a blank model stack.

Outcome

Medium: useful for prototypes or internal workflows, with dependency and maintenance checks before production.

Workflow

• prototype AI features
• build RAG or agent workflows
• evaluate model tooling

Evidence

Scalable data pre processing and curation toolkit for LLMs

Source