Human-Aligned Decision Transformers for smart agriculture microgrid orchestration with zero-trust governance guarantees

说明与用途

文章描述了在农业微电网中部署人类对齐决策变压器，以符合农民优先级并提供零信任治理保障。

问题

A reinforcement‑learning agent that optimizes electricity cost misaligned with farmers’ priorities, causing manual overrides and lost trust.

结果

The HADT successfully aligned microgrid actions with farmer priorities, eliminating manual overrides and providing cryptographic guarantees that no single component could unilaterally seize control of physical infrastructure.

工作流

• 1. Deploy baseline RL scheduler and observe manual overrides.
• 2. Collect operator preference statements (e.g., "tomato harvest this week matters more").
• 3. Use an LLM‑based preference elicitation agent to convert statements into a weight vector.
• 4. Train a preference reward model on pairwise trajectory comparisons from weekly reviews.
• 5. Extend the decision transformer token stream to include return‑to‑go, preference, state, and action at every timestep.
• 6. Inject preferences at every timestep to maintain alignment over long horizons.
• 7. Wrap the transformer inference in a zero‑trust governance layer that cryptographically signs commands and requires multi‑party approval before execution.
• 8. Deploy the HADT in the microgrid and monitor for alignment and safety.
• 9. Iterate preference elicitation and reward‑model fine‑tuning based on operator feedback.

证据

the optimizer doesn’t understand that the tomato harvest this week is worth more than the electricity savings it’s chasing

来源

you can steer behavior at inference time simply by changing the target return—no retraining needed

来源

preferences are injected at every timestep, not just at the start

来源