Este conteúdo explora uma pesquisa sobre o design de sistemas de IA que tomam decisões complexas e sequenciais em ambientes extremos, como a exploração em alto-mar. A investigação focou em integrar preferências humanas no projeto de habitats através de Decision Transformers e aprendizagem por reforço.
This article introduces Decision Transformers as a revolutionary AI architecture for precision oncology, emphasizing the crucial need to align these models with human clinical reasoning. It highlights the importance of sustainable deployment and clinical utility over statistical accuracy for AI in healthcare.
A desert field test with an autonomous rover showed that AI, while optimizing programmed metrics, failed to identify relevant geological features, not "thinking like a geologist". This frustration led to exploring human-aligned artificial intelligence for planetary geology survey missions in extreme environments with low-power deployments.
This content describes a research journey into developing Human-Aligned Decision Transformers for sustainable aquaculture monitoring systems. The core challenge addressed is extreme data sparsity in fish farms, where sensors frequently fail, leading to significant gaps in critical monitoring data and hindering actionable insights.
This article details the author's exploration of Human-Aligned Decision Transformers for low-power satellite anomaly response operations. The journey began after encountering challenges with traditional reinforcement learning agents in CubeSat simulations, highlighting the critical need for human-aligned decisions.
A personal account details a researcher's struggle with a Decision Transformer failing to maintain bio-inspired soft robotic grippers in real-world deployment, despite high simulation performance. The critical issue identified was the misalignment between the AI's learned policy and human safety expectations for the delicate hardware.