We Vetted 2,000 AI Skills Before They Reached Developers
AI skills and plugins are becoming part of the software supply chain. They steer agent behavior, describe tools, run commands, access files, and shape how developers build with AI. Treating them as harmless configuration is a mistake. This talk shares what we learned from building an automated security review system for more than 2,000 internal AI skills before they reached a company wide plugin marketplace. I will walk through the risks we found, the checks that worked, the checks that created noise, and how we turned skill review into something developers could run locally and in CI. We will cover practical patterns for reviewing unsafe instructions, destructive commands, sensitive data exposure, risky tool use, credential handling, external calls, and agent behavior drift. The goal is to help AI engineers think about skills, plugins, and agent instructions as production dependencies that deserve review before they reach real users.
About the AI in Finance Track
AI in Finance sessions at AI Engineer World's Fair 2026 in San Francisco.
When
Thursday, July 2, 2026
1:55 PM - 2:15 PM·20m
Where
Track 3 · Room 2003
Capacity: 250 attendees
Sign in to add this talk to your schedule.
Speaker
Lucas Palma
Information Security Manager
Nubank
Lucas Palma is an Information Security Manager at Nubank, where he leads Product Security across Application Security, Mobile Security, AI Security, and Product Security Engineering. He works at the intersection of software engineering, product security, and AI, helping teams build safer products without slowing down innovation. With more than 15 years of experience in information security, software engineering, and financial services, Lucas has led initiatives ranging from building security programs from scratch to reducing banking malware incidents by 90 percent through layered mobile protections. His current work focuses on securing AI adoption at enterprise scale, including AI coding assistants, agentic workflows, MCP integrations, secure coding guidance, AI security tooling, and automated security review inside developer workflows. Lucas is passionate about making security practical for engineers, turning real attack patterns into guardrails, automation, evaluations, and tools that help teams ship faster and safer.