Companies are increasingly building applications which leverage AI. Testing systems built on AI is a pressing concern. In this talk we will explore strategies for testing systems built on AI, explain why building a custom benchmark should be part of your plan, and walk through the scoping and technical process of building a benchmark. Key Take Away: the goal for this talk is that listeners walk away equipped to have conversations about how testing can play a critical role as companies build AI based features and excided about this new area of testing.