Compound AI is the practice of connecting multiple components—enterprise data, LLMs, machine learning models and business logic—to form a more powerful system.