AI Glossary / Multimodality

🧠 Basics

Multimodality is a model's ability to work with different types of data simultaneously: text, images, audio, and video. A multimodal model can look at a photo and describe what's in it, analyze a chart from a report, or listen to a recording and summarize it. This is one of AI's most important development directions, because the world isn't made of text alone. In practice, multimodality means you can drop a screenshot of an error, a photo of a document, or a meeting recording into a chat-and work with them as naturally as with text.