AI Glossary / Computer use
Computer use
AI controlling a computer like a human: looks at the screen, clicks, types on the keyboard.
Computer use is AI's ability to operate a computer as a human does: the model "looks" at screenshots, recognizes interface elements, and performs actions - clicks, scrolls, types text. This lets it handle any program or website, even without an API. It's a natural evolution of agents: instead of integrating with each application separately, AI uses existing human interfaces. The technology is young and can be unreliable with unusual interfaces, but the direction is clear - an assistant that will "do the clicking" for you.
Related concepts