AI Glossary / GPU
⚙️ Technical
GPU
Graphics card - the workhorse of AI. Training and running models is primarily computation on GPUs.
GPU, or graphics processing unit, is the hardware workhorse of artificial intelligence. Neural networks require millions of parallel matrix operations - exactly the type of computation graphics cards were built for. That's why training and running models happens on GPUs, not regular processors. Demand for AI chips has made their manufacturers the world's most valuable companies, and access to computing power a strategic resource. At home, a GPU with sufficient VRAM lets you run open models locally.
Related concepts