Quick Links
About to buy a new laptop or PC? It might well be an AI PC: a computer with integrated AI processing that can process AI tasks faster and, most importantly, locally.
It’s a big shift from the hardware specs we’ve long known, such as checking how much RAM a new machine has or how fast its processor is. Now, AI PCs are here to bring AI processing directly to your desktop—and just like other hardware, there are more than a few manufacturers competing for your attention.
What Is an AI PC?
An AI PC is a computer that integrates a neural processing unit (NPU), a dedicated AI processor designed to accelerate tasks involving neural computations.
Basically, an AI PC comes with a shiny new chip that works alongside your CPU, GPU, RAM, and so on. Its entire purpose is to speed up AI processing tasks, enable local AI processing (think: ChatGPT without an internet connection, running on your desktop), improve voice recognition and natural language processing, and more.
Most AI tools are cloud-based. When you use ChatGPT, Copilot, Claude, or any of the myriad generative AI chatbots, you’re communicating online. You input your request, hit send, and the data is sent to the cloud-based AI’s server; it processes the request and sends an answer. Voila, you’re using AI, but it requires a constant internet connection.
AI PCs allow you to process AI tasks without sending data over the internet, running any AI tools locally. In time, AI PCs will offer deep operating system-level integrations, allowing control over settings, features, search, and more. Windows 11 users have already experienced the precursor to these integrations with Copilot for Windows 11. While the desktop version currently requires an internet connection, it can perform basic tasks such as opening programs, making small system settings tweaks, and so on, and it is a small look into where AI PCs are heading.
What Does an NPU Do?
So, an AI PC has its core components, just like any other PC, but it also comes with a neural processing unit. The neural processing unit is the specialized processor designed to speed up AI tasks. While GPUs are adept at handling some AI tasks, such as AI image generation and editing, an NPU is further optimized to handle AI algorithm processing at a rapid speed.
NPUs have a few key functions, like outstanding performance in parallel processing and matrix multiplications. They are also highly efficient when it comes to running pre-trained AI models (like GPT-4 or Gemini). They’re also typically very energy efficient, which is incredible when you consider the amount of processing they must handle, and also come with integrations for AI frameworks such as TensorFlow PyTorch, making usage and development easier.
NPU performance is (currently) measured in TOPS (Tera Operations Per Second). This measures how many trillions of operations the NPU can perform in one second. As with most computer hardware, a higher figure indicates better performance.
For example, in December 2023, Intel’s AI-enabled Meteor Lake chips launched with 10 TOPS. Then, at in early June at Computex 2024,Intel revealed its new Lunar Lake chips, equipped with NPUs capable of up to 48 TOPS.
In a fast-moving environment with new AI hardware launching frequently, expect these figures to rise significantly with each generation.
What Does an AI PC Do?
With all that said, the main aim of an NPU is to make AI local, cut down processing time, and focus on local tasks.
For example, you can expect:
That’s just a snippet, but it gives you an idea of how an AI PC should help your daily activities.
What Is a Copilot+ PC?
Among all of the AI developments, Microsoft launched a new PC and laptop standard: Copilot+. Keeping with the Copilot branding it uses across all its AI products, a Copilot+ PC or laptop integrates local AI through an NPU. Basically, you can start using Copilot without an internet connection, bringing local AI to your laptop or PC.
Now, not just any laptop or PC can claim to be a Microsoft Copilot+ machine. Microsoft’s (current!) specifications require an NPU capable of 40 TOPS minimum, at least 16GB RAM, and at least 256GB storage. Oh, anddon’t forget the Copilot key.
These specifications are part ofwhy Qualcomm’s Snapdragon X Elite chips are so sought after—they’re powering the first generation of Microsoft’s Copilot+ standard.
Whether you need an AI PC yetis mostly up to you. If you’re upgrading your hardware anyway, having potential AI features and processing in your mind is worthwhile. If you’re really into AI and want to be at the cutting edge, go for it.
But if you’re not fussed about any AI (or are happy using the online, cloud-based AI tools as they are), I’d suggest waiting for AI PCs and laptops to develop a bit more. As said, hardware moves fast, and with Intel, AMD, Qualcomm, Apple, and Nvidia all champing at the bit, it won’t be long until we see even better AI PCs.
