6 min readLocal & Private AI
Is the Snapdragon X2 Elite Worth It for Local AI Writing?
The 2026 Snapdragon refresh pushes the NPU to 80 TOPS. For running a small local writing model, here is what that buys you and what it does not.
Read article →Topic
Hardware
28 articles tagged Hardware. For the wider topic, see Local & Private AI.
5 min readLocal & Private AI
Why NPU TOPS Scores Stopped Mattering in 2026
Microsoft is no longer selling a single NPU TOPS number as the line for on-device AI. Why that figure was a poor buying signal for local writing all along.
Read article →5 min readLocal & Private AI
Microsoft Build 2026: Local AI Is No Longer Copilot+ Only
At Build 2026 Microsoft dropped the NPU-only rule and opened on-device AI to CPUs and GPUs on any Windows PC. What that means if you write locally.
Read article →6 min readLocal & Private AI
What Changes When You Move From Cloud AI to Local
Switching from a cloud assistant to a local model changes more than privacy. What actually gets better, what you give up, and what surprises people first.
Read article →6 min readLocal & Private AI
How Many Local AI Models Should You Keep Installed?
Disk space and switching overhead versus having the right tool ready. A practical answer to how many local models are worth keeping.
Read article →7 min readLocal & Private AI
Meta Is Back in Open Weights: What Muse Glimmer 30B Actually Runs On
Meta released a 30B Apache 2.0 model on 10 August 2026 that runs on one GPU. Which machines that means, and whether it helps if your job is writing emails.
Read article →6 min readLocal & Private AI
Can You Run Local AI In A VM Or Remote Desktop Session?
Virtual desktops are how a lot of regulated work happens. Whether on-device AI survives that setup, what breaks, and whether it still counts as local.
Read article →6 min readLocal & Private AI
Does Local AI Need A Graphics Card?
Most work laptops have no discrete GPU. Whether local AI writing is viable without one, what integrated graphics actually contributes, and when to stop worrying.
Read article →5 min readLocal & Private AI
How Much Disk Space Local AI Really Needs
Model files are only part of it. What local AI actually consumes on a Windows laptop, where it hides, and how to reclaim it without breaking the tool.
Read article →6 min readLocal & Private AI
How To Choose Between Two Local Models Without Guessing
A bigger model is not automatically the better one for rewriting. A fifteen minute test using your own writing that settles it properly.
Read article →5 min readLocal & Private AI
Local AI On ARM Windows Laptops: What Actually Works In 2026
Snapdragon laptops run local models, but not the way x86 machines do. What works today, what is still missing, and which tools quietly refuse to start.
Read article →6 min readLocal & Private AI
What Actually Makes A Local Model Slow
Model size is the obvious answer and usually the wrong one. The four things that decide how long a local rewrite takes, ranked by how much they matter.
Read article →6 min readLocal & Private AI
Why A Longer Context Window Costs You RAM
Million-token context sounds free until you run one locally. What the context window actually consumes, why it grows as you type, and what it means for a laptop.
Read article →6 min readLocal & Private AI
Why Local AI Slows Down On Battery, And What To Do About It
The same local model that felt fast plugged in crawls on battery. Here is what Windows is actually doing, and the three settings that get the speed back.
Read article →7 min readLocal & Private AI
Does Local AI Use Less Energy Than the Cloud?
Datacenter AI power draw is now a mainstream concern. The honest comparison between running a small model on your laptop and calling a frontier model, including where local loses.
Read article →6 min readLocal & Private AI
GGUF Explained for People Who Just Want to Run a Model
What GGUF files are, how to read the cryptic names, what Q4_K_M actually means, and the three things to check before you download several gigabytes.
Read article →6 min readLocal & Private AI
How Much VRAM Do You Need for a Local LLM in 2026?
A tier-by-tier guide from 8GB of system RAM to a 24GB GPU, with the arithmetic behind each number and the one mistake that ruins mixture-of-experts planning.
Read article →6 min readLocal & Private AI
Int4 Quantization in 2026: How Much Quality Do You Actually Lose?
Four-bit quantization is now the default for local models. What it costs in quality, where the floor is, and why the answer depends entirely on your task.
Read article →6 min readLocal & Private AI
Mixture of Experts, Explained Without the Maths
Nearly every large model in 2026 is a mixture of experts. What that means, why the two parameter counts matter differently, and the planning mistake it causes.
Read article →7 min readLocal & Private AI
NPU Support in Local LLM Runtimes: The Mid-2026 Status
Your laptop has a neural processing unit. Ollama, llama.cpp, and LM Studio do not use it. Why the NPU story is more complicated than the marketing, and what actually runs your model.
Read article →6 min readLocal & Private AI
Can You Run a Trillion-Parameter Model Locally? An Honest Answer
Open weights at frontier scale sound like they put frontier AI on your desk. The arithmetic says otherwise. What the memory math actually allows, and what you should run instead.
Read article →6 min readLocal & Private AI
How to Choose an Open-Weights Model for Your Laptop
A decision procedure that starts with your actual RAM instead of a leaderboard. Which size, which variant, which quantization, and how to know when you have picked wrong.
Read article →6 min readLocal & Private AI
NVIDIA Nemotron and the Art of Compressing a Big Model
NVIDIA keeps shipping compressed open-weight models derived from larger ones. How pruning and distillation work, and why compressed models are the ones that reach your laptop.
Read article →5 min readLocal & Private AI
Do You Need a Copilot+ PC to Run Local AI?
Copilot+ PCs set a 40 TOPS NPU bar, but most local AI writing tools never touch the NPU. What the badge actually buys you, and what runs fine without it.
Read article →4 min readLocal & Private AI
How Much RAM Do You Need to Run a Local LLM?
A straight answer by model size, why free RAM matters more than installed RAM, and how to work out whether your current machine can handle it before downloading anything.
Read article →5 min readLocal & Private AI
NPU vs CPU vs GPU for Local AI Writing
Three chips, three very different jobs. Which one actually runs your local language model, why memory bandwidth beats raw compute, and what to check on your own machine.
Read article →5 min readLocal & Private AI
Quantization Explained for People Who Just Want Better Writing
Q4_K_M, GGUF, four-bit. What the labels on local AI models actually mean, what you lose, and which one to pick for rewriting work text.
Read article →4 min readLocal & Private AI
Hardware Requirements for Running Local AI Models on Your PC
A detailed breakdown of the computer specifications needed to run local language models smoothly, proving that you do not need a supercomputer.
Read article →