Microsoft VP Scott Hanselman Releases Open-Source Tool GPU Taskman for Monitoring VRAM and Local LLM Memory Needs
Microsoft VP Scott Hanselman has released GPU Taskman, an open-source terminal tool that visualizes VRAM usage and estimates KV-cache requirements for local large language models.
Scott Hanselman, Microsoft Vice President and software developer, has released GPU Taskman, an open-source task manager specifically designed to monitor graphics processing unit (GPU) video memory usage. The tool runs on Windows, Linux, and macOS, combining process lists with device data such as VRAM occupancy, load, and temperature via a terminal interface to help developers understand which processes are consuming memory.
For locally running Large Language Models (LLMs), GPU Taskman identifies loaded runtime environments and model files, estimating the storage required for weights and the Key-Value Cache (KV-Cache). The KV-Cache is a critical data structure in Transformer architectures used to accelerate inference, growing in size with context length. The tool distinguishes between measured data and estimates, avoiding the misidentification of unused disk models as active processes.
The latest version, v0.4.0, adds support for additional Intel GPU metrics on Linux and device monitoring for Huawei Ascend NPUs. Developers explicitly state that the software is in an early experimental stage, noting that model attribution and memory allocation calculations are not direct measurements, advising users to treat estimated data with caution.