LecturaInvestigaciónRadarMarco de inversión
Iniciar sesión / Registrarse
← Volver a la lectura
NoticiasTema · GPU TaskmanResumen rápido1 min de lecturaEditorial de DisconfirmAI

Microsoft VP Scott Hanselman Releases Open-Source Tool GPU Taskman for Monitoring VRAM and Local LLM Memory Needs

Microsoft VP Scott Hanselman has released GPU Taskman, an open-source terminal tool that visualizes VRAM usage and estimates KV-cache requirements for local large language models.

2026-11-12 23:37 GMT+8

Scott Hanselman, Microsoft Vice President and software developer, has released GPU Taskman, an open-source task manager specifically designed to monitor graphics processing unit (GPU) video memory usage. The tool runs on Windows, Linux, and macOS, combining process lists with device data such as VRAM occupancy, load, and temperature via a terminal interface to help developers understand which processes are consuming memory.

For locally running Large Language Models (LLMs), GPU Taskman identifies loaded runtime environments and model files, estimating the storage required for weights and the Key-Value Cache (KV-Cache). The KV-Cache is a critical data structure in Transformer architectures used to accelerate inference, growing in size with context length. The tool distinguishes between measured data and estimates, avoiding the misidentification of unused disk models as active processes.

The latest version, v0.4.0, adds support for additional Intel GPU metrics on Linux and device monitoring for Huawei Ascend NPUs. Developers explicitly state that the software is in an early experimental stage, noting that model attribution and memory allocation calculations are not direct measurements, advising users to treat estimated data with caution.

Fuentes

Iniciar sesión / Registrarse
LecturaInvestigaciónRadarMarco de inversión
heise.deiX Magazin↗
Tema

GPU Taskman

微软副总裁Scott Hanselman发布开源终端工具GPU Taskman,旨在解决本地大模型运行中显存占用不透明的问题。该工具不仅监控显卡硬件指标,还能识别进程关联的AI运行时与模型文件,估算KV缓存需求。【背景】随着本地LLM推理普…

3 pasos1 piezasActualizado 2026-11-17 13:13

Cómo llegó hasta aquí

  1. 2026-11-03Scott Hanselman在社交媒体X上首次公开介绍GPU Taskman项目,表示旨在洞察GPU内存去向。tomshardware.com ↗
  2. 2026-11-12iX Magazin报道GPU Taskman正式发布,支持Windows、Linux(含WSL)及macOS,可显示VRAM占用并估算LLM KV缓存。heise.de ↗
  3. 2026-11-12GitHub仓库显示最新版本为0.4.0,新增Intel GPU在Linux下的更多指标及华为Ascend NPU后端支持。github.com ↗

Lo que aún está pendiente

  • GPU Taskman是否会集成进Windows原生任务管理器?Hanselman曾暗示可能扩展标准监控能力。
  • 对于非GGUF格式或复杂多模型并发场景,其KV缓存估算的准确性如何验证?
  • 社区反馈指出其在某些环境下CPU占用较高,后续版本是否有性能优化计划?
Leer el tema completo →
Continuar investigando →