Skip to main content

SATURDAY, 21 NOVEMBER 2026

VARINDIA
Breaking
Data Center

AMD and Unsloth bring NPU support to 100+ Agentic AI applications

2 min read0 views
Share:
AMD and Unsloth bring NPU support to 100+ Agentic AI applications

AMD and Unsloth are enabling more than 100 agentic AI applications and workflows to access local NPU inference on supported AMD Ryzen AI PCs. AMD XDNA 2 NPUs are the first neural processing units (NPUs) supported by Unsloth Desktop, with its API that connects compatible applications to supported models running on the NPU.

AI assistants and agents that work throughout the day need efficient inference alongside everyday PC tasks. This collaboration gives users an alternative to GPU execution, putting AMD XDNA 2 NPUs to work on sustained, low-power inference while leaving CPU and GPU resources available for other applications. The integration builds on AMD’s ongoing work to expand and optimize software support, bringing dedicated NPU acceleration to more of the tools people use.

 

With support for Unsloth Desktop, AMD is expanding the supported compute resources for developers and users to deploy and run agentic workflows locally, efficiently and through familiar applications.

 

Unsloth spans model development and deployment, with open-source tools that accelerate fine-tuning and reduce GPU memory requirements, alongside a desktop app for training and inference without writing code. AMD NPU support extends that ecosystem beyond CPU and GPU execution, giving users a power-efficient inference option and connecting it to more than 100 compatible agentic applications and workflows.

 

How Does It Work?

A compatible application sends a model request to the Unsloth Desktop API, while Lemonade and FastFlowLM handle model serving and inference on the AMD XDNA 2 NPU. The model’s response returns to the application for use in its workflow. The NPU accelerates supported model inference, while the application’s other functions continue to use the PC’s CPU and GPU as needed.

 

What NPU-Powered Tools Are Available Through Unsloth?

The Unsloth Desktop API offers an OpenAI-compliant endpoint for compatible apps. That integration includes more than 100 agentic AI applications and workflows. Tools include Hermes Agent, OpenClaw, Open WebUI, Cline, LangChain and GitHub Copilot.

 

How Does It Benefit PC Users?

AI agents can carry out multistep tasks across connected tools. Access to local NPU inference gives compatible agents a more power-efficient way to process model requests as they work through those tasks, leaving CPU and GPU resources available for orchestration and other applications, helping users spend less time managing individual steps and more time reviewing results.

Join the Conversation

Loading comments…

Share your thoughts on this story. Comments are moderated before they appear.

Your email address will not be published

0/2000

Be respectful. Comments are reviewed before publication, and spam or abusive language will be removed.