DeepSeek is open-sourcing the software it uses to run its AI models at scale

What happened: DeepSeek is open-sourcing DeepInfer, the software it uses to run its AI models at scale. The framework supports the V4.1-Flash model on NVIDIA and Huawei chips and omits several parts of a full service. Why it matters: The release gives outside developers access to DeepSeek's inference stack, and the framework's support for Huawei chips alongside NVIDIA hardware is stated in the content. Total: 372 characters. Coverage: 3 outlets in 24h

DeepSeek is open-sourcing DeepInfer, the software it uses to run its AI models at scale. The framework supports the V4.1-Flash model on NVIDIA and Huawei chips and omits several parts of a full service.

The release gives outside developers access to DeepSeek's inference stack, and the framework's support for Huawei chips alongside NVIDIA hardware is stated in the content. Total: 372 characters.