🤗 Kernels: Major Updates
Hugging Face introduces a new 'kernel' repository type on the Hub, enhancing security with trusted publishers and code signing while improving CLI tools and framework support for kernel development.
The useful question is what changes for users, developers or buyers, and whether the announcement stays industry context or becomes something people can actually use.
Hugging Face has launched a dedicated 'kernel' repository type on the Hub, designed to streamline the packaging, distribution, and consumption of custom kernels. This new format allows users to quickly identify supported accelerators, operating systems, and backend versions for each kernel, improving discoverability and transparency. Kernels are now first-class entities on the Hub, enabling users to track trends across kernels, models, and applications more effectively. The repository type also simplifies the process of finding and evaluating kernels for specific use cases.
Security remains a top priority for the Kernels project, with several enhancements introduced to mitigate risks. Kernels execute native code with the same privileges as the Python process, making malicious kernels a potential threat. To address this, Hugging Face now supports trusted kernel publishers, restricting kernel loading to those verified by the community. Users can opt in to load kernels from untrusted sources using the 'trust_remote_code' argument. Additionally, code signing has been implemented to prevent unauthorized modifications, leveraging Sigstore’s cosign for ephemeral keys and GitHub workflow verification.
The Kernels project has undergone a significant redesign to improve usability and security. The command-line interfaces (CLIs) for both 'kernels' and 'kernel-builder' have been revamped to separate concerns, with 'kernels' focusing on loading and preparing kernels while 'kernel-builder' handles compilation. This separation enhances clarity and supports the growing trend of agentic kernel development, where automated systems generate and optimize kernels. The updated CLIs are designed to be more intuitive and agent-friendly, with non-interactive commands and structured outputs for easier integration into automated workflows.
Hugging Face has also expanded support for frameworks and backends, including improved compatibility with 'manylinux_2_28'. The project now provides better tools for evaluating kernel performance across different hardware configurations, integrating with Hugging Face Jobs for benchmarking. This allows users to assess speedups and identify optimization opportunities. Preliminary guidance on code signing setup is available in the 'kernels 0.16.0' release notes, and further developments are expected as agentic kernel development matures.