Gate News message, April 23 — DeepSeek has open-sourced TileKernels under the MIT license, a GPU kernel library written in TileLang for large language model training and inference. TileLang is a domain-specific language developed by the tile-ai team for expressing high-performance GPU kernels in Python. DeepSeek stated that most kernels in the library have approached hardware performance limits in compute density and memory bandwidth, with portions already deployed in internal training and inference operations.
The library comprises six categories of kernels: MoE (mixture of experts) gating and routing, including Top-k expert selection, token-to-expert mapping, and fused expand/shrink with weight normalization; quantization supporting FP8, FP4, and E5M6 formats with per-token, per-block, and per-channel quantization, including fused SwiGLU+quantization operations; batch transpose; Engram gating with fused RMSNorm forward/backward propagation and weight gradient reduction; Manifold HyperConnection with Sinkhorn normalization and mixed split/apply; and high-level autograd interfaces that wrap low-level kernels into trainable layers.
Engram and Manifold HyperConnection are proprietary components of DeepSeek’s model architecture, with implementation details disclosed publicly for the first time. The library requires NVIDIA SM90 or SM100 architecture GPUs (H100/H200 or Blackwell series), CUDA Toolkit 13.1 or higher, and PyTorch 2.10 or higher.
Disclaimer: The information on this page may come from third parties and does not represent the views or opinions of Gate. The content displayed on this page is for reference only and does not constitute any financial, investment, or legal advice. Gate does not guarantee the accuracy or completeness of the information and shall not be liable for any losses arising from the use of this information. Virtual asset investments carry high risks and are subject to significant price volatility. You may lose all of your invested principal. Please fully understand the relevant risks and make prudent decisions based on your own financial situation and risk tolerance. For details, please refer to
Disclaimer.
Related Articles
Fluent Launches Ethereum Layer 2 Mainnet and BLEND Token with $50M Day-One Liquidity
Gate News message, April 24 — Fluent, an Ethereum-based Layer 2 network, activated its mainnet and native BLEND token on Friday, launching with $50 million in committed day-one liquidity. The network features a "blended execution" environment that enables applications written for different virtual m
GateNews48m ago
COTI Partners with Sayfer to Strengthen Privacy Protocol Security
Gate News message, April 24 — COTI has announced a partnership with Sayfer, a blockchain security firm founded in 2019, to reinforce the security framework supporting its privacy-focused ecosystem. Sayfer will serve as a long-term security advisor to COTI, supporting the project as it prepares to
GateNews3h ago
CoW Swap Launches Solver Infrastructure Upgrades to Strengthen Bidding Mechanism
Gate News message, April 24 — CoW Swap has deployed two solver infrastructure upgrades to enhance bidding mechanisms and optimize execution processes, according to CoW DAO.
The first upgrade, "hidden bids until deadline," prevents solvers from seeing each other's quotes during auctions, requiring b
GateNews3h ago
SHIB Holder Base Surges by 10,000 Wallets to 1.573M as Shibarium Hits 1B Transactions
Gate News message, April 24 — Shiba Inu's holder base expanded sharply between April 19 and April 22, 2026, with more than 10,000 new Ethereum wallets joining the network and pushing the total above 1.573 million. Etherscan data recorded the move as one of the fastest short-term expansions this
GateNews5h ago
USDD Smart Allocator Surpasses $16M in Cumulative Investment Returns
Gate News message, April 24 — USDD's Smart Allocator has accumulated over $16 million in investment returns, demonstrating strong self-generating capability and reinforcing its long-term competitiveness in the stablecoin sector.
Smart Allocator is USDD's yield-sharing mechanism that generates retur
GateNews5h ago
