Transformers.js v4 Released: WebGPU Runtime & Performance Improvements

AI Impact Summary

Transformers.js v4 introduces significant performance and architectural improvements, primarily through the adoption of a new WebGPU runtime and a revamped codebase. This migration enables hardware-accelerated inference for a wider range of models, including those leveraging state-space models and Mixture of Experts architectures. The shift to esbuild for the build system dramatically reduces build times, and the new modular structure enhances maintainability and extensibility, particularly for adding new models and architectures.