Falcon3 family release: new base models, 32k context, open Falcon LLM license, and upcoming multi-modal features

AI Impact Summary

TII releases the Falcon3 family, adding Falcon3-1B-Base, Falcon3-3B-Base, Falcon3-Mamba-7B-Base, Falcon3-7B-Base, and Falcon3-10B-Base with enhanced math, coding, and reasoning capabilities. Most Falcon3 models support up to 32k tokens of context, with the 1B variant limited to 8k, and deployment formats include GGUF, GPTQ-Int4, GPTQ-Int8, AWQ, and 1.58-bit. All transformer-based Falcon3 models are compatible with the Llama architecture, enabling easier integration into existing AI stacks; the release is open-source under the Falcon LLM license. A plan to add multi-modal capabilities in January 2025 provides a clear roadmap for product teams and data pipelines to consider for future workloads.