Kolibri is an English‑German mixture‑of‑experts transformer with 78.1 B total parameters and 3.46 B active parameters per token, released under the Apache 2.0 licence. It was trained on 24 T tokens, with German comprising over 20 % of the data, and includes supervised fine‑tuning and reinforcement learning on more than 1.2 M curated tasks. The model activates only 4.4 % of its parameters per token and, among open models evaluated, sits on the Pareto frontier of quality and serving cost for both English and German.
By Aleph Alpha, :, Moritz Althaus, Artur Baranowski, Michael Barlow, Fabien C. Y. Benureau, Felix Berkenkamp, Amrita Bhattacherjee, Lukas Bl\"ubaum, Duncan Blythe, Augustijn de Boer, Bastian Boll, Thomas F. Burns, Bj\"orn Deiseroth, Niko D\"urr, B\'eni Bal\'azs Egressy, Niklas Finken, Niklas Freymuth, Fabian Gebhart, Max Hammer, Bastian Harren, Andreas Hartel, Johann Higl, Steffen Hirschmann, Pablo Iyu Guerrero, Yasser Jadidi, Andreas Jagusch, Mitja Kleider, Markus Klein, Jonas Knupp, Murali Kondragunta, Garwin Lechner, Dominik L\^e-Kellner, Jurek Leonhardt, Jiaze Li, Sohir Maskey, Omar Mehio, Pit Neitemeier, Letitia Parcalabescu, Alejandro Petry Pacheco, Pranav Ragupathy, Martin Reinhardt, Peter Rodenkirch Nfissi, Dylan Rodriquez, Leonard Salewski, Raziye Sari, Jordan Sassoon, Ivo Schaper, Ilhan Scheer, Frank Schneider, Philipp Scholl, Lukas Schott, Eric Schreiber, Pablo Schumacher, Alessio Serra, Philipp Siedler, Prabhu Teja Sivaprasad, Mohamed Soliman, Till Speicher, Volker Stampa, Simon Thel, Serge Thilges, Irina Vidal Migall\'on, Denis Wa{\ss}mann, Samuel Weinbach, Sascha Wirges, Michael W\"uthrich, Alexei Zacharov
The paper introduces LM-DSB, a lightweight multi‑agent system that automates the creation of daily safety bulletins (DSBs) for construction sites using a retrieval‑augmented generation approach with a locally deployable large language model. The system employs specialized planner, researcher, and writer agents coordinated in a hierarchical architecture, fine‑tuned on construction safety documents and grounded in 37 HSE documents. Validation in two phases showed that the multi‑agent RAG system outperformed alternatives in lexical alignment, coherence, and document completeness, and expert reviewers rated it highly for regulatory compliance and factual accuracy.
By Xianxiang Zhao, Advik Mehta, Falak Sethi, Brian Gue, Qipei Mei, Lingzi Wu
The paper presents InstruBPM, an instruction‑tuned open‑weight large language model that generates BPMN process models from natural language descriptions. By preparing paired text‑diagram data and applying parameter‑efficient fine‑tuning with quantization, the authors demonstrate that the tuned model outperforms both untuned open‑weight baselines and strong proprietary models in sequence, structural, and guideline‑conformance metrics. The approach is cost‑effective, privacy‑preserving, and supports on‑prem deployment, with publicly released models and scripts for reproducibility.
By G\"okberk \c{C}elikmasat, Atay \"Ozg\"ovde, Fatma Ba\c{s}ak Aydemir