arXiv AI

A Large-Scale Measurement of AI Bill of Materials Completeness in Hugging Face Models

arXiv:2607. 17242v1 Announce Type: cross Abstract: Pretrained machine learning (ML) models help developers build ML-intensive software systems without training models from scratch.

arXiv AI
Aug 12

Workflow Cards: Structured Summaries of Workflow Executions Using Provenance Data

arXiv:2608. 11022v1 Announce Type: cross Abstract: Model Cards and Data Cards have demonstrated the value of structured, human-readable documentation for machine learning artifacts, capturing their context, parameters, limitations, and intended use.

By Nicola Giuseppe Marchioro, Gabriele Padovani, Amal Gueroudji, Rafael Ferreira da Silva, Wesley Brewer, Valentine Anantharaj, Sandro Fiore, Renan Souza
arXiv AI
Jul 7

Gypscie: A Cross-Platform AI Artifact Management System

arXiv:2604. 10311v2 Announce Type: replace Abstract: Artificial Intelligence (AI) models, encompassing both traditional machine learning (ML) and more advanced approaches such as deep learning and large language models (LLMs), play a central role in modern applications.

By Fabio Porto, Eduardo Ogasawara, Gabriela Moraes Botaro, Julia Neumann Bastos, Augusto Fonseca, Esther Pacitti, Patrick Valduriez
arXiv AI
Aug 28

6.5% of the Neuro-Symbolic Literature Can Be Reproduced from Its Published Artifacts, a Six-Stage Audit Framework and First Instantiation

The paper introduces a six‑stage audit framework for assessing reproducibility in computer science literature and applies it to the neuro‑symbolic AI (NSAI) subfield. Using the framework, the authors screened 5,497 records, identified 1,304 eligible studies, and found verifiable code artifacts for only 455 of them. Of those, they fully or partially reproduced 85 studies, representing 6.52% of the eligible corpus and 18.68% of attempted reruns, highlighting a significant reproducibility gap even when code is declared available.

By Brandon Colelough, Vladimir Martirosyan, Ishan Tamrakar, William Regli, Aditya Kumar, Anh N. Nhu, Dhruv Dubey, Raj Ambavane, Haowei Deng
arXiv AI
Sep 7

Design Docs Are All You Need: An AI-native Machine-Learning Performance Tool

The paper introduces SMART, a symbolic performance‑modeling library for machine‑learning systems that relies almost entirely on natural‑language design documents rather than code. By using AI coding agents to regenerate the implementation from these documents, the framework eliminates the need for continuous refactoring as models and systems evolve. The authors demonstrate that regenerated implementations match hand‑audited reference models to round‑off precision, suggesting that design documents can serve as the durable artifact for ML‑systems co‑design tools.

By Samuel Kushnir, Kimia Noorbakhsh, Kavya Sreedhar, Liqun Cheng, Ming Liu, Parthasarathy Ranganathan, Mohammad Alizadeh, Fred Kjolstad, Suvinay Subramanian
arXiv AI
Aug 28

Knowledge Cards: Structured Knowledge for AI Systems

The paper introduces Knowledge Cards, a new structured artefact designed to capture validated knowledge about specific concepts that AI systems use to make decisions. Unlike existing model, data, and system cards, Knowledge Cards focus on the layer between inputs and outputs, documenting entities, relationships, reasoning patterns, conditions for validity, and provenance, all grounded in a formal domain ontology and signed off by a domain expert. Prototype cards have been created in the energy and pharmaceutical domains, and the schema is released as a public draft for community engagement.

By Liliana Ferreira
arXiv Machine Learning
Sep 11

Learnware and AI Model Management System

The paper proposes a shift from AI model storage to AI model management, introducing the concept of "learnware"—a combination of a model and its specification. Learnware specifications are generated without exposing developers’ training data, enabling models from different sources to be identified, reused, and assembled for new tasks. The Learnware Dock System (LDS) offers a framework for managing these learnwares and facilitates collaboration among independently developed models through a shared specification protocol.

By Zhi-Hua Zhou