arXiv Machine Learning

Cloud-Native Evaluation-as-a-Service: A Microservices Architecture for Scalable AI Monitoring with Conformal Guarantees

arXiv:2607. 21623v1 Announce Type: new Abstract: We present EaaS, a cloud-native reference architecture that operationalizes AI evaluation methods as six stateless Kubernetes microservices: conformal prediction with finite-sample-corrected Adaptive Prediction Sets, calibration assessment, drift detection via RFF-approximated Maximum Mean Discrepancy, fairness monitoring with bootstrap confidence intervals, a DAG-based pipeline orchestrator, and a result storage API.

arXiv AI
Jul 29

Data Quality Profiling at Scale with Progressive Sampling: A Benchmark for Data-Centric AI Pipelines

arXiv:2607. 25356v1 Announce Type: cross Abstract: Data quality profiling -- computing missing-value rates, duplicate fractions, outlier densities, and functional-dependency violations -- is foundational for data-centric AI pipelines, yet exhaustive scans over millions of rows are prohibitively slow for near-real-time monitoring.

By Laure Berti-Equille
arXiv AI
Jun 30

AI4EOSC: a Federated Cloud Platform for Artificial Intelligence in Scientific Research

arXiv:2512. 16455v4 Announce Type: replace-cross Abstract: The rapid growth of Artificial Intelligence and Machine Learning in scientific research has highlighted a gap between industry-standard MLOps tools and platforms, and the unique requirements of modern and Open Science, particularly regarding the FAIR (Findable, Accessible, Interoperable, and Reusable) principles.

By Ignacio Heredia, \'Alvaro L\'opez Garc\'ia, Fernando Aguilar G\'omez, Diego Aguirre, Caterina Alarc\'on Mar\'in, Khadijeh Alibabaei, Lisana Berberi, Miguel Caballer, Amanda Calatrava, Pedro Castro, Alessandro Costantini, Mario David, Jaime D\'iez Stefan Dlugolinsky, Borja Esteban Sanchis, Giacinto Donvito, Leonhard Duda, Sa\'ul Fernandez, Andr\'es Heredia Canales, Valentin Kozlov, Sergio Langarita, Jo\~ao Machado, Germ\'an Molt\'o, Daniel San Mart\'in, Martin \v{S}eleng, Giang Nguyen, Marcin P{\l}\'ociennik, Marta Obreg\'on Ruiz, Susana Rebolledo Ruiz, Vicente Rodriguez, Judith S\'ainz-Pardo D\'iaz, Viet Tran