Microsoft Research By Somya Chatterjee, Harshita Sahijwani, Min Chen, Sushmitha Rajeswari Muppa, Dayquan Julienne, Irene Shaffer, Chandra Inguva, Jenny Chen, Minha Hwang, Sam Ade Jacobs

From synthetic enterprise data evaluations to real Microsoft Copilot AI confidence

Read the original on Microsoft Research →

The article discusses the challenges of evaluating Microsoft Copilot at enterprise scale, emphasizing the need for test data that reflects the full complexity of real organizations. It highlights that real enterprise data contains sensitive information, making it unusable for evaluation under any circumstances. Consequently, the post explores the transition from synthetic data evaluations to achieving real confidence in Microsoft Copilot’s AI capabilities.

Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at Microsoft Research.

Towards Data Science
Sep 24

Beyond RAGs: Building Actually Truthful AI Harnesses

The article "Beyond RAGs: Building Actually Truthful AI Harnesses" discusses the limitations of Retrieval-Augmented Generation (RAG) systems, emphasizing that retrieval alone does not guarantee evidence for AI claims. It explores methods for constructing AI systems that can substantiate their statements, moving beyond simple retrieval to more robust proof mechanisms. The piece highlights the importance of developing AI that can verify its own outputs rather than merely retrieve information.

By Ari Joury, PhD
arXiv AI
Sep 12

Generating a Consistent Enterprise: Synthesis and Reference-Free Evaluation of Multi-System Business Data

The paper introduces a synthetic data generator that creates fully consistent, fictional enterprises—complete with workforce, customers, sales, support, and communication records—without relying on any real dataset. It validates realism through a five‑axis scorecard, an adversarial detector, and soundness checks, achieving a mean realism score of 99.1 across 23 generated companies. A second generator produces relational databases from business questions, ensuring qualifying rows and exact labels, and is available as a hosted service and containerized simulators.

By Benjamin Gruenbaum, Doron Porat, Assaf Natanzon, Roy Zavida, Chen Dinachi, Or Itzahary, Omer Niv
Microsoft Research
Sep 28

One year in: How Microsoft Research Asia – Singapore is advancing research, partnership and talent for real-world impact

Microsoft Research Asia – Singapore, launched a year ago, has built a solid foundation and strengthened collaboration with government, academia, and industry. The lab is exploring how frontier AI research can generate real‑world value. It continues to advance research, partnership, and talent for practical impact.

By Microsoft Research Team