arXiv AI

Turing's First Imitation Game: Design Concepts and a Human-Approximates-Machine Reading

The paper analyzes Turing’s 1948 report "Intelligent Machinery" as a foundational source for later imitation games, highlighting key design concepts such as the possibility of machine errors, the exclusion of irrelevant physical traits, the role of a human judge, and Turing’s view that intellectual activity is largely search. It argues that limiting the human contestant to a weak chess player heightens the importance of intellectual search, making human behavior more comparable to machine behavior. This reframes the 1948 game as a human‑approximates‑machine scenario, suggesting that imitation games can probe when human intelligence becomes machine‑like under specific task constraints.

arXiv AI
Sep 2

Can machines think efficiently?

The article proposes an updated Turing Test that incorporates energy consumption as a key metric, arguing that the original test is insufficient for distinguishing human from machine intelligence in the context of modern AI. It suggests that by adding an energy constraint, the test evaluates intelligence through the lens of efficiency, linking abstract thinking to tangible resource limits. The new test also provides a measurable, practical endpoint, encouraging society to balance AI time savings against total resource costs.

By Adam Winchell
arXiv AI
Sep 17

What Counts as Strategic Reasoning? A Systematic Mapping of Chess Research on Humans, Engines, and Language Models

The paper presents a systematic mapping of recent chess research involving humans, engines, neural and reinforcement‑learning systems, large language models (LLMs), and hybrid approaches. It identifies 84 core study families and classifies them by agent type, strategic‑reasoning stages, and evaluation dimensions, highlighting a strong focus on situation assessment, evaluation, and action selection while noting gaps in planning, explanation, metacognition, and human–AI collaboration. The study also distinguishes hybrid systems by integration timing and cautions that improved human performance in evaluations does not automatically imply human–AI synergy.

By Paolo Ciancarini, Remo Pareschi
arXiv AI
Aug 19

When AI Designs AI: Innovation or Imitation?

The paper investigates whether large language model (LLM) agents can design AI methods that outperform or differ from human-designed approaches. By mapping both human- and agent-designed methods into task‑specific algorithmic design spaces, the authors evaluate performance and algorithmic differences across multiple modalities. Results show that while agents occasionally match or exceed human state‑of‑the‑art performance, 96.8% of their designs fall within human‑derived spaces, often recombining or exactly matching existing human algorithms.

By Yikang Yang, Zhengxin Yang, Luzhou Peng, Minghao Luo, Yanqi Kan, Wanling Gao, Jianfeng Zhan
arXiv AI
Jul 14

People use fast and flat simulation to reason about new games

arXiv:2510. 11503v2 Announce Type: replace-cross Abstract: Games have long been a microcosm for studying planning and reasoning in both natural and artificial intelligence (AI), often focusing on expert-level or even super-human play.

By Katherine M. Collins, Cedegao E. Zhang, Lionel Wong, Mauricio Barba da Costa, Graham Todd, Adrian Weller, Samuel J. Cheyette, Thomas L. Griffiths, Joshua B. Tenenbaum
arXiv AI
Aug 13

On Benchmarking Human-Like Intelligence in Machines

arXiv:2502. 20502v2 Announce Type: replace Abstract: Recent advances in Artificial Intelligence (AI) have yielded powerful computational models that, by learning from vast amounts of human-generated data, are increasingly posited as approximate models of human cognition.

By Lance Ying, Katherine M. Collins, Lionel Wong, Ilia Sucholutsky, Ryan Liu, Adrian Weller, Tianmin Shu, Thomas L. Griffiths, Joshua B. Tenenbaum