arXiv Machine Learning

Emergent aggregation from collective foraging

arXiv Machine Learning
3d ago

Self-organizing reinforcement learning: a learner-free swarm approaches the explore-exploit optimum

The paper demonstrates that a minimal foraging swarm can approach the explore/exploit optimum of reinforcement learning without any learner or reward signal. Agents use heavy‑tailed Levy flights to explore, recruit neighbors via a threshold cascade on their proximity network, and disperse as patch crowds, creating a cycle that balances exploration and exploitation. The swarm attains the shape of the ideal‑free distribution (committed foragers track richness with slope 0.94) and reaches this allocation dynamically in about 150 steps, though it remains slightly exploitable and does not achieve the exact equilibrium.

By Galen J. Wilkerson
arXiv Machine Learning
Oct 9

Spatial Pattern Formation from Multi-Agent Learning in Public Goods Dilemmas

The study investigates how spatial patterns arise when agents in public goods dilemmas learn movement strategies via tabular Q‑learning. Cooperators tend to cluster around resource peaks, while co‑adaptation with defectors can alter cluster strength and motion, sometimes producing traveling bands. Higher cooperator learning rates combined with lower defector rates lead to the greatest welfare losses, and crowding penalties can mitigate these losses, linking learning rates to spatial organization and collective welfare.

By Yefei Zhang, Yuxuan Zhao
arXiv AI
Sep 12

Role differentiation as ignition of a collective information engine: Structuration in Agent Populations

The paper proposes a new framework for collective information engines that rely on role differentiation rather than consensus. By modeling anti‑coordination games, agents infer roles from noisy social signals tied to persistent identities, and role‑following actions reinforce those identities, creating a feedback loop that can drive collective order. The authors show that when a social loop gain—determined by identity persistence, cognitive capacity, channel fidelity, and schema strength—exceeds one, roles emerge in a bifurcation cascade whose type is selected by resource‑driven replicator dynamics, offering a mechanistic basis for distributional AGI takeoff and a control lever for platform design.

By Maximilian Puelma Touzel
arXiv AI
Oct 7

Self-Referenced Social Preferences: Cooperation without Observing Others Rewards

The paper introduces self‑referenced social preferences, allowing agents to learn cooperative behavior without observing others’ private rewards. Each agent models its own reward, applies this model to observed transitions of other agents, and uses the resulting assessments to inform either the learning reward or policy updates. Experiments on three social‑dilemma environments show that agents can achieve cooperation and more equitable outcomes even when independent learners fail, with the best integration point depending on the type of social preference used.

By Mohamed Ayman Mohamed, Harshil Kotamreddy, Marcos Menon Jose