Towards Data Science

AI Slop Is Already in Your Training Dataset. I Tested Three Ways to Spot It.

The article discusses how AI detectors can mistakenly flag genuine reviews as problematic, leading to a decrease in the accuracy of sentiment models when those reviews are filtered out. It explores three methods the author tested to identify and mitigate this issue of ‘AI slop’ in training datasets.

OpenAI Blog
Apr 6, 2017

Unsupervised sentiment neuron

We’ve developed an unsupervised system which learns an excellent representation of sentiment, despite being trained only to predict the next character in the text of Amazon reviews.

Towards Data Science
5d ago

The AI That Learned to Understand Long After It Stopped Trying

The article titled "The AI That Learned to Understand Long After It Stopped Trying" discusses a small, strange discovery in machine learning known as grokking. It highlights how this phenomenon involves an AI developing understanding after ceasing to actively try. The piece was originally published on Towards Data Science.

By Utkarsh Mangal
arXiv Computation and Language
Aug 27

KESA: A Knowledge Enhanced Approach For Sentiment Analysis

The paper introduces KESA, a knowledge‑enhanced approach for sentence‑level sentiment analysis that incorporates sentiment knowledge through two auxiliary tasks: sentiment word cloze and conditional sentiment prediction. These tasks use prior sentiment polarity to guide the selection of sentiment words and the prediction of overall sentiment, respectively, and explore label combination methods to unify multiple label types. Experiments show that KESA consistently outperforms pre‑trained models and complements existing knowledge‑enhanced post‑training methods.

By Qinghua Zhao, Shuai Ma, Shuo Ren
Towards Data Science
Aug 19

Understanding Anti-AI Public Opinion

The article explores how public opinion toward AI can shift when people recognize tangible benefits, and examines what occurs when such value is not perceived. It discusses the dynamics of acceptance and resistance to AI technologies based on perceived tradeoffs and benefits.

By Stephanie Kirmer