Towards Data Science

FPN Paper Walkthrough: Leveraging the Internal Pyramid

Understanding how FPN allows deep learning models detecting small objects and how to implement it from scratch The post FPN Paper Walkthrough: Leveraging the Internal Pyramid appeared first on Towards Data Science .

arXiv AI
Jun 16

An affordable hardware-aware neural architecture search for deploying convolutional neural networks on ultra-low-power computing platforms

arXiv:2606. 16290v1 Announce Type: cross Abstract: Hardware-aware neural architecture search (HW-NAS) allows the integration of Convolutional Neural Networks (CNNs) in microcontrollers devices by automatically designing neural architectures that can fit prearranged hardware constraints.

By Andrea Mattia Garavagno, Edoardo Ragusa, Antonio Frisoli, Paolo Gastaldo
OpenAI Blog
Mar 14, 2023

GPT-4

We’ve created GPT-4, the latest milestone in OpenAI’s effort in scaling up deep learning. GPT-4 is a large multimodal model (accepting image and text inputs, emitting text outputs) that, while less capable than humans in many real-world scenarios, exhibits human-level performance on various professional and academic benchmarks.

OpenAI Blog
Apr 14, 2020

OpenAI Microscope

We’re introducing OpenAI Microscope, a collection of visualizations of every significant layer and neuron of eight vision “model organisms” which are often studied in interpretability. Microscope makes it easier to analyze the features that form inside these neural networks, and we hope it will help the research community as we move towards understanding these complicated systems.

arXiv Machine Learning
Jun 3

Can Local Learning Match Self-Supervised Backpropagation?

arXiv:2601. 21683v2 Announce Type: replace Abstract: While end-to-end self-supervised learning with backpropagation (global BP-SSL) has become central for training modern AI systems, theories of local self-supervised learning (local-SSL) have struggled to build functional representations in deep neural networks.

By Wu S. Zihan, Ariane Delrocq, Wulfram Gerstner, Guillaume Bellec