Gray Systems Lab (Microsoft)

foundation-model
research
big-tech
Published

November 1, 2024

Overview

Microsoft Research has developed MotherNet, a tabular foundation model that takes a novel hypernetwork approach to tabular prediction. Rather than making predictions directly, MotherNet generates the weights of a smaller task-specific neural network for each new dataset.

Key Product

MotherNet is a hypernetwork-based tabular foundation model that outputs the parameters of a compact neural network tailored to each downstream task. This meta-learning approach sidesteps the need for fine-tuning while producing lightweight, deployable models.

Team

Developed by Microsoft Research, with access to the company’s vast compute resources and research talent. The project sits within Microsoft’s broader AI research portfolio alongside Azure ML and related enterprise AI products.

Outlook

Microsoft’s hypernetwork approach is architecturally differentiated from the in-context learning methods used by most tabular FM competitors. Integration into Azure ML could provide a massive distribution channel, though it remains to be seen whether Microsoft will productize MotherNet or treat it as a research contribution.