Efficient technique improves machine-learning models’ reliability
The method enables a model to determine its confidence in a prediction, while using no additional data and far fewer computing resources than other methods.
Research
Solving a machine-learning mystery
A new study shows how large language models like GPT-3 can learn a new task from just a few examples, without the need for any new training data.
Automating the math for decision-making under uncertainty
A new tool brings the benefits of AI programming to a much broader class of problems.
ChatGPT: Optimizing Language Models for Dialogue
We’ve trained a model called ChatGPT which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests. ChatGPT is a sibling model to InstructGPT, which is trained to follow an instruction
Introducing Whisper
We’ve trained and are open-sourcing a neural net called Whisper that approaches human level robustness and accuracy on English speech recognition.
View Code
View Model Card
Whisper examples:
Whisper is an automatic speech recognition (ASR) system trained on 680,000 hours of multilingual and
Our approach to alignment research
Our approach to aligning AGI is empirical and iterative. We are improving our AI systems’ ability to learn from human feedback and to assist humans at evaluating AI. Our goal is to build a sufficiently aligned AI system that can help us solve all other alignment problems.
Introduction
DALL·E 2 Pre-Training Mitigations
In order to share the magic of DALL·E 2 with a broad audience, we needed to reduce the risks associated with powerful image generation models. To this end, we put various guardrails in place to prevent generated images from violating our content policy. This post focuses on pre-training
Learning to Play Minecraft with Video PreTraining (VPT)
We trained a neural network to play Minecraft by Video PreTraining (VPT) on a massive unlabeled video dataset of human Minecraft play, while using only a small amount of labeled contractor data. With fine-tuning, our model can learn to craft diamond tools, a task that usually takes proficient humans over
AI-Written Critiques Help Humans Notice Flaws
Showing model-generated critical comments to humans helps them find flaws in summaries.
Techniques for Training Large Neural Networks
Large neural networks are at the core of many recent advances in AI, but training them is a difficult engineering and research challenge which requires orchestrating a cluster of GPUs to perform a single synchronized calculation. As cluster and model sizes have grown, machine learning practitioners have developed an increasing