AI Dictionary

Foundation Model

Definition

A large AI model trained on a vast amount of data that can be adapted to a wide range of downstream tasks.

Deep Dive

A Foundation Model refers to a large-scale Artificial Intelligence model, typically a deep neural network, that has been trained on a vast amount of diverse, unlabeled data at scale. These models are designed to learn broad patterns, representations, and capabilities that can then be adapted or fine-tuned for a wide range of more specific downstream tasks, rather than being built for a single purpose. They serve as a powerful general-purpose base layer upon which numerous specialized AI applications can be rapidly developed.

Examples & Use Cases

1GPT-4, a large language model capable of generating human-like text, translating languages, writing code, and answering complex questions across various domains
2DALL-E 3, an image generation model that can create diverse and highly realistic images from text descriptions, adaptable for graphic design, marketing, or entertainment
3BERT, a transformer-based model pre-trained on a massive text corpus, adaptable for tasks like sentiment analysis, question answering, and named entity recognition

Related Terms

Large Language Model (LLM)Generative AIPre-trained Model