Machine Learning

Advanced

Machine learning is a branch of artificial intelligence that enables computer systems to learn from data and improve their performance on tasks without being explicitly programmed for every scenario. At its core, machine learning algorithms identify patterns in data and use those patterns to make predictions or decisions. The field is broadly divided into three paradigms: supervised learning, where models are trained on labeled input-output pairs to predict outcomes for new inputs; unsupervised learning, where algorithms discover hidden structure in unlabeled data through clustering or dimensionality reduction; and reinforcement learning, where agents learn optimal behaviors through trial-and-error interaction with an environment, receiving rewards or penalties for their actions.

Deep learning, a powerful subset of machine learning, uses artificial neural networks with many layers to learn hierarchical representations of data. Inspired by the structure of the human brain, deep neural networks have achieved breakthrough results in computer vision, natural language processing, speech recognition, and generative modeling. Architectures such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), and transformers have enabled capabilities that were previously considered out of reach, from real-time image classification to human-level language understanding. The success of deep learning has been fueled by the availability of massive datasets, advances in GPU computing, and innovations in optimization algorithms like stochastic gradient descent and the Adam optimizer.

Today, machine learning powers a vast range of real-world applications across virtually every industry. In healthcare, ML models assist in diagnosing diseases from medical images and predicting patient outcomes. In finance, algorithms detect fraudulent transactions and optimize trading strategies. Recommendation systems on platforms like Netflix and Spotify use collaborative filtering and content-based approaches to personalize user experiences. Autonomous vehicles rely on machine learning for perception, planning, and decision-making. As the field continues to evolve, critical topics such as model interpretability, fairness, data privacy, and the responsible deployment of AI systems have become central concerns for researchers and practitioners alike.

Practice a little. See where you stand.

Ready to practice?5 minutes. No pressure.

Take the Quiz Learn First

Start here

Quiz

Reveal what you know — and what needs work

Adaptive Learn

Responds to how you reason, with real-time hints

Flashcards

Build recall through spaced, active review

Cheat Sheet

The essentials at a glance — exam-ready

Glossary

Master the vocabulary that unlocks understanding

Learning Roadmap

A structured path from foundations to mastery

Book

Deep-dive guide with worked examples

Key Concepts

A machine learning paradigm in which models are trained on labeled datasets containing input-output pairs. The algorithm learns a mapping function from inputs to outputs, enabling it to predict correct labels for previously unseen data. Common tasks include classification and regression.

Example

Training a spam filter on thousands of emails labeled as 'spam' or 'not spam,' so it can automatically classify new incoming emails.

A machine learning approach where algorithms learn patterns from unlabeled data without predefined output categories. The system discovers inherent structure, groupings, or relationships within the data on its own. Key techniques include clustering, dimensionality reduction, and anomaly detection.

Example

Using $k$-means clustering on customer purchase data to automatically segment customers into distinct groups for targeted marketing campaigns.

Computational models inspired by the biological neural networks of the human brain, consisting of interconnected layers of artificial neurons (nodes). Each connection has a weight that is adjusted during training, and neurons apply activation functions to produce outputs. Deep neural networks with many hidden layers can learn complex, hierarchical representations of data.

Example

A convolutional neural network (CNN) that processes an image through successive layers, first detecting edges, then shapes, then object parts, and finally recognizing the complete object as a cat or dog.

An iterative optimization algorithm used to minimize a model's loss function by updating parameters in the direction of the steepest decrease of the loss. The learning rate controls the step size, and variants like stochastic gradient descent (SGD) and Adam improve efficiency by using subsets of data or adaptive learning rates.

Example

During training, a neural network uses gradient descent to incrementally adjust its millions of weights so that its predictions on training images get progressively closer to the correct labels.

A modeling error that occurs when a machine learning model learns the training data too well, capturing noise and random fluctuations rather than the underlying pattern. An overfit model performs excellently on training data but poorly on unseen test data. Techniques like regularization, dropout, cross-validation, and early stopping help prevent overfitting.

Example

A decision tree with no depth limit memorizes every training example perfectly, achieving 100% training accuracy, but misclassifies many new test samples because it learned noise rather than generalizable patterns.

A fundamental concept describing the tension between two sources of error in machine learning models. Bias is error from overly simplistic assumptions causing the model to miss relevant patterns (underfitting), while variance is error from excessive sensitivity to training data fluctuations (overfitting). The optimal model balances both to minimize total error.

Example

A linear regression model for housing prices has high bias because it cannot capture nonlinear relationships, while a high-degree polynomial model has high variance because it fits training noise. A moderate-complexity model strikes the best balance.

The process of using domain knowledge to create, transform, or select input variables (features) that improve a machine learning model's predictive performance. Good feature engineering can dramatically boost model accuracy and is often more impactful than choosing a more complex algorithm. It includes tasks like normalization, encoding categorical variables, and creating interaction terms.

Example

For a house price prediction model, engineering features such as 'price per square foot,' 'age of the house,' and 'distance to nearest school' from raw data fields like sale price, area, construction year, and GPS coordinates.

A supervised learning algorithm that makes predictions by recursively splitting data based on feature values, forming a tree-like structure of decisions. Each internal node represents a test on a feature, each branch represents an outcome of that test, and each leaf node holds a prediction. They are intuitive and interpretable but prone to overfitting without pruning or ensemble methods.

Example

A medical diagnosis tree that first checks if a patient's temperature exceeds 38 degrees Celsius, then checks white blood cell count, then checks symptom duration, ultimately classifying the condition as bacterial infection, viral infection, or other.

Techniques that combine multiple individual models to produce a single, stronger predictive model. By aggregating the predictions of several base learners, ensembles reduce variance, bias, or both, and generally outperform any single constituent model. Major approaches include bagging (e.g., Random Forests), boosting (e.g., XGBoost, AdaBoost), and stacking.

Example

A Random Forest classifier builds 500 different decision trees on random subsets of the training data and features, then takes a majority vote across all trees to make a final prediction that is more robust than any single tree.

A technique where a model trained on one task is repurposed as the starting point for a different but related task. Instead of training from scratch, the pre-trained model's learned representations are fine-tuned on a smaller, task-specific dataset. This approach significantly reduces the data and computation required and is especially powerful in deep learning for computer vision and natural language processing.

Example

Taking a ResNet model pre-trained on millions of ImageNet images and fine-tuning its final layers on a dataset of 500 X-ray images to detect pneumonia, achieving high accuracy despite the small medical dataset.

One concept at a time.

Explore your way

Choose a different way to engage with this topic — no grading, just richer thinking.

Explore your way — choose one:

Explore with AI →

Curriculum alignment— Standards-aligned

Grade level

Grades 9-12College+Adult / Professional

Learning objectives

•Analyze supervised, unsupervised, and reinforcement learning paradigms including their assumptions, algorithms, and appropriate use cases
•Apply model evaluation techniques including cross-validation, bias-variance tradeoff analysis, and hyperparameter tuning for generalization
•Evaluate neural network architectures including CNNs, RNNs, transformers, and attention mechanisms for deep learning applications
•Design feature engineering pipelines, data preprocessing workflows, and model deployment strategies for production machine learning systems

Recommended Resources

This page contains affiliate links. We may earn a commission at no extra cost to you.

Books

Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow

by Aurelien Geron

Pattern Recognition and Machine Learning

by Christopher M. Bishop

The Hundred-Page Machine Learning Book

by Andriy Burkov

An Introduction to Statistical Learning

by Gareth James, Daniela Witten, Trevor Hastie, and Robert Tibshirani

Courses

Machine Learning Specialization

CourseraEnroll

Machine Learning with Python: From Linear Models to Deep Learning

edXEnroll

My Progress Focus Mode

Tech & Computing

Artificial Intelligence

Artificial Intelligence is the field of computer science focused on building systems that can perform tasks requiring human-like intelligence, including learning, reasoning, perception, and decision-making.

Intermediate

Tech & Computing

Data Science

An interdisciplinary field combining statistics, programming, and machine learning to extract insights and build predictive models from data for real-world decision-making.

Intermediate

STEM & Engineering

Statistics

The science of collecting, analyzing, and interpreting data using descriptive measures, inferential methods, and probability theory to draw meaningful conclusions and inform decision-making.

Intermediate

Tech & Computing

Computer Science

The study of computation, algorithms, data structures, and the design of software systems, encompassing everything from theoretical foundations to artificial intelligence and software engineering.

Intermediate

STEM & Engineering

Mathematics

The study of numbers, quantities, shapes, and patterns using logical reasoning and abstract structures, serving as the foundational language of science and technology.

Intermediate

Machine Learning

Quiz

Adaptive Learn

Flashcards

Cheat Sheet

Glossary

Learning Roadmap

Book

Key Concepts

Supervised Learning

Unsupervised Learning

Neural Networks

Gradient Descent

Overfitting

Bias-Variance Tradeoff

Feature Engineering

Decision Trees

Ensemble Methods

Transfer Learning

Explore your way

Grade level

Learning objectives

Recommended Resources

Books

Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow

Pattern Recognition and Machine Learning

The Hundred-Page Machine Learning Book

An Introduction to Statistical Learning

Courses

Machine Learning Specialization

Machine Learning with Python: From Linear Models to Deep Learning

Related Topics

Artificial Intelligence

Data Science

Statistics

Computer Science

Mathematics