All Machine Learning Algorithms by Domain (Basic to Advanced)
Supervised Learning
- Linear Regression
- Ridge Regression
- Lasso Regression
- Elastic Net
- Logistic Regression
- k-Nearest Neighbors (kNN)
- Decision Trees
- Naive Bayes
- Support Vector Machines (SVM)
- Random Forest
- Gradient Boosting Machines (GBM)
- XGBoost
- LightGBM
- CatBoost
- Neural Networks (MLP)
- Ensemble Methods (Bagging, Boosting, Stacking)
Unsupervised Learning
- K-Means Clustering
- Hierarchical Clustering
- DBSCAN
- OPTICS
- Gaussian Mixture Models (GMM)
- Spectral Clustering
- Mean Shift
- Principal Component Analysis (PCA)
- Independent Component Analysis (ICA)
- t-SNE
- UMAP
- Autoencoders
- Deep Embedded Clustering (DEC)
Reinforcement Learning
- Multi-Armed Bandit
- Monte Carlo Methods
- Temporal Difference (TD) Learning
- Q-Learning
- SARSA
- Deep Q-Network (DQN)
- Double DQN
- Dueling DQN
- Policy Gradient Methods
- REINFORCE
- Actor-Critic Methods
- A3C
- Proximal Policy Optimization (PPO)
- Trust Region Policy Optimization (TRPO)
- Soft Actor-Critic (SAC)
- Deep Deterministic Policy Gradient (DDPG)
Natural Language Processing (NLP)
- Text Preprocessing (Tokenization, Lemmatization)
- Bag of Words (BoW)
- TF-IDF
- Word2Vec
- GloVe
- FastText
- CountVectorizer
- N-gram Models
- Recurrent Neural Networks (RNN)
- Long Short-Term Memory (LSTM)
- Gated Recurrent Unit (GRU)
- Attention Mechanism
- Seq2Seq Models
- Transformer Architecture
- BERT
- RoBERTa
- ALBERT
- GPT-2, GPT-3, GPT-4
- T5, BART
- XLNet
- PaLM, Claude, Gemini
Computer Vision
- Image Filtering (Gaussian, Median)
- Edge Detection (Sobel, Canny)
- Histogram Equalization
- Feature Detection (SIFT, SURF, ORB)
- Convolutional Neural Networks (CNNs)
- AlexNet
- VGG
- ResNet
- Inception
- DenseNet
- EfficientNet
- Object Detection (Faster R-CNN, SSD, YOLOv1-v8)
- Instance Segmentation (Mask R-CNN)
- Semantic Segmentation (U-Net, DeepLab)
- Vision Transformers (ViT, Swin Transformer)
- Segment Anything Model (SAM)
Time Series Analysis
- Moving Average
- Exponential Smoothing
- ARIMA
- SARIMA
- Holt-Winters
- Facebook Prophet
- Kalman Filters
- VAR Models
- LSTM for Time Series
- Temporal Convolutional Networks (TCN)
- Transformer for Time Series Forecasting
- N-BEATS
Graph Machine Learning
- Node2Vec
- DeepWalk
- LINE
- Graph Convolutional Networks (GCNs)
- GraphSAGE
- Graph Attention Networks (GATs)
- Graph Isomorphism Network (GIN)
- Graph Autoencoders
- Graph Transformers
Generative Modeling
- Gaussian Mixture Models (GMM)
- Variational Autoencoders (VAEs)
- Restricted Boltzmann Machines (RBM)
- Generative Adversarial Networks (GANs)
- DCGAN, StyleGAN, BigGAN
- Conditional GANs
- CycleGAN
- Diffusion Models (e.g., DDPM, Stable Diffusion)
Explainable AI (XAI)
- Feature Importance
- Partial Dependence Plots (PDP)
- Permutation Importance
- LIME
- SHAP
- Anchors
- Integrated Gradients
- Saliency Maps
- Grad-CAM
Causal Machine Learning
- Randomized Controlled Trials (RCT)
- Propensity Score Matching
- Inverse Probability Weighting
- Causal Trees
- Causal Forests
- Double Machine Learning (DML)
- DoWhy
- EconML
AutoML
- Grid Search
- Random Search
- Bayesian Optimization
- Hyperband
- Optuna
- AutoSklearn
- TPOT
- AutoKeras
- Neural Architecture Search (NAS)
- DARTS
Optimization Techniques
- Gradient Descent
- Stochastic Gradient Descent (SGD)
- Mini-batch Gradient Descent
- Momentum
- Nesterov Accelerated Gradient
- Adagrad
- RMSprop
- Adam
- AdaMax
- Nadam
- Lookahead Optimizer
Robust and Adversarial ML
- Adversarial Examples
- Fast Gradient Sign Method (FGSM)
- Projected Gradient Descent (PGD)
- Carlini & Wagner Attack (C&W)
- Jacobian-based Saliency Map Attack (JSMA)
- Adversarial Training
- Certified Defenses
- Robust Optimization
Recommender Systems
- Popularity-Based
- Collaborative Filtering (User, Item)
- Matrix Factorization (SVD, ALS)
- Content-Based Filtering
- Hybrid Recommendation
- Deep Learning-based Recommendation (Autoencoders, NCF)
- Wide & Deep Model
- DeepFM
- LightFM
Anomaly Detection
- Z-Score
- IQR Rule
- Isolation Forest
- One-Class SVM
- Local Outlier Factor (LOF)
- Autoencoder for Anomaly Detection
- Deep SVDD
Fairness, Ethics, Privacy
- Fairness Metrics (Demographic Parity, Equal Opportunity)
- Bias Detection & Mitigation
- Differential Privacy
- Federated Learning
- Secure Aggregation
- Adversarial Debiasing
- DP-SGD
