Machine Learning · Beginner Glossary
Machine Learning Terms Every Beginner Should Understand
Quick summary — machine learning terms for beginners
Speak the language before you write the code. This guide explains the machine learning terms every beginner should know — from features and labels to training, overfitting, and precision/recall — in plain English with examples.
In this guide you will learn:
- Core concepts — supervised/unsupervised learning, features, labels, datasets.
- Training terms — algorithm vs model, hyperparameters, training/validation/test splits.
- Evaluation terms — overfitting, underfitting, accuracy, precision, recall, F1.
- Glossary tracker — track which terms you've mastered.
- Tips for beginners — how to internalize these terms.
SECTION 01Core Concepts — Features, Labels, and Learning Types
These are the words you'll see in every ML tutorial, paper, and dataset. Here's what they actually mean:
| Term | Simple Definition | Why It Matters |
|---|---|---|
| Features | The input columns your model uses (e.g., age, income) | Bad features = bad model |
| Label / Target | The output the model is trying to predict | Defines what "success" means |
| Dataset | A collection of rows with features and (maybe) labels | The data your model learns from |
| Supervised Learning | Learning from labelled examples | Most common type — predictions |
| Unsupervised Learning | Finding patterns without labels | Clustering and dimensionality reduction |
| Classification | Predicting a category (spam / not spam) | A type of supervised learning |
| Regression | Predicting a number (house price, temperature) | The other type of supervised learning |
Core Terms — Plain English:
• Features → The input columns
• Label → The output we predict
• Dataset → Rows of features (+ labels)
• Supervised Learning → Learning from labels
• Unsupervised Learning → Finding patterns without labels
• Classification → Predicting a category
• Regression → Predicting a number
Where You'll See Them:
☐ In dataset descriptions
☐ In model documentation
☐ In paper abstracts
☐ In interview questions
☐ In ML course notebooks
☐ In feature engineering discussions
SECTION 02Training Terms — Algorithm, Model, Hyperparameters
These terms are the verbs of machine learning — they describe what happens while the model is learning:
| Term | Simple Definition | Why It Matters |
|---|---|---|
| Algorithm | The method used to learn (e.g., decision tree, linear regression) | You choose it, then fit it |
| Model | The algorithm + the learned parameters (weights) | This is what you actually deploy |
| Training | Fitting the model to data | Where learning happens |
| Hyperparameters | Settings you choose before training (learning rate, tree depth) | You tune them; the model doesn't learn them |
| Parameters | What the model learns (weights, coefficients) | This is the model's "knowledge" |
| Training Set | Data used to train the model | The model learns from this |
| Validation Set | Data used to tune and select models | Your early warning system |
| Test Set | Data used only for final evaluation | Your honest performance measure |
Training Terms — Plain English:
• Algorithm → The method ("how to learn")
• Model → The algorithm + learned weights
• Training → Fitting the model to data
• Hyperparameters → Settings you choose
• Parameters → Settings the model learns
• Training Set → Where the model learns
• Validation Set → Where you tune
• Test Set → Where you judge
Typical ML Workflow:
☐ Split data → train / validation / test
☐ Choose an algorithm
☐ Set hyperparameters
☐ Fit the model on training data
☐ Evaluate on validation set
☐ Tune hyperparameters
☐ Final evaluation on test set
☐ Deploy the model
SECTION 03Evaluation Terms — Overfitting, Precision, Recall
Evaluation terms tell you whether your model actually works — or just looks good on training data:
| Term | Simple Definition | Why It Matters |
|---|---|---|
| Overfitting | Great on training, poor on test | Model memorized instead of learned |
| Underfitting | Poor on training AND test | Model is too simple |
| Accuracy | Percentage of correct predictions | Only meaningful on balanced data |
| Precision | Of positive predictions, how many were correct? | Matters when false positives are costly |
| Recall | Of actual positives, how many did we catch? | Matters when false negatives are costly |
| F1 Score | Harmonic mean of precision and recall | Balance when classes are imbalanced |
| Confusion Matrix | Table of true/false positives and negatives | The full picture behind the metrics |
| Cross-Validation | Testing on multiple splits for stability | More trustworthy than a single split |
Evaluation Terms — Plain English:
• Overfitting → Great on train, bad on test
• Underfitting → Bad on both train and test
• Accuracy → Overall correct rate
• Precision → How often positives are correct
• Recall → How many real positives we caught
• F1 Score → Balance of precision and recall
• Confusion Matrix → Full detail of errors
• Cross-Validation → Test on multiple splits
Precision vs Recall Quick Guide:
Precision matters when false positives are costly
(e.g., spam filters — don't block real email)
Recall matters when false negatives are costly
(e.g., cancer screening — don't miss a case)
F1 combines both — use when you need balance.
Signals:
□ Train accuracy high + test low → overfitting
□ Both low → underfitting
□ Class imbalance → use precision/recall/F1
SECTION 04Glossary Tracker
Use these templates to track which terms you've mastered:
Term Mastery Tracker:
☐ Features — can identify in a dataset
☐ Label — can identify in a dataset
☐ Dataset — can explain training vs test
☐ Supervised Learning — can give example
☐ Unsupervised Learning — can give example
☐ Classification — can give example
☐ Regression — can give example
☐ Algorithm — can name 2 examples
☐ Model — can explain learned parameters
☐ Hyperparameters — can name 2 examples
☐ Parameters — can distinguish from hyperparams
☐ Training Set — can describe its purpose
☐ Validation Set — can describe its purpose
☐ Test Set — can describe its purpose
☐ Overfitting — can spot in a metric curve
☐ Underfitting — can spot in a metric curve
☐ Accuracy — can explain its limits
☐ Precision — can explain when to use it
☐ Recall — can explain when to use it
☐ F1 Score — can explain the trade-off
☐ Confusion Matrix — can interpret one
Weekly Review — Term Check:
Week: _____
Terms I fully understand:
1.
2.
3.
Terms I'm still shaky on:
1.
2.
3.
Terms I used in code this week:
1.
2.
3.
Next week's focus terms:
1.
2.
3.
Concept Map — How Terms Connect:
Dataset (features + label)
↓
Split → Train / Validation / Test
↓
Choose Algorithm + set Hyperparameters
↓
Train → Model learns Parameters
↓
Evaluate on Validation Set
↓
Tune Hyperparameters
↓
Final evaluation on Test Set
↓
Check overfitting / underfitting
↓
Report Accuracy, Precision, Recall, F1
If you can draw this, you understand the terms.
SECTION 05Tips for Beginners
Here are tips to internalize machine learning terms instead of just memorizing them:
- Say each term out loud in one sentence — if you can't, you don't know it yet.
- Connect each term to a dataset — pick one Kaggle dataset and identify its features and label.
- Draw the ML workflow — split, train, validate, test, evaluate.
- Read one paper abstract a week — you'll start recognizing the vocabulary.
- Teach a friend one term a day — explaining forces clarity.
- Build a small project — terms become real when you use them in a model.
SECTION 06Interview Q&A — Machine Learning Terms
Q1What is the difference between supervised and unsupervised learning?
Supervised learning learns from labelled examples — the data includes the correct answer. Unsupervised learning finds patterns in data without labels, like clustering.
Q2What's the difference between an algorithm and a model?
An algorithm is the method (e.g., linear regression). A model is the algorithm plus the learned parameters — the thing you actually deploy to make predictions.
Q3What is overfitting?
Overfitting means the model performs very well on training data but poorly on unseen data. It has memorized patterns instead of learning general rules.
Q4When should you use precision vs recall?
Use precision when false positives are costly (e.g., spam filters). Use recall when false negatives are costly (e.g., cancer screening). Use F1 when you need a balance.
Q5Why do we need three splits — train, validation, and test?
Train is for learning. Validation is for tuning and model selection. Test is for the honest final evaluation. If you tune on the test set, your reported performance is optimistic.
SECTION 07Test yourself — Machine Learning Terms quiz
Five questions. No sign-up.
0 / 5Pick an answer to see why it is right or wrong.
SECTION 08Frequently asked questions
Do I need to know all these terms before starting machine learning?
No — but knowing them makes every tutorial, paper, and code example easier to follow. You can learn them alongside your first project.
What's the most important term to learn first?
Start with "features" and "label." Once you understand inputs and outputs, other terms make sense in context.
Do I need to memorize the math behind training?
Not at the beginning. Understand the concept — fitting parameters to minimize error — and you can use libraries like scikit-learn without manual math.
What's the difference between hyperparameters and parameters?
Hyperparameters are settings you choose before training (learning rate, tree depth). Parameters are what the model learns during training (weights, coefficients).
How can I make these terms stick?
Use them. Build a small model, read evaluation metrics, and explain each term to a friend. Terms stick when they're used in context.
SECTION 09Related reads
Classroom & online · Noida
Your machine learning journey starts now
Our Machine Learning Training Course is designed to help you build real, job-ready models — with skills, projects, and interview prep that get you hired.
₹15,500 · full programme- Complete machine learning roadmap
- Skills & real projects
- Mock interviews
- Weekday & weekend batches