Key takeaways
- Backpropagation, CNN output size calculations and LSTM gates are the most common long questions.
- Learn the formulas for common activation functions and their derivatives.
- Draw neat diagrams of a CNN pipeline and an LSTM cell.
- These are practice questions, not past papers; check your own syllabus and official previous papers.
About these important questions
This page lists the most important Deep Learning questions for B.Tech CSE and IT exams, arranged unit by unit. The units follow the standard syllabus that most Indian technical universities share, so the order may differ slightly from yours.
Please note: these are practice questions based on common syllabus topics. They are not verified past papers, and we do not claim that any question will appear in your exam. Check your own university syllabus first, then solve the official previous year papers. AKTU students can download them from the AKTU old question paper archive.
Unit 1: Neural Network Basics
Covers the biological neuron, perceptrons, multilayer networks and activation functions.
Short questions (2 marks)
- Differentiate between machine learning and deep learning.
- Why can a single perceptron not solve XOR?
- List four activation functions.
Long questions
- Explain the perceptron model and the perceptron learning rule, and train it for the AND gate.
- Explain a multilayer perceptron and the universal approximation idea.
- Compare sigmoid, tanh, ReLU, leaky ReLU and softmax with their ranges and uses.
- Explain forward propagation with a small numeric example.
- Explain loss functions: mean squared error and cross-entropy.
Unit 2: Training Deep Networks
Covers backpropagation, optimisation and the problems of training deep models.
Short questions (2 marks)
- What is the vanishing gradient problem?
- Differentiate between batch, mini-batch and stochastic gradient descent.
- What is an epoch?
Long questions
- Derive the backpropagation algorithm for a network with one hidden layer.
- Explain the vanishing and exploding gradient problems and their solutions.
- Explain momentum, RMSProp and Adam optimisers.
- Explain weight initialisation methods (Xavier and He).
- Explain learning rate schedules and early stopping.
Unit 3: Regularisation and Convolutional Neural Networks
Covers regularisation and CNNs. This unit often carries the most marks.
Short questions (2 marks)
- What is dropout?
- What is padding in a CNN?
- What does a pooling layer do?
Long questions
- Explain L2 regularisation, dropout, batch normalisation and data augmentation.
- Explain the architecture of a CNN: convolution, activation, pooling and fully connected layers.
- For a 32 × 32 × 3 input, 10 filters of 5 × 5, stride 1 and no padding, find the output size and the number of parameters. Hint: output = (W - F + 2P) / S + 1 = 28, so 28 × 28 × 10; parameters = (5 × 5 × 3 + 1) × 10 = 760.
- Explain LeNet, AlexNet, VGG and ResNet, and the idea of skip connections.
- Explain transfer learning and fine-tuning.
Unit 4: Sequence Models
Covers RNNs, LSTM, GRU and attention.
Short questions (2 marks)
- Why are RNNs used for sequence data?
- List the gates in an LSTM.
- What is backpropagation through time?
Long questions
- Explain the RNN architecture with an unrolled diagram, and its types (one-to-many, many-to-one, many-to-many).
- Explain the LSTM cell with a diagram and the role of each gate.
- Compare LSTM and GRU.
- Explain bidirectional RNNs and encoder-decoder (sequence-to-sequence) models.
- Explain the attention mechanism and the basic idea of the transformer.
Unit 5: Autoencoders, Generative Models and Applications
Covers autoencoders, GANs and applications. Some universities add deep reinforcement learning here.
Short questions (2 marks)
- What is an autoencoder?
- What are the generator and discriminator in a GAN?
Long questions
- Explain autoencoders and their types: undercomplete, denoising, sparse and variational.
- Explain the architecture and training of a GAN, and the problem of mode collapse.
- Explain applications of deep learning in computer vision, speech and NLP.
- Explain word embeddings (Word2Vec) in brief.
- Explain deep reinforcement learning with the example of a deep Q-network.
Sample answer outline: Backpropagation
Backpropagation is the most repeated long question. A full answer has six parts:
- State the goal. Find how much each weight contributes to the error, so gradient descent can update it: w = w - η × ∂E/∂w.
- Draw the network. Input layer, one hidden layer and an output layer, with weights labelled.
- Forward pass. Compute the net input and activation for each hidden unit, then for the output unit. Write the error, for example E = ½ (t - o)^2.
- Output layer gradient. With sigmoid activation, δ(o) = (t - o) × o × (1 - o). The update for a hidden-to-output weight is Δw = η × δ(o) × h.
- Hidden layer gradient. δ(h) = h × (1 - h) × sum of (w × δ(o)) over the outputs it connects to. The update for an input-to-hidden weight is Δw = η × δ(h) × x.
- Repeat. Update all weights, then repeat for every example and epoch until the error is small.
Close with one line on the chain rule, which is what makes backpropagation work, and mention the vanishing gradient problem with sigmoid.
Marks weightage and how to write answers
A common pattern, used by AKTU and many other universities, has a compulsory short-answer section that covers every unit, followed by long-answer questions with a choice inside each unit. Marks per question change between universities and years, so confirm the scheme on a recent official paper.
- Short answers (about 2 marks): a crisp definition, one example or diagram, and nothing more. Three to five lines is enough.
- Long answers (7 to 10 marks): start with a definition, add a labelled diagram or table, explain the steps, and finish with an example, advantages or a comparison.
- Draw diagrams for every architecture question: a CNN pipeline, an LSTM cell, an autoencoder or a GAN.
- For numericals such as CNN output size, write the formula, substitute, and state the units (height × width × depth).
A 7-day revision plan for Deep Learning
- Days 1 to 5: one unit a day. Read your notes, then write the long answers for that unit from memory and check them against your notes.
- Day 6: redo the backpropagation derivation, two CNN output size problems, and draw the LSTM and GAN diagrams from memory.
- Day 7: solve one full official previous year paper in three hours, then check which units cost you time.
Keep a single sheet of formulas, definitions and diagrams for the last hour before the exam.
Download Deep Learning Important Questions PDF
Deep Learning Important Questions PDF
The PDF carries the same content as this page in a clean, print-ready layout, so you can read it offline and keep it for revision.
5 pages · 105 KB · PDF · Updated 5 Nov 2026