Why to have more large intermediate layers in deep learning models

Why to have more large intermediate layers in deep learning models

Recipe Objective - Why to have more large intermediate layers in deep learning models?

Intermediate layers are the layers between input layer and the output layer. It is sometimes known as Hidden layer where all the computations involved in neural networks are done. Units and activation function in the intermediate layer plays a major role in calculating validation accuracy. Having smaller units in intermediate layer with relu activation function and network architecture has input and output layer units more than the intermediate layer, then the validation accuracy falls drastically and model does not performs well. Model prediction and deployment is hugely suffers.

Learn to Build a Multi Class Image Classification Model in Python from Scratch

Explanation of large intermediate layers.

Small intermediate layers that is layers with less number of units in comparison to input layer and output layers units tends to compress the lot of information, equivalent to recover the separation hyperplanes of classes involves in neural network, into the intermediate space that is too low-dimensional. Thus neural network crams most of the important information into the dimensions.

Large intermediate layers that is layers with more number of units in comparison to input layer and output layers units donot compress the lot of information, equivalent to recover the separation hyperplanes of classes involves in neural network, into the intermediate space. Thus neural network donot crams most of the important information into the dimensions. The validation accuracy also improves.

What Users are saying..

profile image

Abhinav Agarwal

Graduate Student at Northwestern University
linkedin profile url

I come from Northwestern University, which is ranked 9th in the US. Although the high-quality academics at school taught me all the basics I needed, obtaining practical experience was a challenge.... Read More

Relevant Projects

Text Classification with Transformers-RoBERTa and XLNet Model
In this machine learning project, you will learn how to load, fine tune and evaluate various transformer models for text classification tasks.

Build an optimal End-to-End MLOps Pipeline and Deploy on GCP
Learn how to build and deploy an end-to-end optimal MLOps Pipeline for Loan Eligibility Prediction Model in Python on GCP

Linear Regression Model Project in Python for Beginners Part 2
Machine Learning Linear Regression Project for Beginners in Python to Build a Multiple Linear Regression Model on Soccer Player Dataset.

Classification Projects on Machine Learning for Beginners - 1
Classification ML Project for Beginners - A Hands-On Approach to Implementing Different Types of Classification Algorithms in Machine Learning for Predictive Modelling

End-to-End Speech Emotion Recognition Project using ANN
Speech Emotion Recognition using RAVDESS Audio Dataset - Build an Artificial Neural Network Model to Classify Audio Data into various Emotions like Sad, Happy, Angry, and Neutral

Machine Learning project for Retail Price Optimization
In this machine learning pricing project, we implement a retail price optimization algorithm using regression trees. This is one of the first steps to building a dynamic pricing model.

Learn How to Build PyTorch Neural Networks from Scratch
In this deep learning project, you will learn how to build PyTorch neural networks from scratch.

Build an End-to-End AWS SageMaker Classification Model
MLOps on AWS SageMaker -Learn to Build an End-to-End Classification Model on SageMaker to predict a patient’s cause of death.

House Price Prediction Project using Machine Learning in Python
Use the Zillow Zestimate Dataset to build a machine learning model for house price prediction.

Build a Multi-Class Classification Model in Python on Saturn Cloud
In this machine learning classification project, you will build a multi-class classification model in Python on Saturn Cloud to predict the license status of a business.