MACHINE LEARNING RECIPES
DATA CLEANING PYTHON
DATA MUNGING
PANDAS CHEATSHEET
ALL TAGS
Explain AlBert and its working with the help of an example?
Explain AlBert and its working with the help of an example?
This recipe explains AlBert and its working with the help of an example
Recipe Objective
Explain AlBert and it's working with the help of an example.
Albert is an "A lit BERT" for self-supervised learning language representation, it is an upgrade to BERT that offers improved performance on various NLP tasks. ALBERT reduces model sizes in two ways - by sharing parameters across the hidden layers of the network, and by factorizing the embedding layer.
Step 1 - Install the required library
!pip install transformers
Step 2 - Albert Configuration
from transformers import AlbertConfig, AlbertModel
albert_configuration_xxlarge = AlbertConfig()
albert_configuration_base = AlbertConfig(
hidden_size=768,
num_attention_heads=12,
intermediate_size=3072,
)
Here we are configuring the Albert from the transformer library, The first step is about initializing the ALBERT-xxlarge style configuration, after that we are initializing the ALBERT-base style configuration, then initialize the model
Step 2 - Albert Tokenizer
from transformers import AlbertTokenizer, AlbertModel
import torch
albert_tokenizer = AlbertTokenizer.from_pretrained('albert-base-v2')
albert_model = AlbertModel.from_pretrained('albert-base-v2', return_dict=True)
Step 3 - Print the Results
Sample = tokenizer("Hi everyone your learning NLP", return_tensors="pt")
Results = albert_model(**Sample)
last_hidden_states = Results.last_hidden_state
print(last_hidden_states)
tensor([[[ 2.4208, 1.8559, 0.4701, ..., -1.1277, 0.1012, 0.7205],
[ 0.2845, 0.7017, 0.3107, ..., -0.1968, 1.9060, -1.2505],
[-0.5409, 0.8328, -0.0704, ..., -0.0470, 1.0203, -1.0432],
...,
[ 0.0337, -0.5312, 0.3455, ..., 0.0088, 0.9658, -0.8649],
[ 0.2958, -0.1336, 0.6774, ..., -0.1669, 1.6474, -1.7187],
[ 0.0527, 0.1355, -0.0434, ..., -0.1046, 0.1258, 0.1885]]],
grad_fn=)
Relevant Projects
Predict Macro Economic Trends using Kaggle Financial Dataset
In this machine learning project, you will uncover the predictive value in an uncertain world by using various artificial intelligence, machine learning, advanced regression and feature transformation techniques.
Predict Churn for a Telecom company using Logistic Regression
Machine Learning Project in R- Predict the customer churn of telecom sector and find out the key drivers that lead to churn. Learn how the logistic regression model using R can be used to identify the customer churn in telecom dataset.
Zillow’s Home Value Prediction (Zestimate)
Data Science Project in R -Build a machine learning algorithm to predict the future sale prices of homes.
Identifying Product Bundles from Sales Data Using R Language
In this data science project in R, we are going to talk about subjective segmentation which is a clustering technique to find out product bundles in sales data.
Machine Learning or Predictive Models in IoT - Energy Prediction Use Case
In this machine learning and IoT project, we are going to test out the experimental data using various predictive models and train the models and break the energy usage.
Expedia Hotel Recommendations Data Science Project
In this data science project, you will contextualize customer data and predict the likelihood a customer will stay at 100 different hotel groups.
Solving Multiple Classification use cases Using H2O
In this project, we are going to talk about H2O and functionality in terms of building Machine Learning models.
Customer Churn Prediction Analysis using Ensemble Techniques
In this machine learning churn project, we implement a churn prediction model in python using ensemble techniques.
Music Recommendation System Project using Python and R
Machine Learning Project - Work with KKBOX's Music Recommendation System dataset to build the best music recommendation engine.
Data Science Project - Instacart Market Basket Analysis
Data Science Project - Build a recommendation engine which will predict the products to be purchased by an Instacart consumer again.