How to split train test data using sklearn and python?
This recipe helps you split train test data using sklearn and python
Recipe Objective
To train and test the data we need two different sets of data. The test set which works as completely new set of data for model and use to predict the output. But if we have a fix set of dataset provided then how to generate this test and train data.
So this is the recipe on how we can split train test data using sklearn and python.
Master the Art of Data Cleaning in Machine Learning
Table of Contents
Step 1 - Import the library
from sklearn import datasets
from sklearn.model_selection import train_test_split
We have only imported pandas which is needed.
Step 2 - Setting up the Data
We have imported an inbuilt wine dataset to use test_train_split. We have stored data in X and target in y. We have aslo printed the shape of the data.
wine = datasets.load_wine()
X = wine.data
print(X.shape)
y = wine.target
print(y.shape)
Step 3 - Splitting the Data
So now we are using test_train_split to split the data. We have passed test_size as 0.33 which means 33% of data will be in the test part and rest will be in train part. Parameter random_state signifies the random splitting of data into the two parts. Finally we have printed the shape of test and train data.
dX_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.33, random_state=42)
print(X_train.shape)
print(X_test.shape)
print(y_train.shape)
print(y_test.shape)
So the output comes
(178, 13)
(178,)
(119, 13)
(59, 13)
(119,)
(59,)
Download Materials
What Users are saying..
Abhinav Agarwal
I come from Northwestern University, which is ranked 9th in the US. Although the high-quality academics at school taught me all the basics I needed, obtaining practical experience was a challenge.... Read More