DATA MUNGING
DATA CLEANING PYTHON
MACHINE LEARNING RECIPES
PANDAS CHEATSHEET
ALL TAGS
# How to determine Pearsons correlation in Python?

# How to determine Pearsons correlation in Python?

This recipe helps you determine Pearsons correlation in Python

Pearson"s correlation is very important statical data that we need many times. We can calculate it manually but it takes time.

So this is the recipe on how we can determine Pearson"s correlation in Python

```
import matplotlib.pyplot as plt
import statistics as stats
import pandas as pd
import random
import seaborn as sns
```

We have imported stats, seaborn and pandas which is needed.

We have created a empty dataframe and then added rows to it with random numbers.
```
df = pd.DataFrame()
df["x"] = random.sample(range(1, 100), 75)
df["y"] = random.sample(range(1, 100), 75)
print(); print(df.head())
```

We hawe defined a function with differnt steps that we will see.

- We have calculated mean and standard deviation of x and length of x
- We atre calculating mean and standard deviation of y
- We are calculating standard score by dividing difference of observation and mean with standard deviation. We have done this for both X and Y

```
def pearson(x,y):
n = len(x)
standard_score_x = []; standard_score_y = [];
mean_x = stats.mean(x)
standard_deviation_x = stats.stdev(x)
```

```
mean_y = stats.mean(y)
standard_deviation_y = stats.stdev(y)
```

```
for observation in x:
standard_score_x.append((observation - mean_x)/standard_deviation_x)
for observation in y:
standard_score_y.append((observation - mean_y)/standard_deviation_y)
return (sum([i*j for i,j in zip(standard_score_x, standard_score_y)]))/(n-1)
```

```
result = pearson(df.x, df.y)
print()
print("Pearson"s correlation coefficient is: ", result)
sns.lmplot("x", "y", data=df, fit_reg=True)
plt.show()
```

x y 0 96 62 1 1 81 2 27 73 3 55 26 4 83 93 Pearson"s correlation coefficient is: -0.006387074440361877

In this project, we are going to work on Sequence to Sequence Prediction using IMDB Movie Review Datasetâ€‹ using Keras in Python.

Use the Amazon Reviews/Ratings dataset of 2 Million records to build a recommender system using memory-based collaborative filtering in Python.

There are different time series forecasting methods to forecast stock price, demand etc. In this machine learning project, you will learn to determine which forecasting method to be used when and how to apply with time series forecasting example.

In this machine learning churn project, we implement a churn prediction model in python using ensemble techniques.

In this machine learning project, we will use binary leaf images and extracted features, including shape, margin, and texture to accurately identify plant species using different benchmark classification techniques.

In this project, we are going to work on Deep Learning using H2O to predict Census income.

In this data science project, you will predict borrowers chance of defaulting on credit loans by building a credit score prediction model.

In this project, we are going to talk about Time Series Forecasting to predict the electricity requirement for a particular house using Prophet.

In this human activity recognition project, we use multiclass classification machine learning techniques to analyse fitness dataset from a smartphone tracker.

In this data science project, you will work with German credit dataset using classification techniques like Decision Tree, Neural Networks etc to classify loan applications using R.