2/28/22, 3:10 PM Linear regression
NAME:- PRIADARSHANA
ROLL NO:- 2019332
SIMPLE LINEAR REGRESSION
localhost:8888/notebooks/Machine learning/Linear regression.ipynb 1/7
2/28/22, 3:10 PM Linear regression
In [1]: import pandas as pd
import numpy as np
import matplotlib.pyplot as plt
from sklearn.linear_model import LinearRegression
from sklearn.metrics import r2_score
import statsmodels.api as sm
data = pd.read_csv(r"Advertising.csv")
data
Out[1]:
Unnamed: 0 TV Radio Newspaper Sales
0 1 230.1 37.8 69.2 22.1
1 2 44.5 39.3 45.1 10.4
2 3 17.2 45.9 69.3 9.3
3 4 151.5 41.3 58.5 18.5
4 5 180.8 10.8 58.4 12.9
5 6 8.7 48.9 75.0 7.2
6 7 57.5 32.8 23.5 11.8
7 8 120.2 19.6 11.6 13.2
8 9 8.6 2.1 1.0 4.8
9 10 199.8 2.6 21.2 10.6
10 11 66.1 5.8 24.2 8.6
11 12 214.7 24.0 4.0 17.4
12 13 23.8 35.1 65.9 9.2
13 14 97.5 7.6 7.2 9.7
14 15 204.1 32.9 46.0 19.0
15 16 195.4 47.7 52.9 22.4
16 17 67.8 36.6 114.0 12.5
17 18 281.4 39.6 55.8 24.4
18 19 69.2 20.5 18.3 11.3
19 20 147.3 23.9 19.1 14.6
20 21 218.4 27.7 53.4 18.0
21 22 237.4 5.1 23.5 12.5
22 23 13.2 15.9 49.6 5.6
23 24 228.3 16.9 26.2 15.5
24 25 62.3 12.6 18.3 9.7
25 26 262.9 3.5 19.5 12.0
26 27 142.9 29.3 12.6 15.0
27 28 240.1 16.7 22.9 15.9
28 29 248.8 27.1 22.9 18.9
localhost:8888/notebooks/Machine learning/Linear regression.ipynb 2/7
2/28/22, 3:10 PM Linear regression
Unnamed: 0 TV Radio Newspaper Sales
29 30 70.6 16.0 40.8 10.5
... ... ... ... ... ...
170 171 50.0 11.6 18.4 8.4
171 172 164.5 20.9 47.4 14.5
172 173 19.6 20.1 17.0 7.6
173 174 168.4 7.1 12.8 11.7
174 175 222.4 3.4 13.1 11.5
175 176 276.9 48.9 41.8 27.0
176 177 248.4 30.2 20.3 20.2
177 178 170.2 7.8 35.2 11.7
178 179 276.7 2.3 23.7 11.8
179 180 165.6 10.0 17.6 12.6
180 181 156.6 2.6 8.3 10.5
181 182 218.5 5.4 27.4 12.2
182 183 56.2 5.7 29.7 8.7
183 184 287.6 43.0 71.8 26.2
184 185 253.8 21.3 30.0 17.6
185 186 205.0 45.1 19.6 22.6
186 187 139.5 2.1 26.6 10.3
187 188 191.1 28.7 18.2 17.3
188 189 286.0 13.9 3.7 15.9
189 190 18.7 12.1 23.4 6.7
190 191 39.5 41.1 5.8 10.8
191 192 75.5 10.8 6.0 9.9
192 193 17.2 4.1 31.6 5.9
193 194 166.8 42.0 3.6 19.6
194 195 149.7 35.6 6.0 17.3
195 196 38.2 3.7 13.8 7.6
196 197 94.2 4.9 8.1 9.7
197 198 177.0 9.3 6.4 12.8
198 199 283.6 42.0 66.2 25.5
199 200 232.1 8.6 8.7 13.4
200 rows × 5 columns
In [2]: data.columns
Out[2]: Index(['Unnamed: 0', 'TV', 'Radio', 'Newspaper', 'Sales'], dtype='object')
localhost:8888/notebooks/Machine learning/Linear regression.ipynb 3/7
2/28/22, 3:10 PM Linear regression
In [4]: plt.figure(figsize=(16, 8))
plt.scatter(
data['TV'],
data['Sales']
)
plt.xlabel("TV ")
plt.ylabel("Sales ")
plt.show()
In [6]: X = data['TV'].values.reshape(-1,1)
y = data['Sales'].values.reshape(-1,1)
from sklearn.model_selection import train_test_split
X_train, X_test, y_train, y_test = train_test_split(X,y,test_size=0.3,random_stat
print(X_train.shape)
print(X_test.shape)
print(y_train.shape)
print(y_test.shape)
reg = LinearRegression()
reg.fit(X_train, y_train)
(140, 1)
(60, 1)
(140, 1)
(60, 1)
Out[6]: LinearRegression(copy_X=True, fit_intercept=True, n_jobs=None,
normalize=False)
localhost:8888/notebooks/Machine learning/Linear regression.ipynb 4/7
2/28/22, 3:10 PM Linear regression
In [7]: print(reg.coef_[0][0])
print(reg.intercept_[0])
print("The linear model is: Y = {:.5} + {:.5}X".format(reg.intercept_[0], reg.coe
0.04581434217189623
7.310810165411681
The linear model is: Y = 7.3108 + 0.045814X
In [9]: predictions = reg.predict(X_test)
plt.figure(figsize=(16, 8))
plt.scatter(
data['TV'],
data['Sales']
)
plt.plot(
X_test,
predictions,
linewidth=2,
color='red'
)
plt.xlabel("TV ")
plt.ylabel("Sales ")
plt.show()
localhost:8888/notebooks/Machine learning/Linear regression.ipynb 5/7
2/28/22, 3:10 PM Linear regression
In [10]: X=X_train
y=y_train
X2 = sm.add_constant(X)
est = sm.OLS(y, X2)
est2 = est.fit()
print(est2.summary())
OLS Regression Results
==============================================================================
Dep. Variable: y R-squared: 0.555
Model: OLS Adj. R-squared: 0.552
Method: Least Squares F-statistic: 172.3
Date: Mon, 28 Feb 2022 Prob (F-statistic): 4.76e-26
Time: 14:28:59 Log-Likelihood: -371.64
No. Observations: 140 AIC: 747.3
Df Residuals: 138 BIC: 753.2
Df Model: 1
Covariance Type: nonrobust
==============================================================================
coef std err t P>|t| [0.025 0.975]
------------------------------------------------------------------------------
const 7.3108 0.611 11.957 0.000 6.102 8.520
x1 0.0458 0.003 13.125 0.000 0.039 0.053
==============================================================================
Omnibus: 1.727 Durbin-Watson: 1.908
Prob(Omnibus): 0.422 Jarque-Bera (JB): 1.452
Skew: -0.086 Prob(JB): 0.484
Kurtosis: 2.532 Cond. No. 366.
==============================================================================
Warnings:
[1] Standard Errors assume that the covariance matrix of the errors is correctl
y specified.
In [11]: print('Train Score :', reg.score(X_train,y_train))
print('Test Score:', reg.score(X_test,y_test))
Train Score : 0.5552336104251212
Test Score: 0.725606346597073
In [12]: from sklearn import metrics
print('MSE :', metrics.mean_squared_error(y_test,predictions))
print('RMSE :', np.sqrt(metrics.mean_squared_error(y_test,predictions)))
MSE : 7.497479593464674
RMSE : 2.7381525876883988
MULTIPLE LINEAR REGRESSION
localhost:8888/notebooks/Machine learning/Linear regression.ipynb 6/7
2/28/22, 3:10 PM Linear regression
In [14]: Xs = data.drop(['Sales', 'Unnamed: 0'], axis=1)
y = data['Sales'].values.reshape(-1,1)
reg = LinearRegression()
reg.fit(Xs, y)
print("The linear model is: Y = {:.5} + {:.5}*TV + {:.5}*radio + {:.5}*newspaper
The linear model is: Y = 2.9389 + 0.045765*TV + 0.18853*radio + -0.0010375*news
paper
In [16]: X = np.column_stack((data['TV'], data['Radio'], data['Newspaper']))
y = data['Sales']
X2 = sm.add_constant(X)
est = sm.OLS(y, X2)
est2 = est.fit()
print(est2.summary())
OLS Regression Results
==============================================================================
Dep. Variable: Sales R-squared: 0.897
Model: OLS Adj. R-squared: 0.896
Method: Least Squares F-statistic: 570.3
Date: Mon, 28 Feb 2022 Prob (F-statistic): 1.58e-96
Time: 15:01:01 Log-Likelihood: -386.18
No. Observations: 200 AIC: 780.4
Df Residuals: 196 BIC: 793.6
Df Model: 3
Covariance Type: nonrobust
==============================================================================
coef std err t P>|t| [0.025 0.975]
------------------------------------------------------------------------------
const 2.9389 0.312 9.422 0.000 2.324 3.554
x1 0.0458 0.001 32.809 0.000 0.043 0.049
x2 0.1885 0.009 21.893 0.000 0.172 0.206
x3 -0.0010 0.006 -0.177 0.860 -0.013 0.011
==============================================================================
Omnibus: 60.414 Durbin-Watson: 2.084
Prob(Omnibus): 0.000 Jarque-Bera (JB): 151.241
Skew: -1.327 Prob(JB): 1.44e-33
Kurtosis: 6.332 Cond. No. 454.
==============================================================================
Warnings:
[1] Standard Errors assume that the covariance matrix of the errors is correctl
y specified.
localhost:8888/notebooks/Machine learning/Linear regression.ipynb 7/7
