pandas_basics_practice
April 7, 2021
Consider the following Python dictionary data and Python list labels:
data = {‘birds’: [‘Cranes’, ‘Cranes’, ‘plovers’, ‘spoonbills’, ‘spoonbills’, ‘Cranes’, ‘plovers’, ‘Cranes’,
‘spoonbills’, ‘spoonbills’], ‘age’: [3.5, 4, 1.5, np.nan, 6, 3, 5.5, np.nan, 8, 4], ‘visits’: [2, 4, 3, 4, 3, 4,
2, 2, 3, 2], ‘priority’: [‘yes’, ‘yes’, ‘no’, ‘yes’, ‘no’, ‘no’, ‘no’, ‘yes’, ‘no’, ‘no’]}
labels = [‘a’, ‘b’, ‘c’, ‘d’, ‘e’, ‘f’, ‘g’, ‘h’, ‘i’, ‘j’]
1. Create a DataFrame birds from this dictionary data which has the index labels.
[1]: import pandas as pd
import numpy as np
data = {'birds': ['Cranes', 'Cranes', 'plovers', 'spoonbills', 'spoonbills',␣
,→'Cranes', 'plovers', 'Cranes', 'spoonbills', 'spoonbills'],
'age': [3.5, 4, 1.5, np.nan, 6, 3, 5.5, np.nan, 8, 4],
'visits': [2, 4, 3, 4, 3, 4, 2, 2, 3, 2],
'priority': ['yes', 'yes', 'no', 'yes', 'no', 'no', 'no', 'yes', 'no',␣
,→'no']}
labels = ['a', 'b', 'c', 'd', 'e', 'f', 'g', 'h', 'i', 'j']
df=pd.DataFrame(data, index=labels)
df
[1]: birds age visits priority
a Cranes 3.5 2 yes
b Cranes 4.0 4 yes
c plovers 1.5 3 no
d spoonbills NaN 4 yes
e spoonbills 6.0 3 no
f Cranes 3.0 4 no
g plovers 5.5 2 no
h Cranes NaN 2 yes
i spoonbills 8.0 3 no
j spoonbills 4.0 2 no
2. Display a summary of the basic information about birds DataFrame and its data.
[114]: df.columns
1
[114]: Index(['birds', 'age', 'visits', 'priority'], dtype='object')
[115]: df.describe()
[115]: age visits
count 8.000000 10.000000
mean 4.437500 2.900000
std 2.007797 0.875595
min 1.500000 2.000000
25% 3.375000 2.000000
50% 4.000000 3.000000
75% 5.625000 3.750000
max 8.000000 4.000000
3. Print the first 2 rows of the birds dataframe
[43]: df.iloc[[0,1]]
[43]: birds age visits priority
labels
a Cranes 3.5 2 yes
b Cranes 4.0 4 yes
4. Print all the rows with only ‘birds’ and ‘age’ columns from the dataframe
[52]: df[['birds','age']]
[52]: birds age
labels
a Cranes 3.5
b Cranes 4.0
c plovers 1.5
d spoonbills NaN
e spoonbills 6.0
f Cranes 3.0
g plovers 5.5
h Cranes NaN
i spoonbills 8.0
j spoonbills 4.0
5. select [2, 3, 7] rows and in columns [‘birds’, ‘age’, ‘visits’]
[60]: df.loc[['b','c','g'],['birds','age','visits']]
[60]: birds age visits
labels
b Cranes 4.0 4
c plovers 1.5 3
g plovers 5.5 2
2
6. select the rows where the number of visits is less than 4
[59]: filt=df['visits']<4
df[filt]
[59]: birds age visits priority
labels
a Cranes 3.5 2 yes
c plovers 1.5 3 no
e spoonbills 6.0 3 no
g plovers 5.5 2 no
h Cranes NaN 2 yes
i spoonbills 8.0 3 no
j spoonbills 4.0 2 no
7. select the rows with columns [‘birds’, ‘visits’] where the age is missing i.e NaN
[2]: filt= df['age'].isnull()
df[filt][['birds','visits']]
[2]: birds visits
d spoonbills 4
h Cranes 2
8. Select the rows where the birds is a Cranes and the age is less than 4
[68]: filt=(df['birds']=='Cranes') & (df['age']<4)
df[filt]
[68]: birds age visits priority
labels
a Cranes 3.5 2 yes
f Cranes 3.0 4 no
9. Select the rows the age is between 2 and 4(inclusive)
[70]: filt=(df['age']>=2) & (df['age']<=4)
df[filt]
[70]: birds age visits priority
labels
a Cranes 3.5 2 yes
b Cranes 4.0 4 yes
f Cranes 3.0 4 no
j spoonbills 4.0 2 no
10. Find the total number of visits of the bird Cranes
[71]: df[df['birds']=='Cranes']['visits'].sum()
3
[71]: 12
11. Calculate the mean age for each different birds in dataframe.
[76]: birds_grp=df.groupby('birds')
birds_grp['age'].mean()
[76]: birds
Cranes 3.5
plovers 3.5
spoonbills 6.0
Name: age, dtype: float64
12. Append a new row ‘k’ to dataframe with your choice of values for each column.
Then delete that row to return the original DataFrame.
[106]: df.loc['k']=['Sparrow',3,4,'yes']
df
[106]: birds age visits priority
labels
a Cranes 3.5 2 yes
b Cranes 4.0 4 yes
c plovers 1.5 3 no
d spoonbills NaN 4 yes
e spoonbills 6.0 3 no
f Cranes 3.0 4 no
g plovers 5.5 2 no
h Cranes NaN 2 yes
i spoonbills 8.0 3 no
j spoonbills 4.0 2 no
k Sparrow 3.0 4 yes
[111]: df=df.drop('k')
df
[111]: birds age visits priority
labels
a Cranes 3.5 2 yes
b Cranes 4.0 4 yes
c plovers 1.5 3 no
d spoonbills NaN 4 yes
e spoonbills 6.0 3 no
f Cranes 3.0 4 no
g plovers 5.5 2 no
h Cranes NaN 2 yes
i spoonbills 8.0 3 no
j spoonbills 4.0 2 no
4
13. Find the number of each type of birds in dataframe (Counts)
[73]: df['birds'].value_counts()
[73]: spoonbills 4
Cranes 4
plovers 2
Name: birds, dtype: int64
14. Sort dataframe (birds) first by the values in the ‘age’ in decending order, then by
the value in the ‘visits’ column in ascending order.
[116]: df.sort_values(by=['age','visits'],ascending=[False,True])
[116]: birds age visits priority
i spoonbills 8.0 3 no
e spoonbills 6.0 3 no
g plovers 5.5 2 no
j spoonbills 4.0 2 no
b Cranes 4.0 4 yes
a Cranes 3.5 2 yes
f Cranes 3.0 4 no
c plovers 1.5 3 no
h Cranes NaN 2 yes
d spoonbills NaN 4 yes
15. Replace the priority column values with’yes’ should be 1 and ‘no’ should be 0
[101]: def replace_priority(x):
if x=='yes':
return 1
else:
return 0
df['priority'].apply(replace_priority)
df
[101]: birds age visits priority
labels
a trumpeters 3.5 2 1
b trumpeters 4.0 4 1
c plovers 1.5 3 0
d spoonbills NaN 4 1
e spoonbills 6.0 3 0
f trumpeters 3.0 4 0
g plovers 5.5 2 0
h trumpeters NaN 2 1
i spoonbills 8.0 3 0
j spoonbills 4.0 2 0
16. In the ‘birds’ column, change the ‘Cranes’ entries to ‘trumpeters’.
5
[91]: df['birds']=df['birds'].replace({'Cranes':'trumpeters'})
df
[91]: birds age visits priority
labels
a trumpeters 3.5 2 yes
b trumpeters 4.0 4 yes
c plovers 1.5 3 no
d spoonbills NaN 4 yes
e spoonbills 6.0 3 no
f trumpeters 3.0 4 no
g plovers 5.5 2 no
h trumpeters NaN 2 yes
i spoonbills 8.0 3 no
j spoonbills 4.0 2 no
[ ]:
