Different Engines in read_csv

13 Aug 2020

import pandas as pd

FILEPATH = 'california_housing_train.csv'

%%timeit
df = pd.read_csv(FILEPATH, engine='c') #C engine offers speed

24.8 ms ± 6.24 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)

%%timeit
df = pd.read_csv(FILEPATH, engine='python') #Python engine is more feature rich but slower

139 ms ± 25.4 ms per loop (mean ± std. dev. of 7 runs, 1 loop each)