Viewing a single comment thread. View all comments

peno8 OP t1_j1y6yyr wrote

Hello, thanks for the reply.

May I ask which area are you in or what kind of data is it, roughly?


Artgor t1_j1y757h wrote

It it 4-7 mlns of rows. Sometimes I hit memory limits when I try to create ~100 columns or when calculating complex rolling features. Also, I have multiple programs running - like Pycharm, so they contribute to the problem.