Batch Iterating in Pandas


BATCH_SIZE=32

for k,grp in df.groupby(np.arange(len(df))//BATCH_SIZE):
    # grp is a tiny dataframe BATCH_SIZE rows long
    print(k,grp)
    

References


Revision #3
Created 8 November 2022 11:10:04 by James
Updated 21 January 2024 14:54:01 by James