Decodes large columns of a large data frame by splitting it

Source: R/project.R

Given an extremely large data frame to decode (such as those of UK Biobank, over 500K rows), split the data into a list of smaller data frames, decode each smaller data frame, and then merge list into a larger data frame.

decode_multi_large_df(df, coding, df_size = 2000)

Arguments

df

  • data.frame to process

coding

  • coding data frame

df_size

  • size of the smaller data frames in number of rows.

Value

decoded data frame in terms of columns

Details

This method is not necessarily faster than merging the entire data frame, but it shows a progress bar.