Unify preprocessing and reading in test files

Currently writing the preprocessed files to disk and processing (shifting/scaling) the test files has a complete separate code base, which would ideally be merged