Create runtime_files directory for some benchmarks