Draft: Config for MLP compatible with hls4ml
Changes:
-
Disable the use of latex by default -
Add config velo-query-long_h8-hls4mlbased onvelo-query-long_h8, which has a (3,8,8,8,3)-architecture MLP -
Replace Tanh with ReLU activation, for compatibility with hls4ml -
Disable layernorm, for compatibility with hls4ml, allowing to choose layernorm with a Boolean variable in the embedding config -
Add batch script sbatch_a100_40_script.shfor runningfull_pipeline.ipynbon the cluster, while keeping track of the output from the.err/.outfiles -
Create folder called artifact_archive, where important runs, reports and checkpoints can be archived -
Run full pipeline with config velo-query-long_h8-hls4mland save inartifact_archive