Generate automatically StructToTuple.cuh as part of build

This MR enables automatic generation of StructToTuple.cuh as part of the compilation. The maximum length of the generated struct to tuple depends on the maximum number of parameters + properties existing in any one algorithm.

This effectively removes the limit of parameters + properties.

changed target branch from master to dcampora_nnolte_gaudi_conversion

changed the description

added 1 commit

• f0534b27 - Removed .cuh from StructToTuple pre and post files to avoid copyright scripts.

Compare with previous version

added 1 commit

• dbd9c951 - Set dependency of allen parser to a new symbol.

Compare with previous version

added new feature label

added 1 commit

• 34bbb735 - Add dependency to struct_to_tuple of mep_gec.

Compare with previous version

added 1 commit

• 62776380 - Added /code_generation to mep_test.

Compare with previous version

added 1 commit

• 5939a095 - temporarily removed gitlab-ci.yml; please cherry-pick commits 06353b3f...

Compare with previous version

added 272 commits

• 5939a095...d9cdadec - 157 commits from branch dcampora_nnolte_gaudi_conversion
• 19ee0fcb - Removed the inclusion of DecReports in RawEvent returned by AllenSelReportsToTES.cpp
• 395ff4de - Renamed AllenSelReportsToTES.cpp to AllenReportsToRawEvent.cpp; removed AllenDecReportsToTES.cpp
• 7201a551 - Updated contents of AllenReportsToRawEvent.cpp to reflect new algorithm name
• 100e44d3 - Updated property name in AllenReportsToRawEvent.cpp. Removed DecReports creation from RunAllen.
• 6c592a69 - Add views to the UT event model
• 97c4e85a - Merge branch 'thboettc_ut_event_model' into 'master'
• bce72af3 - Merge branch 'spradlin-alt_t_together_reports' into 'master'
• e745a1b0 - Mandatory --sequence option
• 1015b9fe - Merge branch 'lpica_sequence_arg_mandatory' into 'master'
• 26e66da7 - enable automatic conversion of Allen algorithms into Gaudi algorithms, to be...
• ab55221e - add runtime_options.do_check to host buffer update in globaldecision
• 45a2e2a9 - provide constants reads the two track catboost model
• 16130148 - Fixed formatting
• 0ec00996 - Use choices in ParseAlgorithms.py to denote options. Copy parser and clang with a custom command.
• 5ffdf5a3 - Provide Root Service in Runtime Options.
• d7035729 - Refactored and organized under code_generation all code-generated files.
• 54473c7b - Remove repeated code in TransformParameters.
• 693c41ec - update for rebase
• 233fa3cb - update parameters location in provide constants
• 3b7bfb44 - modified for optional inputs, currently segfaulting though
• f4c3454e - added default initialization for optional inputs, now we have a working sequence.
• 8ccbb626 - Fixed formatting
• 78979aba - add mask_output. not quite sure yet how to deal with it
• 4c603ba6 - have lines actually output shiz
• b5f75754 - remove path manipulation in test_cftree_ops
• 1366c966 - remove default ParamDir from provideconstants
• a0a215d2 - import initialize_event_lists from generator
• 6e810fe3 - Merged properly stream/sequence/CMakeLists.txt
• 99ddc235 - Fixed formatting
• 9c5cbe7f - Fix HLT1.py.
• 82ead061 - Fixed formatting
• 52da627e - fix things after rebase
• 380272e0 - more fixes after rebase
• d321e9ab - change output format for make_sel_report_writerg
• 58ecd7e6 - Fixed formatting
• 2e6f13fa - Add initialize_two_track_mva_model_constants to ProvideConstants.
• fceb2c62 - Make input_provider a shared_ptr.
• 7fc00119 - Move all member variables in ProvideRuntimeOptions to operator() temporaries.
• 30f6e108 - Remove max_scifi_ut_clusters=5000 from gec.
• 5a75dff8 - Fixed formatting
• 1e02ad0a - Fix provide constants and provide default constructors in velo consolidated views.
• 3072c94e - Fixed formatting
• 7a176fc3 - Use --prepend instead of -p.
• 705d071d - Remove gsl-lite as it is not supported anymore.
• 924816c7 - Fix Calo and lines.
• bd2d2a18 - Fixed formatting
• ec8c6119 - Default initialie CheckerTypes.
• 73929d8f - Turn prepend into run with pythonpath.
• c40739ac - Fixed missing quote.
• 3388532c - Added building blocks for something bigger.
• c0e1ccf9 - Drafting how the thing has to look.
• 9f3bd8a6 - Getting somewhere
• 9097d434 - Some issue with the config population.
• e477e893 - Configuration actually seems to work.
• 892259ea - Instantiate many algorithms.
• 8e6aaea9 - Calculate in_deps and out_deps at runtime.
• bf4c34c9 - First attempt at a runtime configured sequence.
• 5bb438c7 - Running version.
• 744c963a - Removed IStream and added creation of AlgorithmDB.
• e999356e - It compiles and runs. Missing proper .json generation and parsing.
• 97301f1d - Add dependencies of datatypes as a separate std::map. Generate configurations...
• 5c2b7b59 - Parse sequence.
• e549bbb9 - Issue with property store.
• c984cf19 - Trying to get algorithms to not be copied...
• ef80f5ec - Working version.
• 9c1daf42 - Use AlgorithmTypes instead of separate Algorithm files.
• 86eaee70 - Remove CUDA warning.
• b7ca43f6 - Fix hlt1_pp_calo sequence.
• 4d917a84 - Use std::cerr in Algorithm.cuh instead of error_cout.
• 405b1ced - Change the traversal to always c++ with the backend includes.
• 8d65fb97 - tweak TypeErasedAlgorithm
• 99cfdab4 - Apply format to Algorithm.cuh.
• d4ba57fc - Added AllenDataHandle to tackle scope.g
• 370d510a - Simplified AllenDataHandle.
• ddce30d2 - Generate dependencies and free dependencies accordingly.
• 11a97f8a - Parse also first dependency.
• e4c304fa - Use enum class instead of string for argument scope.
• 29ba1015 - Do not free host memory buffers, as required by the current Allen memory model.
• 3a804bd1 - Use void* in ArgumentData.
• 7b2d2657 - Added contracts.
• a99b7c79 - Use constexpr expression in Scheduler.cuh.
• 754ff100 - Compile with Gaudi. Clean up remaining code generation.
• 3e7b72c6 - Update algorithms and configurations to new paths.
• 70a12488 - Revert to using gsl::span. Parse without -nostdinc++.
• 08e35548 - Fix CUDA compilation.
• b8384a59 - Fix rate print by passing the correct number of events processed (with repetitions).g
• dbb6cd94 - Fix LIBCLANG_MINIMUM_VERSION_FOUND logic.
• b8883170 - Allow generation of sequences at runtime.
• 21c9ee26 - Remove configuration option, which is now superseeded by sequence.
• 3b69eb05 - Revert "Use privileged xl docker containers for build jobs; add test build...
• 7847f850 - Add copyright.
• 3f759a5a - Fixed formatting
• b2f75edf - Use SEQUENCES in build command. Make generate_algorithms_view build step...
• 482e62c5 - Add option --run-from-json 1 for run jobs.
• a1a6b1bd - Remove warning_cout from Property, use std::cerr instead. Remove bracket depth.
• 27c28f69 - Add pregenerated hlt1_pp_default sequence to avoid generation step when building with Gaudi.
• 5c25514a - Set SEQUENCES to hlt1_pp_default in NOT STANDALONE by default.
• 04d7917a - update test configuration
• e32d81f4 - Update allen.py according to run options.
• 98bb327b - Default to clang version 11.1 when clang is not found.
• 6d7e6477 - Updated sequence hlt1_pp_default to latest UT consolidate changes.
• 104ac3a6 - Fixed formatting
• 11b91b8e - update make_raw usage after rebase
• 484941f0 - Fixed formatting
• 27e0b799 - Remove GCC 11 dbg warning.
• a2b8d7f6 - SciFi v4 decoding to v6 logic
• 1ef6f6cc - Merge branch 'msaur_scifi_V4toV6' into 'master'
• 453f67ac - Merge branch 'dcampora_runtime_sequence' into 'master'
• 1c9414d8 - Updated script generate_code_struct_to_tuple.py
• 842a4f41 - Added option --generate struct_to_tuple to ParseAlgorithms.py
• 7945df1e - Added generation of StructToTuple as a dependency to all Allen host and device libraries.
• ffd59ea2 - Removed .cuh from StructToTuple pre and post files to avoid copyright scripts.
• d3fc00c7 - Add dependency to struct_to_tuple of mep_gec.
• cf99e992 - Added /code_generation to mep_test.
• a7abe73b - Make GenerateConfiguration compatible with macos.

Compare with previous version

changed target branch from dcampora_nnolte_gaudi_conversion to master

changed the description

assigned to @jedavies

I have rebased this branch, let me assign it to you @jedavies as this is ready for a test round.

/ci-test --merge

added ci-test-triggered label

• [2021-11-08 12:37] Validation started with lhcb-master-mr#3103
• [2021-11-09 18:10] Validation started with lhcb-master-mr#3114
• [2021-11-12 00:24] Validation started with lhcb-head#3102

added 2 commits

• 62967d19 - Remove struct_to_tuple generation requirement from Stream library as it is...
• 075cc0ad - Fix build tests.

Compare with previous version

assigned to @ascarabo and unassigned @jedavies

added 1 commit

• 85939e6a - Add struct_to_tuple requirement to Rec/Allen targets.

Compare with previous version