Setup CI to run with grpc frontend similar to xrootd/ssi frontend

changed milestone to %Common gRPC CTA Frontend

assigned to @kskovola

mentioned in merge request !694

added Continuous Integration ci: helm cta: Front End (gRPC) typefeature labels

While the EOS charts are now in main, I'd still suggest to not rebase the current branch and get it to work there first. Once that works, let me know and I will make sure I do the appropriate changes on the eos-charts side to get this to work

There are changes to make the grpc-frontend deployment work in merge request !774. However, as that MR is not up-to-date with the main branch, it will need to be adjusted to the current CI setup.

In order to confirm that the grpc frontend is deployed and able to serve the physics workflows, I did the following (manual testing, for the time being): Create the EOS rpms from this branch: https://gitlab.cern.ch/kskovola/eos/-/tree/use_grpc_in_workflows?ref_type=heads Follow the instructions in continuousintegration/build/development/eos/alma9/Readme.md, using the v2.24 tag from EOS to create the eosdev image in the first step, as the commits in the branch above are based on top of 2.24. Then within the client pod (client-0) execute xrdcp of a file (for example I did the following), to test the CREATE workflow:

EOS_MGM_HOST="ctaeos"
EOS_INSTANCE_NAME="ctaeos"

EOSDF_BUFFER_BASEDIR=/eos/ctaeos/cta
EOSDF_BUFFER_URL=${EOSDF_BUFFER_BASEDIR}
TEST_FILE_NAME=testfile1_eosdf

echo "foo" > /root/${TEST_FILE_NAME}

FULL_EOSDF_BUFFER_URL=root://${EOS_INSTANCE_NAME}/${EOSDF_BUFFER_BASEDIR}
echo "Doing xrdcp of ${TEST_FILE_NAME} in the path root://${EOS_INSTANCE_NAME}/${EOSDF_BUFFER_URL}/${TEST_FILE_NAME}"
xrdcp /root/${TEST_FILE_NAME} root://${EOS_INSTANCE_NAME}/${EOSDF_BUFFER_URL}/${TEST_FILE_NAME}

Finally, to verify that the call went through, I checked the logs of ctaeos and cta-frontend-0:

• ctaeos - check in /var/log/eos/mgm/xrdlog.mgm for the existence of a log line "In SendProtoWFRequestGrpc"
• cta-frontend-grpc: check in /var/log/cta/cta-frontend-grpc.log for the existence of a log line "In WorkflowEvent::WorkflowEvent(): received event"

Thanks for the information. As we are deploying EOS 5.3.something in production soonish, it would be nice to rebase the changes on top of that tag (once we know what it will be). That way, the pipeline should build us an alma9 image that is usable in our CI