diff --git a/argo-workflows/eos_and_secrets/.gitkeep b/argo-workflows/access_eos/.gitkeep similarity index 100% rename from argo-workflows/eos_and_secrets/.gitkeep rename to argo-workflows/access_eos/.gitkeep diff --git a/argo-workflows/eos_and_secrets/README.md b/argo-workflows/access_eos/README.md similarity index 76% rename from argo-workflows/eos_and_secrets/README.md rename to argo-workflows/access_eos/README.md index db4f979fe66551d807138b8659026ba1afa885a5..26291e4b679284d8dd1dd59426e2c249c1ebcfe6 100644 --- a/argo-workflows/eos_and_secrets/README.md +++ b/argo-workflows/access_eos/README.md @@ -1,7 +1,6 @@ ## What is it about? -Creating a pipeline with EOS access and mounting an S3 secret. -A demonstration of mounting different storage options. +Creating a pipeline with EOS access. The script demonstrates: - Creation of a Kubernetes secrets. @@ -17,17 +16,16 @@ To expand, feel free to add customized code with scripts to run. - Open Terminal - Login to kerberos with kinit: - `kinit CERN-USER-ID` +When kerberos has been refreshed, remove any old secret before creating a new one + - `kubectl delete secret krb-secret` - Create a kerberos secret for Kubernetes - `kubectl create secret generic krb-secret --from-file=/tmp/krb5cc_1000` -- Edit `s3_secret.yaml` to add credentials for accessing a bucket -- Create a secret for S3 bucket - - `kubectl apply -f s3_secret.yaml` -- Customize `argo_eos_secrets.yaml` file +- Customize `access_eos.yaml` file - Change user directory in EOS - Use custom image if needed - Use custom command and scripts - Upload the pipeline. Note: {NAMESPACE} is a personal Kubeflow namespace - - `kfp pipeline upload -p eos_secrets_pipeline -d 'namespace: {NAMESPACE}' argo_eos_secrets.yaml` + - `kfp pipeline upload -p eos_secrets_pipeline -d 'namespace: {NAMESPACE}' access_eos.yaml` - Create an experiment (a wrapper for pipeline runs) - `kfp experiment create argo_experiment` - Run the pipeline diff --git a/argo-workflows/eos_and_secrets/argo_eos_secrets.yaml b/argo-workflows/access_eos/access_eos.yaml similarity index 100% rename from argo-workflows/eos_and_secrets/argo_eos_secrets.yaml rename to argo-workflows/access_eos/access_eos.yaml diff --git a/argo-workflows/eos_and_secrets/s3_secret.yaml b/argo-workflows/eos_and_secrets/s3_secret.yaml deleted file mode 100644 index 45f3bd23f68356637961e9309a16dd37825f4740..0000000000000000000000000000000000000000 --- a/argo-workflows/eos_and_secrets/s3_secret.yaml +++ /dev/null @@ -1,11 +0,0 @@ -apiVersion: v1 -kind: Secret -metadata: - name: s3-secret - annotations: - serving.kubeflow.org/s3-endpoint: s3.cern.ch - serving.kubeflow.org/s3-usehttps: "1" -type: Opaque -stringData: - awsAccessKeyID: *** - awsSecretAccessKey: ***