Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
J
JAliEn setup
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Iterations
Requirements
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Locked files
Build
Pipelines
Jobs
Pipeline schedules
Test cases
Artifacts
Deploy
Releases
Package registry
Container registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Code review analytics
Issue analytics
Insights
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
Community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
JAliEn
JAliEn setup
Merge requests
!23
Implement new container setup
Code
Review changes
Check out branch
Download
Patches
Plain diff
Closed
Implement new container setup
kwijethu/jalien-setup:moratuwa-fyp
into
master
Overview
2
Commits
83
Pipelines
2
Changes
46
1 unresolved thread
Hide all comments
Closed
Kalana Wijethunga
requested to merge
kwijethu/jalien-setup:moratuwa-fyp
into
master
1 year ago
Overview
2
Commits
83
Pipelines
2
Changes
46
1 unresolved thread
Hide all comments
Expand
This PR redesign the current container setup to be in sync with the original JAliEn Grid
0
0
Merge request reports
Compare
master
version 1
645c80e4
1 year ago
master (base)
and
latest version
latest version
025076a0
83 commits,
1 year ago
version 1
645c80e4
15 commits,
1 year ago
46 files
+
1622
−
54
Inline
Compare changes
Side-by-side
Inline
Show whitespace changes
Show one file at a time
Files
46
Search (e.g. *.vue) (Ctrl+P)
.github/workflows/build-and-push-aws.yaml
0 → 100644
+
122
−
0
Options
name
:
Push Images to AWS ECR
on
:
schedule
:
-
cron
:
"
45
15
*
*
5"
jobs
:
build-and-push-docker-images
:
runs-on
:
ubuntu-latest
steps
:
-
name
:
Checkout code
uses
:
actions/checkout@v2
-
name
:
Set up Docker
uses
:
docker/setup-buildx-action@v1
-
name
:
Build Docker images
run
:
|
make all
-
name
:
Clone jalien
run
:
|
cd ${{ github.workspace }}
cd ..
git clone https://gitlab.cern.ch/jalien/jalien
-
name
:
Create config.sh for bash
run
:
|
cd ${{ github.workspace }}
cd ..
echo "
export BASE_DIR=$(pwd)
export SCRIPT_DIR=$(pwd)/jalien-setup/bash
export SHARED_VOLUME=$(pwd)/SHARED_VOLUME
export JALIEN=$(pwd)/jalien
export JALIEN_SETUP=$(pwd)/jalien-setup
export JALIEN_SOURCE=https://gitlab.cern.ch/jalien/jalien
export JALIEN_SETUP_SOURCE=https://github.com/FYP-Jalien/jalien-setup
export CE_NAME=shared_volume_JCentral-dev-CE_1
export JCENTRAL_NAME=shared_volume_JCentral-dev_1
export SCHEDD_NAME=shared_volume_schedd_1
export SE_NAME=shared_volume_JCentral-dev-SE_1
export WORKER_NAME=shared_volume_worker1_1
" >> ${{ github.workspace }}/../jalien-setup/bash/config/config.sh
-
name
:
Run jalien-setup bash scripts
run
:
|
cd ${{ github.workspace }}/../jalien-setup/bash
./start.sh --shared --local-images
-
name
:
Clone test-suite
run
:
|
cd ${{ github.workspace }}
cd ..
git clone https://github.com/FYP-Jalien/test-suite
-
name
:
Create .env for test-suite
run
:
|
cd ${{ github.workspace }}
cd ..
echo "
export SHARED_VOLUME_PATH=$(pwd)/SHARED_VOLUME
export JALIEN_SETUP_PATH=$(pwd)/jalien-setup
export CONTAINER_NAME_CE=shared_volume_JCentral-dev-CE_1
export CONTAINER_NAME_CENTRAL=shared_volume_JCentral-dev_1
export CONTAINER_NAME_SCHEDD=shared_volume_schedd_1
export CONTAINER_NAME_SE=shared_volume_JCentral-dev-SE_1
export CONTAINER_NAME_WORKER=shared_volume_worker1_1
export SCRIPT_DIR=$(pwd)/test-suite
export ALIENV_PATH=$(pwd)/test-suite/files/alma-alienv
export SAMPLE_JDL_PATH=$(pwd)/test-suite/files/sample_test.jdl
export TESTSCRIPT_PATH=$(pwd)/test-suite/files/testscript_test.sh
" >> ${{ github.workspace }}/../test-suite/.env
-
name
:
Run test-suite for container specific tests
run
:
|
cd ${{ github.workspace }}/../test-suite
./index.sh --container-only
-
name
:
Configure AWS credentials
uses
:
aws-actions/configure-aws-credentials@v1
with
:
aws-access-key-id
:
${{ secrets.AWS_ACCESS_KEY_ID }}
aws-secret-access-key
:
${{ secrets.AWS_SECRET_ACCESS_KEY }}
aws-region
:
us-east-1
-
name
:
Login to Amazon ECR
id
:
login-ecr
uses
:
aws-actions/amazon-ecr-login@v2
with
:
registry-type
:
public
-
name
:
Build, tag, and push jalien-base to Amazon ECR
env
:
ECR_REGISTRY
:
${{ steps.login-ecr.outputs.registry }}
REGISTRY_ALIAS
:
k7p0k7q2
ECR_REPOSITORY
:
fyp-jalien-base
IMAGE_TAG
:
latest
run
:
|
docker tag jalien-base:latest $ECR_REGISTRY/$REGISTRY_ALIAS/$ECR_REPOSITORY:$IMAGE_TAG
docker push $ECR_REGISTRY/$REGISTRY_ALIAS/$ECR_REPOSITORY:$IMAGE_TAG
-
name
:
Build, tag, and push jalien-ce to Amazon ECR
env
:
ECR_REGISTRY
:
${{ steps.login-ecr.outputs.registry }}
REGISTRY_ALIAS
:
k7p0k7q2
ECR_REPOSITORY
:
fyp-jalien-ce
IMAGE_TAG
:
latest
run
:
|
docker tag jalien-ce:latest $ECR_REGISTRY/$REGISTRY_ALIAS/$ECR_REPOSITORY:$IMAGE_TAG
docker push $ECR_REGISTRY/$REGISTRY_ALIAS/$ECR_REPOSITORY:$IMAGE_TAG
-
name
:
Build, tag, and push worker-base to Amazon ECR
env
:
ECR_REGISTRY
:
${{ steps.login-ecr.outputs.registry }}
REGISTRY_ALIAS
:
k7p0k7q2
ECR_REPOSITORY
:
fyp-worker-base
IMAGE_TAG
:
latest
run
:
|
docker tag worker-base:latest $ECR_REGISTRY/$REGISTRY_ALIAS/$ECR_REPOSITORY:$IMAGE_TAG
docker push $ECR_REGISTRY/$REGISTRY_ALIAS/$ECR_REPOSITORY:$IMAGE_TAG
-
name
:
Build, tag, and push xrootd-se to Amazon ECR
env
:
ECR_REGISTRY
:
${{ steps.login-ecr.outputs.registry }}
REGISTRY_ALIAS
:
k7p0k7q2
ECR_REPOSITORY
:
fyp-xrootd-se
IMAGE_TAG
:
latest
run
:
|
docker tag xrootd-se:latest $ECR_REGISTRY/$REGISTRY_ALIAS/$ECR_REPOSITORY:$IMAGE_TAG
docker push $ECR_REGISTRY/$REGISTRY_ALIAS/$ECR_REPOSITORY:$IMAGE_TAG
Loading