Skip to content

[v9r2] TS: allow to set empty list as SE parameters

Christophe Haen requested to merge chaen/LHCbDIRAC:rel-v9r2_FIX_archiveSEs into master

@romanov complained that he could not anymore empty the list of archives when creating a replication. It was still working 2 weeks ago, so clearly it got broken with v9r2. Not sure where, too many changes. So I've fixed it (test bellow), but I am not 100% confident that I measure the consequences of that. @fstagni and @charpent might need to approve :-)

DIRAC-PROD>dirac-test-plugin -P 76811 -f CHARM_D02KSPIPI_DVNTUPLE.ROOT --Archive2SEs="" --MandatorySEs=CERN-DST-EOS  --SecondarySEs Tier1-DST,Tier2D-DST --Plugin LHCbMCDSTBroadcastRandom  
Transformation type: Replication
BK Query: {'Visible': 'All', 'FileType': 'CHARM_D02KSPIPI_DVNTUPLE.ROOT', 'Production': 76811}
Plugin: LHCbMCDSTBroadcastRandom
Parameters: {}
SE parameters: {'Archive2SEs': [], 'MandatorySEs': 'CERN-DST-EOS', 'SecondarySEs': 'Tier1-DST,Tier2D-DST'}
RequestID: 48718
Getting the files from BK

5 files (0.0 TB) in directories:
/lhcb/MC/2016/CHARM_D02KSPIPI_DVNTUPLE.ROOT/00076811/0000/ 5 files

Now testing the replication plugin LHCbMCDSTBroadcastRandom
Preparing the plugin input data (5 files)
Obtained replicas of 5 files in 3.261 seconds
 [NoThread] [-9999] Starting execution of plugin
Plugin took 8.6 seconds

4 tasks created
1 - Target SEs: CERN-DST-EOS,IN2P3-DST - 1 file  - Current locations: ['CNAF_MC-DST']
    Final SEs: ['CNAF_MC-DST,CERN-DST-EOS,IN2P3-DST']
2:2 (1 tasks) - Target SEs: CERN-DST-EOS,NCBJ-DST - 1 file  - Current locations: ['IN2P3_MC-DST']
    Final SEs: ['IN2P3_MC-DST,CERN-DST-EOS,NCBJ-DST']
3 - Target SEs: CERN-DST-EOS,RAL-HEP-DST - 2 files  - Current locations: ['RAL_MC-DST', 'RRCKI_MC-DST']
    Final SEs: ['RAL_MC-DST,CERN-DST-EOS,RAL-HEP-DST', 'RRCKI_MC-DST,CERN-DST-EOS,RAL-HEP-DST']
4 - Target SEs: CNAF-DST,NCBJ-DST - 1 file  - Current locations: ['CERN_MC-DST-EOS']
    Final SEs: ['CERN_MC-DST-EOS,CNAF-DST,NCBJ-DST']
DIRAC-PROD>dirac-test-plugin -P 76811 -f CHARM_D02KSPIPI_DVNTUPLE.ROOT --MandatorySEs=CERN-DST-EOS  --SecondarySEs Tier1-DST,Tier2D-DST --Plugin LHCbMCDSTBroadcastRandom 
Transformation type: Replication
BK Query: {'Visible': 'All', 'FileType': 'CHARM_D02KSPIPI_DVNTUPLE.ROOT', 'Production': 76811}
Plugin: LHCbMCDSTBroadcastRandom
Parameters: {}
SE parameters: {'MandatorySEs': 'CERN-DST-EOS', 'SecondarySEs': 'Tier1-DST,Tier2D-DST'}
RequestID: 48718
Getting the files from BK

5 files (0.0 TB) in directories:
/lhcb/MC/2016/CHARM_D02KSPIPI_DVNTUPLE.ROOT/00076811/0000/ 5 files

Now testing the replication plugin LHCbMCDSTBroadcastRandom
Preparing the plugin input data (5 files)
Obtained replicas of 5 files in 1.644 seconds
 [NoThread] [-9999] Starting execution of plugin
Plugin took 7.4 seconds

4 tasks created
1 - Target SEs: CERN-ARCHIVE,CERN-DST-EOS,CNAF-DST - 2 files  - Current locations: ['RAL_MC-DST', 'RRCKI_MC-DST']
    Final SEs: ['RAL_MC-DST,CERN-ARCHIVE,CERN-DST-EOS,CNAF-DST', 'RRCKI_MC-DST,CERN-ARCHIVE,CERN-DST-EOS,CNAF-DST']
2 - Target SEs: CERN-DST-EOS,CNAF-ARCHIVE,GRIDKA-DST - 1 file  - Current locations: ['IN2P3_MC-DST']
    Final SEs: ['IN2P3_MC-DST,CERN-DST-EOS,CNAF-ARCHIVE,GRIDKA-DST']
3 - Target SEs: CERN-DST-EOS,RAL-ARCHIVE,RAL-DST - 1 file  - Current locations: ['CNAF_MC-DST']
    Final SEs: ['CNAF_MC-DST,CERN-DST-EOS,RAL-ARCHIVE,RAL-DST']
4 - Target SEs: CNAF-DST,IN2P3-ARCHIVE,RRCKI-DST - 1 file  - Current locations: ['CERN_MC-DST-EOS']
    Final SEs: ['CERN_MC-DST-EOS,CNAF-DST,IN2P3-ARCHIVE,RRCKI-DST']

Merge request reports