Skip to content

Enable streaming behaviour on all 'cta-admin ls' commands

Problem to solve

At the moment, not all cta-admin ls commands are processed in a streaming fashion by the CTA Frontend.

Some examples (not all) are:

  • cta-admin tape ls
  • cta-admin sq

This can be seen with the pv Linux command. If we run cta-admin sq | pv > tmp_file, we can see that the throughput is 0.00 B/s for a while (CTA Frontend is batching all records), until finally all records are transfered at once.

For other commands, such as cta-admin tf ls --vid <vid>, we can see that the records start being sent immediatelly by the CTA Frontend, and printed one-by-one once they are received at the cta-admin client.

Stakeholders

Proposal

For all cta-admin ls commands, we should guarantee that they are transferred in a stream fashion (as long as the algorithm allows).

This is particularly important for commands that output a long list.