Load monitoring via ClipBoard
As discussed in the meeting, it would be useful to have a monitoring tool for data loads at the data processors of different front ends.
This can potentially be done via ClipBoard
. Each ClipBoard
currently has a counter for total number of data objects in and another counter for data out. A separate monitoring thread could access these counters during scans with some configurable time interval and report the data throughput while scans are running or generate a report at the end with timestamps.