An error occurred while retrieving diff files
High load improvements
* Add ActiveMQ Docker logging config for development * Add ClientIndividualConsumer and ClientIndividualListener. These classes allow: * create a listener per connection, to avoid one listener instance shared among all threads * each listener to call ack/nack in their connection * cleanup connections list (was growing forever, every 5 minutes appending new connections) * Catch BrokenPipeError, until stomp.py has a proper fix to the race condition. Provided a [MR](https://github.com/jasonrbriggs/stomp.py/issues/393). * Upgrade from centos stream 8 to centos stream 9 * Bump python 3.6 (EOL was 23 Dec 2021) to 3.9 (EOL 05 Oct 2025) * Replace `pycrypto` (unmaintained, obsolete, and contains security vulnerabilities.) with `pycryptodome` * Log thread_id in all logs * Make Auditing a class instance, property of the processor instance * Share SQLAlchemy engine and connection pooler (set as a class property, protected by a lock) to avoid multiple calls to automap_base which would throw a SA warning * Retry etcd client on external disconnect/ failure to create client * Fix typo: Uppercase priority coming in email gateway
Showing
- .env 4 additions, 2 deletions.env
- .env.safaripush 5 additions, 1 deletion.env.safaripush
- .isort.cfg 1 addition, 1 deletion.isort.cfg
- .pre-commit-config.yaml 1 addition, 1 deletion.pre-commit-config.yaml
- Dockerfile 2 additions, 1 deletionDockerfile
- Dockerfile-base 6 additions, 6 deletionsDockerfile-base
- Makefile 8 additions, 4 deletionsMakefile
- README.md 14 additions, 0 deletionsREADME.md
- docker-compose.yml 3 additions, 1 deletiondocker-compose.yml
- docker/activemq/conf/activemq.xml 4 additions, 1 deletiondocker/activemq/conf/activemq.xml
- docker/activemq/conf/log4j.properties 88 additions, 0 deletionsdocker/activemq/conf/log4j.properties
- logging.yaml 4 additions, 4 deletionslogging.yaml
- notifications_consumer/app.py 21 additions, 15 deletionsnotifications_consumer/app.py
- notifications_consumer/auditing.py 123 additions, 72 deletionsnotifications_consumer/auditing.py
- notifications_consumer/config.py 1 addition, 1 deletionnotifications_consumer/config.py
- notifications_consumer/consumer.py 32 additions, 9 deletionsnotifications_consumer/consumer.py
- notifications_consumer/data_source/postgres/postgres_data_source.py 20 additions, 6 deletions...ons_consumer/data_source/postgres/postgres_data_source.py
- notifications_consumer/megabus/client_individual_consumer.py 110 additions, 0 deletionsnotifications_consumer/megabus/client_individual_consumer.py
- notifications_consumer/megabus/client_individual_listener.py 46 additions, 0 deletionsnotifications_consumer/megabus/client_individual_listener.py
- notifications_consumer/processors/email/aescipher.py 1 addition, 1 deletionnotifications_consumer/processors/email/aescipher.py
Loading
Please register or sign in to comment