kmlabz/sentry-onpremise
kmlabz/sentry-onpremise
Archived
2
0
Fork 0
Code Pull Requests Releases Activity

fix(snuba): Add consumer group to transactions consumer (#599)

Browse Source 
Without the consumer-group option, transactions consumer and events consumer will compete for messages on the same topic and usually events win, which is the first one. This may cause some data loss for performance and make it seem not work.

Should address https://forum.sentry.io/t/perfomance-tracing-for-sentry-itself/10405/5?u=byk
This commit is contained in:
Burak Yigit Kaya 2020-07-17 06:50:36 +03:00 committed by GitHub
parent 0bf688a0a6
commit e82506f5b7
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docker-compose.yml
View File

@ -124,7 +124,7 @@ services:
# Kafka consumer responsible for feeding transactions data into Clickhouse # Kafka consumer responsible for feeding transactions data into Clickhouse
snuba-transactions-consumer: snuba-transactions-consumer:
<< : *snuba_defaults << : *snuba_defaults
command: consumer --storage transactions --auto-offset-reset=latest --max-batch-time-ms 750 command: consumer --storage transactions --consumer-group transactions_group --auto-offset-reset=latest --max-batch-time-ms 750
snuba-replacer: snuba-replacer:
<< : *snuba_defaults << : *snuba_defaults
command: replacer --storage events --auto-offset-reset=latest --max-batch-size 3 command: replacer --storage events --auto-offset-reset=latest --max-batch-size 3