link votes: Use a queue to update links by domain queries
commit7f3113f476ce86fbe7bfdaeccd97a8c5ade24afc
authorBrian Simpson <bsimpson63@gmail.com>
Mon, 17 Oct 2016 23:05:16 +0000 (17 16:05 -0700)
committerBrian Simpson <bsimpson63@gmail.com>
Wed, 26 Oct 2016 18:59:54 +0000 (26 11:59 -0700)
treed561c0d0bb55b36136c5433b8a2ba3b92c7d6dc3
parent5ebee0959f013b8f8a87bb42b99f63127e151adc
link votes: Use a queue to update links by domain queries

The queue can be sharded by domain to minimize lock contention
and the consumer will batch updates to the same links (e.g. several
votes for the same link) and to the same domain (e.g. votes for different
links to a single domain).
install/reddit.sh
r2/example.ini
r2/r2/config/queues.py
r2/r2/lib/app_globals.py
r2/r2/lib/voting.py
upstart/reddit-consumer-domain_query_q.conf [new file with mode: 0644]