A fast and reliable distributed task processing library for Python 3. Fork of dramatiq.io
Changelog: https://remoulade.readthedocs.io/en/latest/changelog.html
Documentation: https://remoulade.readthedocs.io
If you want to use it with RabbitMQ
$ pipenv install 'remoulade[rabbitmq]'or if you want to use it with Redis
$ pipenv install 'remoulade[redis]'- Make sure you've got RabbitMQ running, then create a new file called
example.py:
from remoulade.brokers.rabbitmq import RabbitmqBroker
import remoulade
import requests
import sys
broker = RabbitmqBroker()
remoulade.set_broker(broker)
@remoulade.actor
def count_words(url):
response = requests.get(url)
count = len(response.text.split(" "))
print(f"There are {count} words at {url!r}.")
broker.declare_actor(count_words)
if __name__ == "__main__":
count_words.send(sys.argv[1])- In one terminal, run your workers:
$ remoulade example- In another, start enqueueing messages:
$ python3 example.py http://example.com
$ python3 example.py https://github.com
$ python3 example.py https://news.ycombinator.comVisit the user guide to see more features!.
Check out SuperBowl a dashboard for real-time monitoring and administrating all your Remoulade tasks. See the current progress, enqueue, requeue, cancel and more ... Super easy to use !.
Remoulade is tailored to run transparently in containers on Kubernetes and to make the most of their features. This does not mean it cannot run outside of Kubernetes ;)
Remoulade provides a Prometheus Middleware that exposes various metrics (processed messages, retries, fails etc.), Check it out.
Take a look at opentelemetry-instrumentation-remoulade if you want to enable tracing for Remoulade operations (enqueue, message processing, retries etc.). See here for an example. The library follows OpenTelemetry standards.
remoulade is licensed under the LGPL. Please see COPYING and COPYING.LESSER for licensing details.