Celery

What Celery is

Celery is a free, open-source distributed task queue for real-time processing that also supports scheduled work. It sends task messages through a broker to worker processes for execution; systems can use multiple workers and brokers for high availability and horizontal scaling. Celery Beat starts tasks at regular intervals for available worker nodes. Documented transports include RabbitMQ, Redis, Amazon SQS, Kafka, and Google Pub/Sub, with different capability notes: RabbitMQ and Redis are stable, SQS is stable without monitoring or remote control, and Kafka is experimental without those capabilities. Celery documents integrations for Django, Pyramid, Pylons, Flask, web2py, Tornado, and FastAPI. Commands can inspect and manage worker nodes, and monitoring options include Flower and event utilities. Celery 5.6 supports Python 3.9 through 3.13 and PyPy 3.9 or newer. It is self-hosted under the New BSD License. The project advises restricting broker access because Celery should be treated as unsafe; supported broker backends can use SSL encryption and authentication. Windows is not officially supported, though it may work.