Technologies/Luigi/luigi.worker.task_count
LuigiLuigiMetric

luigi.worker.task_count

Tasks assigned per worker
Dimensions:None
Available on:PrometheusPrometheus (1)DatadogDatadog (1)
Interface Metrics (2)
PrometheusPrometheus
Current number of tasks being executed by this worker
Dimensions:None
DatadogDatadog
Number of tasks assigned to each worker
Dimensions:None
Sources
luigi_worker_active_tasksgithub.com
luigi.worker.task_countgithub.com

Technical Annotations (8)

Configuration Parameters (5)
task_limit
maximum tasks to schedule per invocation, prevents scheduler spam
keep_aliverecommended: false
whether workers stay alive when no jobs available
max_keep_alive_idle_durationrecommended: 0
max seconds to keep idle worker alive (0 = indefinite)
count_uniquesrecommended: false
whether to exit when all pending jobs are on other workers
significantrecommended: False
creates distinct instances while maintaining same task signature hash
Technical References (3)
workercomponentluigi.cfgfile pathcentral schedulercomponent
Related Insights (5)
Task limit exceeded stops workflow schedulingwarning
▸
Workers stay alive indefinitely while idleinfo
▸
Task instance caching causes shared state within workerwarning
▸
Worker process does not scale beyond thousands of taskswarning
▸
Unconfigured resource limits enable task contentionwarning
▸