Technologies/Luigi/luigi.resources.total
LuigiLuigiMetric

luigi.resources.total

Total available resources
Dimensions:None
Available on:PrometheusPrometheus (1)
Interface Metrics (1)
PrometheusPrometheus
Total amount of resource available in the scheduler
Dimensions:None
Sources
luigi_resources_totalgithub.com

Technical Annotations (14)

Configuration Parameters (2)
[resources]
section in luigi.cfg defining resource limits
LUIGI_CONFIG_PATHrecommended: path to config file with [resources] section
Environment variable that both scheduler and workers must reference
Error Signatures (3)
RuntimeError: Unfulfilled dependencies at run timeexception
25exit code
This progress looks :| because there were tasks that were not granted run permission by the schedulerlog pattern
Technical References (9)
dependenciesconceptcontainercomponentcentral schedulercomponentMesoscomponentresourcescomponentluigi.cfgfile path[resources]componentschedulercomponentluigidcomponent
Related Insights (8)
Luigi tasks fail with unfulfilled dependency errors under resource contentionwarning
▸
Resource exhaustion prevents task executionwarning
▸
Resource limits throttle task execution when capacity exceededwarning
▸
Multiple workers can overload system without global resource limitswarning
▸
Resource limits prevent task parallelism overloadinfo
▸
Unspecified resources default to limit 1, causing unexpected task serializationwarning
▸
Resource limits not enforced when scheduler lacks config file accesswarning
▸
Unconfigured resource limits enable task contentionwarning
▸