Technologies/Apache Spark/spark_rdd_memory_used
Apache SparkApache SparkMetric

spark_rdd_memory_used

Amount of memory used in the application's persisted RDDs
Dimensions:None
Available on:DatadogDatadog (1)
Interface Metrics (1)
DatadogDatadog
Amount of memory used in the application's persisted RDDs
Dimensions:None
Related Insights (1)
Inefficient Caching Causing Memory Evictionwarning

Indiscriminate caching of large datasets competes with execution memory, causing high cache eviction rates and forcing re-computation of expensive operations.