The folks at Databricks who lead the development of Apache Spark, including Xin (currently the number three committer to Spark), took those comments to heart and pledged to do something about Python’s ...

The software provides detailed resource usage and performance information about Spark applications, as well as line-by-line code analysis for all Spar-on-YARN applications developed in Scala, Java, ...