Running Dask
Hello, I'm trying to run a Python/Dask application (with a skein driver) on the cluster using Dask-Yarn, but every time I try to deploy it, I can't get past the initial phase where it crashes indefinitely on the constructor. From the logs I can see that the scheduler and workers are created without throwing exceptions (so it's not a problem with deploying the Conda environment) and it's classified as RUNNING, and I've called kinit before submitting anything, but I never get a monitoring URL (which I should have with skein), and it stops doing anything. Has anyone tried using Dask on the cluster? Are you aware of any configuration issues when using it, like on using specific ports?