In this video, I have explained how you can handle the missing values in Spark Dataframes from one or multiple columns. And how you can filter the spark dataframes based upon some missing values conditions.
In this tutorial, I have used PySpark, but the process will be the same if you are using the spark with the scala programming language.