If you want to run a spark job in windows that make use of the spark SQL pool, you need to set the HADOOP_HOME and hadoop.home.dir environment variables manually and there is a very quick and easy solution to do this.
java.io.FileNotFoundException: HADOOP_HOME and hadoop.home.dir are unset
← Explore more articlesWritten by Enrique Catalá