You might need to install/configure Hive.
To enable access to a SchemaRDD, it needs to be registered in a catalog that is outside of just the local context. Currently today, the Hive Metastore (“Hive context”) is the only supported service (the Spark SQL connector evolved out of the Hive connector) - thus the need for the Hive Thrift Server.
Can you please point us to any documentation on how to 'register SchemaRDD in Hive Metastore'? I tried searching for it online but to no avail. I'd greatly appreciate your help.
I personally have to direct experience with that but here's something from our internal manuals:
Tableau can use Initial SQL to create a temporary table to store the SchemaRDD and enable access without having to explicitly put the data HDFS and the Hive metastore. An example of this is below:
create temporary table test
options (path ‘/data/json/*');
cache table test;
Then, Custom SQL can be used to explicitly display the temporary table that was created in Tableau:
SELECT * FROM ‘test