Maybe you can checkout Apache Zeppelin which is an alternative to run spark shell without much complex configuration.

https://zeppelin.apache.org/docs/0.10.0/quickstart/kubernetes.html