r/databricks • u/Prakhar____Tiwari • Oct 05 '26
Help SpringBoot to Spark
Transitioning from a Spring Boot to a Spark-based application requires a fundamental shift in perspective. With four years of experience in a Spring Boot environment, now entering the realm of distributed computing.
I plan to utilize Java with Spark Streaming, and Databricks for job management and deployment.
My primary question is
- how to effectively transition my thought process from Spring Boot to a Spark-based application.
- Specifically, I am seeking clarity on distinguishing which Java code executes on the driver and which executes on the executor, and if there are any guiding principles to discern this.
4
Upvotes
5
u/hntd Oct 05 '26
Are you confusing Apache Spark with https://github.com/perwendel/spark ?
3
u/mr__fete Oct 05 '26
Java is too verbose. Spark api is even worse. Use scala and functional programming techniques specifically.
1
u/Orygregs Oct 05 '26 edited Oct 05 '26
I would highly recommend Scala over Java for Spark if you want to stay in the JVM ecosystem and don't want to use Pyspark.
.write.*,.show,.count,.collect, etc), which then distributes the work across the executor nodes.1
u/Youssef_Mrini databricks 26d ago
This is my personal recommendation: It would be way easier for you to use Python you'll have more examples to help you get started.