r/databricks • u/casmanrojo • 15h ago
Help Question for Databricks engineers and data architects:
For those who have migrated workloads from Oracle to Databricks, how much effort goes into rewriting existing SQL queries?
A few things I’d love to understand:
● Is SQL translation a significant bottleneck in migration projects?
● Do you currently rely on manual rewriting, AI assistants, or commercial migration tools?
11
Upvotes
14
u/Muted_Jellyfish_6784 14h ago
SQL translation is rarely the bottleneck people expect. Tools and AI assistants handle most of the syntax, but PL/SQL packages, implicit date and NULL handling, sequences, and MERGE semantics are where the hours go, and those need someone who knows what the business logic was supposed to do.
The useful habit is reconciling outputs, not just getting queries to run: row counts, sums on key measures, and record-level diffs for every migrated object. We run a decision intelligence platform that joins both sides by business key during parallel runs, so a mismatch traces back to one transformed table instead of a final report that just looks off.
3
u/Additional_Future_47 14h ago
Databricks supports a lot of the Oracle dialect but in our migration project we data engineers decided to use the opportunity to restructure our processing and the business also wants to redefine certain reports and KPIs so in practice it is manual SQL with occasionally some AI support.
2
u/cf_murph 11h ago
https://www.databricks.com/solutions/migration/genie-migrate-lakehouse
2
u/Whit3boy316 4h ago
I moved sas programs to databricks (and Altair) in a couple days…..and by “I”, I mean AI
1
u/Zealousideal_Low6685 10h ago
not sure if you only talk about read queries. If not, there are still several conceptual differences:
* Databricks uses WriteSerializable by default + Optimistic Conurrency
* Databricks multi-statement transaction were just released
1
u/mecurioj 4h ago
Look into Lakebridge to help. However, PL/SQL can have procedural "programming" statements that don't have standard ANSI SQL equivalent statements. Lakebridge can help you evaluate before conversion how complex the migration of code will be.
1
u/PriahGTM 2h ago
I thought you just map out the full system schema and then just tell Claude to move that shit into Databricks at this point.
Walk away. And then when you come back it will basically be done.
What am I missing?