The Real Challenge: Strategy Before Selection
Modern enterprises are drowning in data but starving for insight. The demand for real-time dashboards, predictive models, and AI-driven decisions is growing but infrastructure and skills are often the bottleneck.

Snowflake and Databricks approach this challenge differently: one optimises for simplicity and governance; the other for flexibility and engineering control.
Databricks: The Engineer’s Playground
If your data team thrives on Spark, Python, and building end-to-end ML pipelines, Databricks is a powerhouse. It’s a full-blown engineering ecosystem with deep AI capabilities.
Best for:
- Engineering-heavy organisations
- AI and ML workloads needing native support for frameworks like PyTorch and TensorFlow
- Complex, high-throughput streaming use cases
Business outcomes we’ve seen:
- Real-time operational insights for utilities and logistics
- Collaborative data science at scale
- Fine-grained tuning for cost optimisation (if you have the skills to manage it)
With tools like Genie (Conversational AI) and Mosaic (Generative AI management), Databrickscontinues to lead in applied AI innovation.
My Take
When I’m thinking of our clients and their decision making process, I weigh three things first:
- People: What skills do you already have in-house?
- Priorities: Is your focus on governed analytics or engineering flexibility?
- Path: Where do you want to be in 3 years and how fast do you need to get there?
And my personal stance? Running both adds unnecessary complexity unless there’s a very specific, high-value use case.
The organisations who get this right don’t just pick a tool, they pick the tool that amplifies their team’s strengths, meets their regulatory needs, and accelerates their AI ambitions.
And if you want true long-term flexibility? Build with open table formats like Apache Iceberg so you can move between platforms if your strategy shifts.