Choosing your data stack in a market saturated with tools
Every week another platform promises to revolutionise how you work with data. The question isn't how many you master, but which ones you pick and on what grounds.
Every day we see infographics, developer surveys, LinkedIn ads and job postings that invite us to believe we need to know everything. And what exactly does everything mean?
In the world of data and AI roles, the constant arrival of new tools can be overwhelming. Every week brings platforms and libraries promising to revolutionise how we work. But the question almost nobody asks is: do you really need to master every one of them to stay relevant?
The problem with abundance
The belief that you must know every available tool is common in this industry. And that mindset doesn’t just exhaust you: it leads to lower productivity and worse decisions.
“The worst kind of waste is the waste we don’t recognise.”
Taiichi Ohno
The criteria I use
I chose to prioritise depth over breadth. I work with SQL Server, Python and Power BI: tools that fit what I need and that I know thoroughly. When I evaluate a new one, I ask three questions:
- Relevance: does it solve a real problem in my workflow?
- Scalability: does it grow with my projects, or my clients’?
- Learning curve: do I have the time to master it, or will it only add complexity?
There’s a fourth factor that usually falls out of the conversation: where you are in your career. If the company you work for runs a Microsoft-based stack (SQL, Power BI, Fabric, Azure) and you plan to stay a while, committing to those specific tools isn’t complacency. It’s focus.
Fundamentals weigh more than the catalogue
A professional with solid foundations in data modelling, efficient SQL, an understanding of business logic and judgement about visualisation delivers more value than someone with surface-level knowledge of many tools.
“You don’t have to see the whole staircase, just take the first step.” Martin Luther King Jr.
How to filter the noise
Staying current is necessary. Swallowing everything isn’t. These are the filters I apply:
- Real innovation: is this genuinely new, or a reinvention of something that exists?
- Trusted references: what do colleagues whose judgement I respect actually say?
- Controlled trials: test it against a specific goal, not “just to see”.
- Impact on productivity: does it simplify the workflow or complicate it?
Recommendations
- Focus. You don’t need to know every tool.
- Choose deliberately. Pick what delivers real value, beyond the trend.
- Keep curiosity, with direction. Explore, but with a clear purpose.
- Ignore external pressure. Passing trends aren’t a career plan.
- Master your stack. Go deep on what you use every day.
Take your time
In an environment that rewards constant innovation, betting on stability and deep command of specific tools can look unusual. For me it’s been key to sustaining productivity, delivering tangible value and avoiding technology fatigue.
It isn’t about chasing every new tool, but about choosing wisely and using them with mastery.