Why analytics is genuinely hard to learn

Learning is hard.

But some things are harder than others. And most people dramatically underestimate where analytics sits on that scale.

Not implementation, analysis.

There's a reasonably well-established framework for why some skills are harder to acquire than others. It comes down to four things: cognitive load, prerequisite depth, feedback loop quality, and abstraction level.

Cognitive load is how much you have to hold in your head simultaneously. Prerequisite depth is how much you need to already know before the new thing makes sense. Feedback loop quality is how quickly and clearly you find out if you were right or wrong. Abstraction is how far removed you are from the thing you're actually trying to understand.

By all four measures, analytics is hard.

The cognitive load issues

You're not looking at stable data.

 You're looking for variations in a liquid changing mass where every element interacts with every other element. A traffic drop could be a broken tag, a seasonal pattern, a campaign ending, a competitor move, or five things happening at once. 

You can't evaluate any single explanation without holding all the others in your head simultaneously.

That's not just complicated. 

That's a genuinely high cognitive load in the technical sense.

The prerequisite problem runs deeper than most people acknowledge. It's not just knowing what a session or a funnel is. You need enough domain knowledge about the specific business to know what normal looks like. Which means analytics has a double prerequisite layer. You need to understand analytics and the business you're applying it to. 

Swap industries and you start over. Not completely, but enough to matter.

The feedback loop problem is where it gets interesting.

The data gives you fast feedback. You can know within hours or even minutes that something changed. But whether your interpretation of that change was correct might take weeks to discover. And often you never find out at all.

 The business moved on. The next campaign started. The context shifted. You can be wrong about causation indefinitely and never get clean confirmation.

The abstraction problem

You are never looking at behavior. You are looking at a record of behavior. A number that represents an action that a human took, filtered through a tracking implementation, aggregated with thousands of other actions, and then presented to you as a metric.

Every step in that chain involves translation. And every translation introduces distance from reality.

Most other difficult skills keep you closer to the thing itself. A surgeon operates on an actual body. A chess player moves actual pieces. A language learner hears actual responses. In analytics, the raw material is always one step removed. You're reading shadows on a wall and trying to describe what cast them.

This matters because it means you can be confidently wrong in ways that feel right. 

A number goes up. You build a story around it. The story is coherent, the data supports it, the stakeholders nod. And the underlying behavior it was supposed to represent was something else entirely.

Abstraction doesn't just make analytics harder to learn. It makes it harder to know when you've learned it.

The data quality problem

The data quality in analytics is significantly below what you'd find in, say, medical diagnostics. A broken tracking tag looks identical to a genuine traffic drop. A consent banner change can silently remove 40% of your data with no error message. GA4 models data and doesn't always distinguish between what's real and what's interpolated. The instrument fails quietly and invisibly.

In medicine, you get a second signal. Clinical observation runs alongside lab results. In analytics, the data is often the only window into reality. If it's broken, you're blind and don't know it.

Which means before you can even begin analyzing, you have to determine whether the data is trustworthy. That's a completely separate skill set from analytical reasoning. Most analysts aren't trained for it. Most organizations don't know it exists.

The population problem

You're never looking at a user. You're looking at a superposition of overlapping populations. Different intent, different context, different devices, different relationships to the product. All collapsed into a single number.

A 3% conversion rate could be 30% conversion from high-intent visitors dragging up a 1% baseline from everyone else. Or two segments moving in opposite directions that happen to net to 3%. The aggregate is real but potentially meaningless without segmentation.

Most analysts read aggregates as if they represent a coherent group. Almost all stakeholders do.

Four problems, not one

So you end up with four problems layered on top of each other.

Is the data trustworthy? Which population am I actually looking at? What pattern is present? What does that mean for behavior?

Most analytics training addresses problem three. Most analytics work lives in problem three. Problems one and two are where the actual leverage is. They're also the most invisible and the most thankless.

Where this leaves analytics

Probably top 20% of human skills to do well. Comparable in difficulty profile to medical diagnosis, with business domain knowledge replacing biological knowledge. Same high element interactivity, same weak feedback loops, same translation from observable signals to hidden causes.

Harder than chess. Harder than a spoken foreign language. Not harder than becoming a great writer or a psychiatrist, but uncomfortably close.

And unlike bomb disposal, the difficulty is chronic rather than acute. No hard deadline. No binary outcome. Just ambiguity, indefinitely.

Start making it hard

None of which stops organizations from assuming that if you give people data, they'll naturally know what to do with it.

Learning to use data well is like learning a new language, a new type of math, consumer psychology, and a new habit at the same time.

You don't just become data-driven by having data.

It's a process. 

A slow one. 

And it starts with taking the difficulty seriously.

Next
Next

THE SHORTCUT DOCTRINE