Have you ever been in a situation where you just ‘know’ a course of action is right?

No data, no detailed scenario planning, you just know.

I have.

Where does that confidence come from, and is it justified?

Have you distinguished between genuine intuition, based on experience and knowledge, and the overconfidence that can arise from a lack of awareness of one’s limitations?”

In my experience which includes choices that have been both very good, and very poor, there are two qualitative drivers of those good choices.

Significant domain experience.

This experience does not come from being around for a while, it comes from taking action many times, and learning from the outcomes, resetting, and trying again.

For example: a seasoned chess grandmaster can often intuitively anticipate the best move without consciously calculating every possible outcome, drawing on years of experience and pattern recognition.”

Learning from analogy.

When you see a course of action succeed in other domains that have some similarity to your own, you can infer that the success may be repeatable in yours.

For example:  The introduction of disc brakes in cars came from their development  for use in stopping aeroplanes when landing.

In a world increasingly dominated by data, it’s crucial to remember that  while numbers provide valuable insights, they should not be blindly trusted. True wisdom often lies in the delicate balance between data-driven analysis and the intuition honed through experience and learning from mistakes.

Chess is a game where a grand master has a store of intuition gathered and sorted by years of practice that is leveraged instinctively when playing.