Seed Phrase & Wallet Security

I was importing my wallet on a new device & it was successful but I couldn't see my balances. I freaked at first & upon checking I found out that I had entered the wrong seed phrase - I had switched two words so the order was incorrect.

So I had accidentally imported someone else's account.

Now my question is, what's stopping someone from entering random words to unlock wallets? As per my understanding no matter how careful you are, or if you use a cold wallet, there's a chance - however miniscule - that your wallet can be hacked.

Is there anything that can be done to increase security to prevent this from happening? The probability of something like this happening is slim but can we negate it completely?

Edit: I get that the chance of it happening is incredibly low, it just seems like a big deal to me cause it happened that easily.