Unpopular Opinion: For many people L2 isn't cheaper

Hear me out.

Obviously an L2, like Loopring, can do a transaction today for $0.32. That same transaction would cost $9.07 on ETH L1.

But the per-transaction cost isn't the only factor...

How I invest is as follows ... I save my money .... and whenever there is a major dip .... I move my fiat into a CEX, buy some crypto, move it to a wallet I control, then use Uniswap to buy the asset I want to invest in and HODL.

When I invest I incur the $100ish L1 fee anyway. To use L2 I would still need to incur the L1 fee anyway and then incur an L2 fee as well. This makes no sense, for me and how I invest.

So for me, to use L2 I first have to incur the L1 fee to deposit my crypto into the L2 solution. So using L2 makes sense for people who transact often. But not for me.

Is there a better way? Am I doing something wrong? For my investing pattern is there a more cost efficient way to invest?