I disagree. I think people are overestimating how much stuff like this matters in casual play. What matters more is stuff like positioning and map movements, but since it is harder to determine the "correct" play people just ignore it. Unless you are Diamond+ I find this was a waste of your own chance to win.
On the other side, since people overestimate stuff like this, your team would likely get tilted as hell (if it's ranked), and this lowers the win chance by a lot. So maybe at the end of the day you saved yourself some brain cells :)
If you are above bronze then it matters a lot lol. Junglers without smite will get outjungled by anyone
It is a disadvantage sure, but it is a much bigger disadvantage to the team when someone is not rotating where they should. Smite is easy to see, but map plays casual players often just ignore. My point is that the disadvantage is not as big as people here make it out to be.