I always gave it the smell test. All of it, breastmilk, formula, whole milk, etc... Formula I was a little more watchful of the time, but everything else gets a smell test before deciding I needed to toss it.
I just do the smell test. But most of the time it's back in the fridge anyway
You could probably get away with putting it back in the refrigerator.