Well, he did take notice of the first one. Maybe after that he was just distracted, trying to figure out what's going on in Asgard around him?
I dunno. Definitely something that could and should have been handled better (as could a bunch of things in this movie), but not movie-breaking.