And if we leave in pairs, they'll make a different assumption if they do notice.

[Which is probably a very bad thing, but at least it's an excuse.]

Especially since most of the local trainers are content to stay on a single route, waiting for challengers. Few bother with the complete badge challenge, let alone more difficult battles.