I'm not sure if they actually want to leave them... but some can be really curious and wonder around in curiosity.

[Like his Petilil... good things she's in her ball right now.]

I don't think the Pokémon can change trainers on their own.