My best guess is a throaway line from someone in the first episode (probably Enid or maybe even Wednesday delivering exposition to the audience) saying 'Oh, did you hear? Xavier had to go on some last minute family trip thing' and that will be why he's not in Nevermore.
It'll be pretty weird to see a new actor acting as if he's been with the cast for the whole time when they've not.