Why do some people say “on accident” rather than “by accident”?

Is it a regional thing? Is it like “anyways” where it’s an informal version of it?