I have a Validation trigger set to run Before Create, but it doesn't look like it's getting executed.
Trigger setup:
After creating a record:
Validation triggers are executed separately (before) from ON_BEFORE_CREATE. So your trigger is running properly.
However we should also display validation triggers in Debug window, this will be fixed in the next release.