An important subclass of Artin-Schelter regular algebras that has gained lots of attention in recent years is the class of N-Koszul Artin-Schelter regular algebras. While structurally rich with many results in the literature applicable to the entire subclass, the only known examples of such algebras are either when N = 2, i.e. the algebra is Koszul, or when N = 3. Under a mild Hilbert series assumption, we rule out the existence of N-Koszul Artin-Schelter regular algebras for N even. Furthermore, we set restrictions on the possible global dimension for such algebras.