Intentional doping and unintentional impurities in intrinsic semiconductors generate carriers that enable device operations. Fundamental to the electronic activity of dopants and impurities is the introduction of defect states inside the forbidden energy gap of semiconductors having shallow and/or deep characteristics, which fundamentally define the ability to engineer its physical properties and associated device performance. Here we demonstrate that unintentional electron doping by oxygen (O_N) impurities and intentional magnesium hole doping (Mg_Sc) in scandium nitride (Sc_N) do not introduce any defect states inside its fundamental bandgap and that the rigid-band electronic structure remains unchanged. Employing a combination of spectroscopic techniques as well as first-principles density functional theory analysis, we show that the O_N and Mg_Sc defect states in ScN are located inside the bands, which leaves behind the virgin ScN bandgap as well as the valence and conduction band edges that are important for electronic transport. The rigid-band electronic structure of ScN with respect to the electron and hole doping results in high electron and hole concentrations due to the free movement of Fermi level and results in tunable electronic and thermoelectric properties necessary for device applications.