Thin films of Ni-Zr glassy alloy were deposited at room temperature by magnetron co-sputtering. The alloy films were vacuum annealed in steps of 200°C from room temperature up to 800 °C, where devitrification finally occurred. Mechanical properties of the films were measured after each thermal anneal, through (cyclic) nanoindentation technique. The hardness values were observed to steadily increase with annealing temperature, as the alloy films underwent an amorphous to crystalline transformation. Grazing incidence X-ray diffraction measurements were performed on the as-deposited and annealed films both before and after nanoindentation. The resistance to plastic deformation was strongly linked to the (nano)structure of the material.