Periodic nanostructuring can enhance the optical nonlinearity of plasmonic metals by several orders of magnitude. By patterning a gold film, the largest sub-100 femtosecond nonlinearity is achieved, which is suitable for terahertz rate all-optical data processing as well as ultrafast optical limiters and saturable absorbers.