Sheathe your weapon

Guards will tell you to sheathe your weapon if you have it out. If you ignore their second warning, they'll attack.