ssh - sign_and_send_pubkey: signing failed: agent refused operation

I have tried every possible piece of command I could lay my hands on. I still get this. I spun a digital ocean droplet with ubuntu 16.04 on it. I followed the tutorial until I had to login in again as the new user. I am at my wits end trying to find a solution. This is the output if I give the command ssh-add

Could not open a connection to your authentication agent.