"I know I was trying to protect myself that day, and so I’ve just never forgotten that," the actor shared.