Should a UPS always be plugged in?

Yes, if you do not want to have uninterrupted power if there is a power outage