have a poor time of it (third-person singular simple present has a poor time of it, present participle having a poor time of it, simple past and past participle had a poor time of it)