I've seen them both and would prefer your company alone.

"I did not know whether you would prefer the company of your own friends."

You would have preferred the company of your husband's students.

But she preferred his company to that of her father's.

It was just that I always preferred my own company.

He merely preferred his own company to that of anyone else's.

"I always prefer the company of a beautiful woman, my lady."

He preferred its company to that of ordinary human beings.

But Liz has found she prefers the company of her cat.