You can live without many things, but you shouldn't cheap out on the mattress for your bed. No matter if it's hot or cold the mattress can compensate for that thanks to how it's built.
From Wayfair
Cashmere Pillow-Top Open Coil Mattress
The Range
Natural Cashmere Pillowtop Mattress - White / Superking