The standard choice of heating is often convective air heating. It makes some sense if warmer climates because you can use the air conditioning vents to deliver heating too. The problem is that there are alternative heating methods that do the job much better.
In the colder countries in the world you will not often find convective air providing winter heat. This is because it is inefficient, and according to many people, bad for your health.
Systems based on radiant water heat do a much better job of heating homes, and are one option well worth considering. This is for many reasons including the fact that radiant heat does not blow winter diseases about the home, and it radiates more directly to the human occupants of a room that blown air does.
All that is needed for these systems is a way of heating water - gas heating systems, oil, electric, and a place to deliver the hot water. This can be metal radiators hung on the wall, discrete unit at floor level or any one of a number of designer shapes.
Alternatively you can go with hydronic radiant floor heat - this is hot water pumped under the floor. It is perhaps the oldest form of central heating - the Roman Empire made extensive use of it in the villas of the rich and famous.