There is nothing to be terrified of, however I do not find it necessary to have driving license If the one is not interested in driving.
I would say that driving is much close to playing piano: it's easy to play single voice melody which is like driving around car parking space, and easy to play simple piece composed for rookie kids. On the other hand, having full controll over car in difficult situations, may be as hard as playing like a virtuoso. It takes months or even years of theory and practice (practice is far more efficient when you already know what should be done), however it cannot be achieved in normal driving, because everyday traffic is most often like playing that simple piece for kids, and there is no place for training. However some day some extreme situations may happen, eg. road may be covered with black ice, or some other driver will force priority, and then you will have to act fast, precise, use all the grip that is avaible or inavaible.
Please don't get me wrong. I do not want to be a pert, just telling what I believe is important. In fact, both driving skills and piano playing are my hobby, I took part in a few car rallies, I live in a country where are quite difficult driving conditions and I really find both things similar in terms of skills level. I also believe that paying attention to driving skills not only can save your life, but it's also fun and makes you relaxed while driving, beause you have better ability to recognize threats, and you can drive more easyli and efficient in terms of speed and fuel consumption. Thanks to a hard training in special driving school and a few rallies I took part in a past, I do not find any conditions to be difficult, I can drive safe and quite quick on snow, ice, or in a mountains, in fact I find it to be great entertainment.