Viruses aren’t necessarily under selection pressure to be less virulent (as long as they can keep transmitting). I highly recommend this piece why, all else equal, the first encounter can be more dangerous—hence novel virus emergence can spark pandemics.