Can you only get HSV if someone has a breakout?

No, you don't need to see an "active breakout" (sores) to contract HSV. Both herpes simplex virus type 1 (HSV-1) and type 2 (HSV-2) can be spread through skin-to-skin contact with an infected person. HSV-2 most commonly causes genital herpes, while HSV-1 can cause both oral herpes (cold sores) and genital herpes. The viruses can be spread even when someone does not have visible symptoms. This means that someone infected with HSV can transmit the virus to others even when there are no sores present.