That’s the easier way to do it unless you have baby hands. Pull the retaining clips and pull the light forward enough to expose the socket and you’re good.
You definitely dont NEED to remove the headlight. The passenger's side is super easy to get to, and the driver's side can be done but it's tight with the battery right there. Sometimes it's tough to pull a headlight on a 94-98.