Umbilical Cord Fell Off?

My baby girl is just over 2 weeks old and her umbilical cord stump just fell off last night. I called the doctor and the nurse said I can give her a full bath now, but my question is, can I wash her belly on w/ soap? like, get inside of her belly on, or should I just keep swabbing it w/ alcohol?