This question was asked by Charity in the Philippines. I answered her briefly in the comments section of this blog, but below is a more thorough answer.

The Bible, both the Tanakh (OT) and the Testimony of Yeshua (NT), promote male leadership, eldership and priesthood as normative. However, there have been times when men were not available to fulfill the plans and purposes of Elohim, so he used woman. A most notable example was Deborah who was both a prophetess and a judge in Israel (although she was most likely the wife of Barak who was a military leader in Israel, which would have made her the co-leader of Israel with her husband). Huldah was a prophetess, a judge and a counselor to kings. 

The Testimony of Yeshua carries the idea of male leader into the church. In the apostolic era, the Head Leader, of course, was Yeshua himself, then there were his twelve male apostles, and then there were male elders over each congregation (1 Tim 3:1–7; Tit 1:5–9), and the head over each family was the husband and father (Eph 5:22–33). 

The apostolic writings also promote the idea of the priesthood of all believers (e.g. 1 Pet 2:9; Rev 1:6). When it comes to salvation and spiritual equality, in YHVH’s eyes there is neither male or female, Jew or Gentile. All are equal and one in Messiah (Rom 10:12; Gal 3:28; Col 3:11). 

However, the New Testament Scriptures record that the church was still led by male elders. Nevertheless, there are examples of husband and wife ministry teams. In Romans we see the husband and wife apostolic team of Andronicus and Junia (Rom 16:7). Another example of such a evangelistic-pastoral team was Aquila and Priscilla. They worked so closely together that sometimes Scripture mentions wife first, and sometimes the husband (Acts 18:2, 8, 26. Rom 16:3; 1 Cor 16:19; 2 Tim 4:19). 

One example of a likely woman pastor is Lydia who, apparently, led a church in her home (Acts 16:40). The Bible reveals that if there is no man to do fulfill YHVH purposes, he will raise up a woman to do it. The only caveat is that to follow a biblical authority structure, she needs to be under the authority of or accountable to a male elder in some way. Lydia would have been under the eldership of Paul who led her to Yeshua and baptized her (Acts 16:14).

If a woman is leading a congregation and she is married, she should be doing so in conjunction with her husband, with his blessing. If she is not, then she is out of order spiritually. If she’s not married, then she needs to be working in conjunction with male eldership.