Because you have endogamy, total cM counts will be inflated. So the 180cM match is maybe more distant than would be expected without endogamy. 3rd cousin would be reasonable, maybe.
If you and that match have very developed trees, say back through 3rd-great-grandparents, then I’d guess there is an NPE. It could be either in your match’s line or your own. If your match doesn’t have the same endogamy as you do, it may be easier to detect an NPE in their side. I don’t know if there’s a tactful way to ask them if there is a great-grandparent they haven’t found any matches to yet, but it may help to have an answer to that question.