Some pastors flight around from one church to another, never settling anywhere for long. They are like migratory birds; they change locations with the seasons. These pastors tend to treat ministry like a sprint (or a stepping stone) and not the marathon it is.
Pastor, as far as it depends on you, stay at your church for the long term. Don’t give up. Be patient, loving, and faithful to the Word. If possible, stay at your church until the Lord plucks you to be with Him in eternity. In the end, this will be best for you and your congregation.