The five fold ministry has a time limit on it. It will only last, "Till we all come in the unity of the faith, and of the knowledge of the Son of God, unto a perfect man". Once that comes about it is no longer needed for that person who has become perfect (mature). Every single person in the body of Christ does the "work of the ministry" not just only five people. What is the "work of the ministry"? For the "perfecting of the saints, for the work of the ministry, for the edifying of the body of Christ:" Each and every Christian is called to this work! The five fold ministry is to "perfect" the saints so that they (the Saints) can do the work of the ministry, which is to build up the Body of Christ.
The Apostle Paul was trying to teach a group of people in the book of Hebrews, but could not because they were still babies in the Lord, yet they had been saved long enough to where they should have been "teachers" them-self's. How long does it take to become mature to where one can go about teaching others, thereby being able to edify the body of Christ, which is the work of the ministry?
Are we suppose to stay in a brick, and mortar building Church until we die, or are we to lean and become "mature" and then go out to teach others, so that they to can teach others?
Eph 4:11 And he gave some, apostles; and some, prophets; and some, evangelists; and some, pastors and teachers;
Eph 4:12 For the perfecting of the saints, for the work of the ministry, for the edifying of the body of Christ:
Eph 4:13 Till we all come in the unity of the faith, and of the knowledge of the Son of God, unto a perfect man, unto the measure of the stature of the fulness of Christ:
Eph 4:14 That we henceforth be no more children, tossed to and fro, and carried about with every wind of doctrine, by the sleight of men, and cunning craftiness, whereby they lie in wait to deceive;
Heb 5:12 For when for the time ye ought to be teachers, ye have need that one teach you again which be the first principles of the oracles of God; and are become such as have need of milk, and not of strong meat.
Heb 5:13 For every one that useth milk is unskilful in the word of righteousness: for he is a babe.
Heb 5:14 But strong meat belongeth to them that are of full age, even those who by reason of use have their senses exercised to discern both good and evil.