Mount Gideon Unified Free Will Baptist Church Inc., was founded by Reverend Henry E. Smith. The first service was held on the fifth Sunday in January of 1972.

Mount Gideon had its first service in the Rockview Administration Building at 295 Wilmot Road, New Haven, Connecticut. We continued worship service in the Rockview Administration Building for two years. Rev. Smith investigated renting a small church building at 234 Shelton Avenue in New Haven. The congregation leased the church in October 1974 and remained there for almost 1-1/2 years. In April 1976, the congregation purchased a building at 165 Sheffield Avenue, New Haven, CT. and converted this building into a church. The Lord continued to bless us and provided all of our needs. We were not content with the small building we were in, because it was not conducive to a church on the move. Dr. Smith heard that a church on the junction of Dixwell and Shelton Avenues was for sale. After investigating it, Dr. Smith called the congregation together to discuss the possible purchase of the church. In August of 1984, we moved into our new church home, at 363 Dixwell Avenue in New Haven, Connecticut.

In November of 1985, a church meeting was held to discuss the transition from the Unified Free Will Baptist Denomination. It was at this meeting that the church transitioned to Mount Gideon Faith Fellowship Church Inc.

In the year of 2004, through prayer and much thought, Dr. Henry E. Smith began implementing steps towards the future of Mount Gideon Faith Fellowship Church. On December 2, 2004, Minister Gary A Hyman Sr. was ordained by Dr. Henry Smith as Pastor of Mount Gideon Faith Fellowship Church. Pastor Gary and Lady Joyce Hyman worked under Dr. Henry E. Smith fervently promoting the spirit of fellowship and excellence.