聖荷西華人浸信會是始於一個異象，乃是要在聖荷西地區建立一間華人浸信會。起初五個家庭為這異象每週聚集向神祈禱。經過六個月的禱告後，即在一九七五年十一月十五日，他們聚在一起開始了家庭敬拜，一九七六年一月四日於金寶市的第一浸信會的副堂舉行第一次主日崇拜。二零一一年一月三十日是聖荷西華人浸信會慶祝教會成立三十五週年的大日子。
本會在一九八二年起正式在現有的地址聚會張達吉牧師是本教會的第一位牧師，隨後有潘明仁牧師、吳宗文牧師、杜祥光牧師、招世超牧師、李均祥牧師、伍柏楨牧師、和傅華耀牧師。
聖荷西華人浸信會現時是美南浸信會及北加州華人浸信會區聯會之會員。
Community Baptist Church of San Jose (CBCSJ) began its history with a vision to plant a Chinese Church in the San Jose area. Five families in Christ gathered together to pray for this vision once a week. After six months of praying, on November 15, 1975, they gathered in a home for worship. Using the Fellowship Hall of the First Baptist Church of Campbell, CBCSJ started its first Sunday Worship Service on January 4, 1976. CBCSJ celebrated her 35th Anniversary on January 30, 2011.
Rev. Timothy Chang was our very first pastor. Former pastors have been Rev. Moses Pan, Rev. Daniel Ng, Rev. Dr. Peter Tow, Rev. Abraham Chiu, Rev. Gary Lee, Rev. Fred Eng and Rev Wah Yiu Fu. CBCSJ has been at this site, 2215 Curtner Avenue since 1982.
Community Baptist Church of San Jose is a member of the Southern Baptist Convention and the Northern California Chinese Baptist Association.