This page details the Baptist Churches in
Quote ... "In 1846 they began work
on Ebenezer, a brick
This is the closest I have come to the address
Includes some terrific photos of "old" Walsall
There are a number listed under Stafford Street
But none that I can be sure of being the one that Joseph attended
More research needed !!