When we assume that there is a complete reaction, then the water is being absorbed by the soap formed because it has a hydrophilic nature or it can bind to water. Also, the amount of water is less than the amount of the soap formed that can dissolve the soap completely therefore we see a solid cake of soap.
