In the scarlet letter, does Chillingworth move in with Dimmesdale because...?

He suspects that it was Dimmesdale, but he finds out pretty much for sure that it was him when he finds him with his shirt off and sees that he had, it's more implied than actually stated, but he had carved an "A" into his chest just like Hester had to wear because he felt so guilty.