Did I hurt him? He hasn't contacted me like he usually does?

If he feels that you should just trust him, and he can't respect the fact that you don't, it's probably time to get rid of him. People who just expect trust do not truly respect others, so he probably desn't really respect you anyways. Just be careful.