Family law questions? Ask a family lawyer online.
you should not be bullied, I agree
the idea of you not doing enough is a purely matter of opinion
from what you have described you did more than enough
in my opinion I would not be worried about the home visit
the fact that the social worker is on your side is very helpful for you as well