Also you mentioned networking problems with the address that you are using in for Openssh can you ping the box?  try pinging the host box from client using ping -c4 <host ip address>  check for packet loss.  If you are losing packets and/or the host cannot be reached than you have a network problem other than just ssh and you will need to solve this first.

--
James