Perform the following steps in the order listed. If the issue resolves after a step, there is no need to complete the subsequent steps.
- If internal network issues are not ongoing and this issue is not a recurring problem, attempt the following steps:
- Make sure that all InfiniBand (IB) cables in the rack and in adjacent racks are connected securely to the node and are undamaged.
- Make sure there are no kinks or sharp bends in the cables. InfiniBand (IB) cables have an approximate maximum bend radius of 1.5 inches (38mm).
- If internal network issues are ongoing but do not continually recur, attempt the following steps.
- Determine whether the issue is related to the cable or the node. Plug the affected cable into another node that has a functioning network port and an identical network configuration. Be sure to plug the cable into the same network port on the different node.
- If the issue persists after plugging the cable into a different node, replace the cable.
- If the issue persists after replacing the cable, move the cable to another port on the switch.
- Confirm that multiple clusters are not connected to the same IB switch. This configuration is unsupported and can cause this issue. Each cluster must be connected to a dedicated IB switch.
If the above steps do not resolve the issue, gather logs, and then contact EMC Isilon Technical Support for additional troubleshooting. For instructions, see Gathering cluster logs.