RIOIP01

Use this procedure to isolate a failure in a RIO/HSL/12X loop using i5/OS(R) service tools.

Follow the steps in the Main task and you will be directed to the proper subtasks.

Note:
During this procedure, you will be disconnecting and reconnecting cables. If errors concerning missing resources (such as disk units and RIO/HSL/12X failures) occur, ignore them. Missing resources will report in again when the loop reinitializes.

Main task

  1. Were you sent here from a B600 xxxx reference code?
  2. Before powering down any system unit or expansion unit, work with the customer to end all subsystems in all of the partitions using each partition's console.
  3. From the partition control panel, IPL the system or partition to Dedicated Service Tools (DST).
    Attention: Do not use function 21!
  4. Are all system and expansion units on the loop powered on?
  5. Perform the following:
    1. Power on all system and expansion units on the loop. If a frame cannot be powered on, perform the Cannot power on unit subtask below, and then continue with step 6.
    2. Was the RIO/HSL/12X link error cleared up when the frames were powered back on?
  6. Perform the following:
    1. Access the Service Action Log (SAL) entry for this error; the field replaceable units (FRUs) should be listed there. Look for part numbers and descriptions for the FRUs containing the RIO/HSL/12X port for two frames. There should also be a FRU for the cable between them. The locations information for the FRUs is the location of the failed ports on the failed link.
    2. Record the loop number from the SAL (if it is displayed there in one of the FRU descriptions) or from the first four characters of word 7 of the reference code. Go to Converting the loop number to RIO/HSL/12X port location labels to determine which RIO/HSL/12X cables on the system you are working with.

      Is this information in the SAL?

  7. Is the cable connecting the failed ports an optical cable?
  8. Perform the following:
    1. Clean the RIO/HSL/12X cable connectors and ports using the fiber optic cleaning kit and the fiber optic cleaning procedures in "SY27-2604 Fiber Optic Cleaning Procedures".
    2. To determine if cleaning the connectors and ports solved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
      • No: Then the problem is fixed, go to Verifying a repair. This ends the procedure.
      • Yes: Continue with the next step.
  9. There are now three cases to consider. Continue with the appropriate subtask of this procedure:

The ports on both ends of the failed link are in different system units on the loop

  1. There may be failed hardware that will report a different error on the other system units. Perform the following:
    1. Work any other RIO/HSL/12X problems in the serviceable event view on the other system units.
    2. Perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
      • No: Then the problem is fixed, go to Verifying a repair. This ends the procedure.
      • Yes: Continue with the next step.
  2. Is the cable an optical RIO/HSL/12X cable?
  3. Perform the following:
    1. Verify that the cables are connected securely. For any cable that was loose, disconnect the cable at that end, wait 30 seconds, and reconnect the cable securely. If there are thumbscrews, you must tighten both thumb screws within 30 seconds of when the cable makes contact with the port.
    2. If you disconnected and reconnected the cable at either end, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
      • No: Then the problem is fixed, go to Verifying a repair. This ends the procedure.
      • Yes: Continue with the next step.
  4. Replace the cable between the two system unit ports on the failed link. To determine if replacing the cable resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  5. Exchange the FRU with the RIO/HSL/12X port in one of the system units. If you are working with a serviceable event view and the RIO/HSL/12X FRUs are listed, exchange the FRU corresponding to the first RIO/HSL/12X cable port listed. Otherwise, exchange the FRU that is quickest and easiest to replace). To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  6. Exchange the remaining FRU with the RIO/HSL/12X port on the other system unit. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  7. Use the procedure RIO/HSL/12X connection problems to determine if there are any additional RIO/HSL/12X cable-related FRUs, such as interposer cards and internal ribbon cables, that may be on either unit. Did you exchange any additional RIO/HSL/12X FRUs?
  8. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?

The port on one end of the failed link is in a system unit and the port on the other end is in an I/O unit

  1. Switch the two RIO/HSL/12X cables on the I/O unit with the failed port, so that each cable is connected to the port where the other cable was previously connected. Disconnect both cables at the same time, wait 30 seconds, and then reconnect the cables one at a time.
    Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
  2. Refresh the port status for the first failing resource by performing Refresh the port status below. Then continue with the next step.
  3. Is the port on the system unit that was failed now working?
  4. Switch the cables back to their original positions by disconnecting both cables at the same time, waiting 30 seconds, and then reconnecting the cables one at a time.
    Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
  5. Exchange the cable between the two ports on the failed link. To determine if replacing the cable resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  6. Use the procedure RIO/HSL/12X connection problems to determine if there are any additional RIO/HSL/12X cable-related FRUs, such as interposer cards and internal ribbon cables, that may be on either unit. Did you exchange any additional RIO/HSL/12X FRUs?
  7. Exchange the RIO/HSL/12X FRU that contains the failing port in the system unit. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  8. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?

The ports on both ends of the failed link are in an I/O unit

  1. Switch the two RIO/HSL/12X cables on the first (or "From") cable's I/O unit with the failed port so that each cable is connected to the port where the other cable was previously connected.
    Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
  2. Refresh the port status for the first failing resource by performing Refresh the port status below. Then continue with the next step.
  3. Is the port on the I/O unit on which you did not switch the cables now working?
  4. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link and return to this point. Did the ports you were working on have a status of "failed"?
  5. Switch the cables back to their original positions.
    Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
  6. Switch the two RIO/HSL/12X cables on the second (or "To") I/O unit with the failed port so that each cable is connected to the port where the other cable was previously connected.
    Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
  7. Refresh the port status for the first failing resource by performing Refresh the port status. Then continue with the next step.
  8. Is the port on the I/O unit on which you did not switch cables now working?
  9. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?
  10. Switch the cables back to their original positions.
    Attention: For copper cables with thumbscrews, you must fully connect the cable and tighten the connector's screws within 30 seconds of when the cable makes contact with the port. Otherwise, the link will fail and you must disconnect and reconnect again. Also, if the connector screws are not tightened, errors will occur on the link and it will fail.
  11. Exchange the RIO/HSL/12X cable between the two ports on the failed link. To determine if replacing the cable resolved the problem, perform Manually detecting the failed link, then return to this point.

    Did the ports you were working on have a status of "failed"?

  12. Use the procedure RIO/HSL/12X connection problems to determine if there are any additional RIO/HSL/12X cable-related FRUs, such as interposer cards and internal ribbon cables, that may be on either unit. Did you exchange any additional RIO/HSL/12X FRUs?
  13. To determine if replacing the FRU resolved the problem, perform Manually detecting the failed link below and return to this point. Did the ports you were working on have a status of "failed"?

Cannot power on unit

  1. Work the errors related to powering on the unit(s), and then continue with the next step. If a unit still cannot be powered on, re-cable the RIO/HSL/12X loop without the I/O units and system units that cannot be powered on, allowing the loop to be complete (no disconnected cables).
  2. To determine if re-cabling the loop resolved the problem, perform Manually detecting the failed link below and return to this point.
  1. Get the loop number from the reference code if you do not already have it. The loop number is a hexadecimal number in word 7 of the reference code.
  2. Sign on to SST or DST (if you have not already done so). Select Start a service tool -> Hardware service manager -> Logical hardware resources -> High-speed link (HSL) resources.
  3. Select Resources associated with loop for the RIO/HSL/12X loop with the failed link. The RIO/HSL/12X bridges will be displayed under the loop.
  4. Select Display detail for the loop with the failed link.
  5. Record the name of the NIC/RIO controller resource you are starting from on the display. You will need to know this name to determine if you have followed the loop around and back to this resource.
  6. If the leading port does not have a status of "failed", select Follow leading port until a leading port with a "failed" status is found, or the display is showing information for the starting NIC/RIO resource you recorded. Did you find a leading port with a status of "failed"?
  7. Select Follow leading port one more time and note all the information for the resource name with a failed trailing port.
  8. Select Display system information and note the power controlling system's type, model, and serial number (and name, if available). This info may be needed for FRU replacement at a later time.
  9. Select Cancel twice to return to the previous screen.
  10. Go to each resource name (found above) and select Associated packaging resource(s). This gives the description of the failing item and the unit ID.
  11. Select Display detail to find the part number and location associated with the possible failing item. Then return to the step that sent you here.

Refresh the port status

  1. Wait one minute, and then sign on to SST or DST (if you have not already done so).
  2. Select Start a service tool -> Hardware service manager -> Logical hardware resources -> High-speed link (HSL) resources.
  3. Move the cursor to the RIO/HSL/12X loop that you want to examine and select Display detail -> Include non-reporting resources.
  4. If the display is not already showing the ports for one of the units you are working on, then select Follow leading port. Continue to select Follow leading port until the display is showing the ports for one of the units you are working on. Note the status of the port you were working on. Select Follow leading port until the display is showing the ports for the other unit you are working on, and note the status of the port you were working on.
  5. Select Cancel -> Refresh -> Display detail for the failing resource you are checking. Note any change in the status for the resource. Then return to the step that sent you here.