Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

IPv6/IPv4 address always been zero. #4

Open
ghost opened this issue Aug 29, 2016 · 2 comments
Open

IPv6/IPv4 address always been zero. #4

ghost opened this issue Aug 29, 2016 · 2 comments

Comments

@ghost
Copy link

ghost commented Aug 29, 2016

Hi,

No matter what IPv4 nor IPv6 addresses had been assigned to HFI IPoIB interfaces, opaportinfo always return " IPAddr IPV6/IPAddr IPv4: ::/0.0.0.0". We expect opaportinfo shows the IP addresses be used.

[root@rdma-qe-15 ~]$ ip addr show | grep inet
(Only keep Intel HFI/OPA interface info)
inet 172.31.20.15/24 brd 172.31.20.255 scope global hfi1_opa0
inet6 fe80::211:7501:167:fb0/64 scope link
inet 172.31.22.15/24 brd 172.31.22.255 scope global hfi1_opa0.8022
inet6 fe80::211:7501:167:fb0/64 scope link tentative
inet 172.31.24.15/24 brd 172.31.24.255 scope global hfi1_opa0.8024
inet6 fe80::211:7501:167:fb0/64 scope link tentative

[root@rdma-qe-15 ~]$
[root@rdma-qe-15 ~]$ ibstat
CA 'hfi1_0'
CA type:
Number of ports: 1
Firmware version:
Hardware version: 10
Node GUID: 0x0011750101670fb0
System image GUID: 0x0011750101670fb0
Port 1:
State: Active
Physical state: LinkUp
Rate: 100
Base lid: 3
LMC: 0
SM lid: 3
Capability mask: 0x00490022
Port GUID: 0x0011750101670fb0
Link layer: InfiniBand
[root@rdma-qe-15 ~]$

[root@rdma-qe-15 ~]$ /usr/sbin/opaportinfo -p 1
Present Port State:
Port 1 Info
Subnet: 0xfe80000000000000 GUID: 0x0011750101670fb0
LocalPort: 1 PortState: Active
PhysicalState: LinkUp
OfflineDisabledReason: None
IsSMConfigurationStarted: True NeighborNormal: True
BaseLID: 0x00000003 SMLID: 0x00000003
LMC: 0 SMSL: 0
PortType: Unknown LimtRsp/Subnet: 32 us, 536 ms
M_KEY: 0x0000000000000000 Lease: 0 s Protect: Read-only
LinkWidth Act: 4 En: 4 Sup: 1,2,3,4
LinkWidthDnGrd ActTx: 4 Rx: 4 En: 3,4 Sup: 1,2,3,4
LinkSpeed Act: 25Gb En: 25Gb Sup: 25Gb
PortLinkMode Act: STL En: STL Sup: STL
PortLTPCRCMode Act: 14-bit En: 14-bit,16-bit,48-bit Sup: 14-bit,16-bit,48-bit
NeighborMode MgmtAllowed: Yes FWAuthBypass: Off NeighborNodeType: Switch
NeighborNodeGuid: 0x00117501026480e3 NeighborPortNum: 36
Capability: 0x00490022: CN DM CM APM SM
Capability3: 0x0008: SS
SM_TrapQP: 0x0 SA_QP: 0x1
IPAddr IPV6/IPAddr IPv4: ::/0.0.0.0 <-----
VLs Active: 8+1
VL: Cap 8+1 HighLimit 0x0000 PreemptLimit 0x0000
VLFlowControlDisabledMask: 0x00000000 ArbHighCap: 16 ArbLowCap: 16
MulticastMask: 0x0 CollectiveMask: 0x0
P_Key Enforcement: In: Off Out: Off
MulticastPKeyTrapSuppressionEnabled: 0 ClientReregister 0
PortMode ActiveOptimize: Off PassThru: Off VLMarker: Off 16BTrapQuery: Off
FlitCtrlInterleave Distance Max: 1 Enabled: 1
MaxNestLevelTxEnabled: 0 MaxNestLevelRxSupported: 0
FlitCtrlPreemption MinInitial: 0x0000 MinTail: 0x0000 LargePktLim: 0x00
SmallPktLimit: 0x00 MaxSmallPktLimit 0x00 PreemptionLimit: 0x00
PortErrorActions: 0x172000: CE-UVLMCE-BCDCE-BTDCE-BHDR-BVLM
BufferUnits:VL15Init 0x0110 VL15CreditRate 0x00 CreditAck 0x0 BufferAlloc 0x3
MTU Supported: (0x7) 10240 bytes
MTU Active By VL:
00:10240 01: 0 02: 0 03: 0 04: 0 05: 0 06: 0 07: 0
08: 0 09: 0 10: 0 11: 0 12: 0 13: 0 14: 0 15: 2048
16: 0 17: 0 18: 0 19: 0 20: 0 21: 0 22: 0 23: 0
24: 0 25: 0 26: 0 27: 0 28: 0 29: 0 30: 0 31: 0
StallCnt/VL: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
HOQLife VL[00,07]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
HOQLife VL[08,15]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
HOQLife VL[16,23]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
HOQLife VL[24,31]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
ReplayDepth Buffer 0x80; Wire 0x09
DiagCode: 0x0000 LedEnabled: Off
LinkDownReason: None NeighborLinkDownReason: None
OverallBufferSpace: 0x0940
Violations M_Key: 0 P_Key: 0 Q_Key: 0
[root@rdma-qe-15 ~]$
@weiny2
Copy link

weiny2 commented Aug 29, 2016

It is not quite that simple:

  1.  You can have multiple IPoIB interfaces assigned to a physical port.  Which IP Address would you prefer the SMA use?

  2.  The driver/SMA does not currently have access to the IPoIB layer

  3.  The PortInfo IPAddrs were really designed to allow finding out of band access to switches which have only 1 IP assigned to them.

For these reasons PortInfo.IP Addresses are currently reserved fields in HFI ports.

Ira

From: HonggangLI [mailto:[email protected]]
Sent: Monday, August 29, 2016 1:19 AM
To: 01org/opa-ff [email protected]
Subject: [01org/opa-ff] IPv6/IPv4 address always been zero. (#4)

Hi,

No matter what IPv4 nor IPv6 addresses had been assigned to HFI IPoIB interfaces, opaportinfo always return " IPAddr IPV6/IPAddr IPv4: ::/0.0.0.0". We expect opaportinfo shows the IP addresses be used.

[root@rdma-qe-15 ~]$ ip addr show | grep inet
(Only keep Intel HFI/OPA interface info)
inet 172.31.20.15/24 brd 172.31.20.255 scope global hfi1_opa0
inet6 fe80::211:7501:167:fb0/64 scope link
inet 172.31.22.15/24 brd 172.31.22.255 scope global hfi1_opa0.8022
inet6 fe80::211:7501:167:fb0/64 scope link tentative
inet 172.31.24.15/24 brd 172.31.24.255 scope global hfi1_opa0.8024
inet6 fe80::211:7501:167:fb0/64 scope link tentative

[root@rdma-qe-15 ~]$
[root@rdma-qe-15 ~]$ ibstat
CA 'hfi1_0'
CA type:
Number of ports: 1
Firmware version:
Hardware version: 10
Node GUID: 0x0011750101670fb0
System image GUID: 0x0011750101670fb0
Port 1:
State: Active
Physical state: LinkUp
Rate: 100
Base lid: 3
LMC: 0
SM lid: 3
Capability mask: 0x00490022
Port GUID: 0x0011750101670fb0
Link layer: InfiniBand
[root@rdma-qe-15 ~]$

[root@rdma-qe-15 ~]$ /usr/sbin/opaportinfo -p 1
Present Port State:
Port 1 Info
Subnet: 0xfe80000000000000 GUID: 0x0011750101670fb0
LocalPort: 1 PortState: Active
PhysicalState: LinkUp

OfflineDisabledReason: None

IsSMConfigurationStarted: True NeighborNormal: True
BaseLID: 0x00000003 SMLID: 0x00000003
LMC: 0 SMSL: 0
PortType: Unknown LimtRsp/Subnet: 32 us, 536 ms
M_KEY: 0x0000000000000000 Lease: 0 s Protect: Read-only
LinkWidth Act: 4 En: 4 Sup: 1,2,3,4

LinkWidthDnGrd ActTx: 4 Rx: 4 En: 3,4 Sup: 1,2,3,4

LinkSpeed Act: 25Gb En: 25Gb Sup: 25Gb

PortLinkMode Act: STL En: STL Sup: STL

PortLTPCRCMode Act: 14-bit En: 14-bit,16-bit,48-bit Sup: 14-bit,16-bit,48-bit
NeighborMode MgmtAllowed: Yes FWAuthBypass: Off NeighborNodeType: Switch
NeighborNodeGuid: 0x00117501026480e3 NeighborPortNum: 36
Capability: 0x00490022: CN DM CM APM SM
Capability3: 0x0008: SS
SM_TrapQP: 0x0 SA_QP: 0x1
IPAddr IPV6/IPAddr IPv4: ::/0.0.0.0 <-----
VLs Active: 8+1
VL: Cap 8+1 HighLimit 0x0000 PreemptLimit 0x0000
VLFlowControlDisabledMask: 0x00000000 ArbHighCap: 16 ArbLowCap: 16
MulticastMask: 0x0 CollectiveMask: 0x0
P_Key Enforcement: In: Off Out: Off
MulticastPKeyTrapSuppressionEnabled: 0 ClientReregister 0
PortMode ActiveOptimize: Off PassThru: Off VLMarker: Off 16BTrapQuery: Off
FlitCtrlInterleave Distance Max: 1 Enabled: 1
MaxNestLevelTxEnabled: 0 MaxNestLevelRxSupported: 0
FlitCtrlPreemption MinInitial: 0x0000 MinTail: 0x0000 LargePktLim: 0x00
SmallPktLimit: 0x00 MaxSmallPktLimit 0x00 PreemptionLimit: 0x00
PortErrorActions: 0x172000: CE-UVLMCE-BCDCE-BTDCE-BHDR-BVLM
BufferUnits:VL15Init 0x0110 VL15CreditRate 0x00 CreditAck 0x0 BufferAlloc 0x3
MTU Supported: (0x7) 10240 bytes
MTU Active By VL:
00:10240 01: 0 02: 0 03: 0 04: 0 05: 0 06: 0 07: 0
08: 0 09: 0 10: 0 11: 0 12: 0 13: 0 14: 0 15: 2048
16: 0 17: 0 18: 0 19: 0 20: 0 21: 0 22: 0 23: 0
24: 0 25: 0 26: 0 27: 0 28: 0 29: 0 30: 0 31: 0
StallCnt/VL: 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0
HOQLife VL[00,07]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
HOQLife VL[08,15]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
HOQLife VL[16,23]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
HOQLife VL[24,31]: 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00
ReplayDepth Buffer 0x80; Wire 0x09
DiagCode: 0x0000 LedEnabled: Off
LinkDownReason: None NeighborLinkDownReason: None
OverallBufferSpace: 0x0940
Violations M_Key: 0 P_Key: 0 Q_Key: 0

[root@rdma-qe-15 ~]$

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com//issues/4, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AACVleZZFTwHIdAC0CC5CqemT8viHrtsks5qkpYBgaJpZM4JvP2R.

@ghost
Copy link
Author

ghost commented Aug 30, 2016

  1. You can have multiple IPoIB interfaces assigned to a physical port. Which IP Address would you prefer the SMA use?

I'd prefer to see the IPv4 and IPv6 addresses of the master IPoIB interface (hfi1_opa0).

Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@weiny2