Unexpect mailbox IRQ on Witherspoon during Power on

[gkeishin]

Noticed this on jenkins HW CI test run : gerrit: https://gerrit.openbmc-project.xyz/#/c/openbmc/openbmc/+/35426/

------------------------------------------------------------------------ 
APPLICATION DATA : BMC state	Executed : /usr/bin/obmcutil state
------------------------------------------------------------------------ 
CurrentBMCState     : xyz.openbmc_project.State.BMC.BMCState.Ready
CurrentPowerState   : xyz.openbmc_project.State.Chassis.PowerState.On
CurrentHostState    : xyz.openbmc_project.State.Host.HostState.Running
BootProgress        : xyz.openbmc_project.State.Boot.Progress.ProgressStages.OSStart
OperatingSystemState: xyz.openbmc_project.State.OperatingSystem.Status.OSStatus.Inactive

SOL log:

 73.28880|ISTEP 21. 2 - host_verify_hdat
 73.28493|ISTEP 21. 3 - host_start_payload
[   74.109998065,5] OPAL skiboot-v6.0.14 starting...
[   74.110001552,7] initial console log level: memory 7, driver 5
[   74.110003606,6] CPU: P9 generation processor (max 4 threads/core)
[   74.110005386,7] CPU: Boot CPU PIR is 0x0824 PVR is 0x004e1201
[   74.110008233,7] OPAL table: 0x30103730 .. 0x30103cf0, branch table: 0x30002000
[   74.110011273,7] Assigning physical memory map table for nimbus
[   74.110014072,7] Parsing HDAT...
[   74.110015337,5] SPIRA-S found.
[   74.110018167,6] BMC #0: HW version 3, SW version 2, chip DD1.0
[   74.110397745,6] SP Family is ibm,ast2500,openbmc
[   74.110403918,7] LPC: IOPATH chip id = 0
[   74.110405286,7] LPC: FW BAR       = f0000000
[   74.110406772,7] LPC: MEM BAR      = e0000000
[   74.110408218,7] LPC: IO BAR       = d0010000
[   74.110409662,7] LPC: Internal BAR = c0012000
[   74.110422172,7] LPC UART: base addr = 3f8 (3f8) size = 1 clk = 1843200, baud = 115200
[   74.110424934,7] LPC: BT [0, 0] sms_int: 0, bmc_int: 0
[   74.111107125,5] UART: Using UART at 0x60300d00103f8
[   74.112978360,4] HDAT I2C: found e3p1 - unknown@1a dp:ff (ff:)
[   74.113074539,4] HDAT I2C: found e3p1 - unknown@1b dp:ff (ff:)
[   74.113118788,4] HDAT I2C: found e3p0 - unknown@1b dp:ff (ff:)
[   74.113167271,4] HDAT I2C: found e3p1 - unknown@1c dp:ff (ff:)
[   74.113209739,4] HDAT I2C: found e3p0 - unknown@1d dp:ff (ff:)
[   74.113259045,4] HDAT I2C: found e3p1 - unknown@1d dp:ff (ff:)
[   74.113321029,4] HDAT I2C: found e3p0 - unknown@1c dp:ff (ff:)
[   74.113379040,4] HDAT I2C: found e3p0 - unknown@1a dp:ff (ff:)
[   74.113433386,3] DT: dt_attach_root failed, duplicate gpio@50
[   74.113730112,4] HDAT I2C: found e3p1 - unknown@1a dp:ff (ff:)
[   74.113819035,4] HDAT I2C: found e3p1 - unknown@1b dp:ff (ff:)
[   74.113864621,4] HDAT I2C: found e3p0 - unknown@1b dp:ff (ff:)
[   74.113905755,4] HDAT I2C: found e3p1 - unknown@1c dp:ff (ff:)
[   74.113953276,4] HDAT I2C: found e3p0 - unknown@1d dp:ff (ff:)
[   74.113997902,4] HDAT I2C: found e3p1 - unknown@1d dp:ff (ff:)
[   74.114053788,3] DT: dt_attach_root failed, duplicate gpio@50
[   74.114113558,4] HDAT I2C: found e3p0 - unknown@1c dp:ff (ff:)
[   74.114165653,4] HDAT I2C: found e3p0 - unknown@1a dp:ff (ff:)
[   74.116776551,5] P9 DD2.10 detected
[   74.116834396,5] CHIP: Chip ID 0000 type: P9N DD2.1
[   74.116892697,5] P9 DD2.10 detected
[   74.116926099,5] CHIP: Chip ID 0008 type: P9N DD2.1
[   74.117881177,5] PLAT: Detected Witherspoon platform
[   74.117965312,5] PLAT: Detected BMC platform ast2500:openbmc
[   74.145674875,5] CPU: All 144 processors called in...
[   75.398891107,5] BT: Interface initialized, IO 0x00e4
[   75.398961432,7] LPC: Routing irq 10, policy: 0 (r=1)
[   75.398962492,7] LPC: SerIRQ 10 using route 0 targetted at OPAL
[   81.203118632,3] HIOMAP: hiomap_get_info failed: -1
[   81.203171029,3] HIOMAP: Failed to get hiomap parameters
[   81.203223472,7] LPC: Routing irq 9, policy: 0 (r=1)
[   81.203224479,7] LPC: SerIRQ 9 using route 1 targetted at OPAL
[   83.101046546,3] MBOX-FLASH: BMC NOT RESPONDING 1 second wait
[   84.101167134,3] MBOX-FLASH: BMC NOT RESPONDING 2 second wait
[   84.203662056,3] MBOX-FLASH: Timeout waiting for BMC
[   84.203725057,3] MBOX-FLASH: Error waiting for BMC
[   84.203767185,3] LPC-MBOX: In flight message dropped on the floor
[   86.101496467,3] MBOX-FLASH: BMC NOT RESPONDING 1 second wait
[   86.101568355,3] LPC-MBOX: Got a response to a message we no longer care about
[   87.101692589,3] MBOX-FLASH: BMC NOT RESPONDING 2 second wait
[   87.101764667,3] LPC-MBOX: Got a response to a message we no longer care about
[   87.204223683,3] MBOX-FLASH: Timeout waiting for BMC
[   87.204279259,3] MBOX-FLASH: Error waiting for BMC
[   87.204310073,3] LPC-MBOX: In flight message dropped on the floor
[   89.102042885,3] MBOX-FLASH: BMC NOT RESPONDING 1 second wait
[   89.102123881,3] LPC-MBOX: Got a response to a message we no longer care about
[   90.102236975,3] MBOX-FLASH: BMC NOT RESPONDING 2 second wait
[   90.102305800,3] LPC-MBOX: Got a response to a message we no longer care about
[   90.204775409,3] MBOX-FLASH: Timeout waiting for BMC
[   90.204833758,3] MBOX-FLASH: Error waiting for BMC
[   90.204884562,3] PLAT: Failed to open init PNOR driver
[   91.005687455,4] NVRAM: Query before is done loading
[   91.005733929,4] NVRAM: Waiting for load
[   91.005757212,2] NVRAM: Failed to load
[   91.005781265,4] NVRAM: Query before is done loading
[   91.005814050,4] NVRAM: Waiting for load
[   91.005840074,2] NVRAM: Failed to load
[   91.005875588,5] STB: Found ibm,secureboot-v2
[   91.005903780,4] NVRAM: Query before is done loading
[   91.005930742,4] NVRAM: Waiting for load
[   91.005952237,2] NVRAM: Failed to load
[   91.005973233,5] STB: secure mode off
[   91.006000575,4] NVRAM: Query before is done loading
[   91.006027380,4] NVRAM: Waiting for load
[   91.006052013,2] NVRAM: Failed to load
[   91.006079061,5] STB: trusted mode off
[   91.006101203,5] OPAL: Using OPAL UART console
[   91.006106928,4] FLASH: Can't load resource id:4. No system flash found
[   91.006108892,4] FLASH: Can't load resource id:3. No system flash found
[   91.006209619,4] NVRAM: Query before is done loading
[   91.006237763,4] NVRAM: Waiting for load
[   91.006256922,2] NVRAM: Failed to load
[   91.006280450,7] LPC: Routing irq 4, policy: 0 (r=1)
[   91.006281313,7] LPC: SerIRQ 4 using route 2 targetted at OPAL
[   91.006476119,4] NVRAM: Query before is done loading
[   91.006519582,4] NVRAM: Waiting for load
[   91.006541125,2] NVRAM: Failed to load
[   91.006564140,5] SLW: Enabling: stop0_lite
[   91.006587499,5] SLW: Enabling: stop0
[   91.006608105,5] SLW: Enabling: stop1
[   91.006628218,5] SLW: Enabling: stop2
[   91.006649175,5] SLW: Enabling: stop4
[   91.006667798,5] SLW: Enabling: stop5
[   91.006690633,4] NVRAM: Query before is done loading
[   91.006716064,4] NVRAM: Waiting for load
[   91.006743771,2] NVRAM: Failed to load
[   91.006824702,4] FLASH: Can't load resource id:2. No system flash found
[   91.006884223,4] FLASH: Can't load resource id:0. No system flash found
[   91.006897458,6] NX RNG[0] pace:2000
[   91.006904138,6] NX RNG[8] pace:2000
[   91.006963647,4] FLASH: Can't load resource id:1. No system flash found
[   91.006964552,3] IMC: IMC Catalog load failed
[   91.007041483,4] NVRAM: Query before is done loading
[   91.007071932,4] NVRAM: Waiting for load
[   91.007098080,2] NVRAM: Failed to load
[   91.007124136,4] NVRAM: Query before is done loading
[   91.007175337,4] NVRAM: Waiting for load
[   91.007201444,2] NVRAM: Failed to load
[   91.007227079,4] NVRAM: Query before is done loading
[   91.007254063,4] NVRAM: Waiting for load
[   91.007275706,2] NVRAM: Failed to load
[   91.007296710,4] NVRAM: Query before is done loading
[   91.007322069,4] NVRAM: Waiting for load
[   91.007343720,2] NVRAM: Failed to load
[   91.007364822,4] NVRAM: Query before is done loading
[   91.007397813,4] NVRAM: Waiting for load
[   91.007422338,2] NVRAM: Failed to load
[   91.013888419,3] CAPP: Error loading ucode lid. index=201d1
[   91.022339824,4] NVRAM: Query before is done loading
[   91.022393816,4] NVRAM: Waiting for load
[   91.022434885,2] NVRAM: Failed to load
[   91.022735242,4] NVRAM: Query before is done loading
[   91.022793715,4] NVRAM: Waiting for load
[   91.022825814,2] NVRAM: Failed to load
[   91.033123679,5] PCI: Resetting PHBs and training links...
[   91.104971338,3] LPC-MBOX: Got a response to a message we no longer care about
[   91.207504806,3] LPC-MBOX: Got a response to a message we no longer care about
[   91.310038473,3] LPC-MBOX: Got a response to a message we no longer care about
[   91.412572449,3] LPC-MBOX: Got a response to a message we no longer care about
[   92.003106133,3] LPC-MBOX: Got a response to a message we no longer care about
[   92.069747569,5] PCI: Probing slots...
[   92.105683638,3] LPC-MBOX: Got a response to a message we no longer care about
[   92.126191834,5] PHB#0000:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:00..00 SLOT=SLOT3 
[   92.126276515,5] PHB#0001:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..01 
[   92.126330706,5] PHB#0001:01:00.0 [EP  ] 104c 8241 R:02 C:0c0330 (      usb-xhci) 
[   92.126385204,5] PHB#0002:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..02 
[   92.126433929,5] PHB#0002:01:00.0 [ETOX] 1a03 1150 R:04 C:060400 B:02..02 
[   92.126479567,5] PHB#0002:02:01.0 [PCID] 1a03 2402 R:01 C:ff0000 (        device) 
[   92.126548088,5] PHB#0003:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:00..00 SLOT=SLOT1 
[   92.126604824,5] PHB#0004:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..12 
[   92.126656071,5] PHB#0004:01:00.0 [SWUP] 10b5 8725 R:ca C:060400 B:02..12 
[   92.126706777,5] PHB#0004:02:02.0 [SWDN] 10b5 8725 R:ca C:060400 B:03..03 SLOT=S000403 
[   92.126772824,5] PHB#0004:03:00.0 [LGCY] 1b4b 9235 R:11 C:010601 (          sata) LOC_CODE=S000403
[   92.126837574,5] PHB#0004:02:0a.0 [SWDN] 10b5 8725 R:ca C:060400 B:04..08 SLOT=GPU0 
[   92.126896110,5] PHB#0004:02:0b.0 [SWDN] 10b5 8725 R:ca C:060400 B:09..0d SLOT=GPU1 
[   92.126958043,5] PHB#0004:02:0c.0 [SWDN] 10b5 8725 R:ca C:060400 B:0e..12 SLOT=GPU2 
[   92.127013244,5] PHB#0004:01:00.1 [EP  ] 10b5 87d0 R:ca C:088000 (system-peripheral) 
[   92.127064537,5] PHB#0004:01:00.2 [EP  ] 10b5 87d0 R:ca C:088000 (system-peripheral) 
[   92.127113899,5] PHB#0004:01:00.3 [EP  ] 10b5 87d0 R:ca C:088000 (system-peripheral) 
[   92.127163517,5] PHB#0004:01:00.4 [EP  ] 10b5 87d0 R:ca C:088000 (system-peripheral) 
[   92.127215570,5] PHB#0005:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..01 
[   92.127263901,5] PHB#0005:01:00.0 [EP  ] 14e4 1657 R:01 C:020000 (      ethernet) 
[   92.127315967,5] PHB#0005:01:00.1 [EP  ] 14e4 1657 R:01 C:020000 (      ethernet) 
[   92.127363082,5] PHB#0006:00:00.0 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127405318,5] PHB#0006:00:00.1 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127455665,5] PHB#0006:00:00.2 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127503731,5] PHB#0006:00:01.0 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127551670,5] PHB#0006:00:01.1 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127602540,5] PHB#0006:00:01.2 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127647974,5] PHB#0007:00:00.0 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127695730,5] PHB#0007:00:00.1 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127742196,5] PHB#0007:00:00.2 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127794344,5] PHB#0007:00:01.0 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127840820,5] PHB#0007:00:01.1 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127888966,5] PHB#0007:00:01.2 [EP  ] 1014 04ea R:01 C:060400 (           pci) 
[   92.127934960,5] PHB#0030:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:00..00 SLOT=SLOT2 
[   92.127987109,5] PHB#0033:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:00..00 SLOT=SLOT1 
[   92.128040750,5] PHB#0034:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..01 SLOT=SLOT0 
[   92.128096895,5] PHB#0034:01:00.0 [EP  ] 14e4 1657 R:01 C:020000 (      ethernet) LOC_CODE=SLOT0
[   92.128155428,5] PHB#0034:01:00.1 [EP  ] 14e4 1657 R:01 C:020000 (      ethernet) LOC_CODE=SLOT0
[   92.128209777,5] PHB#0034:01:00.2 [EP  ] 14e4 1657 R:01 C:020000 (      ethernet) LOC_CODE=SLOT0
[   92.128265338,5] PHB#0034:01:00.3 [EP  ] 14e4 1657 R:01 C:020000 (      ethernet) LOC_CODE=SLOT0
[   92.128362543,5] PHB#0035:00:00.0 [ROOT] 1014 04c1 R:00 C:060400 B:01..11 
[   92.128409983,5] PHB#0035:01:00.0 [SWUP] 10b5 8725 R:ca C:060400 B:02..11 
[   92.128465071,5] PHB#0035:02:04.0 [SWDN] 10b5 8725 R:ca C:060400 B:03..07 SLOT=GPU3 
[   92.128521199,5] PHB#0035:02:05.0 [SWDN] 10b5 8725 R:ca C:060400 B:08..0c SLOT=GPU4 
[   92.128573845,5] PHB#0035:02:0d.0 [SWDN] 10b5 8725 R:ca C:060400 B:0d..11 SLOT=GPU5 
[   92.128805053,4] FLASH: Failed to load VERSION data
[   92.211963931,3] LPC-MBOX: Got a response to a message we no longer care about
[   92.314508328,5] IPMI: Resetting boot count on successful boot
[   92.314593792,5] INIT: Waiting for kernel...
[   92.314625341,5] INIT: platform wait for kernel load failed
[   92.314663069,5] INIT: Assuming kernel at 0x20000000
[   92.314689754,3] INIT: ELF header not found. Assuming raw binary.
[   92.314728505,5] OCC: All Chip Rdy after 0 ms
[   92.315523466,4] NVRAM: Query before is done loading
[   92.315581946,4] NVRAM: Waiting for load
[   92.315612611,2] NVRAM: Failed to load
[   92.337045928,5] INIT: Starting kernel at 0x0, fdt at 0x3096f5f0 317566 bytes
[   92.337133869,0] FATAL: Kernel is zeros, can't execute!
[   92.337180033,0] Assert fail: core/init.c:587:0
[   92.337207099,0] Aborting!
CPU 0824 Backtrace:
 S: 0000000035d23c40 R: 000000003001a550   ._abort+0x4c
 S: 0000000035d23cc0 R: 000000003001a5cc   .assert_fail+0x34
 S: 0000000035d23d40 R: 000000003001460c   .load_and_boot_kernel+0xb54
 S: 0000000035d23e30 R: 0000000030014d54   .main_cpu_entry+0x658
 S: 0000000035d23f00 R: 0000000030002700   boot_entry+0x1b8
 --- OPAL boot ---
[   92.440039401,3] LPC-MBOX: Got a response to a message we no longer care about
[   93.035563117,3] LPC-MBOX: Got a response to a message we no longer care about
[   93.143086813,3] LPC-MBOX: Got a response to a message we no longer care about
[   93.250611094,3] LPC-MBOX: Got a response to a message we no longer care about
[   93.358133633,3] LPC-MBOX: Got a response to a message we no longer care about
[   93.463095303,3] LPC-MBOX: Got a response to a message we no longer care about
[   94.056056786,3] LPC-MBOX: Got a response to a message we no longer care about
[   94.161018316,3] LPC-MBOX: Got a response to a message we no longer care about
[   94.265980031,3] LPC-MBOX: Got a response to a message we no longer care about
[   94.370941545,3] LPC-MBOX: Got a response to a message we no longer care about
[   94.475903145,3] LPC-MBOX: Got a response to a message we no longer care about
[   95.068864688,3] LPC-MBOX: Got a response to a message we no longer care about
[   95.173826230,3] LPC-MBOX: Got a response to a message we no longer care about
[   95.278787793,3] LPC-MBOX: Got a response to a message we no longer care about
[   95.383749416,3] LPC-MBOX: Got a response to a message we no longer care about
[   95.488710907,3] LPC-MBOX: Got a response to a message we no longer care about
[   96.081672590,3] LPC-MBOX: Got a response to a message we no longer care about
[   96.186634164,3] LPC-MBOX: Got a response to a message we no longer care about
[   96.291595881,3] LPC-MBOX: Got a response to a message we no longer care about
[   96.396557375,3] LPC-MBOX: Got a response to a message we no longer care about
[   96.501518800,3] LPC-MBOX: Got a response to a message we no longer care about
[   97.094480412,3] LPC-MBOX: Got a response to a message we no longer care about
[   97.199442075,3] LPC-MBOX: Got a response to a message we no longer care about
[   97.306940897,3] LPC-MBOX: Got a response to a message we no longer care about
[   97.411902491,3] LPC-MBOX: Got a response to a message we no longer care about
[   98.004864095,3] LPC-MBOX: Got a response to a message we no longer care about
[   98.109825627,3] LPC-MBOX: Got a response to a message we no longer care about
[   98.214787266,3] LPC-MBOX: Got a response to a message we no longer care about
[   98.319748735,3] LPC-MBOX: Got a response to a message we no longer care about
[   98.424710330,3] LPC-MBOX: Got a response to a message we no longer care about
[   99.017671785,3] LPC-MBOX: Got a response to a message we no longer care about
[   99.122633373,3] LPC-MBOX: Got a response to a message we no longer care about
[   99.227595039,3] LPC-MBOX: Got a response to a message we no longer care about
[   99.332556618,3] LPC-MBOX: Got a response to a message we no longer care about
[   99.437518102,3] LPC-MBOX: Got a response to a message we no longer care about
[  100.030479711,3] LPC-MBOX: Got a response to a message we no longer care about
[  100.135441368,3] LPC-MBOX: Got a response to a message we no longer care about
[  100.240402819,3] LPC-MBOX: Got a response to a message we no longer care about
[  100.345364472,3] LPC-MBOX: Got a response to a message we no longer care about
[  100.450325990,3] LPC-MBOX: Got a response to a message we no longer care about
[  101.043287395,3] LPC-MBOX: Got a response to a message we no longer care about
[  101.148249050,3] LPC-MBOX: Got a response to a message we no longer care about
[  101.255748021,3] LPC-MBOX: Got a response to a message we no longer care about
[  101.360709522,3] LPC-MBOX: Got a response to a message we no longer care about
[  101.465671175,3] LPC-MBOX: Got a response to a message we no longer care about
[  102.058632682,3] LPC-MBOX: Got a response to a message we no longer care about
[  102.163594237,3] LPC-MBOX: Got a response to a message we no longer care about
[  102.268555800,3] LPC-MBOX: Got a response to a message we no longer care about
[  102.373517268,3] LPC-MBOX: Got a response to a message we no longer care about
[  102.478478831,3] LPC-MBOX: Got a response to a message we no longer care about
[  103.071440397,3] LPC-MBOX: Got a response to a message we no longer care about
[  103.176402076,3] LPC-MBOX: Got a response to a message we no longer care about
[  103.281363551,3] LPC-MBOX: Got a response to a message we no longer care about
[  103.386325114,3] LPC-MBOX: Got a response to a message we no longer care about
[  103.491286746,3] LPC-MBOX: Got a response to a message we no longer care about
[  104.084248314,3] LPC-MBOX: Got a response to a message we no longer care about
[  104.189209747,3] LPC-MBOX: Got a response to a message we no longer care about
[  104.294171342,3] LPC-MBOX: Got a response to a message we no longer care about
[  104.399132823,3] LPC-MBOX: Got a response to a message we no longer care about
[  104.504094435,3] LPC-MBOX: Got a response to a message we no longer care about
[  105.097056027,3] LPC-MBOX: Got a response to a message we no longer care about
[  105.204554827,3] LPC-MBOX: Got a response to a message we no longer care about
[  105.309516409,3] LPC-MBOX: Got a response to a message we no longer care about
[  105.414477940,3] LPC-MBOX: Got a response to a message we no longer care about

[gkeishin]

@amboar can u check on it. .Thanks