Repository navigation
[BUG] ipc timed out MOD_SET_DX in suspend-resume in TGL/MTL #7482
Description
Describe the bug
Found in Intel internal daily test, test case was check-suspend-resume-with-playback
planresultdetail/23903?model=TGLU_UP_HDA_IPC4ZPH&testcase=check-suspend-resume-with-playback-5
[ 6168.932762] kernel: snd_sof:sof_ipc4_log_header: sof-audio-pci-intel-tgl 0000:00:1f.3: ipc tx : 0x47000000|0x0: MOD_SET_DX [data size: 8]
[ 6168.971415] kernel: e1000e: EEE TX LPI TIMER: 00000011
[ 6169.437427] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: ipc timed out for 0x47000000|0x0
[ 6169.437432] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: Attempting to prevent DSP from entering D3 state to preserve context
[ 6169.437435] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: ------------[ IPC dump start ]------------
[ 6169.437453] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: hda irq intsts 0x00000000 intlctl 0xc0000000 rirb 00
[ 6169.437457] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: dsp irq ppsts 0x00000000 adspis 0x00000000
[ 6169.437479] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: Host IPC initiator: 0xc7000000|0x0|0x0, target: 0x0|0x0|0x0, ctl: 0x3
[ 6169.437483] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: ------------[ IPC dump end ]------------
[ 6169.437486] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: ------------[ DSP dump start ]------------
[ 6169.437488] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: IPC timeout
[ 6169.437490] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: fw_state: SOF_FW_BOOT_COMPLETE (7)
[ 6169.437498] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: 0x00000005: module: ROM, state: FW_ENTERED, running
[ 6169.437533] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: extended rom status: 0x5 0x0 0x0 0x0 0x0 0x0 0x0 0x1
[ 6169.437535] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: ------------[ DSP dump end ]------------
[ 6169.437540] kernel: sof-audio-pci-intel-tgl 0000:00:1f.3: ctx_save IPC error: -110, proceeding with suspend
To Reproduce
TPLG=/lib/firmware/intel/avs-tplg/sof-hda-generic.tplg MODEL=TGLU_UP_HDA_IPC4ZPH ~/sof-test/test-case/check-suspend-resume-with-audio.sh -l 5 -m playback
Reproduction Rate
Checking the Reproduction Rate but not so often
Environment
- Kernel Branch: topic/sof-dev
- Kernel Commit: cea8235d1887
- SOF Branch: main
- SOF Commit: 6aa71dd6f249
- Zephyr Commit: zephyr-v3.3.0-1778-g1851950977d5
Screenshots or console output
mtrace-tglu-hda.txt
dmesg-tglu-hda.txt
Activity
fredoh9 commentedon Apr 20, 2023
same issue was reported in #6679 which is closed now
kv2019i commentedon Apr 21, 2023
@juimonen Can you take a look? Potentially related to the recent PM change for cAVS2.5.
ranj063 commentedon Apr 25, 2023
This seems to also show up on TGL nocodec but reproduction rate is quite low
juimonen commentedon Apr 25, 2023
yeah tried to get with sof/zephyr/kernel heads with nocodec in upx.... just could not reproduce. Actually got errors from mtrace bailing out... but not this
ranj063 commentedon Apr 27, 2023
looks like this one is also seen without audio playback in a recent test
juimonen commentedon Apr 27, 2023
@ranj063 can you point me to some of those failing... tried to search but quite tedious...
ranj063 commentedon May 2, 2023
@juimonen I disabled support for D0i3 ( by making the deep buffer PCM not D0i3 compatible) in TGL/ADL in our topologies. I think with that change, this issue has not been seen lately.
fredoh9 commentedon May 2, 2023
Without audio has same error,
Intel intenal daily test:
planresultdetail/24699?model=TGLU_UP_HDA_IPC4ZPH&testcase=check-suspend-resume-50
11 remaining items
[-][BUG] ipc timed out MOD_SET_DX in suspend-resume in TGLU_UP_HDA[/-][+][BUG] ipc timed out MOD_SET_DX in suspend-resume in TGL HDA[/+]fredoh9 commentedon Jun 12, 2023
This is pretty severe on TGLH_SKU0A70_HDA_IPC4ZPH.
Intel internal daily test: planresultdetail/27417
kv2019i commentedon Jun 14, 2023
@juimonen Worth checking if this is related to zephyrproject-rtos/zephyr#59060
kv2019i commentedon Jun 14, 2023
@plbossart wrote:
Due to kernel dependencies, IPC4/cavs2.5 is still opt-in configuration for 2.6 and this issue is recoverable (DSP boots fine next time).
juimonen commentedon Jun 16, 2023
should be fixed by: zephyrproject-rtos/zephyr#59272
keqiaozhang commentedon Jun 19, 2023
@juimonen I have confirmed that zephyrproject-rtos/zephyr#59272 can fix this issue. Please help to merge the fix to main branch.
juimonen commentedon Jun 20, 2023
@keqiaozhang 59272 merged to zephyr main and sof/stable2.6
fredoh9 commentedon Jun 27, 2023
Found the issue today in MTLP_RVP_NOCODEC_MULTICORE with daily test.
intel internal daily test: planresultdetail/28254?model=MTLP_RVP_NOCODEC_MULTICORE&testcase=check-suspend-resume-with-playback-5
[-][BUG] ipc timed out MOD_SET_DX in suspend-resume in TGL HDA[/-][+][BUG] ipc timed out MOD_SET_DX in suspend-resume in TGL/MTL[/+]RDharageswari commentedon Jun 27, 2023
This issue is seen in MTL as well with the mtl-005 firmware branch
The behavior is random
marc-hb commentedon Jul 12, 2023
Seen again in Intel today's daily result/planresultdetail/28947
keqiaozhang commentedon Jul 17, 2023
The kernel log is a little bit different today(29111):
keqiaozhang commentedon Jul 20, 2023
Let's track the IPC error issue
ipc error for msg 0x47000000|0x0 |MOD_SET_DXin (#7969).keqiaozhang commentedon Jul 20, 2023
This issue can be closed, no reproductions in CI for weeks.