Skip to content

Build mt8195 mt8186 into SOF docker image - #5388

Merged
lgirdwood merged 2 commits into
thesofproject:mainfrom
tinghan-shen:test-ci
May 25, 2022
Merged

lgirdwood merged 2 commits into
thesofproject:mainfrom
tinghan-shen:test-ci

Conversation

@tinghan-shen

Copy link
Copy Markdown
Contributor

test test

Signed-off-by: Tinghan Shen tinghan.shen@mediatek.com

@tinghan-shen

Copy link
Copy Markdown
Contributor Author

The CI build for mt8195 and mt8186 is still failed with this PR.
https://github.com/thesofproject/sof/runs/5243341615?check_suite_focus=true

@marc-hb

marc-hb commented Feb 18, 2022

Copy link
Copy Markdown
Collaborator

The CI build for mt8195 and mt8186 is still failed with this PR.

I don't understand. First this PR needs to be merged, then someone needs to rebuild and publish a new Docker image. Only then can the toolchain be used in other PRs. The Docker update process is all manual for now, see discussion in #5073 We don't update the docker image very often so it has not been worth the effort to fully automate its creation and test.

Did you build a new docker image on your system with this change? Then did you test it that docker image, I mean did you try to build SOF with it?

@tinghan-shen

tinghan-shen commented Feb 18, 2022 •

Copy link
Copy Markdown
Contributor Author

Oh, I get your point. I had a miss understanding of the process when I test the CI by this PR.
I was a bit worry about the issue of gcc-build-only for mt8186 and mt8195.
I was thought that this has to be solved ASAP.

I guess I can close this PR and wait until the Docker image updated.
I will take some time to build the docker image locally.
thank you, marc.

@marc-hb marc-hb reopened this May 12, 2022
@afq984

afq984 commented May 12, 2022

Copy link
Copy Markdown
Contributor

Hi @marc-hb I wonder what is missing for a docker image that supports targeting mt81xx?
The work for xtensa-overlay and crosstool-ng seems complete [1][2].

[1] thesofproject/xtensa-overlay@ccd9727
[2] thesofproject/crosstool-ng@3d5c8ed

@marc-hb

marc-hb commented May 12, 2022

Copy link
Copy Markdown
Collaborator

@fredoh9 can you try this?

@marc-hb

marc-hb commented May 13, 2022 •

Copy link
Copy Markdown
Collaborator

I will take some time to build the docker image locally.

Just trying to make sure there is no misunderstanding: @afq984 you did test this PR on your personal system, correct? I mean you created a Docker image with the mt818x toolchains and tested them and they worked fine?

Manual and local testing is required because we have no automated testing for Docker changes (#5073).

I'm asking because you @tinghan-shen closed this PR on Feb 17 after writing this, I wonder why. Also, it was always a draft, never promoted.

@afq984

afq984 commented May 13, 2022 •

Copy link
Copy Markdown
Contributor

you did test this PR on your personal system, correct?

no, I ran into some weird ulimit issues to build the image that I hadn't figure out

I'm asking because you closed this PR on Feb 17

It was @tinghan-shen, not me :)

@marc-hb

marc-hb commented May 13, 2022

Copy link
Copy Markdown
Collaborator

Some ulimit defaults are often too small for crosstool-ng

https://github.com/crosstool-ng/crosstool-ng/issues?q=ulimit

Just trying increasing the failing ones temporarily in the terminal before cleaning and trying to build again

@tinghan-shen

Copy link
Copy Markdown
Contributor Author

I will take some time to build the docker image locally.

I'm asking because you @tinghan-shen closed this PR on Feb 17 after writing this, I wonder why. Also, it was always a draft, never promoted.

I'm sorry. I haven't done it since then. I'll find some time to do it.
This PR was created to test the CI for mt8195 and mt8186, so I didn't plan to promote this PR.

@marc-hb

marc-hb commented May 16, 2022

Copy link
Copy Markdown
Collaborator

I'll find some time to do it.

Thank you!

This PR was created to test the CI for mt8195 and mt8186, so I didn't plan to promote this PR.

But this PR can still:

  • be used for testing on your local workstation?
  • be submitted and merged once your local testing is successful?
  • be kept open as a draft to show that you're still trying to find time to work on it?

It's your PR so you can do what you want, just some suggestions :-)

@marc-hb

marc-hb commented May 18, 2022

Copy link
Copy Markdown
Collaborator

@tinghan-shen I wonder what you're expecting with your recent, "debug" pushes... did you misunderstand or forget this below?

someone needs to rebuild and publish a new Docker image. Only then can the toolchain be used in other PRs. The Docker update process is all manual for now, see discussion in #5073 We don't update the docker image very often so it has not been worth the effort to fully automate its creation and test.

Changes to scripts/docker_build/sof_builder/Dockerfile are NOT tested in any CI, every CI uses the static Docker image that was manually built, tested and uploaded.

Comment thread scripts/docker-run.sh Outdated

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The set -x should print the command below which contains $SOF_DOCKER_RUN

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a hack and dropped now.

Comment thread scripts/docker-run.sh Outdated

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Our documentation used to recommend creating such a local sof tag but I removed it after wasting too much time forgetting to update it.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a hack and dropped now.

@tinghan-shen

Copy link
Copy Markdown
Contributor Author

@tinghan-shen I wonder what you're expecting with your recent, "debug" pushes... did you misunderstand or forget this below?

someone needs to rebuild and publish a new Docker image. Only then can the toolchain be used in other PRs. The Docker update process is all manual for now, see discussion in #5073 We don't update the docker image very often so it has not been worth the effort to fully automate its creation and test.

Changes to scripts/docker_build/sof_builder/Dockerfile are NOT tested in any CI, every CI uses the static Docker image that was manually built, tested and uploaded.

Hi Marc,

I had a local build SOF docker image and still under testing.
I forget to do it in another local branch, but update to this PR branch directly.
Sorry for causing any inconvenience.

@tinghan-shen tinghan-shen changed the title test mt8195 mt8186 CI Build mt8195 mt8186 into SOF docker image May 19, 2022
@tinghan-shen

tinghan-shen commented May 19, 2022 •

Copy link
Copy Markdown
Contributor Author

@marc-hb, my local built SOF docker image can build mt8186 and mt8195 image after applied the docker_build commit in this PR.

Will intel update the image on dockerhub? or I can update it?

@tinghan-shen
tinghan-shen marked this pull request as ready for review May 19, 2022 01:59
@tinghan-shen
tinghan-shen requested a review from aborisovich as a code owner May 19, 2022 01:59
marc-hb
marc-hb previously approved these changes May 19, 2022

@marc-hb marc-hb left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great news, thanks! Let's merge this and yes someone at Intel will update the Docker image (I can't promise when exactly)

@afq984

afq984 commented May 19, 2022

Copy link
Copy Markdown
Contributor

thanks for doing this :)

@tinghan-shen

tinghan-shen commented May 19, 2022 •

Copy link
Copy Markdown
Contributor Author

Great news, thanks! Let's merge this and yes someone at Intel will update the Docker image (I can't promise when exactly)

Should I remove the change for .github before the Docker image updated?

@marc-hb

marc-hb commented May 19, 2022

Copy link
Copy Markdown
Collaborator

Should I remove the change for .github before the Docker image updated?

Yes please. It requires an updated Docker image.

You can comment it out and leave a TODO.

Add support for building mt8186 and mt8195 toolchain in docker image.

Signed-off-by: Tinghan Shen <tinghan.shen@mediatek.com>
Add masked mt81xx gcc build to pull request tests.
Unmask mt81xx after docker image updated with mt81xx toolchain.

Signed-off-by: Tinghan Shen <tinghan.shen@mediatek.com>
@tinghan-shen

Copy link
Copy Markdown
Contributor Author

Yes please. It requires an updated Docker image.

You can comment it out and leave a TODO.

Updated. Thanks!

@marc-hb marc-hb left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ICL-only Copy build to DUT FAIL in https://sof-ci.01.org/sof-pr-viewer/#/build/PR5388/build9383529, @wszypelt any idea?

Unfortunately common suspend/resume failures in https://sof-ci.01.org/sofpr/PR5388/build430/devicetest, unrelated.

@lgirdwood

Copy link
Copy Markdown
Member

SOFCI TEST

@marc-hb

marc-hb commented May 24, 2022

Copy link
Copy Markdown
Collaborator

SOFCI TEST

scripts/docker_build/sof_builder/Dockerfile is not tested in CI, see discussion above.

@lgirdwood
lgirdwood merged commit 41992a2 into thesofproject:main May 25, 2022
@marc-hb

marc-hb commented Jun 1, 2022 •

Copy link
Copy Markdown
Collaborator

Added to Github Actions in

Thank you @fredoh9 for the Docker update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants