Skip to content

Unable to add host due to networking or authentification error #7437

Closed
Closed
Unable to add host due to networking or authentification error#7437
Milestone
unplanned

Description

@MilanHofmann
MilanHofmann
opened on Apr 15, 2023
ISSUE TYPE
  • Bug Report
COMPONENT NAME
host
CLOUDSTACK VERSION
4.18
CONFIGURATION

advanced networking with KVM

OS / ENVIRONMENT

Ubuntu focal fossa

SUMMARY

I am not able to add a host to a zone.
In the ui a message pops up "Unable to reach the management server or a browser extension may be blocking the network request. in the ui".
the mangement server cloudstack service status says "trying to add new host ip-address Failed to authenticate with ssh key, retrying with password." - Although i selected password as auth method.
When adding the ssh key, and selecting the option for system ssh key I get "Could not add host at [http://ip-address/] with zone [1], pod [1] and cluster [1] due to: [Authentication error with ssh private key]."

BUT:
ssh root@ip-address from the management server works just fine, as well as the usual password auth.

STEPS TO REPRODUCE
add a zone and try to add a host.
EXPECTED RESULTS
Host is added.
ACTUAL RESULTS
network error when using the password auth - "Unable to reach the management server or a browser extension may be blocking the network request. in the ui"
Auth error when selecting system ssh key - "Could not add host at [http://ip-address/] with zone [1], pod [1] and cluster [1] due to: [Authentication error with ssh private key]."

Activity

  1. weizhouapache commented on Apr 15, 2023

    @weizhouapache
    weizhouapache
    on Apr 15, 2023
    Member

    @MilanHofmann
    When you add a host with password, you can ignore the warning message like "unable to connect to host via ssh key", which is not the root cause if you are unable to add the host.
    You may need to check other errors in the log.

    Regarding adding host via ssh key, please refer to cloudstack documentation: https://docs.cloudstack.apache.org/en/latest/installguide/configuration.html#adding-a-host

    Before adding the host in CloudStack do the following,

Copy the SSH public key from /var/cloudstack/management/.ssh/id_rsa.pub on the management server
Add the copied key to /root/.ssh/authorized_keys file on the host

  2. MilanHofmann commented on Apr 17, 2023

    @MilanHofmann
    MilanHofmann
    on Apr 17, 2023
    Author

    @weizhouapache yes I did that.
    ssh root@ip-address from the management server works just fine, as well as the usual password auth.

  3. MilanHofmann commented on Apr 17, 2023

    @MilanHofmann
    MilanHofmann
    on Apr 17, 2023
    Author

    @weizhouapache
    After un- and reinstalling cloudstack-agent I get ->
    Could not add host at [http://10.200.1.11] with zone [1], pod [1] and cluster [1] due to: [ can't setup agent, due to com.cloud.utils.exception.CloudRuntimeException: Failed to setup certificate in the KVM agent's keystore file, please see logs and configure manually! - Failed to setup certificate in the KVM agent's keystore file, please see logs and configure manually!].

    Can you give me a hint, why this is suddenly not possible anymore and how I maybe give the right permsissions for an automatic setup?

  4. weizhouapache commented on Apr 17, 2023

    @weizhouapache
    weizhouapache
    on Apr 17, 2023
    Member

    @MilanHofmann
    Which cloudstack version do you use ?
    The issue should have been fixed by #7090 (which fixed #6716)

  5. MilanHofmann commented on Apr 17, 2023

    @MilanHofmann
    MilanHofmann
    on Apr 17, 2023
    Author

    @weizhouapache 4.18

  6. weizhouapache commented on Apr 17, 2023

    @weizhouapache
    weizhouapache
    on Apr 17, 2023
    Member

    @weizhouapache 4.18

    @MilanHofmann
    you can retry after the following changes on the kvm host

    if [ -f "$LIBVIRTD_FILE" ]; then
        echo "Reverting libvirtd to not listen on TLS"
        sed -i "s,^listen_tls=1,listen_tls=0,g" $LIBVIRTD_FILE
        systemctl restart libvirtd
    fi

    echo "Removing cloud.* files in /etc/cloudstack/agent"
    rm -f /etc/cloudstack/agent/cloud.*

  7. MilanHofmann commented on Apr 17, 2023

    @MilanHofmann
    MilanHofmann
    on Apr 17, 2023
    Author

    @weizhouapache

    I have removed the files and even reinstalled the operating system on the host.
    Still the same issue.
    Funny thing is, that management server + cs management service is a fresh install as well.

  8. weizhouapache commented on Apr 17, 2023

    @weizhouapache
    weizhouapache
    on Apr 17, 2023
    Member

    @weizhouapache

    I have removed the files and even reinstalled the operating system on the host. Still the same issue. Funny thing is, that management server + cs management service is a fresh install as well.

    @MilanHofmann
    can you please upload the full log ?

  9. MilanHofmann commented on Apr 17, 2023

    @MilanHofmann
    MilanHofmann
    on Apr 17, 2023
    Author

    @weizhouapache
    I hope this covers the relevant part.
    The management server's setup was yesterday so there would be a lot of text.
    Please let me know if you need the setup part as well.

    mgmtlog.txt
    agentlog.txt

  10. boie0025 commented on May 8, 2023

    @boie0025
    boie0025
    on May 8, 2023

    If anyone stumbles across this unable to find the CloudStack ssh public key, I finally found on Ubuntu 20.04 -- it was in /var/lib/cloudstack/management/.ssh.

  11. weizhouapache commented on May 8, 2023

    @weizhouapache
    weizhouapache
    on May 8, 2023
    Member

    If anyone stumbles across this unable to find the CloudStack ssh public key, I finally found on Ubuntu 20.04 -- it was in /var/lib/cloudstack/management/.ssh.

    yes, the location is different on OSes.

    on centos, the location is

    # echo ~cloud/.ssh/
/var/cloudstack/management/.ssh/

    we need to update the doc
    https://docs.cloudstack.apache.org/en/latest/installguide/configuration.html#adding-a-host

  12. weizhouapache commented on May 8, 2023

    @weizhouapache
    weizhouapache
    on May 8, 2023
    Member

    @weizhouapache I hope this covers the relevant part. The management server's setup was yesterday so there would be a lot of text. Please let me know if you need the setup part as well.

    mgmtlog.txt agentlog.txt

    @MilanHofmann
    I noticed you have created other issues. Has this issue been already fixed ?

  13. MilanHofmann commented on May 8, 2023

    @MilanHofmann
    MilanHofmann
    on May 8, 2023
    Author

    @weizhouapache
    Actually the issue was gone after another clean install.
    Hard to tell what the exact issue was, it did not occur anymore.

  14. MilanHofmann
    closed this as completedon May 8, 2023
  15. DaanHoogland
    added this to the unplanned milestone on Sep 19, 2025

  16. nerf commented on Apr 1, 2026

    @nerf
    nerf
    on Apr 1, 2026

    For anyone landing here after searching for a fix:
    My issue was because of keystore.passphrase property in /etc/cloudstack/agent/agent.properties .
    For me this property had a value that was from past setup try and was failing the new setup attempts.
    Just remove/comment it.

    Cloudstack ver. 4.22

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions