Repository navigation
VMware: VM ingestion broken in case of dynamically handled hypervisor/guest OS versions. #8412
Description
ACS 4.19 RC1
VMware ingestion is broken when testing with VMware 8.0.0.2as the hypervisor and Rocky Linux (8 or 9) - this is a consequence of changes implemented in #7380:
- if no record for 8.0.0.2 in the hypervisor_capabilities table, then use "capabilities" of the "parent" version which is VMware 8.0;
- if no records in the guest_os_hypervisor table, then use the records/mappings of the "parent" version - from 8.0
- this all works fine during VM deployment
- this does not work during VMware ingestion, where we do reverse-mapping, and code seems to look for a DB record for "rockylinux_64Guest" for version 8.0.0.2 in the guest_os_hypervisor table - and this record does not exist
The logic of "mapping minor version guest OS mappings, if missing, to a parent version mappings" - sounds fine, as long as:
- It's supported by all ACS features/code where we try to use guest OS hypervisor mappings (this now includes VMware VM ingestion that needs to be fixed, but there might be other places)
- there is detailed logging similar to "The guest OS mappings for XXX was not found for the hypervisor version YYYYY (8.0.0.2), looking for parent version mappings (8.0), found, using that mapping etc" - something similar to this, needs to be very verbose, otherwise troubleshooting will be impossible.
For the hypervisor capabilities, I would propose the following:
- Revert the logic of dynamically "assuming" that the minor version has the same capabilities as the major version (in fugure, VMware e.g. 8.5 version will certainly NOT have the same capabilities as the 8.0 version, it would have more capabilities) - so revert the code and recreated the needed DB records in the hypervisor_capabilities table
- Worst case, even though it's a bad solution - leave it as it is, but add a loooot of logging, similar to the guest OS mappings logging (not found this, using that version capabilities)
Activity
[-]VMware: VM ingestion broken in case od dynamically handled hypervisor/guest OS versions.[/-][+]VMware: VM ingestion broken in case of dynamically handled hypervisor/guest OS versions.[/+]shwstppr commentedon Dec 28, 2023
@andrijapanicsb @weizhouapache @nvazquez @DaanHoogland @harikrishna-patnala @rohityadavcloud this seems like a blocker. I guess I'll have to recall the RC1 and wait for a fix. Any other suggestions?
engine-schema: fix finding guestos mapping with parent version
shwstppr commentedon Jan 4, 2024
Did some investigation for this. Guest OS and VM import issue should be solved with #8426 (currently it needs #8429 to be merged). The hypervisor capabilities issue is more complex and below are my findings,
Based on the above findings and the original report do we need to consider the hypervisor capabilities issue as a blocker?
To solve this hypervisor capabilities behaviour I feel the following are our options:
hypervisorversionparam in theupdateHypervisorCapabilitiesAPI.@andrijapanicsb @weizhouapache cc @harikrishna-patnala @DaanHoogland @nvazquez feedback, suggestions?
DaanHoogland commentedon Jan 4, 2024
@shwstppr at this stage I think you can make the call you do above. In general and as a matter of design principle I feel we should always fall back even over major versions (ad 1). In this case, woking around a backwards incompatible vmware feature we will have to be explicit about what we support. making an extra API is good if that means the operator has more control, but we must make sure regular upgrades can not conflict with that (ad 2). I think we should fix forward, not backwards (ad 3). Of course only if feasible given we want to release.
schema: add vmware 8.0.0.2 support explicitly
shwstppr commentedon Jan 4, 2024
Based on the discussion with some of the participants here, I've created #8444 to explicitly add support for VMware 8.0.0.2 and also add logs when capabilities retrieval falls back to the parent version
DaanHoogland commentedon Jan 5, 2024
will you include that now? or is it for 4.19.1?
engine-schema: fix finding guestos mapping with parent version
shwstppr commentedon Jan 8, 2024
@DaanHoogland already created the PR. We can include it in 4.19.0
engine-schema: fix finding guestos mapping with parent version (#8426)
engine-schema: fix finding guestos mapping with parent version (apach…
schema,engine-schema: explicit VMware 8.0.0.2, 8.0.0.3 support, logs (#…
shwstppr commentedon Jan 9, 2024
Fixes for both guest OS mappings and hypervisor capabilities have been merged.
Based on the discussions, in the future, we may have to take care when support for new minor versions is added and there is a breaking change resulting in a difference in capabilities. API update may also be allowed in such cases.
schema,engine-schema: explicit VMware 8.0.0.2, 8.0.0.3 support, logs (a…