You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[PERF]: Measure the performance impact of the "layered design" in cuda-bindings #1605
API calls in cuda-bindings currently are made through 3 layers.
As an experiment to measure the performance impact of calling through these layers, I "flattened" the call so the top layer just directly calls the C function pointer in the library (currently handled by the bottom layer). The overhead of each of these layers is pretty small, by design, but there is still some Python exception handling, as well as our library initialization check (cuPythonInit()) along the way.
While we lose some safety and version independence doing this, it is useful as an experiment to see what the cost of that flexibility is.
Activity