* NF4 reference initial commit * Compilable version. * Executable NF4. * Fixed nf4 unpacking. * 1) Fixed warnings with nf4. 2) Removed unused functions. * Added one test for nf4. * Fixed code-style errors. * Fixed code-style errors. * Fixed NamingConventionCheck errors. * Fixed test with nf4. * Fixed windows compilation. * Fixed casting warning. * Fixed incorrect changes. * Changed order of elements in nf4 pack/unpack. * 1) Made Convert only on direction nf4->other type. 2) Applied reviewers suggestions. * Fixed code style. * Fised code style. * 1) Added array header. 2) Added Bitsandbytes to third-party-programs.txt. * 1) Removed unused code. 2) Fixed style typos. 3) Revert submodule version. * Added test for nf4 compression. * NF4 test refactoring. * Added cpp tests for NF4. * Removed model compilation from NF4 tests. * Reverted submodule version. |
||
|---|---|---|
| .. | ||
| docs | ||
| include | ||
| src | ||
| tests | ||
| CMakeLists.txt | ||
| README.md | ||
README.md
OpenVINO C API
OpenVINO C API is a key part of the OpenVINO extension for C API users. This component provides C API for OpenVINO Toolkit.
flowchart LR
c_application[("C Application")]
openvino_c{{openvino::c}}
openvino{{openvino}}
style c_application fill:#427cb0
style openvino_c fill:#6c9f7f
style openvino fill:#6c9f7f
c_application-->openvino_c-->openvino
OpenVINO C API uses the common coding style rules.
Key contacts
People from the openvino-c-api-maintainers group have the rights to approve and merge PRs to the C API component. They can assist with any questions about C API component.
Components
OpenVINO C API has the following structure:
- docs contains developer documentation for OpenVINO C APIs.
- include contains all provided C API headers. Learn more.
- src contains the implementations of all C APIs.
- tests contains all tests for OpenVINO C APIs. Learn more.
NOTE: Using API 2.0 is strongly recommended. Legacy API (for C) header file, source file, unit test are also included in the component, but the legacy API is no longer extended.
Tutorials
- How to integrate OpenVINO C API with Your Application
- How to wrap OpenVINO objects with C
- How to wrap OpenVINO interfaces with C
- Samples implemented by OpenVINO C API
- How to debug C API issues
- How to write unit test
How to contribute to the OpenVINO repository
See CONTRIBUTING for details.