Skip to content

[Feature]: OpenAI Compatible Embeddings for the Recommender #400

Open

Description

@shopsD

Type of request

New feature

What problem would this solve?

I already have a dedicated LXC that handles my AI models and is located on a separate machine in my home lab. All my apps access my models using the OpenAI compatible endpoint v1.
By implementing this capability, users can keep their AI and model setups and use pre-defined endpoints for the recommender without having to setup network mounts, or redownload and thus, duplicate models

What would you like to see?

Support in the recommender for using the /v1/embeddings endpoint rather than requiring models be stored in the environment and have support for setting the endpoint and API key as environment variables

RECOMMENDER_EMBEDDING_PROVIDER=openai
RECOMMENDER_EMBEDDING_BASE_URL=http://192.168.x.x:8080/v1
RECOMMENDER_EMBEDDING_API_KEY=your-key
RECOMMENDER_EMBEDDING_MODEL=your-model-name

Area

Not sure

Activity

  1. Priveetee commented on Nov 12, 2026

    @Priveetee
    Member

    You know what, I was kinda thinking about this yesterday lmao 😂 But I don't really know this side: is it expensive? Is it easy? How does it work? Is there any documentation? I have a lot of questions in mind, so I'd love to learn more if you can help me! If there are any docs or other resources you can link me, that would be great.

  2. shopsD commented on Nov 12, 2026

    @shopsD
    Author

    @Priveetee
    LocalAI have some good documentation on where to start.

    It's pretty straightforward imo. I haven't looked at your repo backend, but generally you store the embeddings data as per usual. All you really need is the API key, and the endpoint. The LocalAI docs do contain some good info on the API

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions