Skip to content

Default LLM 'deepseek-v3:671b' not found in available models: [] #23

Closed

Description

@will-zdu

`
spring:
profiles:
active: shell
application:
name: agent-api
threads:
virtual:
enabled: true
output:
ansi:
enabled: ALWAYS
ai:
openai:
api-key: ${OPENAI_API_KEY}
base-url: ${OPENAI_BASE_URL}
chat:
options:
model: deepseek-v3:671b

embabel:
agent-platform:
name: embabel-default
description: Embabel Default Agent Platform
scanning:
annotation: true
bean: true
ranking:
max-attempts: 5

models:
default-llm: deepseek-v3:671b
default-embedding-model: text-embedding-3-small
llms:
deepseek-v3:671b:
provider: openai
model: deepseek-v3:671b
base-url: {base-url}
api-key: {api-key}
`

this configuration can not work,with start app error log
Caused by: java.lang.IllegalArgumentException: Default LLM 'deepseek-v3:671b' not found in available models: []
at com.embabel.common.ai.model.ConfigurableModelProvider.(ConfigurableModelProvider.kt:63) ~[embabel-common-ai-0.1.0-20250710.004942-22.jar:0.1.0-SNAPSHOT]
at com.embabel.agent.config.AgentPlatformConfiguration.modelProvider(AgentPlatformConfiguration.kt:131) ~[embabel-agent-api-0.1.0-20250713.012108-127.jar:0.1.0-SNAPSHOT]
at com.embabel.agent.config.AgentPlatformConfiguration$$SpringCGLIB$$0.CGLIB$modelProvider$8() ~[embabel-agent-api-0.1.0-20250713.012108-127.jar:0.1.0-SNAPSHOT]
at com.embabel.agent.config.AgentPlatformConfiguration$$SpringCGLIB$$FastClass$$1.invoke() ~[embabel-agent-api-0.1.0-20250713.012108-127.jar:0.1.0-SNAPSHOT]
at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:258) ~[spring-core-6.2.8.jar:6.2.8]
at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:400) ~[spring-context-6.2.8.jar:6.2.8]
at com.embabel.agent.config.AgentPlatformConfiguration$$SpringCGLIB$$0.modelProvider() ~[embabel-agent-api-0.1.0-20250713.012108-127.jar:0.1.0-SNAPSHOT]
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103) ~[na:na]
at java.base/java.lang.reflect.Method.invoke(Method.java:580) ~[na:na]
at org.springframework.beans.factory.support.SimpleInstantiationStrategy.lambda$instantiate$0(SimpleInstantiationStrategy.java:171) ~[spring-beans-6.2.8.jar:6.2.8]

Activity

  1. johnsonr commented on Jul 15, 2025

    @johnsonr
    Contributor

    I've edited this to anonymize your API key but you might want to change it

  2. johnsonr commented on Jul 15, 2025

    @johnsonr
    Contributor

    It looks like it's not finding any models. You need to configure the models in Embabel configuration rather than rely on Spring AI. Subclass OpenAiCompatibleModelFactory to define the model you want, parallel to OpenAiModels.

    While Embabel uses Spring AI ChatModel, an Embabel LLM needs additional information beyond the Spring ChatModel.

  3. will-zdu commented on Jul 15, 2025

    @will-zdu
    Author

    It looks like it's not finding any models. You need to configure the models in Embabel configuration rather than rely on Spring AI. Subclass OpenAiCompatibleModelFactory to define the model you want, parallel to OpenAiModels.

    While Embabel uses Spring AI ChatModel, an Embabel LLM needs additional information beyond the Spring ChatModel.

    Can you add a corresponding example in the current demo configuration? I really feel that it has been difficult to solve this problem.

  4. will-zdu commented on Jul 15, 2025

    @will-zdu
    Author

    I've edited this to anonymize your API key but you might want to change it

    I've removed my API Key, which is my error

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions