Activity

1. RobinQu

   added this to First GA Release of instinct.cppon Jun 14, 2024
2. RobinQu

   converted this from a draft issue on Jun 14, 2024
3. RobinQu

   added this to the v0.1.6 milestone on Jun 14, 2024
4. RobinQu commented on Jun 14, 2024

   

   RobinQu

   on Jun 14, 2024

   Last edited by RobinQu

   OwnerAuthor

   More actions

   General and tool-use

   • Not yet implemented
     • Stream API
     • Context compression
     • Properties like tool_resources, temperature are working only with Assistant. Some may not work on Thread or Run. A more detailed description will be provided.
   • In-consistency with OpenAI
     • Agent trajectories may differ, as we take completely different implementations. And OpenIA's technical details are beyond my reach.

   file-search

   • Not yet implemented
     • File expiration policy
     • Only pdf, markdown, and txt are supported right now. But further support is relatively easy.
     • Upload limitations in both file count and file bytes.
     • DB transaction is required for some APIs, but not currently implemented. This may cause some in-consistency in some corner cases, which will be addressed in near future.
   • In-consistency with OpenAI
     • In file annotations, as start_index and end_index are implementation dependent, it cannot be exact the same if we don't have access to the OpenAI's code.
     • The way file search is activated is not documented by OpenAI. It's largely dependent on how agent workflow is implemented. In mini-assistant, we first decide which files are most relevant to the user question, and do recall within these files. So it's expected that some queries won't trigger file search at all.
     • Due to the current implementation, extra time is needed to generate summary for each uploaded file.

   code interpreter

   This is not yet implemented.
5. RobinQu

   changed the title [-]Limitation of mini-assistant[/-] [+]Limitations of mini-assistant[/+] on Jun 14, 2024
6. RobinQu

   moved this to In Progress in First GA Release of instinct.cppon Jun 16, 2024
7. RobinQu

   moved this from In Progress to No status in First GA Release of instinct.cppon Jun 16, 2024
8. RobinQu

   removed this from the v0.1.6 milestone on Jun 16, 2024