Skip to content

Improving Test score using DIN SQL #40

Open

Description

@goyalpramod

Spider Is topped by DIN-SQL two aspects have not been explored in the mentioned model namely. DB content used and DSP. Implementation of the mentioned features in DIN-SQL may present substantial improvement in the test score.

Colab Notebook. This is the current Notebook in which the work is being pursued.

Activity

  1. goyalpramod commented on Jun 19, 2023

    @goyalpramod
    ContributorAuthor

    Current progress:

    • A breakdown of the DIN SQL model has been prepared and added to the notebook
    • Literature review of the DIN SQL paper has been made & a PR will be made soon to add the information

    Problems encountered:

    • The model can not be shifted to gpt 3.5 to reduce the cost and time as tokens become the bottleneck
    • Cannot figure out how "db content used", can be used in this model.

    Scope of Improvement:

    • The DIN SQL model does not have prompts for extra hard questions, they need to be framed and added specifically to the model
    • Ways to add DSP need to be explored

    Papers:
    Link The following paper talks about QA on knowledge database, This can be useful to understand how to implement DSP on DIN SQL (Nothing of substance was found)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions