Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add PGVector retriever support #282

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

vishwamartur
Copy link

Related to #167

Add support for PGVector and GraphRAG retrievals.

  • knowledge_storm/rm.py:

    • Add PGVectorRetriever class to support PGVector retrieval.
    • Add GraphRAGRM class to support GraphRAG retrieval.
    • Update import statements to include necessary libraries for PGVector and GraphRAG.
  • examples/storm_examples/run_storm_wiki_claude.py and examples/storm_examples/run_storm_wiki_gemini.py:

    • Update environment variable descriptions to include PGVector and GraphRAG.
    • Add cases for pgvector and graphrag retrievers in the main function.
  • knowledge_storm/collaborative_storm/engine.py:

    • Add pgvector_retriever attribute to CollaborativeStormLMConfigs class.
    • Add set_pgvector_retriever method to CollaborativeStormLMConfigs class.
    • Update import statements to include PGVectorRetriever.
  • tests/test_pgvector_retriever.py:

    • Add unit tests for the new PGVectorRetriever class.

Related to stanford-oval#167

Add support for PGVector and GraphRAG retrievals.

* **knowledge_storm/rm.py**:
  - Add `PGVectorRetriever` class to support PGVector retrieval.
  - Add `GraphRAGRM` class to support GraphRAG retrieval.
  - Update import statements to include necessary libraries for PGVector and GraphRAG.

* **examples/storm_examples/run_storm_wiki_claude.py** and **examples/storm_examples/run_storm_wiki_gemini.py**:
  - Update environment variable descriptions to include PGVector and GraphRAG.
  - Add cases for `pgvector` and `graphrag` retrievers in the main function.

* **knowledge_storm/collaborative_storm/engine.py**:
  - Add `pgvector_retriever` attribute to `CollaborativeStormLMConfigs` class.
  - Add `set_pgvector_retriever` method to `CollaborativeStormLMConfigs` class.
  - Update import statements to include `PGVectorRetriever`.

* **tests/test_pgvector_retriever.py**:
  - Add unit tests for the new `PGVectorRetriever` class.
@shaoyijia
Copy link
Collaborator

Hi @vishwamartur , thank you for your contributions! Could you provide (1) more context for PGVector and GraphRAG retrievals (like what they are and their features) and (2) a concrete case (i.e., input, output) by running the example script? This would help us better understand this contribution. Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants