GitHub - rayliuca/T-Ragx: Enhancing Translation with RAG-Powered Large Language Models
github.com
Enhancing Translation with RAG-Powered Large Language Models - rayliuca/T-Ragx

Excited to share my T-Ragx project! And here are some additional learnings for me that might be interesting to some:

  • vector databases aren’t always the best option
    • Elasticsearch or custom retrieval methods might work even better in some cases
  • LoRA is incredibly powerful for in-task applications
  • The pace of the LLM scene is astonishing
    • TowerInstruct and ALMA-R translation LLMs launched while my project was underway
  • Above all, it was so fun!

Please let me know what you think!

  • slacktoid@lemmy.mlEnglish
    1·
    1 year ago

    Can you elaborate on why vector databases arent the best option? also really cool project.

    • rayliucaOPEnglish
      4·
      1 year ago

      Thanks! Vector databases store the semantic vector representation of each record and compare it to the query for retrieval, which would give results close to the meaning of the text, but not necessary the text surface. A lexical search, i.e. BM25 and levenshtein distance, seems to work better as translation examples in this case