cross-posted from: https://lemmy.ca/post/16866615

Excited to share my T-Ragx project! And here are some additional learnings for me that might be interesting to some:

  • vector databases aren’t always the best option
    • Elasticsearch or custom retrieval methods might work even better in some cases
  • LoRA is incredibly powerful for in-task applications
  • The pace of the LLM scene is astonishing
    • TowerInstruct and ALMA-R translation LLMs launched while my project was underway
  • Above all, it was so fun!

Please let me know what you think!