GaianetBot

비디오

설명

I am developing a Telegram bot using grammy to interface with Gaianet’s LLM (Large Language Model). The bot's primary function is to answer user queries related to the Gaianet protocol and network by leveraging the power of decentralized AI.

Project Goals:

Provide User Support & Information: The bot serves as a question-and-answer platform for users seeking information on the Gaianet protocol or network.
Integrate Gaianet's LLM Model: Utilizing Gaianet’s public LLM API, the bot can intelligently respond to user queries in real time, offering accurate and contextually relevant answers.
Enhance Retrieval-Augmented Generation (RAG): By employing RAG techniques, the bot will enhance its performance in answering queries by accessing and parsing additional external resources like links. This will involve building a vector database to store parsed data and optimize responses.

Technical Overview:

Telegram Bot with grammy: The Telegram bot is built using grammy, a flexible and efficient framework for bot development. The bot handles user interactions and relays their queries to the server.
Express Server for Gaianet API Integration: The architecture features an Express server that processes incoming requests from the Telegram bot, makes calls to Gaianet’s LLM API, and sends back responses. A separate server is dedicated to handling external resources for the RAG process.
Markdown Formatting in Telegram: The bot utilizes Markdown formatting to structure responses, allowing for better readability and a richer user experience. Currently, there is a challenge with handling Markdown syntax errors like 'Bad Request: can't parse entities,' which is being resolved.
Gemma Node for Enhanced Decentralization: You are setting up a Gemma node, allowing the bot to operate more efficiently within Gaianet's decentralized framework.

Future Developments:

Building Vector Database: As part of the RAG approach, you'll build a vector database that allows the bot to retrieve and parse additional external data sources to improve response accuracy.
Enhanced AI Integration: With the integration of the Gaianet LLM model and future RAG enhancements, your bot will become a robust decentralized AI system that can handle complex, data-driven queries.

해커톤 진행 상황

During the AI Decentralized Hackathon, I built a Telegram bot using the grammy framework to integrate with Gaianet's LLM. The bot answers user questions about the Gaianet protocol by sending queries to the LLM and returning responses in real-time. I handled API integration and made progress toward adding Retrieval-Augmented Generation (RAG) to enhance the bot’s capabilities by retrieving relevant external data. I also faced and am resolving Markdown formatting issues in Telegram. Future improvements include finalizing RAG and optimizing response accuracy with a vector database.

자금 모금 상태

I plan to pursue funding opportunities. These funds will help scale the project, enhance its features (such as Retrieval-Augmented Generation), and improve overall user experience and adoption.