Menna Ltd
Exploiting open source LLMs.
Menna.AI helps small business owners make better financial decisions and run their businesses better by combining AI with rich real-time data.
Hartree Centre Cardiff Hub experts explored the use of open-source large language models (LLMs) in a conversational financial assistant providing comparison to proprietary commercial offerings.
Working with the Hartree team has been great. They've helped us to think differently about how we use conversational AI to support our users – bringing together the best of open source and commercial LLMs in a more efficient, scalable and low-cost application.
The final implementation handles user interactions differently depending on the resources needed, reducing cost. General queries such as “What does Menna offer?” are answered using a computationally efficient RAG-based system. Transactional queries such as “What is my balance?” are answered using ReACT, a more expensive process that simulates reasoning.
This company received an approximately 12-hour interaction focused on a specific business problem or technology area and a 1-3 month collaboration focused on developing and testing a specific idea.