For the team at Infosys, the company at the forefront of the next-generation digital services and consulting, open source is the future. Using Llama 3.1, they’ve developed numerous agent-based AI models and retrieval augmented generation (RAG) systems for text, documents, videos, audio, etc. The company offers the services as a component of the Infosys Topaz – the AI-first solution used to unlock business value at scale for global enterprises.
In a company environment, the Infosys team first came across Llama on the Hugging Face and has gradually incorporated new functions for internal processes, starting with documents and then moving on to videos and images as well as structured data. The Infosys Topaz applications that include Llama are applied to different types of documents such as legal contracts, invoices, purchase orders, research documents, and training videos.
An example of Llama 3.1 ‘s first user, Infosys is using its strength to reap benefits that is a continuous effort of the company to provide its full support to open source initiatives.
Like Llama 3.1, Infosys also similarly uses Llama 3 as a part of their internal, legal help tool that employs RAG. When a person poses a question, they are offered information and the sources to which the information can be traced, thus making users have more confidence in it. For security reasons, the legal assistant is hosted on a GPU unit inside the Infosys firewall and assists in offering state-of-the-art gen AI to Infosys clients in privacy.
Infosys declares Llama 3.1 is the future of open-source
Speaking of the origins of many emerging technologies, Bovelli said that they were launched within the open-source community. In a more general view, while organizations continue to develop their generative AI framework, they cannot ignore the importance of working in the open-source model. Infosys’ team also believes that it will act as a great equalizer as well as be a revenue generator.
“Open source is fun and helps us sharpen our skills,” says Sandro Bovelli, gen AI architect at Infosys. “The open source ecosystem allows us to get our hands dirty with some of the best technologies without spending a fortune. We are extremely happy with it.”