Zoho Corporation is set to leverage the NVIDIA AI accelerated computing platform to build and deploy large language models (LLMs) in its SaaS applications. The LLMs, tailored for a wide range of business use cases, will be available to Zoho’s 700,000+ customers across ManageEngine and Zoho.com. The corporation is investing heavily in NVIDIA’s AI technology, with plans to invest an additional USD10m in the coming year. Zoho’s LLMs will not be trained on customer data, ensuring user privacy. The partnership will see Zoho accelerate its LLMs with NVIDIA Hopper GPUs and NeMo platform providing a variety of model sizes to suit different needs while improving performance and cost-effectiveness.
A Step Forward in AI for SaaS Applications
Zoho Corporation recently revealed that a significant investment in AI technology is being made to enhance SaaS applications. This will be achieved by leveraging the NVIDIA AI accelerated computing platform, including NVIDIA NeMo, a part of the NVIDIA AI Enterprise software. The purpose? To construct and deploy large language models (LLMs) that will be accessible to a vast customer base.
Investment in AI Technology
Over the previous year, there has been a hefty investment of over USD10m in NVIDIA’s AI technology and GPUs. An additional USD10m is set to be invested in the forthcoming year. The announcement was made during the much-anticipated NVIDIA AI Summit in Mumbai.
A New Approach to LLMs
Director of AI at Zoho Corporation spearheading this initiative, Ramprakash Ramamoorthy, stated,
“Many LLMs on the market today are designed for consumer use, offering limited value for businesses. Our mission is to develop LLMs tailored specifically for a wide range of business use cases.”
The aim is to build models from the ground up, ensuring they are compliant with privacy regulations from the outset. The objective is to help businesses realise ROI swiftly and effectively, by leveraging the full stack of NVIDIA AI software and accelerated computing to increase throughput and reduce latency.
Decade of Developing AI
The company has been developing its own AI technology for over a decade and incorporates it contextually into its portfolio of over 100 products. Businesses that do not have a large amount of data can still benefit from AI, thanks to a multi-modal approach and a commitment to privacy.
Collaboration with NVIDIA
In this collaboration, the company will be accelerating its LLMs on the NVIDIA accelerated computing platform with NVIDIA Hopper GPUs, using the NVIDIA NeMo end-to-end platform for developing custom generative AI. They are also testing NVIDIA TensorRT-LLM to optimise their LLMs for deployment, which has already shown a 60% increase in throughput and a 35% reduction in latency compared to a previously used open-source framework.
Final Thoughts
The move towards the development and deployment of LLMs is indicative of a growing trend in leveraging AI for business purposes. By focusing on creating models that are compliant with privacy regulations from the outset and optimising them for performance, the company is placing a high value on user privacy and efficiency. The partnership with NVIDIA and the significant investment in AI technology highlights Zoho’s commitment to providing an effective and secure AI solution for businesses. The future of AI in SaaS applications looks promising, with developments like these paving the way.
FAQ
Q: What is Zoho Corporation leveraging the NVIDIA AI accelerated computing platform for?
A: Zoho Corporation is leveraging the NVIDIA AI accelerated computing platform to build and deploy its large language models (LLMs) in its SaaS applications.
Q: How many customers will have access to the LLMs developed by Zoho Corporation?
A: The LLMs developed by Zoho Corporation will be available to its 700,000+ customers across ManageEngine and Zoho.com globally.
Q: How does Zoho Corporation approach user privacy in developing its AI models?
A: Zoho Corporation prioritises user privacy from the outset to create models that are compliant with privacy regulations from the ground up, rather than retrofitting them later. The LLM models will not be trained on customer data.
Q: What is the main goal of Zoho Corporation in leveraging NVIDIA’s AI technology?
A: The main goal of Zoho Corporation in leveraging NVIDIA’s AI technology is to help businesses realise ROI swiftly and effectively by increasing throughput and reducing latency through the full stack of NVIDIA AI software and accelerated computing.
Q: How does Zoho Corporation differentiate between large language models (LLMs) and other models it is building?
A: Zoho Corporation is building narrow, small, and medium language models in addition to LLMs, providing options for using different size models to cater to a variety of use cases. This approach allows businesses with varying amounts of data to benefit from AI.
Q: What benefits has Zoho Corporation seen by using NVIDIA’s AI software and accelerated computing platform?
A: Zoho Corporation has seen a 60% increase in throughput and a 35% reduction in latency compared to a previously used open-source framework by using NVIDIA’s AI software and accelerated computing platform to accelerate its LLMs.
