Industry NewsAI Business & Ecosystem
IBM and Together AI Sign Multi-Year $240M Agreement to Scale Open-Source AI on IBM Cloud
Article content
IBM and Together AI have signed a multi-year $240 million agreement to scale open-source AI inference using NVIDIA's latest AI infrastructure on IBM Cloud.
Under the agreement, IBM plans to deploy a large cluster of NVIDIA HGX B300 systems, with expected availability in the first quarter of 2027. Together AI will use the infrastructure to provide production-scale inference for open-source AI models.
The deployment will be the first dedicated large-scale inference cluster on IBM Cloud using NVIDIA HGX B300 systems and NVIDIA Spectrum-X Ethernet networking. According to NVIDIA, the infrastructure is designed to deliver significantly higher AI factory output than previous generations.
Building Infrastructure for Open-Source AI
The collaboration comes as enterprises increasingly look for ways to deploy AI with greater control over cost, performance and model choice.
Together AI operates an AI Native Cloud that combines open-source models, high-performance infrastructure and AI efficiency research. The company says its inference platform now serves 400 trillion tokens monthly, reflecting growing demand for production-scale AI inference.
Together AI recently raised $800 million in Series C financing at an $8.3 billion valuation, with the company planning to expand its AI Native Cloud and capabilities across inference, training, fine-tuning and agentic workflows.
The new IBM agreement provides additional infrastructure capacity as Together AI expands its enterprise offering.
NVIDIA Infrastructure on IBM Cloud
The planned cluster will combine NVIDIA HGX B300 systems with NVIDIA Spectrum-X Ethernet networking and Together AI's inference platform on IBM Cloud.
The combination is designed to give enterprises access to accelerated computing infrastructure capable of supporting real-time AI services while improving the economics of running AI workloads at scale.
Together AI selected IBM and NVIDIA based on their infrastructure roadmaps and ability to provide GPU capacity at the pace required for its expansion, while supporting lower token costs for production AI workloads.
Expanding Enterprise Access to Open-Source AI
The agreement also reflects the broader shift toward open-source AI models in enterprise environments.
Together AI argues that open and modular model stacks give developers greater flexibility in building AI applications, while the IBM and NVIDIA infrastructure is intended to provide the performance, reliability and scale needed to move those models into production.
For enterprises, the collaboration could help bridge the gap between experimenting with open-source models and deploying them as production-grade AI services.
Extending IBM and NVIDIA's AI Collaboration
The partnership builds on a broader collaboration between IBM and NVIDIA spanning AI infrastructure and software.
The companies have also announced work across GPU-native data analytics, unstructured data extraction, on-premises and cloud infrastructure, and consulting services, with the broader objective of helping organizations operationalize AI at scale.
IBM's hybrid cloud capabilities, NVIDIA's accelerated computing infrastructure and Together AI's inference platform create a combined stack designed to support the next phase of enterprise AI deployment.
Looking Ahead
The planned Q1 2027 availability of the NVIDIA HGX B300 cluster marks a significant infrastructure expansion for Together AI as demand for production-scale AI inference continues to grow.
For IBM, the agreement further strengthens its position as an enterprise AI infrastructure provider, while Together AI gains additional capacity to bring open-source AI inference to more enterprise customers.
The collaboration highlights a broader industry trend: as AI adoption moves from experimentation to production, infrastructure efficiency, model flexibility and inference economics are becoming increasingly important to enterprise AI strategies.
About IBM
IBM is a global provider of hybrid cloud, AI and consulting services, helping organizations across industries use data, technology and AI to transform operations and drive business outcomes.
About Together AI
Together AI is an AI Native Cloud platform combining open-source AI models, high-performance infrastructure and research focused on AI efficiency and scalability. Founded in 2022, the company supports developers and AI-native organizations with production-scale inference, training and reinforcement learning capabilities.