Skip to main content

Clarifai launches Compute Orchestration to allow companies to optimize AI deployments

 The AI platform Clarifai is attempting to make it easier for companies to leverage their existing cloud and hardware investments for AI. Clarifai already offers tools to assist throughout the whole AI lifecycle, including data labeling, training, evaluation, workflows, and feedback. 

Now in public preview, Compute Orchestration provides companies with a single control plane for governing access to AI resources, monitoring performance, and managing costs.

Customers can deploy any model using any hardware vendor in any cloud, on-premises, air-gapped, or SaaS environments, which is a major expansion of the deployment options Clarifai offers.

According to Clarifai, Compute Orchestration uses clusters and nodepools to organize and manage compute resources. A compute cluster is the “overarching computational environment where models are executed,” while nodepools are a set of dedicated nodes within a cluster that share similar configurations.

“Cluster configuration lets you specify where and how your models are run, ensuring better performance, lower latency, and adherence to regional regulations. You can specify a cloud provider, such as AWS, that will provide the underlying compute infrastructure for hosting and running your models. You can also specify the geographic location of the data center where the compute resources will be hosted,” Clarifai wrote in its documentation. 

Compute Orchestration leverages capabilities like GPU fractioning, batching, autoscaling, and spot instances to automatically optimize resource usage. According to the company, Compute Orchestration can reduce compute usage by 3.7x, support more than 1.6 million inference requests per second, and offers 99.9997% reliability under extreme load. It can also reduce costs by 60% to 90%, depending on the configuration. 

Customers can also deploy into a VPC or on-premises Kubernetes clusters without needing to open any inbound ports, set up VPC peering, or create custom IAM roles, which helps companies maintain security and flexibility. 

“This new platform capability brings the convenience of serverless autoscaling to any environment, regardless of deployment location or hardware, and dynamically scales resources to meet workload demands. Clarifai handles the containerization, model packing, time slicing, and other performance optimizations on your behalf,” Clarifai stated in its documentation.

The post Clarifai launches Compute Orchestration to allow companies to optimize AI deployments appeared first on SD Times.



from SD Times https://ift.tt/QgPS7Jp
Labels:

Comments

Post a Comment

Popular posts from this blog

Difference between Web Designer and Web Developer Neeraj Mishra The Crazy Programmer

Have you ever wondered about the distinctions between web developers’ and web designers’ duties and obligations? You’re not alone! Many people have trouble distinguishing between these two. Although they collaborate to publish new websites on the internet, web developers and web designers play very different roles. To put these job possibilities into perspective, consider the construction of a house. To create a vision for the house, including the visual components, the space planning and layout, the materials, and the overall appearance and sense of the space, you need an architect. That said, to translate an idea into a building, you need construction professionals to take those architectural drawings and put them into practice. Image Source In a similar vein, web development and design work together to create websites. Let’s examine the major responsibilities and distinctions between web developers and web designers. Let’s get going, shall we? What Does a Web Designer Do?...
Post a Comment
Read more

A guide to data integration tools

CData Software is a leader in data access and connectivity solutions. It specializes in the development of data drivers and data access technologies for real-time access to online or on-premise applications, databases and web APIs. The company is focused on bringing data connectivity capabilities natively into tools organizations already use. It also features ETL/ELT solutions, enterprise connectors, and data visualization. Matillion ’s data transformation software empowers customers to extract data from a wide number of sources, load it into their chosen cloud data warehouse (CDW) and transform that data from its siloed source state, into analytics-ready insights – prepared for advanced analytics, machine learning, and artificial intelligence use cases. Only Matillion is purpose-built for Snowflake, Amazon Redshift, Google BigQuery, and Microsoft Azure, enabling businesses to achieve new levels of simplicity, speed, scale, and savings. Trusted by companies of all sizes to meet...
Post a Comment
Read more

2022: The year of hybrid work

Remote work was once considered a luxury to many, but in 2020, it became a necessity for a large portion of the workforce, as the scary and unknown COVID-19 virus sickened and even took the lives of so many people around the world.  Some workers were able to thrive in a remote setting, while others felt isolated and struggled to keep up a balance between their work and home lives. Last year saw the availability of life-saving vaccines, so companies were able to start having the conversation about what to do next. Should they keep everyone remote? Should they go back to working in the office full time? Or should they do something in between? Enter hybrid work, which offers a mix of the two. A Fall 2021 study conducted by Google revealed that over 75% of survey respondents expect hybrid work to become a standard practice within their organization within the next three years.  Thus, two years after the world abruptly shifted to widespread adoption of remote work, we are dec...
Post a Comment
Read more