Connect with us

Technology

Tetrate and Bloomberg collaborate on community-led open standard for AI Gateways built on CNCF’s Envoy Gateway project

Published

on

Joint effort will expand capabilities of the Envoy Gateway project, one of the Kubernetes Gateway API implementations.

SAN FRANCISCO, Oct. 3, 2024 /PRNewswire-PRWeb/ — Driven by the surge in applications built to utilize large language models (LLMs), the open source AI gateway space is heating up. In response, engineers from Bloomberg and Tetrate have partnered to develop an innovative, community-led set of core AI gateway features for enterprise AI integration. This effort will expand the capabilities of the CNCF’s Envoy Gateway project, one of the Kubernetes Gateway API implementations.

As an ‘open source first’ company, Bloomberg believes in the power and collaborative nature of the open source community to develop web scale solutions, and that important difference makes this project a valuable alternative to other ongoing efforts.

As the emerging open standard for handling Kubernetes ingress traffic, Envoy Gateway is designed for at-scale operation and is extensible, making it a solid choice to underpin this new set of features, as well as future innovation in the AI API gateway space. Furthermore, Envoy Gateway is a community-led open source project with no commercially licensed features, and where community members drive decisions about upstream feature development.

This sets it apart from both existing vendor-led open source AI gateway offerings and fully proprietary, commercial AI gateway solutions that have sought to address this problem. Both of these approaches can create greater complexity for some enterprises and hamper innovation, which is why the Envoy community is developing an option without vendor lock-in or features that can only be accessed through additional, paid enterprise licenses.

“Historically, when shared problems arise in the software industry, the open source community rallies to solve them, accelerating innovation,” said Varun Talwar, founder of Tetrate. “Our collaboration with Bloomberg and the CNCF aims to achieve precisely that: designing and delivering a community-led, fully open source AI gateway, powered by the leading contender to replace legacy models for Kubernetes ingress. It’s a solution the market is asking for, and we’re excited to be part of the team of maintainers and contributors creating it.”

AI Gateways enable organizations to integrate AI functionality into workflows and applications. They route requests to multiple AI service providers and models through a single reverse proxy layer (often referred to as a gateway). AI Gateways simplify AI integration by providing a single unified API layer with which developers interact, and can provide additional functionality, such as rate limiting, caching and observability.

The initial idea for this project arose when Dan Sun, engineering team lead for Bloomberg’s Cloud Native Compute Services – AI Inference team and co-founder/maintainer of the KServe project, came to the Envoy community and outlined his views of the problem space and a potential path forward for solving it. Tetrate, a major upstream contributor to the Envoy project, stepped forward to express interest in helping Sun and Bloomberg turn their vision for the Envoy AI Gateway API into reality.

“Bloomberg has more than 15 years of experience delivering value to our customers by incorporating artificial intelligence (AI) – in particular, machine learning and natural language processing – in enterprise applications,” said Steven Bower, engineering lead for Bloomberg’s Cloud Native Compute Services group. “When we looked to the community for someone to collaborate with to start building gateway features that accelerate AI integration in our products, we immediately identified the engineering team at Tetrate. Their people are leading contributors to Envoy Gateway, and they bring significant expertise to the project around handling cloud-native, scalable traffic. Beyond that, as an ‘open source first’ company, Bloomberg believes in the power and collaborative nature of the open source community to develop web scale solutions, and that important difference makes this project a valuable alternative to other ongoing efforts.”

Envoy Gateway and KServe can be used together to allow traffic routing to both self-hosted and vendor-hosted LLMs. In this case, the AI gateway sits on the top and routes open source LLM model traffic to self-hosted endpoints using KServe, and vendor-hosted model traffic is routed to AWS Bedrock or other, similar cloud-based services.

The first features to be included in Envoy AI Gateway will provide:

application traffic management to LLM providers with high-availability routing strategies;LLM usage monitoring and control at the application, organization and enterprise levels, to help users manage costs; anda unified interface for LLM requests through which the gateway handles back-end connectivity to various LLM providers.

The open source Envoy Gateway extensions and enhancements will offer usage control for applications that are integrated with multiple LLM providers and models, robust authorization mechanisms, and intelligent fallback options to ensure continued operation even when cloud providers are unavailable or too expensive.

This open source initiative, part of the Cloud Native Computing Foundation (CNCF), is more than just a tool; it’s a strategic response to challenges enterprises face in adopting and integrating AI in their applications at scale. By laying the groundwork for scalable AI platforms, Tetrate and Bloomberg engineers are addressing the immediate needs of today’s enterprises and setting the stage for the future of AI applications within cloud-native environments.

“The Envoy project continues to impress with its flexibility to support new and valuable use cases,” said Chris Aniszczyk, CTO of the CNCF. “Bloomberg and Tetrate have done exactly what our community is designed to do: bring people and organizations together to solve a common problem. That they’re doing it with Envoy Gateway only validates the power and extensibility of the project.”

*Learn More About the Envoy AI Gateway Project*
Join the “Enabling AI Adoption at Scale – The AI Platform with Envoy AI Gateway” webinar, an online panel discussion of Bloomberg and Tetrate engineers hosted by the CNCF on Thursday, October 17, 2024 at 1 PM EDT. Erica Hughberg of Tetrate will be joined by Dan Sun and Yuzhui Liu of Bloomberg and other contributors from Tetrate and the CNCF community for a conversation about the project and ways for others to get involved and contribute.

The session will include discussions about:

Industry trends from traditional AI to generative AIWhat to think about when enabling the use of AI in an enterprise organizationThe role of the AI Platform – what it solves and what it doesn’tWhy build an AI Gateway using Envoy and Envoy Gateway?How do I get started building my organization’s AI Platform?

Register for the online panel here.

In addition, attendees at KubeCon + CloudNativeCon North America 2024 (November 12-15) in Salt Lake City, UT, will have the opportunity to learn more about the project and how to get involved in it. A demo of the Envoy AI Gateway will also be available in the Tetrate booth (Booth Q2).

About Tetrate
Rooted in open source, Tetrate was founded to solve the application networking and security challenges created by modern computing so enterprises can innovate with speed and safety in hybrid and multi-cloud environments. As applications evolve into collections of decentralized microservices, monitoring and managing the network communications and security among those myriad services becomes challenging. This is why some of the largest financial institutions, governments and other enterprises rely on Tetrate to deliver modern application networking and security. Find out more at http://www.tetrate.io.

About Bloomberg
Bloomberg is a global leader in business and financial information, delivering trusted data, news, and insights that bring transparency, efficiency, and fairness to markets. The company helps connect influential communities across the global financial ecosystem via reliable technology solutions that enable our customers to make more informed decisions and foster better collaboration. For more information, visit Bloomberg.com/company or request a demo.

About the CNCF
Cloud native computing empowers organizations to build and run scalable applications with an open source software stack in public, private, and hybrid clouds. The Cloud Native Computing Foundation (CNCF) hosts critical components of the global technology infrastructure, including Kubernetes, Prometheus, and Envoy. CNCF brings together the industry’s top developers, end users, and vendors and runs the world’s largest open source developer conferences. Supported by more than 800 members, including the world’s largest cloud computing and software companies, as well as over 200 innovative startups, CNCF is part of the nonprofit Linux Foundation. For more information, please visit http://www.cncf.io.

The Linux Foundation has registered trademarks and uses trademarks. For a list of trademarks of The Linux Foundation, please see our trademark usage page. Linux is a registered trademark of Linus Torvalds.

Media Contact

Cristin Connelly, Tetrate, 4049316752, cristin@cathey.co, www.tetrate.io 

Chaim Haas, Bloomberg, 212-617-7025, chaas30@bloomberg.net, www.bloomberg.com

View original content to download multimedia:https://www.prweb.com/releases/tetrate-and-bloomberg-collaborate-on-community-led-open-standard-for-ai-gateways-built-on-cncfs-envoy-gateway-project-302266565.html

SOURCE Tetrate

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Technology

Who’s Working Remotely? Virtual Vocations Survey Highlights Evolving Jobseeker Demographics

Published

on

By

This survey underscores the diverse backgrounds and experiences of remote jobseekers, highlighting the growing demand for flexible work arrangements across various demographics.

TUCSON, Ariz., Dec. 27, 2024 /PRNewswire-PRWeb/ — With over 500 participants from the U.S. (69%) and international locations (31%), Virtual Vocations‘ 2024 demographics survey offers valuable insights into the evolving landscape of remote work. By comparing responses across these groups, the survey highlights shared experiences and unique challenges faced by jobseekers worldwide.

“Whether based in the U.S. or abroad, jobseekers are embracing remote roles to align their careers with their personal goals, and we’re proud to be a part of their journey.” –Laura Spawn, CEO and co-founder of Virtual Vocations

Although Virtual Vocations is a U.S.-based company, it supports international jobseekers through its fully remote job board and career resources, addressing the global demand for remote work opportunities. The company frequently receives inquiries from international members seeking to access fully remote roles, punctuating the worldwide appeal of flexible work arrangements.

“The 2024 demographics survey results reinforce what we’ve known for years—professionals around the world are seeking flexibility, balance, and opportunities to work from home,” said Virtual Vocations CEO Laura Spawn. “Whether based in the U.S. or abroad, jobseekers are embracing remote roles to align their careers with their personal goals, and we’re proud to be a part of their journey.”

Fully Remote Jobs Remain Most Desired

A significant 43% of U.S.-based jobseekers and 42% of international respondents named fully remote, no-travel jobs as their top preference. These roles, which allow employees to work entirely from home, offer flexibility, aligning with both personal and professional goals. Although occasional in-person requirements may arise, fully remote roles are favored over hybrid, partially remote, and “work from anywhere” options. These positions provide businesses with access to a broader talent pool and enable employees to prioritize workplace values and culture.

Top Industries for Remote Jobseekers

The survey also highlights four key industries attracting remote jobseekers worldwide. Information Technology (IT) stands out as the leading industry for remote roles, with significantly more job postings than any other field. Healthcare follows closely, benefiting from the growth of telehealth and remote medical roles. Customer service offers engaging opportunities for professionals interested in client interaction, while education presents a wide array of roles in online teaching, tutoring, and instructional design, fueled by the expansion of virtual learning.

Jobseekers’ Common Frustrations

Both U.S. and international jobseekers shared frustrations, particularly with online job scams. Jobseekers expressed dissatisfaction with the prevalence of scams, especially when searching for work-at-home positions. Despite relying on online job boards, only a quarter (23% of U.S. respondents and 24% of international respondents) use dedicated remote job boards, like Virtual Vocations, where job postings are thoroughly vetted to ensure they are free of scams. Additionally, many jobseekers expressed frustration with excessive job requirements and employers failing to provide feedback or “ghosting” applicants during the hiring process, with one-third of respondents from both groups reporting these issues.

Income Insecurity: A Global Concern

Income insecurity remains a pressing issue for both U.S. and international jobseekers, with many reporting their earnings as insufficient for comfortable living. Sixty-five percent of U.S. respondents and 77% of international respondents reported inadequate household incomes. Nearly half (48%) of U.S. jobseekers earn less than $60,000 annually, while 68% of international jobseekers earn under $30,000. To improve financial stability, many jobseekers have set income targets, with 30% of U.S. jobseekers aiming for $60,000–$89,999 and another 30% targeting at least $120,000. In contrast, international respondents generally require lower salaries, with 38% seeking $30,000–$59,999 and 32% aiming for $60,000–$89,999.

For a comprehensive analysis and additional insights, read the full demographics survey report here: https://www.virtualvocations.com/blog/annual-statistical-remote-work-reports/remote-work-demographics-survey-results-2024/

ABOUT VIRTUAL VOCATIONS
Founded in 2007 by CEO Laura Spawn and her brother, CTO Adam Stevenson, Virtual Vocations is a small company with a big mission: to connect jobseekers with legitimate remote job openings. To date, Virtual Vocations has helped more than four million jobseekers in their quests for flexible, remote work.

In addition to providing a database of current, hand-screened, and 100% remote job openings, Virtual Vocations offers jobseekers a number of tools to aid in their job searches, including exclusive career courses, downloadable jobseeker content, and career coaching and resume writing services. Virtual Vocations also releases several data-driven reports each year on current trends in remote work.

Virtual Vocations, Inc. is a private, family-owned, and 100% virtual company incorporated in Tucson, Arizona.

Media Contact

Kimberly Back, Virtual Vocations, Inc., 1 (800) 379-5092 x. 703, kim@virtualvocations.com, https://www.virtualvocations.com

View original content to download multimedia:https://www.prweb.com/releases/whos-working-remotely-virtual-vocations-survey-highlights-evolving-jobseeker-demographics-302339757.html

SOURCE Virtual Vocations, Inc.

Continue Reading

Technology

Judge Baker Children’s Center d/b/a The Baker Center for Children and Families Provides Notice of Data Security Incident

Published

on

By

BOSTON, Dec. 27, 2024 /PRNewswire/ — Judge Baker Children’s Center d/b/a The Baker Center for Children and Families (“The Baker Center”), a nationally recognized provider of services for children’s mental health, has learned of a data security incident that may have impacted certain personal and / or protected health information. On December 27, 2024, The Baker Center formally notified potentially affected individuals with available address information and provided resources to assist them.

On July 28, 2024, The Baker Center discovered unusual activity within its local digital storage environment. After taking immediate steps to ensure the environment was secure, The Baker Center enlisted independent cybersecurity experts to conduct an investigation to determine what happened and whether sensitive information may have been impacted. According to the investigation, an unauthorized actor gained access to The Baker Center’s systems between July 26 – 28, 2024 and may have downloaded certain files. Following a thorough review of the impacted files, on October 28, 2024, The Baker Center determined that certain individuals’ personal and/or protected health information was potentially impacted during the incident.

The information affected during this incident varies between individuals but may have involved the following: name, address, date of birth, Social Security number, driver’s license or other government identification number, financial account information, health insurance information, medical treatment or diagnosis information, and/or clinical information.

On December 27, 2024, The Baker Center mailed notification letters to potentially impacted individuals with verifiable address information. The letters include information about this incident and about steps that potentially impacted individuals can take to monitor and help protect their personal and protected health information. The Baker Center has established a toll-free call center to answer questions about the incident and to address related concerns. The call center can be reached at 844-920-8988, Monday through Friday from 9:00 AM to 9:00 PM Eastern time

The Baker Center takes the security and privacy of information in its possession very seriously and is taking steps to prevent a similar event from occurring in the future. The Baker Center deeply regrets any inconvenience or concern this incident may cause.

View original content:https://www.prnewswire.com/news-releases/judge-baker-childrens-center-dba-the-baker-center-for-children-and-families-provides-notice-of-data-security-incident-302339677.html

SOURCE The Baker Center for Children and Families

Continue Reading

Technology

outboundIQ Achieves Certified Implementation Partner (CIP) Status with Five9

Published

on

By

Delivering Optimized, Outbound-Focused Contact Center Solutions for Modern Businesses

LAUDERDALE LAKES, Fla., Dec. 27, 2024 /PRNewswire/ — outboundIQ www.outboundiq.com proudly announces its accreditation as a Five9 Certified Implementation Partner (CIP), a distinction that reflects its deep expertise in optimizing and streamlining outbound-focused contact center operations. With a team of seasoned Five9 veterans, expert programmers, and industry thought leaders, outboundIQ is uniquely equipped to help businesses of all sizes unlock the full potential of Five9’s Virtual Contact Center platform.

Optimized Solutions for Complex Contact Center Needs
outboundIQ specializes in providing expedited, outbound-focused contact center implementations, integrating advanced features such as inbound and outbound Voice, SMS, Chat, Email, Salesforce Integration, and other third-party app integrations. Clients can also leverage ongoing optimization engagements and monthly retainers for strategic consulting designed to support long-term, outreach-focused success.

“Who better to handle your domain configuration than the experts that understand the outbound contact center world. To be an outbound expert, you must know 3 things; how to configure the domain front end, how the architecture interprets that design, and how carriers respond to your dialing behavior as a result of the build. outboundIQ has the advantage of deeply understanding all 3 things. Our experts are seasoned professionals that will guide toward the best build for your business. You tell us about your business, your needs and your processes, and we will build you a domain fit for purpose. outboundIQ offers best in class Domain Optimization, Implementation and Consulting for customers of all sizes and complexity. Due to our methodology and proprietary automations, we are able to bring our customers’ projects to life within accelerated timeframes.”

Jessica Clay, VP Support and Services

“We launched our business in June and were fortunate to connect with the incredible team at outboundIQ early on. Navigating the world of outbound calling and building efficient prospecting systems isn’t easy, but the entire team at outboundIQ brought our vision to life seamlessly. They implemented our ideas quickly and executed them flawlessly. Since partnering with them, our contact rates have significantly improved, our conversions have increased, and our overall business is thriving. We’re deeply grateful for this collaboration and look forward to continuing our work together on future endeavors!”

– Tim, Lit Financial

“I genuinely don’t know enough ways to thank the entire outboundIQ team. I inherited a domain riddled with mistakes, tangled beyond belief, and I had essentially planned to scrap the whole thing and start over. That’s when this team, led by Jessica Clay’s brilliance, took over to understand exactly what I wanted to create and completely revitalized my domain. We are all beyond thankful as they continue to consult for us to this day and I see no reason to stop. Thank you, Jessica, Jason, Rudy, Bruno, Sandy and everyone who gets the pleasure of working with these domain geniuses!”

– Michael, Lifetime Home Remodeling

A Holistic Approach to Outbound Excellence
Creating a competitive, consumer-focused outreach program requires more than just advanced technology. As outboundIQ explains, a thriving contact center functions like a high-performing racing team:

The Car: Five9 Virtual Contact Center provides a cutting-edge technology foundation.The Driver: Strong Dialer Administrators who skillfully manage operations.The Pit Crew: IT/Support teams ensuring seamless functionality.The Spotters: Data Analytics and Reporting experts optimizing performance.The Fuel: High-quality data driving better outcomes.

outboundIQ’s professional services team brings these critical elements together, ensuring clients achieve best-in-class outbound operations that prioritize consumer experience while maintaining a competitive edge.

A Call to Collaboration
With its new CIP certification, outboundIQ invites businesses to explore select partnership opportunities and projects to reimagine their contact center operations. Whether through expedited implementations or ongoing strategic consulting, outboundIQ is committed to driving measurable results for its clients.

About outboundIQ
outboundIQ delivers optimized, outbound-focused contact center implementations, combining years of Five9 expertise with cutting-edge strategies to help businesses achieve exceptional outreach outcomes. As a Five9 Certified Implementation Partner, outboundIQ provides tailored solutions to meet the unique needs of modern organizations.

About Five9
Five9 is a digital enterprise’s leading cloud contact center and software provider. The Five9 Intelligent CX Platform is reliable, secure, compliant, and scalable, designed to create exceptional personalized customer experiences.
www.five9.com

Media contact: 
Sandy Tafur
Phone: 404-660-5314
mail: sandy@outboundiq.com

View original content to download multimedia:https://www.prnewswire.com/news-releases/outboundiq-achieves-certified-implementation-partner-cip-status-with-five9-302339797.html

SOURCE outboundIQ

Continue Reading

Trending