Connect with us

Technology

Groq® LPU™ Inference Engine Leads in First Independent LLM Benchmark

Published

on

ArtificialAnalysis.ai Adjusts Chart Axes to Accommodate Groq Performance Levels

MOUNTAIN VIEW, Calif., Feb. 13, 2024 /PRNewswire/ — Groq®, a generative AI solutions company, is the clear winner in the latest large language model (LLM) benchmark by ArtificialAnalysis.ai, besting eight top cloud providers in key performance indicators including Latency vs. Throughput, Throughput over Time, Total Response Time, and Throughput Variance. The Groq LPU™ Inference Engine performed so well with a leading open-source LLM from Meta AI, Llama 2 70b, that axes had to be extended to plot Groq on the Latency vs. Throughput chart. Groq participated in its first public LLM benchmark in January 2024 with competition-crushing results.

“Groq represents a step change in available speed, enabling new use cases for LLMs.” – ArtificialAnalysis.ai

“ArtificialAnalysis.ai has independently benchmarked Groq and its Llama 2 Chat (70B) API as achieving throughput of 241 tokens per second, more than double the speed of other hosting providers,” said ArtificialAnalysis.ai Co-creator Micah Hill-Smith. “Groq represents a step change in available speed, enabling new use cases for large language models.”

Groq has run several internal benchmarks, reaching 300 tokens per second consistently, setting a new speed standard for AI solutions that has yet to be achieved by legacy solutions and incumbent providers. ArtificialAnalysis.ai benchmarks confirm Groq superiority over other providers, especially regarding throughput at 241 tokens per second and total time to receive 100 output tokens at 0.8 seconds according to the benchmark techniques of input prompt size and output prompt size. For more benchmark details please visit https://groq.link/aabenchmark.

“Groq exists to eliminate the ‘haves and have-nots’ and to help everyone in the AI community thrive,” said Groq CEO and founder Jonathan Ross. “Inference is critical to achieving that goal because speed is what turns developers’ ideas into business solutions and life-changing applications. It is incredibly rewarding to have a third party validate that the LPU Inference Engine is the fastest option for running Large Language Models and we are grateful to the folks at ArtificialAnalysis.ai for recognizing Groq as a real contender among AI accelerators.”

ArtificialAnalysis.ai benchmarks are conducted independently and are ‘live’ in that they are updated every three hours (eight times per day). Prompts are unique, around 100 tokens in length, and generate ~200 output tokens. This is designed to reflect real-world usage and measures changes to throughput (tokens per second) and latency (time to first token) over time. Benchmarks are also present on ArtificialAnalyis.ai with longer prompts to reflect retrieval augmented generation (RAG) use cases.

The LPU Inference Engine is available through the Groq API. For access, please complete the request form at https://groq.link/contact.

About Groq

Groq® is a generative AI solutions company and the creator of the LPU™ Inference Engine, the fastest language processing accelerator on the market. It is architected from the ground up to achieve low latency, energy-efficient, and repeatable inference performance at scale. Customers rely on the LPU Inference Engine as an end-to-end solution for running Large Language Models (LLMs) and other generative AI applications at 10x the speed. The LPU Inference Engine is available via the GroqCloud, an API that enables customers to purchase Tokens-as-a-Service for experimentation and production-ready applications. Jonathan Ross, inventor of the Google Tensor Processing Unit (TPU), founded Groq to preserve human agency while building the AI economy. Experience Groq speed for yourself at https://groq.com/.

Media Contact for Groq
Allyson Scott
PR-media@Groq.com

 

 

View original content to download multimedia:https://www.prnewswire.com/news-releases/groq-lpu-inference-engine-leads-in-first-independent-llm-benchmark-302060263.html

SOURCE Groq

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Technology

123Invent Inventor Develops Improved Cable Pushing Tool (PLB-567)

Published

on

By

PITTSBURGH, May 6, 2025 /PRNewswire/ — “As a technician, I needed a smoother tool for pushing telecom, AV, electrical, and low voltage cables,” said an inventor, from Clarksboro, N.J., “so I invented the GLOW ROD. My design offers a smoother connection point, which helps prevent issues with the connections breaking off.”

The invention provides an improved tool designed to increase smoothness when pushing cables through conduit, drop ceilings, walls, etc. In doing so, it helps prevent issues associated with breakage at the connection point. It also helps save time. Additionally, the invention features an effective design that is easy to use.

The GLOW ROD is currently available for licensing or sale to manufacturers or marketers. For more information, visit www.glowrod.net. Or contact Ethan Andress at 609-519-0287 or email info@glowrod.net.

View original content to download multimedia:https://www.prnewswire.com/news-releases/123invent-inventor-develops-improved-cable-pushing-tool-plb-567-302446793.html

SOURCE InventHelp

Continue Reading

Technology

Synteq Digital Announces Acquisition of Crunchbits, Accelerating its Expansion into High-Performance Computing Data Center Services & Solutions

Published

on

By

WILMINGTON, Del., May 6, 2025 /PRNewswire/ — Synteq Digital (“Synteq”), a global provider of data center hardware services and infrastructure solutions, announced today that it has entered into a binding agreement for the acquisition of Crunchbits LLC, a fast-growing high-performance computing (HPC) infrastructure and services provider.

Crunchbits offers affordable and powerful server solutions with a focus on server rentals, including VPS, VDS, Dedicated Servers, and GPU Servers.  As part of its operational scope and scale, Crunchbits has 7 active data center operations in the USA, located strategically across Washington State, Pennsylvania, New York, and Texas.

For current Crunchbits customers, this transaction will be seamless from an operating and support standpoint. The same trusted team will remain in place, led by founder Eric Yingling, who will continue to serve as a direct point of contact for many clients. But at the same time, clients will be receiving an upgrade across the board. Backed by Synteq’s team, capital, engineering scale, and global footprint, customers can expect even greater service reliability, faster turnaround times, and access to newer, more powerful hardware—while still benefiting from the same nimble, execution-focused approach they’ve come to rely on.

This strategic acquisition marks a major step forward in Synteq’s mission to deliver scalable, performance-driven solutions for next-generation computing workloads. As part of the acquisition, Crunchbits founder Eric Yingling joins Synteq as VP of HPC Operations, where he will lead execution and operations across Synteq’s growing HPC portfolio. Crunchbits CTO Yann St. Arnaud also joins the team as Director of HPC Technical Operations, along with all remaining team members covering client, network, and hardware support.

Eric brings over a decade of real-world data center experience, forged through a unique career path spanning military service in the U.S. Marine Corps, digital asset mining, and hands-on infrastructure deployment. Starting in 2012, Eric launched one of the earliest large-scale GPU mining operations engineered for uptime and efficiency—eventually founding Crunchbits in 2021 and scaling it into a respected name in the HPC hosting space.

“Eric’s proven operational track record and experienced team position us to rapidly expand our HPC data center capabilities,” said Taras Kulyk, CEO of Synteq Digital. “His expertise and innovative approach to data center infrastructure have already delivered remarkable growth, and we’re excited to build on that momentum together.”

“I am truly excited to integrate Crunchbits into Synteq Digital,” said Eric Yingling. “Synteq provides a powerful corporate platform for growth, allowing us to deliver enhanced value to our customers through superior hardware, faster support, and deeper technical expertise-all while maintaining the practical, performance-driven approach that has defined our success. The strong alignment in culture and vision between our teams establishes a solid foundation for scalable growth and continued innovation across the organization.”

Keefe, Bruyette & Woods, a Stifel Company, acted as exclusive financial advisor and Cozen O’Connor acted as legal counsel to Synteq on this transaction.

About Synteq Digital

Synteq Digital is a premier provider of infrastructure, hardware, services, and solutions for the global data center sector.

About Crunchbits LLC

Crunchbits is a leading solutions provider for innovative HPC data center infrastructure specializing in dedicated servers, virtual servers, storage solutions and cloud GPU services, with facilities in Washington State, Pennsylvania, New York, and Texas.

To learn more about Crunchbits, please visit crunchbits.com
To learn more about Synteq Digital, please visit synteq.digital

For media inquiries, please contact PR (at) Synteq (dot) digital.

Media Contact

pr@synteq.digital, http://synteq.digital

View original content to download multimedia:https://www.prnewswire.com/news-releases/synteq-digital-announces-acquisition-of-crunchbits-accelerating-its-expansion-into-high-performance-computing-data-center-services–solutions-302447388.html

SOURCE Synteq Digital

Continue Reading

Technology

India Global Forum Welcomes the Signing of the Historic UK-India Free Trade Agreement

Published

on

By

LONDON, May 6, 2025 /PRNewswire/ — As the United Kingdom and India announce a historic Free Trade Agreement (FTA), India Global Forum (IGF) and the UK India Future Forum (UKIFF) commend the sustained efforts of both governments in achieving this landmark economic milestone. We acknowledge the complexities involved in such negotiations and recognise the dedication of all stakeholders in navigating these challenges.

The UK-India FTA signifies more than a trade pact; it embodies a shared vision for a comprehensive strategic partnership. It reflects a mutual commitment to fostering economic growth, innovation, and cultural exchange between our two nations. Over the years, IGF has served as a critical platform facilitating dialogue among policymakers, business leaders, and civil society, consistently bridging contexts, and promoting collaboration across sectors.

Manoj Ladwa, Founder & Chairman, India Global Forum and UK India Future Forum said: “My congratulations to Prime Ministers Narendra Modi and Kier Starmer, as well as the negotiation teams of both countries. FTAs are notoriously complex and this truly is a remarkable achievement that will serve both countries well. This agreement represents a significant milestone in UK–India relations, underscoring the potential of our partnership and the opportunities that lie ahead. It is a testament to what can be achieved when diplomacy, pragmatism, and partnership come together with purpose, and of course, it is proof that democracies work best when democracies work together.”

Looking ahead, IGF remains committed to supporting the implementation of this agreement. We will continue to provide spaces for constructive dialogue, monitor progress, and encourage initiatives that deepen UK–India ties, particularly at our upcoming flagship programme in the UK, IGF London 2025. IGF London (June 16-20) will be the first major international platform to celebrate this achievement and to explore its real-world impact.

The signing of the agreement, a decade since Prime Minister Narendra Modi’s first bilateral visit to Britain, underscores how far the UK–India relationship has progressed, anchored in mutual strategic interest, economic ambition, and shared global outlook.

About India Global Forum

India Global Forum is a global affairs organisation that tells the story of contemporary India. We believe India’s pace of change and growth presents limitless opportunities to the world — and we’re the gateway to seize them. Our initiatives accelerate prosperity and global resilience, connect India’s tech and innovation ecosystem to the world, promote proactive climate leadership for a sustainable future, drive empowerment through diversity in business and society, and inspire creativity to help shape our future. And with headline events across multiple continents, we bring together the world’s most influential changemakers who are setting the agenda, right now. To know more, click here

Social Media Handles & Hashtag to Follow

Twitter: @IGFUpdates & @manojladwa

LinkedIn: India Global Forum

Photo – https://mma.prnewswire.com/media/2680603/PG_and_JR.jpg
Logo – https://mma.prnewswire.com/media/2566069/5304029/IGF_Logo.jpg

View original content to download multimedia:https://www.prnewswire.com/in/news-releases/india-global-forum-welcomes-the-signing-of-the-historic-ukindia-free-trade-agreement-302447468.html

Continue Reading

Trending