Connect with us

Technology

Suicide Bot: New AI Attack Causes LLM to Provide Potential “Self-Harm” Instructions

Published

on

New LLM attack class, Flowbreaking, successfully caused a widely used LLM to potentially provide a researcher, masquerading as a girl, with “self harm” instructions

TEL AVIV, Israel, Nov. 26, 2024 /PRNewswire-PRWeb/ — Knostic is releasing today research on two new LLM attacks, which may constitute a new attacks class, called Flowbreaking, resulting in a widely used successful LLM providing potential instructions to our researcher, masquerading as a girl, on “self-harm”. Technologically, these attacks affect AI/ML-based system architecture for LLM applications and agents, logically similar in concept to race conditions in software vulnerabilities.

Flowbreaking can be consistently exploited to force the LLM to respond and divulge otherwise protected information before it retracts the original text, enabling attackers to exfiltrate sensitive data with a very small exfiltration footprint.

Knostic.ai is further disclosing two new attacks that fit this new class: “Second Thoughts” and “Stop and Roll”, reproduced on ChatGPT and Microsoft O365 Copilot.

A video of the “Second Thoughts” attack in action: https://www.youtube.com/watch?v=AS2kJgOgyQ4

These attacks resulted in information exposure through bypassing safety measures such as guardrails, as well as mentioned, more severe actions where a widely used successful LLM provided potential instructions to our researcher, masquerading as a girl, on the topic of self-harm, which is considered a substantial finding in AI security circles. This was discovered after we published our results, and we will follow up with more details after we responsibly disclose the issue to the provider.

Other research we mention, quoted from academia, shows these attacks resulting in revealing another user’s prompt, and buffer overflow exploitation.

Flowbreaking can be consistently exploited to force the LLM to respond and divulge otherwise protected information before it retracts the original text, enabling attackers to exfiltrate sensitive data with a very small exfiltration footprint.

Up to now, LLM attacks such as jailbreaking and prompt injection were mostly focused on directly bypassing first-line guardrails by use of “language tricks” and token level attacks, breaking the system’s policy by exploiting its reasoning limitations.

In this research we’ve used these prompting techniques as a gateway into the inner workings of the AI/ML systems. Under the auspices of this approach we try to understand the other components in the system, LLM-based or not, and to avoid them, bypass them, or use them against each other.

This expands the attack surface for security researchers studying LLMs, enabling them to make LLMs to ignore their guardrails and act beyond their intended design.

“AI/ML systems such as LLM applications and agents are more than just the model and the prompt. They have multiple components besides the model, such as guardrails, all of which can be attacked on their own, or by gaming the interplay between them,” said Gadi Evron, Co-Founder and CEO of Knostic, the world’s first provider of need-to-know based access controls for LLMs.

For example, as a result of one of these new attacks, “Second Thoughts”, when answering a sensitive question, Knostic researchers observed the LLM show signing of hesitation, having “second-thoughts” (hence the name) and retracting its answer, providing a new, redacted one.

“As LLM technologies stream answers to the user as they’re being generated, enterprises cannot safely adopt LLM applications without making sure that the answers are provided when complete, as opposed to streaming as they are formed. Further, they’d need to deploy LLM-specific access controls such as need-to-know boundaries and context-aware permissions.” Evron stated.

Evron further elaborated, “The LLM age requires a new form of identity based on the user’s need-to-know, i.e. their business context. Looking beyond security and attackers, need-to-know based controls ensure organizations can safely proceed with adoption of GenAI systems, such as Microsoft Copilot for M365 and Glean.”

Knostic Research’s findings also highlight the importance of developing new AI security mechanisms. On the offensive side we need to expand the focus of evaluations and audits beyond the model and prompts. The systems surrounding LLMs should be considered holistically instead. On the defensive side, both application security (AppSec) and model security (ModSec) should be considered critical for the secure design of AI/ML systems.

This new attack class joins Prompt Injection and Jailbreaking as an attack type, but with a consideration for the wider AI/ML system components and architecture, and significantly expands the research possibilities into LLM attacks.

You can read Knostic’s research directly on their blog, here: https://www.knostic.ai/blog/introducing-a-new-class-of-ai-attacks-flowbreaking

About Knostic.ai

Knostic.ai is the world’s first provider of need-to-know based access controls for Large Language Models (LLMs). With knowledge-centric capabilities, Knostic enables organizations to accelerate the adoption of LLMs and drive AI-powered innovation without compromising value, security, or safety. For more details, visit https://www.knostic.ai/.

For more information

Gadi Evron, CEO, Knostic

Email: press@knostic.ai.

Media Contact

Gadi Evron, Knostic, 972 50-542-8610, gadi@knostic.ai, knostic.ai

View original content to download multimedia:https://www.prweb.com/releases/suicide-bot-new-ai-attack-causes-llm-to-provide-potential-self-harm-instructions-302316660.html

SOURCE Knostic

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Technology

HONGQI in 2024: Pioneering Innovation and Elevating the Future of Luxury Mobility

Published

on

By

CHANGCHUN, China, Dec. 27, 2024 /PRNewswire/ — 2024 has been a landmark year for HONGQI, as the brand made significant strides in the global luxury automotive market. With the unveiling of its flagship all-electric vehicles, groundbreaking technological innovations, and active participation in international events, HONGQI has strengthened its position as a key player in the evolving landscape of sustainable mobility.

The EH7 sedan and EHS7 SUV made a powerful impression this year at the prestigious Goodwood Festival of Speed, captivating audiences and earning widespread acclaim. Built on the advanced TianGong electric platform, the EH7 delivers a WLTP range of 655 km, while the EHS7 achieves 600 km. Both models feature ultra-fast charging technology, enabling the battery to charge from 10% to 80% in just 20 minutes. This innovation offers unparalleled convenience and efficiency, meeting the demands of modern electric mobility.

International reviews have praised these vehicles for their innovation and craftsmanship. The EHS7 has been highlighted as “tailored to meet European preferences, with high-quality engineering and abundant features.” Meanwhile, the EH7 has been lauded for its “impressive range, smooth handling, offering a balanced blend of luxury and practicality.” These evaluations reflect the growing recognition from global media and users of HONGQI’s ability to deliver sophisticated luxury vehicles that meet international standards.

HONGQI’s new vehicles, built on the revolutionary TianGong electric platform described as “a highly flexible pure electric platform capable of solving practical problems for users in cold areas” address the diverse needs of modern drivers while ensuring reliable performance in extreme conditions.

This year, HONGQI left a lasting impression at two major international motor shows. At Automechanika Frankfurt, the spotlight was on its flagship models, the EH7 and EHS7, which drew praise for their innovative design, remarkable range, and exceptional performance. Meanwhile, at the Paris Motor Show 2024, HONGQI showcased its groundbreaking TianGong electric platform, celebrated for its adaptability and advanced technology. HONGQI’s collaboration with SCABAL further demonstrated the seamless fusion of Chinese craftsmanship and European luxury aesthetics, reinforcing its dedication to innovation and artistry.

On its journey to becoming the “World’s New Luxury” automotive brand, HONGQI will continue to promote its vision of sustainability and innovation, gaining greater recognition through its commitment to quality. Looking ahead, HONGQI will focus on continuous improvement, enhancing its products and services to meet the evolving demands of the market. Over the next five years, HONGQI plans to launch 10 new models in Europe, expanding options in the global market and bringing fresh momentum to the development of the luxury mobility sector.

Photo – https://mma.prnewswire.com/media/2588124/image.jpg

 

View original content:https://www.prnewswire.co.uk/news-releases/hongqi-in-2024-pioneering-innovation-and-elevating-the-future-of-luxury-mobility-302339599.html

Continue Reading

Technology

MySize present year over year growth, 2025 targets $15M Revenue, Anticipates Strong 2024 Finish close to 100% Growth from 2022

Published

on

By

Strong Revenue Growth, Strategic Market Expansion, M&A strategy and Cutting-Edge Technology Set the Stage for Continued Success

AIRPORT CITY, Israel, Dec. 27, 2024 /PRNewswire/ — MySize, Inc. (NASDAQ: MYSZ)

(“MySize” or the “Company”), a global leader in AI-driven sizing solutions and omnichannel e-commerce platforms, today shared its annual shareholder update. The update highlights robust revenue growth, strategic geographic expansion, transformative technological advancements, and plans to explore M&A opportunities within the Company’s core industries.

Delivering on Growth and Performance

MySize anticipates closing 2024 with $8.5 million in revenue, reflecting a 23% year-over-year growth. MySize believes that this momentum, fueled by advancements in technology and market expansion of Orgad, potentially positions the Company to achieve a projected $15 million in revenue by 2025 based on current market conditions. Moreover, the Company believes that it will be able to achieve further significant operational cost savings that will enhance a flexibility in cash flow management and provide the foundation for continued strategic investment and growth.

“Our preliminary financial results highlight Orgad’s pivotal role in driving our revenue growth. By optimizing operational efficiency and capitalizing on strategic market expansions, Orgad demonstrates its capacity to deliver strong performance while providing the flexibility needed to pursue ambitious targets,” said Ronen Luzon, Founder and CEO of MySize. “2024 has proven that our strategy is not just ambitious, but highly effective, and we believe that it lays the groundwork for sustainable growth.”

Expanding Geographic Reach

MySize’s e-commerce platform, Orgad, is undergoing a strategic shift from focusing primarily on North America to expanding operations across Europe.

This move follows the receipt of certification to become a supplier for a major European retailer. This milestone represents significant growth potential and has the potential to unlock new opportunities in one of the world’s largest retail markets. The Company believes this strategic expansion demonstrates Orgad’s ability to adapt and capitalize on emerging opportunities.

“We believe that Europe represents a significant opportunity for Orgad as we tap into new markets and strengthen relationships with global retail leaders,” Luzon added. “The certification as a supplier to a leading European retailer underscores our commitment to delivering excellence.”

Pioneering Innovation with Naiz Fit

The Company’s AI-driven sizing solution, Naiz Fit, continues to set industry benchmarks:

✅ Delivered over 42 million personalized size recommendations across 18+ countries, enabling customers to find their perfect fit.✅ Supported 1.5 million virtual try-ons, ensuring precision and enhancing consumer confidence.✅ Increased conversion rates by 5.7x, reducing friction in the purchasing journey.✅ Achieved a 14% reduction in return rates, driving cost savings and operational efficiency for retail partners.✅ Boosted average order value (AOV) by 27%, reinforcing the financial value of MySize’s solutions.✅ Improved consumer engagement by 15%, creating stronger connections between brands and their customers.

Interestingly, trousers emerged as the most frequently returned item, providing valuable insights that MySize leverages to refine its technology further and support its partners.

“Naiz Fit continues to solidify our position as a technological leader in the fashion and retail space,” Luzon remarked. “These results are a testament to the impact and effectiveness of our solutions.”

Looking Ahead

“As we reflect on 2024, I am proud of how far MySize has come,” Luzon concluded. Building on this momentum, MySize is gearing up for a strong presence at two key industry events in January 2025: CES in Las Vegas and NRF in New York. These events present unique opportunities to showcase our cutting-edge technologies and connect with global leaders in the retail and e-commerce industries.

Additionally, MySize is actively exploring mergers and acquisitions (M&A) to enhance growth opportunities and scale operations. By targeting companies aligned with its expertise in AI-driven sizing solutions, e-commerce platforms, and operational technologies, MySize aims to:

Expand Product Offerings: Enhance the range of technologies and solutions, providing clients with more robust and innovative tools.Accelerate Market Reach: Broaden geographic penetration, especially in untapped regions, and strengthen relationships in existing markets.Optimize Operational Synergies: Drive cost efficiencies and maximize profitability through integration with complementary businesses.

“Our approach to M&A is grounded in strategic alignment and long-term value creation,” Luzon emphasized. “By leveraging these opportunities, we aim to scale our business and unlock innovative pathways that support sustainable growth and deliver meaningful results for our shareholders.”

“We believe that our strategic expansion, cutting-edge technology, and commitment to innovation position us for an exciting future. Together, with our partners and investors, we aim to shape the future of fashion and e-commerce.”

About MySize, Inc.

MySize, Inc. (NASDAQ: MYSZ) is a global leader in omnichannel e-commerce platforms and AI-driven sizing solutions, including MySizeID and Naiz Fit. The Company’s solutions are designed to drive revenue growth, reduce operational costs, and enhance customer experiences for business clients worldwide.

We routinely post information that may be important to investors in the Investor Relations section of our website. Follow us on Facebook, LinkedIn, Instagram, and X (formerly known as Twitter).

For more information, visit www.mysizeid.com.

Estimated Preliminary Results for the Year Ending December 31, 2024 (Unaudited)

Set forth above are certain estimated preliminary financial results and other business metrics for the year ended December 31, 2024. These estimates are based on the information available to us at this time. Our actual results may differ materially from the estimated preliminary results presented due to the completion of our financial closing and accounting procedures, including final adjustments, the completion of the preparation and audit of the Company’s financial statements and the subsequent occurrence or identification of events prior to the filing of the audited consolidated financial statements for the fiscal year ending December 31, 2024, in the Company’s Annual Report on Form 10-K. The estimated preliminary financial results and other business metrics have not been audited or reviewed by our independent registered public accounting firm. These estimates should not be viewed as a substitute for our full interim or annual financial statements. Accordingly, you should not place undue reliance on this preliminary data. In addition, any such statements regarding the Company’s financial performance are not necessarily indicative of the Company’s financial performance that may be expected to occur for the fiscal year ending December 31, 2024, or for any future fiscal period.

Forward-looking Statements

This press release contains certain forward-looking statements within the meaning of the safe harbor provisions of the Private Securities Litigation Reform Act of 1995, including statements related to its strategic and business plans, technology, relationships, objectives, expectations for its business, growth, expected revenue guidance and potential merger and acquisition opportunities. These statements are identified by the use of the words “could,” “believe,” “anticipate,” “intend,” “estimate,” “expect,” “may,” “continue,” “predict,” “potential,” “project” and similar expressions that are intended to identify forward-looking statements. All forward-looking statements speak only as of the date of this press release. You should not place undue reliance on these forward-looking statements. Although we believe that our plans, objectives, expectations and intentions reflected in or suggested by the forward-looking statements are reasonable, we can give no assurance that these plans, objectives, expectations or intentions will be achieved. Forward-looking statements involve significant risks and uncertainties (some of which are beyond our control) and assumptions that could cause actual results to differ materially from historical experience and present expectations or projections. Actual results may differ materially from those in the forward-looking statements and the trading price for our common stock may fluctuate significantly. Forward-looking statements also are affected by the risk factors described in the Company’s filings with the U.S. Securities and Exchange Commission. Except as required by law, we undertake no obligation to update or revise publicly any forward-looking statements, whether as a result of new information, future events or otherwise, after the date on which the statements are made or to reflect the occurrence of unanticipated events.

Investor Contacts

Or Kles, CFO
Email: ir@mysizeid.com

Logo – https://mma.prnewswire.com/media/689689/3320229/MySize_Logo.jpg

View original content:https://www.prnewswire.com/news-releases/mysize-present-year-over-year-growth–2025-targets-15m-revenue–anticipates-strong-2024-finish-close-to-100-growth-from-2022-302339582.html

SOURCE My Size Inc.

Continue Reading

Technology

Pixie Dust Technologies Announces Debt Financing

Published

on

By

NEW YORK and TOKYO, Dec. 27, 2024 /PRNewswire/ – Pixie Dust Technologies, Inc. (the “Company”), a Japanese technology company focused on commercializing innovative products and materials utilizing proprietary wave control technology, today announced its new debt financing.

New debt financing
On December 27, 2024, Pixie Dust Technologies, Inc. (the “Company”) reached an agreement with Suzuyo Group Finance Co., Ltd. (the “Lender”) to obtain new debt financing (the “New Debt”) in the amount of 1.5 billion yen.

Below is an outline of terms and conditions of New Debt.

Loan Amount

1,500,000,000 yen

Use of funds

General working capital

Borrowing Date

December 27, 2024

Maturity Date

March 14, 2025

Principal Repayment Method

Pay in a lump sum on the Maturity Date

Interest Rate

1.03% per annum

Forward-Looking Statements
Certain statements contained in this press release are “forward-looking statements” made pursuant to the safe harbor provisions of the Private Securities Litigation Reform Act of 1995. Such forward-looking statements reflect the Company’s current expectations or beliefs concerning future events and actual events may differ materially from current expectations. Words such as “expect,” “anticipate,” “should,” “believe,” “hope,” “target,” “project,” “aim,” “objective,” “goal,” “estimate,” “potential,” “predict,” “may,” “will,” “might,” “could,” “intend,” variations of these terms or the negative of these terms and similar expressions are intended to identify these forward-looking statements. Any such forward-looking statements are subject to various risks and uncertainties, many of which involve factors or circumstances that are beyond the Company’s control, including but not limited to the strength of the economy, changes to the market for securities, the effects of inflation and its associated impact on prevailing interest rates, political or financial instability, and other factors which are set forth in the Company’s prospectus that forms a part of the Registration Statement on Form F-1 (File No. 333-272476), as amended, and in all filings with the SEC made by the Company subsequent to the filing thereof (including, without limitation, the Company’s most recent annual report filed under cover of Form 20-F). The forward-looking statements included in this press release represent the Company’s views as of the date of this press release. The Company anticipates that subsequent events and developments will cause its views to change. These forward-looking statements should not be relied upon as representing the Company’s views as of any date subsequent to the date of this press release. The Company does not undertake to publicly update or revise its forward-looking statements, whether as a result of new information, future events or otherwise.

View original content:https://www.prnewswire.com/news-releases/pixie-dust-technologies-announces-debt-financing-302339285.html

SOURCE Pixie Dust Technologies

Continue Reading

Trending