Connect with us

Technology

PolyU research finds improving AI large language models helps better align with human brain activity

Published

4 months ago

on

HONG KONG, May 27, 2024 /PRNewswire/ — With generative artificial intelligence (GenAI) transforming the social interaction landscape in recent years, large language models (LLMs), which use deep-learning algorithms to train GenAI platforms to process language, have been put in the spotlight. A recent study by The Hong Kong Polytechnic University (PolyU) found that LLMs perform more like the human brain when being trained in more similar ways as humans process language, which has brought important insights to brain studies and the development of AI models.

Current large language models (LLMs) mostly rely on a single type of pretraining – contextual word prediction. This simple learning strategy has achieved surprising success when combined with massive training data and model parameters, as shown by popular LLMs such as ChatGPT. Recent studies also suggest that word prediction in LLMs can serve as a plausible model for how humans process language. However, humans do not simply predict the next word but also integrate high-level information in natural language comprehension. 

A research team led by Prof. Li Ping, Dean of the Faculty of Humanities and Sin Wai Kin Foundation Professor in Humanities and Technology at PolyU, has investigated the next sentence prediction (NSP) task, which simulates one central process of discourse-level comprehension in the human brain to evaluate if a pair of sentences is coherent, into model pretraining and examined the correlation between the model’s data and brain activation. The study has been recently published in the academic journal Sciences Advances.

The research team trained two models, one with NSP enhancement and the other without, both also learned word prediction. Functional magnetic resonance imaging (fMRI) data were collected from people reading connected sentences or disconnected sentences. The research team examined how closely the patterns from each model matched up with the brain patterns from the fMRI brain data.

It was clear that training with NSP provided benefits. The model with NSP matched human brain activity in multiple areas much better than the model trained only on word prediction. Its mechanism also nicely maps onto established neural models of human discourse comprehension. The results gave new insights into how our brains process full discourse such as conversations. For example, parts of the right side of the brain, not just the left, helped understand longer discourse. The model trained with NSP could also better predict how fast someone read – showing that simulating discourse comprehension through NSP helped AI understand humans better.

Recent LLMs, including ChatGPT, have relied on vastly increasing the training data and model size to achieve better performance. Prof. Li Ping said, “There are limitations in just relying on such scaling. Advances should also be aimed at making the models more efficient, relying on less rather than more data. Our findings suggest that diverse learning tasks such as NSP can improve LLMs to be more human-like and potentially closer to human intelligence.”

He added, “More importantly, the findings show how neurocognitive researchers can leverage LLMs to study higher-level language mechanisms of our brain. They also promote interaction and collaboration between researchers in the fields of AI and neurocognition, which will lead to future studies on AI-informed brain studies as well as brain-inspired AI.”

Media Contact
Ms Annie Wong
Senior Manager, Public Affairs
Tel: +852 3400 3853
Email: anniewy.wong@polyu.edu.hk 

View original content:https://www.prnewswire.co.uk/news-releases/polyu-research-finds-improving-ai-large-language-models-helps-better-align-with-human-brain-activity-302156065.html

Related Topics:
Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Technology

Tulufan, Xinjiang: For the first time, a new energy plant and station has achieved “all-green electricity” operation

Published

19 mins ago

on

September 20, 2024

By

TULUFAN, China, Sept. 20, 2024 /PRNewswire/ — On September 19, employees of State Grid Tulufan Electric Power Supply Company came to State Power Investment Zhongli Tenghui Qiquanhu Photovoltaic Power Station to provide comprehensive technical support and guidance for new energy enterprises.

Seven wind power and photovoltaic power generation enterprises, including Xinjiang Jize Power Generation Company in Tulufan, have obtained 6.035 million KWH of grid electricity by purchasing 6,035 “green certificates” to achieve “green electricity – green electricity” and achieve green energy use in the whole link of new energy power generation.

The green power certificate, referred to as “green certificate”, is the only certificate that identifies the production and consumption of renewable energy power. Promoting the all-green operation of new energy power generation is an important measure to promote the green consumption of renewable energy.

“Before, we were just ‘producers’ of green electricity. Now the buyers of green certificates have become green electricity consumers, and the production process is fully green.” Qiquan Lake photovoltaic power station inspection officer Forzati Dilishati said.

Since the launch of the green electricity and green certificate market, State Grid Tulufan Electric Power Supply Company has actively promoted green electricity trading, promoted the supply of green electricity and green certificates in multiple scenarios, promoted the rapid promotion and popularization of related services in Tulufan, and helped build a new power system.

In the first eight months of this year, the cumulative volume of green electricity transactions in Xinjiang reached 1.174 billion KWH, 93.83 times that of the whole year of 2022.

 

View original content:https://www.prnewswire.com/apac/news-releases/tulufan-xinjiang-for-the-first-time-a-new-energy-plant-and-station-has-achieved-all-green-electricity-operation-302253902.html

SOURCE State Grid Tulufan Electric Power Supply Company

Continue Reading

Technology

KuCoin’s Alicia Kao Shares Insights on How AI is Accelerating Mass Crypto Adoption at TOKEN2049 Singapore

Published

19 mins ago

on

September 20, 2024

By

VICTORIA, Seychelles, Sept. 20, 2024 /PRNewswire/ — Alicia Kao, Managing Director at leading global cryptocurrency exchange, KuCoin, shared her vision on how crypto exchanges are the drivers that hold the keys to unlocking mainstream crypto adoption. Speaking at the OKX Main Stage at TOKEN2049 in Singapore on a panel session titled “Exchanges at the Helm: Driving Crypto from Niche to Mainstream,” Alicia shared that “accessing information about blockchain has become significantly easier…at KuCoin, we leverage complex data analysis algorithms using our trading bots to help users trade more efficiently.”

Industry stakeholders from all groups were in attendance for the panel, comprising investors, crypto enthusiasts, and more. The focus was on the crucial role of cryptocurrency exchanges in paving the way for crypto adoption and the eventual integration of digital assets into mainstream financial systems. Alicia and her fellow panelists explored both the challenges and opportunities that lay ahead for the crypto industry.

Alongside Alicia, the panel also featured leaders from leading crypto exchanges such as Ben Zhou, Co-Founder and CEO of Bybit; Gracy Chen, CEO of Bitget; Vivien Lin, Chief Product Officer of BingX; and Sonia Shaw, President of CoinW, and moderated by Michael Casey, Chairman of the Decentralized AI Society.

In addition to the panel discussion, KuCoin cemented its position as a leading centralised exchange (CEX) with a prominent presence on the show floor and activations that showcased the platform’s latest developments. The KuCoin Arcade also drew significant attention, offering an engaging and immersive experience with interactive crypto-themed games and activities.

“As we wrap up another edition of TOKEN2049 in Singapore, I’m once again filled with optimism for the future of the crypto industry. The energy, innovation, and collaboration displayed over the past two days have been immensely inspiring. At KuCoin, we will continue striving to be the driving force in this ever evolving space to build a more inclusive, decentralised, and prosperous financial future” added Alicia as TOKEN2049 concluded.

About KuCoin

Launched in September 2017, KuCoin is a leading cryptocurrency exchange with its operational headquarters in Seychelles. As a user-oriented platform with a focus on inclusiveness and community engagement. It offers over 900 digital assets across Spot trading, Margin trading, P2P Fiat trading, Futures trading, and Staking to its 34 million users in more than 200 countries and regions. KuCoin ranks as one of the top 6 crypto exchanges. KuCoin was acclaimed as “One of the Best Crypto Apps & Exchanges of June 2024” by Forbes Advisor and has been included as one of the top 50 companies in the “2024 Hurun Global Unicorn List”. Learn more at https://www.kucoin.com/.

 

View original content to download multimedia:https://www.prnewswire.com/apac/news-releases/kucoins-alicia-kao-shares-insights-on-how-ai-is-accelerating-mass-crypto-adoption-at-token2049-singapore-302253908.html

SOURCE KuCoin

Continue Reading

Technology

PayPal Ventures Reinforces Support of Chaos Labs with Additional Investment

Published

19 mins ago

on

September 20, 2024

By

SINGAPORE, Sept. 20, 2024 /PRNewswire/ — Today, PayPal Ventures, the global venture capital arm of PayPal, announced an additional investment in Chaos Labs, an industry leader in onchain risk management. This investment underscores PayPal Ventures’ confidence in Chaos Labs’ potential and their blockchain products.

Chaos Labs’ recent launch of Edge, a new decentralized oracle protocol, has garnered significant attention within the industry. Edge has already secured a remarkable $30B over the last 2 months and has been adopted by leading exchanges such as Jupiter, the top perpetuals exchange on Solana, and GMX, the leading exchange on Arbitrum.

Edge offers a comprehensive, low-latency oracle solution, combining accurate price data with actionable market intelligence. Its advanced architecture ensures the security and efficiency of DeFi applications while providing insights into market dynamics and security risks. Edge monitors the market for specific risk signals, performs the offchain data parsing and computation, and outputs one actionable data point.

Omer Goldberg, CEO and Founder of Chaos Labs, said, “We’re excited to receive the strong confidence and additional support from the PayPal Ventures team. Edge by Chaos is the culmination of our entire company’s work and expertise. Edge Price, Risk, and Proofs deliver meaningful and unmatched contextualized risk and price data for assets including stablecoins and other real-world-assets, in addition to the crypto assets and venues that provide access to them.”

Last month, Chaos Labs announced a $55 million Series A funding round led by Haun Ventures, including prominent new investors such as F-Prime Capital, Slow Ventures, and Spartan Capital, and existing investors including PayPal Ventures. Chaos Labs has experienced significant growth, tripling its customer base and securing billions in trading volume, loans, and incentives.

PayPal Ventures’ investment aligns with PayPal’s ongoing commitment to the blockchain ecosystem. In May 2024, PayPal launched its stablecoin, PYUSD, on the Solana blockchain.

Amman Bhasin, Partner at PayPal Ventures, said, “Our continued investment in Chaos Labs reflects our belief in their vision to create a safer crypto ecosystem and move more financial services on chain. Chaos Labs has emerged as a leading risk authority in the sector and we are thrilled to witness their evolution as they launch innovative products like Edge to mitigate oracle vulnerabilities.”

Chaos Labs will receive the total investment in PYUSD on-chain. A simulation will be shown live on-stage on September 20th at the annual Solana Breakpoint conference in Singapore.

About Chaos Labs

Chaos Labs leads the blockchain risk management industry with innovative solutions for the evolving onchain financial landscape. Chaos Labs enables protocols to verify stability across all market conditions, merging offchain observability with onchain risk parameter adjustments. Backed by leading venture capital firms, Chaos Labs continues to set new standards for security and responsiveness in onchain finance. Founded in 2021, Chaos Labs is headquartered in New York City.

About PayPal Ventures

PayPal Ventures is the global corporate venture arm of PayPal. We invest for financial return in companies at the forefront of innovation in fintech, commerce enablement, digital infrastructure, and crypto/blockchain technologies. Through the expertise, experience, and vast network of PayPal Ventures – and the companies we invest in – we are helping to bring transformative solutions to market faster. For more information, please visit: www.paypal.vc 

 

View original content to download multimedia:https://www.prnewswire.com/news-releases/paypal-ventures-reinforces-support-of-chaos-labs-with-additional-investment-302253911.html

SOURCE Chaos Labs, Inc.

Continue Reading

Trending