At Arm, we recognize the importance of the latest research findings from academia and how they can help to shape future technology roadmaps. As a global semiconductor ambassador, we play a key role in academic engagements and refining the commercial relevance of their respective research.

Our approach is multifaceted, involving broad engagements with entire departments and focused collaborations with individual researchers. This ensures that we are not only advancing the field of computing but also fostering the talent that will lead the industry in the future.

Pioneering research and strategic investments in academia

A prime example of our broad engagement is our long-standing relationship with the University of Cambridge’s Depart of Computer Science and Technology. We’ve announced critical investment into the Department’s new CASCADE (Computer Architecture and Semiconductor Design) Centre. To realize the potential of AI through next-gen processor designs, this initiative will fund 15 PhD students over the next five years who will undertake groundbreaking work in intent-based programming.

Meanwhile, our work with the Morello program continues to push the boundaries of secure computing. This is a research initiative aimed at creating a more secure hardware architecture for future Arm devices. The program is based on the CHERI (Capability Hardware Enhanced RISC Instructions) model, which has been developed in collaboration with the University of Cambridge since 2015. By implementing CHERI architectural extensions, Morello aims to mitigate memory safety vulnerabilities and enhance the overall security of devices.

In the United States, our membership in the SRC JUMP2.0 program, a public-private partnership alongside DARPA (Defense Advanced Research Projects Agency) and other noted semiconductor companies, enables us to support pathfinding research across new and emerging technical challenges. One notable investment is the PRISM Centre (Processing with Intelligent Storage and Memory), which is led by the University of California San Diego, where we are deeply engaged in advancing the computing field.

Fuelling innovation through strategic PhD investments

Arm’s broad academic engagements are complemented by specific investments in emerging research areas, where the commercial impact is still being defined. PhD studentships are ideal for these exploratory studies, providing the necessary timeframe to progress ideas and early-stage concepts toward potential commercial viability. Examples include:

• A PhD at the University of Limerick developing next-generation automotive vision systems, supported by a cross-Arm collaboration.
• Ongoing funding to the Barcelona Supercomputing Centre for PhD students working on high-performance computing (HPC) and genomics workloads.
• A PhD studentship at the University of Utah exploring security and verification topics.

Shaping the future through research and technology

In areas where challenges are just being identified, Arm convenes workshops with academic thought leaders to scope future use cases and the fundamental experimental work needed to advance the field. Moreover, our white papers on Ambient Intelligence and the Metaverse are helping the academic community develop future research programs, acting as a springboard for further innovation.

Given our position in the ecosystem, we are often invited to provide thought leadership at academic conferences. Highlights from this year include:

• A keynote by Rob Dimond, a System Architect and Fellow at Arm, at the DATE conference in Valencia, a major event for our industry and academia.

• Simon Craske, a Lead Architect and Fellow at Arm, participated as a speaker at the inaugural IET REACH Computer Architecture Conference.

Reinforcing academic engagements by investing in future talent

Investing in PhDs is not just about research; it’s about nurturing the future talent pipeline for our industry. We also engage with governments and funding agencies to ensure that university research funding is targeted appropriately.

For instance, Andrea Kells sits on the EPSRC (UK) Science Advisory Team for Information and Communication Technologies and the Semiconductor Research Corporation (US) Scientific Advisory Board, which both link with the Arm Government Affairs team on research investments.

Check out Andrea’s webinar on advances and challenges in semiconductor design

Expanding global collaborations to drive technological marvels

Arm’s commitment to academic engagements spans the globe, reflecting our dedication to fostering innovation worldwide. In Asia for instance, we have initiated collaborations with leading institutions to explore new frontiers in semiconductor technology. Our partnership with the National University of Singapore focuses on developing power-efficient computing solutions, which are crucial for the next generation of mobile and IoT devices.

In Europe, beyond our engagements in the U.K. and Spain, we are also working with the Technical University of Munich on advanced research in quantum computing. This collaboration aims to address some of the most challenging problems in computing today, paving the way for breakthroughs that could revolutionize the industry.

Bridging academics and the industry for a brighter future

innovation and supporting the next generation of technology leaders. Our investments in academic engagements not only advance the field of semiconductor technology but also ensure that we remain at the forefront of technological progress.

As we continue to nurture upcoming talent, support groundbreaking research, and foster global collaborations, we are shaping the future of computing.

The post Arm: The Partner of Choice for Academic Engagements appeared first on Arm Newsroom.

Once again, CES 2025 in Las Vegas proved to be a premier event for showcasing the latest and greatest in technology innovation. This year’s event featured a host of groundbreaking products and announcements that will help to transform a broad range of industries.

Whether it was the significant advancements in autonomous driving, leading-edge technologies for consumer tech markets, or new partnerships, Arm’s presence at CES 2025 highlighted our dedication to driving technology innovation in the age of AI.

Arm’s landmark partnership with the Aston Martin Aramco Formula One Team

The big Arm announcement at CES 2025 was the new landmark multiyear partnership with the Aston Martin Aramco Formula One® Team, with Arm named as the team’s ‘Official AI Compute Platform Partner.’ In Formula One, Arm’s compute platform will drive advancements in AI and computing, helping Aston Martin Aramco push the boundaries of performance on and off the track.

Moreover, through this unique partnership, Arm and Aston Martin Aramco aim to:

• Accelerate equity and inclusivity for the future of STEM and motorsport as described in this blog;
• Encourage opportunities for women in STEM and motorsport, with Jessica Hawkins, Head of F1 Academy at Aston Martin Aramco, representing Arm as an Official Ambassador; and
• Empower the next generation of engineers, racers, and innovators. 

As part of a CES 2025 panel live stream, Ami Badani, Arm’s Chief Marketing Officer, and Dipti Vachani, SVP and GM of Arm’s Automotive Line of Business, sat down with Jessica and Charlie Blackwall, Head of Electronics at Aston Martin Aramco Formula One Team. They spoke about the new partnership and its commitment to driving technology innovation alongside greater equity and inclusivity in tech and motorsport.

Pioneering innovations with NVIDIA

On the Monday before the start of CES 2025, NVIDIA showcased its latest AI-based technology innovations in Jensen Huang’s keynote. Arm’s technology is playing a pivotal role in NVIDIA’s solutions for the next generation of consumer and commercial vehicles. Arm CPU cores are also central to NVIDIA’s new personal AI supercomputer that will deliver accessible high-performance AI compute to developers.

New AI capabilities for next-generation vehicles

During the NVIDIA keynote, Jensen Huang announced that the NVIDIA DRIVE AGX Thor, a centralized compute system that delivers advanced AI capabilities for a range of automotive applications, will be available for production vehicles later this year. This is the first solution to use Arm Neoverse V3AE, our first ever Neoverse CPU enhanced for automotive applications, with many leading automakers already making plans to adopt NVIDIA DRIVE AGX Thor for the next-generation of software-defined vehicles (SDVs). These include Jaguar Land Rover, Mercedes Benz and Volvo Cars.

Moreover, Toyota was added to the list of OEM partners adopting the Arm-based NVIDIA DRIVE Orin, alongside Lotus Eletre, Lucid, Polestar, Rivian, Zeekr, and Zoox, among others.

For more details on this collaboration, you can read Dipti Vachani’s news blog here.

High-performance AI at developers’ desks

NVIDIA also introduced Project DIGITS, a new personal AI supercomputer that makes it possible for every AI developer to have a high-performance AI system on their desk. This will help to democratize access to high-performance AI computing, enabling a new wave of innovation and research.

Project DIGITS is powered by the NVIDIA GB10 Grace Blackwell Superchip, which features 20 of Arm’s leading-edge CPU cores. Working with NVIDIA and our leading software ecosystem, we cannot wait to see how this new device brings the next generation of highly innovative AI applications to market.

For more insights into Project DIGITS and the GB10 features, you can read a blog from Parag Beeraka, Senior Director, Consumer Computing in the Client Line of Business, here.

The future of automotive is built on Arm

As the big screen at the entrance to the West Hall in the Las Vegas Convention Center said: “the future of automotive is built on Arm”, with 94 percent of global automakers using Arm-based technology in their newest vehicle models.

On the CES 2025 showfloor, this was apparent with a range of new vehicles featuring Arm-based technology, including Honda’s new family concept car called the SUV Zero. This caught the attention of Ami Badani and Will Abbey, Arm’s Chief Commercial Officer, during their CES 2025 show walkthrough, as shown in the video below.

A joint announcement from Renesas and Honda at event confirmed that the new SUV model will run on Arm-based technology, with Renesas signing an agreement with Honda to develop a high-performance system-on-chip (SoC) for the next-generation of SDVs. This will feature Renesas’ new 5th-Generation R-Car SoC that adopts Arm Cortex-A720AE CPU cores for application processing and Arm Cortex-R52 dual lockstep CPU cores for real-time processing.

Honda was represented on the Arm-sponsored session “Revolutionizing the Future of Driving – Unleashing the Power of AI“, which also featured representatives from the BMW Group, Nuro and Rivian. During the session, Dipti Vachani outlined how AI is helping to revolutionize the automotive industry across three key trends:

• Electrification;
• Autonomy; and
• The driver experience.

Hearing from the leading automotive companies represented on the panel, it was clear that scalable, consistent, power-efficient compute platforms are needed to deliver the next-generation of AI-enabled SDVs.

Dipti Vachani also participated in a “Six Five On The Road at CES 2025” discussion about how Arm aims to shape innovation in the automotive industry. This covered a range of topics, from the biggest technology trends for 2025 to Arm’s role across the automotive ecosystem.

Meanwhile, Arm technology was shown to be accelerating software across leading automotive applications throughout CES 2025. Mapbox, a leading platform for powering location experiences, demoed its new virtual platform, the Virtual Head Unit (VHU), which it developed in partnership with Arm and Corellium.

This creates virtual prototypes of the Arm-based in-vehicle hardware before seamlessly integrating these with Mapbox’s navigation stack. Automotive OEMs can use the new VHU to build maps how they want, and then test and render it their way at a quicker rate before deployment.

Elsewhere, AWS Automotive showed how Arm optimizations supported the development of its prototype chatbot-based application for the next-generation of SDVs.

New, innovative consumer tech solutions

As with every CES, the event in Las Vegas highlighted a broad range of the latest consumer technology innovations. On the showfloor, it was difficult to escape the broad range of new TV products, including the latest AI TVs – many of which would be powered by Arm technology. This also included brand-new smart displays that provide a range of information for the smart home or even images and video, like the fireplace in the video below.

However, one notable highlight for the TV market away from the showfloor was Eclipsa Audio. Developed by Google, Samsung, Arm, and the Alliance for Open Media, this new open-source technology delivers a three-dimensional (3D) audio experience, revolutionizing the way people experience sound. Through leveraging the Immersive Audio Model and Formats (IAMF), Eclipsa Audio produces immersive soundscapes, spreading audio vertically and horizontally to closely mimic natural settings.

Arm played a crucial role in the technology through optimizing the Opus codec and IAMF library to enable better performance on Arm CPUs. These enhancements ensure that Eclipsa Audio can deliver unparalleled performance across a variety of consumer devices, from high-end cinema systems to entry-level mobile devices and TVs.  

For more information on Eclipsa Audio, you can read the blog here.

Two new Arm-based XR products garnered significant attention at CES 2025. ThinkAR showcased its AiLens product series, which are lightweight AR smart glasses that offer intuitive experiences enhanced by powerful edge AI capabilities. The devices are powered by Ambiq’s ultra-efficient Apollo4 SoC, which features Arm technology.

Working in conjunction with SoftBank, the AiLens will cover a variety of applications and use cases, including healthcare, workplace productivity and training, retail, navigation and travel, education and skill development, and entertainment.

Moreover, XREAL displayed its new XREAL One Series AR smart glasses. Built on Arm Cortex-A CPU technology, these AR wearables offer impressive display capabilities on a very lightweight form factor, with users able to generate 3D objects through speaking to the devices.

Elsewhere at CES 2025, MediaTek highlighted the capabilities of its Arm-based Kompanio 838 for gaming and education on Chromebook devices. For gaming, all Android games can be played on Chromebook devices that are built on MediaTek’s Kompanio 838 processor. This provides a smooth and responsive experience for players. Meanwhile, its AI intelligence enhances camera capabilities for high-quality image capture and “text-to-image” translation, supporting education use cases for students.

Also leading OEM ASUS demonstrated its Chromebook CZ12, which is designed as a “rugged, student-centric study mate.” The device, which is powered by the Arm-based MediaTek 520 processor, aims to provide enriched educational experiences through a robust design that is easy for students to use.

Bringing advanced AI capabilities to edge and endpoint devices

Alif Semiconductor made waves at CES 2025 by announcing the integration of Arm’s Ethos-U85 NPU into its second generation of Ensemble microcontrollers (MCUs). These new Ensemble MCUs and fusion processors are designed to support generative AI workloads, enabling advanced AI capabilities at the edge and endpoint devices. This is particularly valuable for edge AI applications focused on vision, voice, text, and sensor fusion, providing instant, accurate, and satisfying user experiences without relying on the cloud.

Arm’s standardized Ethos NPU IP was chosen for its superior performance and efficiency, as well as its broad ecosystem support.

Sustainable AI for the future

On the last day of CES 2025, Ami Badani hosted a fascinating panel discussion with representatives from Meta and NVIDIA on “the key to powering a sustainable AI revolution.” All agreed that the next frontier of AI compute will require unprecedented compute power, with Arm, Meta and NVIDIA committed to power-efficient AI technologies and software from cloud to edge. The panel also discussed how the future of AI will see different models for different levels of performance and use cases, with AI resources being delivered more efficiently as part of this sustainable AI future.

Arm technology across every corner of CES 2025

With Arm technology touching 100 percent of the connected global population, AI innovations from our global partner ecosystem were across every corner of CES 2025. Alongside some incredibly exciting announcements, Arm’s presence at CES 2025 is setting the scene for the year ahead, with the Arm compute platform at the heart of all AI experiences.

The post Arm at CES 2025: AI Innovations and Technology Highlights appeared first on Arm Newsroom.

Imagine sitting in your living room and watching a movie. As the helicopter flies overhead, you can hear it moving seamlessly above you, and then from one side of the room to the other, creating a truly immersive experience. This is now possible because of Eclipsa Audio, based on Immersive Audio Model and Formats (IAMF), a new open-source audio technology that uses fast and efficient processing for a variety of common consumer products – from high-end cinema systems featuring premium TVs to entry-level mobile devices and TVs.

The technology was developed by Google, Samsung, Arm, and the Alliance for Open Media (the organization behind the popular AV1 video format), which was launched at the Consumer Electronics Show (CES) 2025. 

What is Eclipsa Audio? 

Eclipsa Audio is a multi-channel audio surround format that leverages IAMF to produce an immersive listening experience. It will revolutionize the way we experience sound by spreading audio vertically as well as horizontally. This creates a three-dimensional soundscape that closely mimics natural settings, bringing movies, TV shows, and music to life.  

Eclipsa Audio dynamically adjusts audio levels for different scenes, ensuring optimal sound quality. Additionally, it offers customization features that allow listeners to tweak the sound to their preferences, helping to ensure that every listening experience is personalized and unique. 

An Eclipsa Audio bitstream can contain up to 28 input channels, which are rendered to a set of output speakers or headphones. These input channels can be fixed, like a microphone in an orchestra, or dynamic, like a helicopter moving through a sound field in an action movie. 

Eclipsa Audio also features binaural rendering, which is essential for mobile applications when delivering immersive audio through headphones. Finally, the new audio technology supports content creation across consumer devices, enabling users to create their own immersive audio experiences. 

How Arm worked with Google during IAMF development

Arm has been a strategic partner throughout the development of IAMF, working closely with Google’s team to optimize the technology’s performance. Our contributions focused on enhancing the efficiency of the Opus codec and the IAMF library (libiamf), ensuring that it delivers the best possible performance on Arm CPUs that are pervasive across today’s mobile devices and TVs. 

Arm CPUs have included the NEON SIMD extension since 2005 and evolved significantly since then, providing remarkable performance boosts for DSP tasks like audio and video processing. For IAMF specifically, Arm’s engineers have focused on optimizations that allow real-time decoding of complex bitstreams with minimal CPU usage, ensuring reliable performance even when CPUs are busy processing other elements of the experience. This is particularly important for mobile applications where power efficiency is crucial. 

Performance Enhancements

Arm has been upstreaming patches to the opus-codec and libiamf, focusing on floating point implementations for optimal performance. These enhancements include: 

• NEON Intrinsic Optimizations: Supporting various Arm architectures (armv7+neon, armv8-a32, armv8-a64, and armv9), these optimizations speed up float to int16 conversion and soft clipping, and provide CPU-specific optimizations for matrix multiplication and channel unzipping in multi-channel speaker output. 

• Performance Improvements: Significant performance uplifts were observed across different speaker configurations (Stereo, 5.1, 9.1.6) on devices like Quartz64 and Google Pixel 7. For instance, 9.1.6 output showed over 160% improvement on the Arm Cortex-A55 CPU cores in the Pixel 7.  

• Decoding Efficiency: After optimizations, all test files decode in less than 16% of real-time on Aarch64 and less than 23% on Arm32, making them highly efficient on the Cortex-A55. 

Core Technologies

IAMF supports several codecs, including LPCM, AAC, FLAC, and Opus. Opus, being the most modern codec, is likely to be the preferred choice. We have further optimized Opus for the Arm architecture, ensuring it performs efficiently within the IAMF framework. 

The IAMF library (libiamf) decodes IAMF bitstreams and produces speaker output for various sound systems. Arm introduced a framework for CPU specializations, using compile-time feature detection to ensure the library is optimized for the platform it runs on. 

By optimizing key components like the Opus codec and libiamf library, our engineers ensured that IAMF delivers unparalleled performance on Arm CPUs. This not only enhances the user experience but also demonstrates the value of our technology in cutting-edge applications. 

IAMF’s open standard approach, supported by the Alliance for Open Media, aligns with Arm’s vision of broad accessibility and innovation. This partnership highlights our role in driving the future of immersive audio, making high-quality sound experiences available across a wide range of existing and future devices, from high-end home cinema systems to entry-level mobile devices and TVs. 

The future of immersive audio is here

IAMF represents a significant leap forward in immersive audio technology, offering a versatile and high-quality audio experience using AI and deep-learning techniques coupled with robust performance optimizations that are supported by Arm.  

The future of immersive audio is here and is now more accessible than ever. Whether you’re a casual listener or an audiophile, IAMF promises to transform audio experiences, bringing you closer to the action than ever before. 

The post Redefining Audio Experiences with Eclipsa Audio by Google, Samsung, Arm and the Alliance for Open Media appeared first on Arm Newsroom.

Equity and inclusivity are core pillars in the Arm DEI (Diversity, Equity, and Inclusion) strategy that helps to drive business and cultural impact within the company and beyond. That overarching commitment is also a vital part of the landmark multiyear partnership between Aston Martin Aramco Formula One® Team and Arm, announced at the Consumer Electronics Show (CES).

The Arm and Aston Martin Aramco commitment to equity and inclusivity

Both tech and motorsport have made substantial strides towards attracting more diverse talent and advancing equity and inclusivity. The partnership aims to accelerate this even further across STEM (Science, Technology, Engineering and Mathematics) and motorsport, and the synergy between these two industries provides fantastic opportunities for Arm and Aston Martin Aramco to work together to nurture diverse talent and leadership. The dual commitment of both organizations to driving equity and inclusivity while collaborating to deliver leading-edge technology platforms makes the partnership truly unique.

Ami Badani, Arm’s Chief Marketing Officer, is excited about the partnership and the benefits it will bring to technology and motorsport. She says: “We believe that if we’re going to change industries like technology and sport for good, then equity and inclusivity needs to be at the heart of everything we do. It was clear from the beginning of the partnership that both Arm and Aston Martin Aramco have shared values around equity and inclusivity, and a similar passion for technology innovation. Through working together in this new partnership, we will be making a meaningful impact in both of these areas.”

Inspiring and empowering future talent

One of the core aims of the partnership is educating and empowering the next generation of engineers, racers and innovators by equipping them with the engineering and technical skills and knowledge needed for a future career in either technology or motorsport. As part of the partnership, Jessica Hawkins, Head of the F1 Academy at Aston Martin Aramco, will represent Arm as an Official Ambassador. In addition, Arm will be actively investing in Jessica’s own career, supporting her growth as a racer and female leader in motorsport, including her ambitions to race at the 24 hours of Le Mans in an Aston Martin car and to be the first female Formula One driver.

Arm’s support as part of the new partnership also extends to the Aston Martin Aramco F1 Academy program led by Jessica, which was created to cultivate women in motorsport. It aims to change the dynamics of an industry where the vast majority of racers are men, yet women are the fastest growing fan base.

A “game-changing” new partnership

Dipti Vachani, SVP and GM of Arm’s Automotive Line of Business, is passionate about the new partnership and what it will bring to representation in STEM and motorsport, particularly Jessica’s own career.

She says: “I realized this new partnership would be truly game-changing when I had a conversation with Jessica for the first time. I felt inspired by her story and achievements and believe that with the right support, Jessica can go as far she can in her career. This partnership is all about showing women that they deserve a seat at the table in tech and sport, with Jessica doing just this for motorsport.”

Ami and Dipti both featured alongside Jessica and Charlie Blackwall, Head of Electronics at Aston Martin Aramco Formula One Team, at CES 2025 to speak about the new partnership, including equity and inclusivity across both industries. They highlighted their own experiences navigating the technology industry and passions to drive greater inclusion into the future of technology and motorsport.

The start of a unique new partnership

The Arm and Aston Martin Aramco partnership represents a truly exciting moment across technology and motorsport. Both Arm and Aston Martin Aramco will be working hard to accelerate equity and inclusivity in STEM and motorsport through driving greater opportunities for the next generation of diverse talent, all while building transformative leading-edge technologies. This is just the start of a truly unique partnership, so watch this space for future developments!

The post Arm and Aston Martin Aramco Formula One® Team Unite to Champion Equity and Inclusivity in STEM and Motorsport appeared first on Arm Newsroom.

At Arm, we are constantly thinking about the future of computing. From the latest architectural features to new technologies for silicon solutions, everything we create and design is geared towards how technology will be used and experienced in the future.

This is supported by our unique position in the technology ecosystem where we have a vast understanding of the global, interconnected and highly specialized semiconductor supply chain covering all markets, from IoT to datacenters and everything in between. This means we have a broad range of insights into the future direction of technology and key trends that are likely to emerge in the years ahead.

With this in mind, we have the following technology predictions for 2025 and beyond, covering all aspects of technology, from the future growth of AI to silicon designs to key trends across different technology markets. Read on to see what Arm thinks the year ahead will bring…

Silicon

A rethinking of silicon design with chiplets being part of this solution

From a cost and physics perspective, it is getting increasingly difficult to do traditional silicon tape-outs. The industry will need to rethink silicon designs and go beyond these traditional approaches. For example, there is a growing realization that not everything needs to be integrated on a single, monolithic chip, with new approaches like chiplets beginning to emerge as foundry and packaging companies find new ways to push the boundaries of Moore’s law, but under new dimensions.

The different implementation techniques of chiplets are getting more attention and having a deep impact on core architecture and micro-architecture. For chiplets, architects will need to be increasingly aware of what different implementations offer, whether it’s the manufacturing process node or the packaging technology, and then take advantage of the features for performance and efficiency benefits.

Chiplets are already addressing specific market needs and challenges, with this likely to advance in the years ahead. In the automotive market, chiplets can help companies achieve auto-grade qualifications during the silicon development process They can also help to scale and differentiate silicon solutions through utilizing different computing components. For example, chiplets focused on compute have a different number of cores, whereas memory-focused chiplets have different sizes and types of memories, so by combining and packaging these various chipsets at a system integrator level companies can develop a greater number of highly differentiated products.

The Moore’s Law “recalibration”

Moore’s Law has put billions of transistors on a chip, doubled performance and halved power every year. However, this continuous push for more transistors, more performance and less power on a single, monolithic chip is not sustainable. The semiconductor industry will need to rethink and recalibrate Moore’s Law and what it means to them.

Part of this means moving away from solely focusing on performance as the key metric and instead valuing performance per watt, performance per area, performance per power and total cost of ownership as core metrics during silicon design. There are also new metrics that focus on the implementation aspect of the system – which present the most challenges for development teams – and making sure performance is not degraded once the IP is integrated into a system-on-chip (SoC) and then the overall system. Therefore, this will involve continuous performance optimizations during silicon development and deployment. These metrics are more relevant to where the wider tech industry is heading, as it pushes for more efficient computing for AI workloads.

The growth of specialized silicon

The industry-wide push for specialized silicon will continue to grow. The rise of AI has put power consumption in focus, emphasizing that the datacenter can no longer be built around off-the-shelf computing solutions. Instead, the compute must be built and designed around specific datacenters and workloads. Across the industry, we have witnessed a movement towards custom silicon, particularly with leading cloud hyperscalers, including Amazon Web Services (AWS), Google Cloud and Microsoft Azure. In 2025, we expect this movement to continue with significant investment in technologies that allows leading technology companies to more rapidly design and deploy custom silicon, from ASIC services to chiplets.

True commercial differentiation in silicon solutions

The push for more specialized silicon will be part of the ongoing move for companies to deliver true commercial differentiation with their silicon solutions. A big part of this is the growing adoption of compute subsystems (CSS), which are core computing components that enable companies – big and small – to differentiate and customize their solutions, with each configured to perform or contribute towards specific computing functions or specialized functionalities.

The growing importance of standardization  

Standardized platforms and frameworks are vital to ensure the ecosystem can differentiate their products and services, adding true commercial value while saving time and costs. With the emergence of chiplets that integrate different computing components, standards will be more important than ever, as it will enable different hardware from different vendors to work together seamlessly. Arm is already working with more than 50 technology partners on the Arm Chiplet System Architecture (CSA) and expect more to join as part of this growing push towards standardization in the chiplet marketplace. In the automotive industry, this will be combined with SOAFEE that aims to de-couple hardware and software in software-defined vehicles (SDVs), leading to greater flexibility and interoperability between computing components and faster development cycles. 

Ecosystem collaboration on silicon and software like we have never seen before 

As the complexities of silicon and software continue to grow, no single company will be able to cover every level of silicon and software design, development and integration alone, with deep levels of ecosystem collaboration needed. This provides unique opportunities for different companies – big and small – to deliver different computing components and solutions based on their core competencies. This is especially relevant to the automotive industry, which needs to bring together the entire supply chain – from silicon vendors and Tier 1s to OEMs and software vendors – to share their expertise, technologies and products to define the future of AI-enabled SDVs and fulfil its true potential for the end-user. 

The rise of AI-enhanced hardware design

The semiconductor industry will see increased adoption of AI-assisted chip design tools, where AI helps optimize floor plans, power distribution, and timing closure. This approach will not only optimize performance results, but accelerate the development cycle of optimized silicon solutions and enable smaller companies to enter the market with specialized chips. While AI will not replace human engineers, it will become an essential tool in handling the growing complexity of modern chip design, particularly for power-efficient AI accelerators and edge devices.

AI

Significant investments into performant, power-efficient AI 

A topic at the forefront of everyone’s minds – governments, industry and society in general – is how to manage the increasing power and compute demands in the age of AI. Finding ways to limit the power consumption of large datacenters without compromising performance is paramount, especially with the world’s datacenters requiring 460 terawatt-hours (TWh) of electricity annually, which is the equivalent to the entire country of Germany. 

Performant, power efficient AI will be achieved through co-design of the entire system, with investments in both hardware and software. From a hardware perspective, further advancements in underlying processor technologies and CPU architecture will ensure that AI is processed as efficiently as possible. Specialized hardware will leverage these advancements to efficiently handle intensive AI workloads across all aspects of the datacenter, including network, storage, security, and data management. Meanwhile, new innovative software will optimize AI workloads, so they can operate with fewer resources while maintaining or improving performance. 

The continuous growth of AI inference

In the year ahead, AI inference workloads will continue to grow, helping to ensure that AI can be deployed widely and sustainably everywhere. This growth is being driven by the increasing number of AI-enabled devices and services. In fact, the majority of AI inference, which covers everyday AI use cases like text generation and summarization, can take place on smartphones and laptops, which provides more responsive and secure AI-based experiences for the end-user. In order to see this growth, devices must be built upon a bedrock which enables faster processing, lower latency and efficient power management. Two key Armv9 architecture features are SVE2 and SME2, which together combine to enable fast and efficient AI workloads on the Arm CPU.

The power of heterogenous computing in the AI era

It is clear that no individual piece of hardware or computing component will be the answer for all workloads. This is especially important as AI inference continues to permeate all aspects of compute across all types of devices, from smart thermostats to the datacenter. We have seen significant growth of AI accelerators in 2024 including from leading hyperscalers, but to leverage those accelerators for AI workloads requires a CPU platform. Arm Neoverse is providing a level of flexible computing that makes the coupling of an Arm CPU with an accelerator seamless, enabling new types of engineering creativity and development like we have seen with the Grace Blackwell superchip that pairs NVIDIA’s Blackwell GPU architecture with the Arm Neoverse-based Grace CPU. The Arm CPU is the most ubiquitous compute platform in the world, and we expect to see more of these heterogenous compute collaborations in 2025.

AI at the edge will grow in prominence

In 2024, we have seen an increasing number of AI workloads running at the edge – on device – rather than being processed in large datacenters. This means power and cost savings, as well as privacy and security benefits for consumers and businesses.

2025 will also likely see the emergence of sophisticated hybrid AI architectures that separate AI tasks between edge devices and the cloud. These systems will use AI algorithms in edge devices to detect events of interest before employing cloud models to provide additional information. Determining where to run AI workloads, locally or in the cloud, will be based on factors like available power, latency requirements, privacy concerns, and computational complexity.

Edge AI workloads represent a shift towards decentralized AI, enabling smarter, faster, and more secure processing on the devices closest to the data source, which will be particularly beneficial in markets that require higher performance and localized decision-making, such as industrial IoT and smart cities. 

The acceleration of smaller language models (SLMs)

Smaller, compact models with an increased compression, quantization and a decreasing number of parameters are evolving at a rapid rate. Examples include Llama, Gemma and Phi3, which are more cost-effective, efficient, and easier to deploy on devices with limited computational resources and we expect the number to grow in 2025. These models can run directly on edge devices, bringing enhanced performance and privacy.

We expect to see a rise in SLMs used for on-device tasks for language and device interactions, as well as vision-based tasks, such as interpreting and scanning for events. In the future, learnings will be distilled from larger models to develop local expert systems.

Multimodal AI models that can hear, see and understand more

Right now, large language models (LLMs), like GPT-4, are trained on human text. If these models are asked to describe a scene, they respond with a text-based description. However, we are beginning to see the advent of multimodal AI models that include text, images, audio, sensor data and many more. These multimodal models will deliver more advanced AI-based tasks through audio models that can hear, vision models that can see, and behavior models that can understand relationships between people and objects. These will give AI the ability to sense the world just as humans do – being able to hear, see and experience.

The growing use of AI agents

If users interact with AI today, they are likely to be interacting with a single AI that will do its best to complete the task requested on its own. With AI agents, a person still tells one AI that task required, but it would delegate this to a network of AI agents or bots. Examples of industries that have started using AI agents today include customer service support and coding assistants. We expect this to grow substantially in the year ahead across more industries, as AI becomes even more connected and intelligent. This will help to set the next stage for the AI revolution, leading to an even bigger impact on productivity for both our personal and work lives.

More powerful, intuitive, intelligent applications

Fueled by the rise of AI, there will be more powerful and personalized applications on devices. These will include more intelligent and intuitive personal assistants, and even personal physicians, with applications moving away from simply reacting to user requests, to making proactive suggestions based on the user and the environment they find themselves in. The move towards the hyper-personalization of AI through such applications will lead to an exponential rise in data usage, processing and storage, which supports the need for greater security measures and regulatory guidance from industry and governments.

Healthcare will be the key AI use case

Healthcare appears to be one of the leading use cases for AI, with this set to accelerate in 2025. Examples of AI for health use cases include predictive healthcare, digital record storage, digital pathology, the development of vaccines and gene therapy to help cure diseases. In 2024, the founders of DeepMind were awarded the Nobel Prize for Chemistry, as they worked with scientists to use AI to predict complex protein structures with 90 percent accuracy. Meanwhile, the use of AI has been shown to shorten the R&D cycle during the drug research process by 50 percent. The benefits of such AI innovations to society are significant, accelerating the research and creation of life-saving medicines. Furthermore, the combination of mobile devices, sensors and AI will allow users to have access to far better health data, so they can make more informed decisions about their own personal health.

A push towards “greener AI”  

The integration of sustainable practices within AI is set to accelerate. Alongside the use of power-efficient technologies, there could be an increasing focus on “greener AI” approaches. For example, in response to increasing energy demands, training AI models in lower-emission geographies and during periods of lower grid demand could evolve to become standard practice. By balancing energy loads on the grid, this approach will help mitigate peak demand stress and reduce overall emissions. Therefore, expect to see more cloud providers offering scheduling options for energy-efficient model training.

Other approaches could include optimizing existing AI models for efficiency, reusing or repurposing pre-trained AI models, and an uptake in “green coding” to minimize energy usage. We may also start to see the introduction of voluntary, then formal, standards for sustainable AI development as part of this wider move towards “greener AI.”

Advancements in renewable energy paired with AI

The combination of renewable energy and AI is expected to increase innovation across the energy sector. The reliability of renewable sources and lack of flexibility to balance peak loads currently limits energy grid decarbonization. However, we expect AI to help predict energy demand with greater accuracy, optimize grid operations in real-time, and enhance the efficiency of renewable energy sources to help tackle this. Energy storage solutions are also benefiting from AI, which optimizes battery performance and longevity that are crucial for balancing the intermittent nature of renewable energy sources.

AI integration not only offers solutions to the challenge of predicting and balancing peak demand, but also predicting maintenance. This reduces disruptions while smart grids leverage AI for real-time energy flow management and reduction of wastage. The advancements in AI paired with renewable energy promises significant improvements in efficiency and sustainability of energy systems.

Markets

Heterogeneous computing for all types of AI in IoT

The broad range of AI applications, particularly in IoT, will need to use different computational engines for different AI demands. To maximize the deployment of AI workloads, CPUs will remain a key focus for deployment on existing devices. New IoT devices will offer enhanced performance for AI with increased memory sizes and higher performance Cortex-A CPUs. Embedded accelerators, such as the latest Ethos-U NPUs, will be used to accelerate low power machine learning (ML) tasks, and bring power-efficient edge inference to a broader range of use cases such as industrial machine vision and consumer robotics.

Essentially, in the short term, we will see multiple compute elements used to serve the AI needs of specific applications. This trend will continue to emphasize the need for common tools, libraries and frameworks to enable application developers to make the most of the capabilities in the underlying hardware. There is no “one size fits-all” solution for edge AI workloads, highlighting the importance of a flexible compute platform for the ecosystem.

Increasing adoption of virtual prototypes to transform silicon and software development process (Automotive)

Virtual prototypes are accelerating silicon and software development cycles, with companies able to develop and test software before the physical silicon is ready. The benefits are particularly relevant to the automotive industry where the availability of virtual platforms is accelerating automotive development cycles by up to two years.

In 2025, we are expecting more companies to launch their own virtual platforms as part of this ongoing transformation of the silicon and software development process. These virtual platforms will work seamlessly, with Arm architecture offering ISA parity, ensuring uniformity in architecture in the cloud and at the edge. With ISA parity, the ecosystem can build their virtual prototype in the cloud and then seamlessly deploy at the edge. 

This saves significant time and costs, while giving developers more time to extract even greater performance from their software solutions. Following the introduction of the Armv9 architecture to automotive markets for the very first time in 2024, we expect to see more developers take advantage of this ISA parity in automotive and leverage virtual prototyping to build and deploy automotive solutions quicker. 

End-to-end AI will enhance automated driving systems

Generative AI technology is rapidly being adopted in end-to-end models that promise to address scalability barriers faced by traditional automated driving (AD) software architectures. With end-to-end self-supervised learning, AD systems are more capable of generalizing to cope with previously unseen scenarios. This novel approach promises an effective way of enabling faster scaling of operational design domains, making it quicker and cheaper to deploy AD technology from the highway to urban areas.

More hands-off driving, but more driver monitoring too

Progress in the harmonization of vehicle regulations for L2+ hands-off DCAS and L3 ALKS will accelerate wide deployment of these premium features worldwide. Leading automakers are already investing in equipping vehicles with the hardware necessary to up-sell these features through subscriptions throughout the lifetime of the vehicle.

In order to prevent driver misuse of driving automation systems, regulations and New Car Assessment Programs are focusing on increasingly sophisticated in-cabin monitoring systems like driver monitoring (DMS). In Europe, for example, EuroNCAP 2026’s new rating scheme will incentivize deeper integration of direct-sensing (e.g. camera-based) DMS with advanced driver assistance systems (ADAS) and AD features to provide adequate vehicle responses to different levels of driver disengagement. 

The smartphone is the primary consumer device for decades, not just years

The smartphone’s crown as the world’s primary consumer device will not be going away anytime soon. In fact, it is likely to be the go-to device for consumers for decades, not just years, with no device likely to offer a realistic challenge. With adoption of Armv9 growing across leading smartphones, this will mean more computing capabilities and better application experiences from new flagship smartphones in 2025 that will only reinforce this number one position. However, it is clear that consumers use different devices for different purposes, with the smartphone being primarily used for app use, web browsing and communication, whereas PCs and laptops are still seen as the “go-to” devices for productivity and work-based tasks.

It will also be interesting to see the emergence of AR wearables, like smart glasses, as the ideal companion device for the smartphone. A key reason behind the staying power of the smartphone is its ability to evolve, from apps to cameras to gaming, and now the industry is seeing the emergence of new usage models for AR, with the smartphone beginning to support AR-based experiences from wearable devices.

The ongoing miniaturization of technology

Across the tech industry, we are seeing smaller, sleeker devices, like AR smart glasses and smaller wearable tech. This is being made possible through a combination of factors. Firstly, the adoption of power-efficient technologies that offer the performance required to support key device features and experiences. Secondly, in the case of AR smart glasses, we are now seeing the adoption of ultra-thin silicon carbide technologies that not only enable high-definition displays, but also dramatically reduce the thickness and weight of the devices. Finally, new compact language models are transforming AI-based experiences across these smaller devices, making them more immersive and interactive. The powerful combination of power-efficiency, lightweight hardware and smaller AI models will be a driver for the growth of smaller, more capable consumer devices in the next year. 

The continuous rise of Windows on Arm

In 2024, the Windows on Arm (WoA) ecosystem saw significant progress, with the most widely used applications now providing Arm-native versions. In fact, 90 percent of the time spent by the average Windows user will be with applications that are now Arm-native. One recent example is Google Drive, which released an Arm-native version at the end of 2024. We expect this momentum to continue throughout 2025 and lead to WoA becoming even more appealing for both developers and consumers, as demonstrated by the impressive performance enhancements for Arm-native applications, like Google Chrome, that are essential to everyday user experiences.

The post Arm Tech Predictions for 2025 and Beyond appeared first on Arm Newsroom.

2024 was the year of the Arm compute platform for AI, with significant announcements, products and initiatives that made this a reality. Here’s the Arm A to Z of what we achieved in the past year.

A is for Automotive Enhanced (AE), with a brand-new suite of technologies announced for the automotive market, including the first times we introduced Neoverse beyond server markets and Armv9 CPUs to the automotive market. This was alongside SOAFEE reaching 150 members from across the entire automotive supply chain.

B is for Bears, with Arm-based AI being used to identify bears as part of the BearID wildlife conservation project, which was discussed in two Arm Viewpoints podcast episodes here and here.

C is for Compute Subsystems (CSS), with Arm launching two new Neoverse CSS built on brand-new third-generation Neoverse IP and CSS for Client with verified implementations of new Arm CPUs and GPUs, while a new CSS for Automotive was announced for 2025.

D is for Developers, with over 20 million software developers worldwide building their applications on the Arm compute platform, developer engagement continued throughout 2025 via leading industry events, like GitHub Universe, Microsoft Build and Ignite, KubeCon NA, PyTorch Conference, and AWS re:Invent, Even the ever-growing Arm Developer Program hit 13,000 members in 2024.

E is for Edge AI, with the new Arm Ethos-U85 NPU offering support for transformer networks, which, when combined with Arm CPUs, accelerates edge AI for IoT applications that demand higher performance and localized real-time decision making.

F is for Frederique Olivier, a wildlife photographer and explorer who uses Arm-based tech to capture stunning visuals and footage. Her story was featured as part of the ‘Purpose on Arm’ collaboration with National Geographic.

G is for GitHub, with a combination of the new Arm extension for GitHub Copilot, GitHub Actions, native GitHub runners and AI frameworks all supported on Arm, which unlocks simplified AI workflows and deployments from cloud to edge for millions of developers worldwide.

H is for Heterogenous computing, with the Arm compute platform providing the flexibility for partners to use and integrate different computational engines, including accelerator technologies, in specialized silicon solutions for different AI use cases and demands.

I is for Influence, with Arm’s role as a global semiconductor ambassador facilitating vital discussions on security and AI at a G7 Semiconductor Experts Working Group hosted at Arm’s global HQ in Cambridge, UK.

J is for Jensen Huang who featured as the first guest on the new Tech Unheard podcast, which is hosted by Arm CEO Rene Haas. Expect more podcast episodes with tech industry leaders, with the second episode featuring Mike Gallagher, Head of Defense at Palantir Technologies, and a former Congressman and Marine.

K is for Kleidi, Arm’s new CPU acceleration software, which seamlessly integrates with leading frameworks to ensure AI workloads run best on the Arm CPU, with developers then able to access this accelerated performance. Kleidi has already been integrated into Meta’s ExecuTorch and PyTorch, Google’s MediaPipe and Tencent’s Hunyuan.

L is for Llama, with the Arm and Meta collaboration enabling the new Llama 3.2 Large Language Models (LLMs) on optimized Arm CPUs when running a range of AI inference workloads.   

M is for Mobile Generative AI, with a range of use cases, including virtual chatbots, group chat and voice note summarization and real-time assistant, possible on Arm-powered mobile devices, like the latest AI flagship smartphones, via the Arm CPU.

N is for the Nasdaq-100 Index, which represents a collection of the top 100 largest and most actively traded companies on the Nasdaq stock exchange, with Arm among the fastest companies to be included in the index post-IPO.

O is for One Hundred (100) billion Arm-powered devices from cloud to edge that will be AI-ready by the end of 2025, as announced by Rene Haas during his 2024 COMPUTEX keynote.

P is Power efficiency, with Arm’s mission to tackle the insatiable energy demands of AI in the datacenter through our power-efficient compute platform.

Q is for Quantum Computing, with Equal1 successfully testing its Arm-based quantum chip in cryogenic temperatures.

R is for the Role of Arm in enabling a thriving the emerging chiplet marketplace through ecosystem collaboration on standards and a common framework, and supporting partners to develop next-generation chiplet silicon solutions, like those from Alphawave Semi and Rebellions.

S is for SOX (the PHLX Semiconductor Index), which Arm was added to in September 2024 in recognition of our rapid growth as a company, with SOX representing 30 of the largest eligible semiconductor companies listed in the U.S. ranked by market capitalization.

T is for Total Design, with the number of Arm Total Design members doubling since the ecosystem was formed in 2023. This has led to powerful ecosystem collaborations that are accelerating the development and deployment of specialized silicon solutions, including chiplets, for the cloud and datacenter.

U is for Unlocking new possibilities in the cloud, with leading partners including AWS, Google Cloud and Microsoft announcing a range of hardware and software innovations to support developers’ cloud workloads.

V is for Virtual Platforms, with a range of automotive partners launching their own Arm-based virtual prototyping solutions to accelerate silicon and software development.

W is for Windows on Arm (WoA) momentum, with the most widely used applications now Arm-native, which is bringing performance benefits to WoA users, such as those highlighted in the new Arm-native Google Chrome.

X is for Cortex-X, with the new Arm Cortex-X925 CPU setting the industry-standard for performance and efficiency.

Y is Young Sohn, the latest appointment to the Arm Board of Directors, with Charlotte Eaton also being appointed as the new Arm Chief People Officer.

Z is for Net Zero, with the 2024 Arm Sustainable Business Report providing comprehensive information about how Arm positively impacts the environment, our people and society as a whole.

We cannot wait to see what 2025 brings, with Arm continuing to be the prominent force that is driving all AI experiences.

The post The Arm A to Z in 2024: The Compute Platform for AI appeared first on Arm Newsroom.

Each year kicks off with the Consumer Electronics Show (CES), which showcases the latest and greatest tech innovations from the world’s technology companies, big and small. At CES 2024, AI took center stage, with attendees demoing their latest AI-based tech solutions, including many of Arm’s partners from automotive, consumer technology and IoT markets.

At CES 2025, we anticipate that AI will remain front and center at the event, as it continues to expand and grow at a rapid rate. In fact, Ami Badani, Arm’s Chief Marketing Officer, will be talking with industry leaders, including Meta and NVIDIA, on how to power a sustainable AI revolution. However, we also expect to see more specific tech trends emerging that will set the tone for innovation for the rest of the year.

This blog outlines these trends, and how Arm and our partners are playing leading roles across each one. These include:

• Autonomous driving innovations;
• More AI coming to the car;
• Accelerating automotive software development;
• AI-powered smart home devices, including the TV;
• Momentum around Arm-based PCs and laptops;
• Driving XR tech adoption; and
• The rise of high-performance edge AI.

Autonomous driving innovations

2024 saw various technology innovations that are set to take us closer to fully-fledged autonomous vehicles on the roads. The collaboration between Arm and Nuro is helping to accelerate this future, with the Nuro Driver integrating Arm’s Automotive Enhanced (AE) solutions for more intelligent and advanced autonomous experiences in cars. NVIDIA will bring Arm Neoverse-V3AE to its upcoming DRIVE Thor for next-generation software-defined vehicles (SDVs). Several leading OEMs have already announced plans to adopt the chipset for their automotive solutions, including BYD, Nuro, XPENG, Volvo and Zeekr. We expect CES 2025 to highlight the latest technology solutions and collaborations that will define the future of autonomous driving in the year ahead and beyond.

More AI coming to the car to enhance the driver experience

Across in-vehicle infotainment (IVI) and advanced driver assistance systems (ADAS), there have been various OEM innovations in the past year, with AI models being integrated into these systems. For example, Mercedes-Benz is using Chat-GPT for intelligent virtual assistants within its vehicles. It will be fascinating to see the broad range of OEM innovations on display at CES 2025, with 94 percent of global automakers using Arm-based technology for automotive applications. This is alongside the top 15 automotive semiconductor suppliers in the world adopting Arm technologies in their silicon solutions.

As a technology thought leader in the automotive industry, Dipti Vachani, Arm’s SVP and GM for the Automotive Line of Business, will be participating in a CES 2025 panel with leading OEMs, including BMW, Honda and Rivian, as well as Nuro, on revolutionizing the future of driving through unleashing the power of AI. The panel will discuss the technological impacts of AI on future vehicle designs.

However, hardware innovation is only as strong the software to run on it, which is why we are looking forward to AWS, Elektrobit, LeddarTech, and Plus.AI highlighting their latest AI-enabled solutions at CES 2025. AWS will be showcasing its new generative AI-powered voice-based user guide for inside the vehicle, which runs on virtual hardware in the cloud before running on the physical instance in the car. The chatbot-based solution allows users to interact with the car on its features and dashboard information, with the AI small language model (SLM) being continuously kept up-to-date via software.

Other AI-based in-vehicle demos include the US debut of Elektrobit’s first functional safety compliant Linux operating system (OS) for automotive applications, the EB corbos Linux, which has been announced as a 2025 Honoree in Vehicle Tech and Advanced Mobility in the CES 2025 Innovation Awards. LeddarTech, which is already optimizing its ADAS perception and fusion algorithms through utilizing the latest Arm AE solutions and virtual platforms, will display its latest LeddarVision software for SDVs. Meanwhile, Plus.AI will be highlighting their latest AI-based autonomous driving software solutions, demonstrating how its autonomous driving technology stack can scale across all levels of autonomy for passenger cars and commercial vehicles, with this running on any Arm-based hardware.  

Accelerating automotive software development

As the automotive industry evolves to introducing more SDVs on the road, accelerating software development is becoming critical. In 2024, as part of our launch of new automotive technologies, we announced a range of new virtual platforms from our partners. These are transforming the silicon design, development and deployment process, as the virtual platforms allow our partners to develop and test their software before physical hardware is ready. This accelerates development times and leads to a faster time-to-market.

Tata Technologies will be presenting its cloud-to-car demo, which showcases technologies from all four members of the SDV Alliance – which was launched at CES 2024 – that run both on physical Arm-based hardware and on virtual platforms running in an AWS Graviton-powered cloud instance. Meanwhile, AWS will also be showcasing its Graviton G4 hosted Arm RD-1AE reference implementation running on a Corellium virtual platform. Finally, QNX is using CES 2025 to show how developers can create their own innovative cross-platform solutions through its highly accessible software.

The value of ecosystem collaborations in automotive

At CES 2025, we expect to see a range of automotive partners highlighting the value of ecosystem collaborations to support the development and deployment of software in vehicles. This includes Mapbox, a leading platform for powering location experiences for automakers such as BMW, General Motors, Rivian and Toyota, which recently launched its own virtual platform solution, the Virtual Head Unit (VHU), in partnership with Arm and Corellium. The solution empowers leading automakers to expedite the integration, testing, and validation of their navigation systems.

There will also be a range of SOAFEE members highlighting their latest Blueprints at the event. LG will be introducing the LG PICCOLO, which enhances its Battery Management System (BMS) from a solution that has limited update capabilities to one that can be continuously updated and customized with new scenarios at any time. We have been working with LG to integrate BMS and LG PICCOLO into the cloud virtual platform for the Arm RD1-AE, allowing for virtual validation, lower costs and a quicker time-to-market before deployment to the vehicles. In addition, Tier IV and Denso will showcase their SOAFEE Open AD kit Blueprints for autonomous driving, and Red Hat will highlight its mixed-critical demo to improve security and safety in SDVs.

AI-powered smart home devices, including the TV

Previous CES events have demonstrated the possibilities of true integration across smart home devices and applications, like heating, lighting and security, with the TV at the center of these experiences. This is likely to continue at CES 2025, as the smart home effectively becomes a “smart assistant” that adjusts settings in the home based on user preferences, from temperature and light settings to playing music.

It will also be interesting to see the range of new AI-powered features and applications in next-generation TVs on display at CES. This started with picture quality enhancements and content recommendations, but AI in the TV is now powering a range of new use cases, including health and fitness through body tracking via the smart camera. CES 2025 is likely to unearth yet more fascinating AI use cases for the TV, including new immersive experiences.  

Moreover, as with previous CES events, the latest premium TVs will be on full display. These include new leading-edge Arm-powered TVs from LG, Hisense, Samsung and TCL. CES 2024’s “showstopper” TV product was LG’s transparent TV, so it will be interesting to see what will take the crown in 2025.

Momentum around Arm-based PCs and Laptops

In 2024, there was significant progress with the Windows on Arm (WoA) ecosystem with the most widely used applications on PC and laptop now providing Arm-native versions. Most recently, Google released an Arm-native version of Google Drive for WoA. This continuous momentum means WoA is an increasingly attractive area of tech for the wider ecosystem. We also expect a range of hardware for AI PCs to be highlighted at the event. This includes MediaTek’s Kompanio SoCs for Chromebook devices that are increasingly adopting new AI-based features.

Driving XR tech adoption

2024 saw significant XR tech innovation, with new AR smart glasses, like Snap’s fifth-generation Spectacles, Meta’s next-generation Ray-Ban, and Meta’s Orion smart glasses, being launched and announced. Hardware advancements, including touch screens and camera miniaturization, as well as software improvements in applications and operating systems, have created opportunities for XR wearable devices to become more mainstream.

CES 2025 will provide the perfect platform to highlight further innovation in the XR space, whether this is new wearable devices or supporting tech and apps. For example, SoftBank-backed ThinkAR will be showcasing its range of wearable devices, including AI smart glasses and wearable AI assistants. Meanwhile, there will be AI updates to current generation XR wearable products, like Meta’s Ray-Ban AR smart glasses.

The rise of high-performance edge AI

CES 2024 saw a range of low power IoT products from Arm partners showcasing edge AI capabilities, enabling use cases like presence, face and gesture detection, and natural language processing. At CES 2025, we expect a step-up in edge AI through higher performance use cases on IoT devices, like localized decision-making, real-time data processing and responses, and autonomous navigation. These are particularly beneficial for applications servicing primary industries, as well as smart cities, industrial IoT and robotics, where quick responses to environments are crucial for functionality and safety.

Looking at the shortlist for the CES 2025 Innovation Awards, there are a range of innovative Arm-powered tech products across IoT industries that are showcasing advanced edge AI use cases. For industrial IoT and robotics, R2C2 ARIII is a robot brain that enhances autonomous industrial inspection, while DeepRobotics is demoing its Lynx four-foot robotic dog for diverse terrains. Elsewhere, SoftBank-backed Aizip is highlighting its on-device edge AI application for high-accuracy fish counting in underwater environments.

CES runs on Arm

With unmatched scale that touches 100 percent of the connected global population, we fully expect the Arm compute platform to feature heavily across many of the technologies on display at CES 2025. We will be kicking off the new year through showing the world that Arm is at the heart of AI experiences, with CES running on Arm-powered technology.

To get the latest Arm CES 2025 updates visit here.

We look forward to meeting with you at the event!

The post The Tech Trends to Look Out For at CES 2025 appeared first on Arm Newsroom.

As we move into the era of advanced computing, Arm is leading the charge with groundbreaking tech innovations. November 2024 has been a month of significant strides in technology innovation, particularly in AI, machine learning (ML), Arm Neoverse-based Kubernetes clusters, and system-on-chip (SoC) architecture.   

The Arm Editorial Team has highlighted the cutting-edge tech innovations that happened at Arm in November 2024 – all of which are set to shape the next generation of intelligent, secure, and high-performing computing systems. 

Harnessing SystemReady to drive software interoperability on Arm-based hardware

Arm’s SystemReady program ensures interoperability and standardization across Arm-based devices. Dong Wei, Standards Architect and Fellow at Arm, talks about how the program benefits the industry by reducing software fragmentation, lowering development costs, and enabling faster deployment of applications on a wide range of Arm hardware. Meanwhile, Pere Garcia, Technical Director at Arm, discusses the certification benefits of SystemReady, including how it simplifies software deployment across different Arm devices, reduces fragmentation, and enhances the reliability of embedded systems.   

Building safe, secure, and versatile software with Rust on Arm

The Rust programming language enhances safety and security in software development for Arm-based systems by eliminating common programming errors at compile time. In the first blog of this three-part Arm Community series, Jonathan Pallant, Senior Engineer and Trainer at Ferrous Systems, explains why Rust’s unique blend of safety, performance, and productivity has gained attention from government security agencies and the White House.

This blend delivers a robust toolchain for mission-critical applications, reduces vulnerabilities, and improves overall software reliability. Part 2 and Part 3 from Jonathan Pallant provides more insights.  

Boosting efficiency with Arm Performance Libraries 24.10

Arm Performance Libraries 24.10 enhance math libraries for 64-bit Arm processors, boosting efficiency in numerical applications with improved matrix-matrix multiplication and Fast Fourier Transforms. Chris Goodyer, Director, Technology Management at Arm, highlights significant speed improvements, including a 100x increase in the Mersenne Twister random number generation. This offers faster, more accurate computations for engineering, scientific, and ML applications across Linux, macOS, and Windows.  

Enabling real-Time sentiment analysis on Arm Neoverse-based Kubernetes clusters

Real-time sentiment analysis on Arm Neoverse-based Kubernetes clusters enables businesses to efficiently process social media data for actionable insights. Na Li, ML Solutions Architect at Arm, demonstrates how AWS Graviton instances with tools like Apache Spark, Elasticsearch, and Kibana provide a scalable, cost-effective framework adaptable across cloud providers to enhance analytics performance and energy efficiency. 

Enhancing control flow integrity with PAC and BTI on AArch64

Enabling Pointer Authentication (PAC) and Branch Target Identification (BTI) on the AArch64 architecture strengthens control flow integrity and reduces gadget space, making software more resilient to attacks. In the first blog of this three-part Arm Community series, Bill Roberts, Principal Software Engineer at Arm, explores how these features enhance security, minimize vulnerabilities, and improve software reliability. Part 2 and Part 3 provide further insights around PAC and BTI. 

Harnessing Arm’s Scalable Vector Extension (SVE) in C#

.NET 9’s support for Arm Scalable Vector Extension (SVE) allows developers to write more efficient vectorization code. Alan Hayward, Staff Software Engineer, highlights how using SVE in C# improves performance and ease of use, enabling more optimized applications on Arm-based systems.  

Expanding Arm on Arm with the NVIDIA Grace CPU

The NVIDIA Grace CPU, built on Arm Neoverse V2 cores, enhances performance, reduces costs, and improves energy efficiency for high-performance computing (HPC) and data center workloads. Tim Thornton, Director Arm on Arm, discusses how the NVIDIA Grace CPU Superchip-based servers enable Arm to deploy high-performance Arm compute in their own data centers, providing access to the same Neoverse V2 cores used in AWS and Google Cloud.  

Accelerating ML development with Corstone-320 FVP: A guide for Arm Ethos-U85 and Cortex-M85

The benefits of the new Arm Corstone-320 Fixed Virtual Platform (FVP) include developing and testing ML applications without physical hardware. Zineb Labrut, Software Product Owner in Arm’s IoT Line of Business, highlights how this platform accelerates development, reduces costs, and mitigates risks associated with hardware dependencies, making it a valuable tool for developers in the embedded and IoT space.

Real-time Twitter/X sentiment analysis on the Arm Neoverse CPU: A KubeCon NA 2024 demo 

Pranay Bakre, a Principal Solutions Engineer at Arm, demonstrates the power of an Arm Neoverse-based CPU as it runs a real-time Twitter/X sentiment analysis program using a StanfordNLP model during KubeCon North America 2024. More information can also be found in this blog.

Learning all about the Fragment Prepass for Arm Immortalis and Mali GPUs

The latest Arm GPUs for consumer devices – the Immortalis-G925, Mali-G725 and Mali-G625 – all adopt a new feature called the Fragment Prepass. Tord Øygard, a Principal GPU Architect at Arm, provides more details about this Hidden Surface Removal technique in this Arm Community blog, which leads to improved performance and power efficiency when processing geomerty workloads for graphics and gaming.

Elsewhere with graphics and gaming at Arm, Ian Bolton, Staff Developer Relations Manager, summarized Arm’s involvement in the inaugural AI and Games Conference in this Arm Community blog.

Exploring .NET 9 and Arm’s SVE with Microsoft and VectorCamp’s simd.info

In the latest “Arm Innovation Coffee”, Kunal Pathak from Microsoft dives into .NET 9 and Arm’s SVE, while Konstantinos Margaritis and Georgios Mermigkis from VectorCamp showcase simd.info, a cutting-edge online reference tool for C intrinsics across major SIMD engines. 

Built on Arm partner stories: AI, automotive, cloud and Windows on Arm

Insyde Software CTO Tim Lewis highlights their groundbreaking AI BIOS product, which leverages AI to simplify firmware settings, and showcases their expertise in developing firmware for everything from laptops to servers. Lewis also explains how collaborating with Arm is driving innovation in power management and security. 

Tilo Schwarz, VP and Head of Autonomy at Nuro, discusses the innovative Nuro Driver, a state-of-the-art software and hardware solution powering autonomous driving technology, and explains how its partnership with Arm is shaping the future of modern transportation. 

Bruce Zhang, Computing Product Architect at Alibaba, discuss how Arm and Alibaba are accelerating AI workloads in the cloud and enabling robust applications that are transforming industries.

Francis Chow, VP and GM of the Edge Business at Red Hat, explains how Red Hat’s solutions, which run on Arm technologies, incorporate leading-edge performance, power efficiency and real-time data processing features as part of the industry-wide move to modern software-defined vehicles.

Aidan Fitzpatrick, CEO and Founder of Reincubate, a London-based software company, talks about the benefits of Windows on Arm to their flagship application Camo, which enables users to create high-quality video content. Main benefits include advanced AI-powered features and performance without sacrificing battery life.

Exploring the latest Trends in the automotive and connected vehicle space

As part of a panel at Reuters Event Automotive USA, Dipti Vachani, SVP and GM of the Automotive Line of Business at Arm, highlights the latest trends and challenges in the automotive and connected vehicle space.  

The post Beyond the Newsroom: Exploring Tech Innovations from Arm in November 2024 appeared first on Arm Newsroom.

The Arm Tech Symposia 2024 events in China, Japan, South Korea and Taiwan were some of the biggest and best attended events ever held by Arm in Asia. The size of all the events was matched by the enormity of the occasion that is being faced by the technology industry.

As Chris Bergey, SVP and GM of Arm’s Client Line of Business, said in the Tech Symposia keynote presentation in Taiwan: “This is the most important moment in the history of technology.”  

There are significant opportunities for AI to transform billions of lives around the world, but only if the ecosystem works together like never before.

A re-thinking of silicon

At the heart of these ecosystem collaborations is a broad re-think of how the industry approaches the development and deployment of technologies. This is particularly applicable to the semiconductor industry, with silicon no longer a series of unrelated components but instead becoming “the new motherboard” to meet the demands of AI.

This means multiple components co-existing within the same package, providing better latency, increased bandwidth and more power efficiency.

Silicon technologies are already transforming the everyday lives of people worldwide, enabling innovative AI features on smartphones, like the real-time translation of languages and text summarization, to name a few.

As James McNiven, VP of Product Management for Arm’s Client Line of Business, stated in the South Korea Tech Symposia keynote: “AI is about making our future better. The potential impact of AI is transformative.”

The importance of the Arm Compute Platform

The Arm Compute Platform is playing a significant role in the growth of AI. This combines hardware and for best-in-class technology solutions for a wide range of markets, whether that’s AI smartphones, software-defined vehicles or data centers.

This is supported by the world’s largest software ecosystem, with more than 20 million software developers writing software for Arm, on Arm. In fact, all the Tech Symposia keynotes made the following statement: “We know that hardware is nothing without software.”

How software “drives the technology flywheel”

Software has always been an integral part of the Arm Compute Platform, with Arm delivering the ideal platform for developers to “make their dreams (applications) a reality” through three key ways.

Firstly, Arm’s consistent compute platform touches 100 percent of the world’s connected population. This means developers can “write once and deploy everywhere.”

The foundation of the platform is the Arm architecture and its continuous evolution through the regular introduction of new features and instruction-sets that accelerate key workloads to benefit developers and the end-user.

SVE2 is one feature that is present across AI-enabled flagship smartphones built on the new MediaTek Dimensity 9400 chipset. It incorporates vector instructions to improve video and image processing capabilities, leading to better quality photos and longer-lasting video.

Secondly, through having acceleration capabilities to deliver optimized performance for developers’ applications. This is not just about high-end accelerator chips, but having access to AI-enabled software to unlock performance.

One example of this is Arm Kleidi, which seamlessly integrates with leading frameworks to ensure AI workloads run best on the Arm CPU. Developers can then unlock this accelerated performance with no additional work required.

At the Arm Tech Symposia Japan event, Dipti Vachani, SVP and GM of Arm’s Automotive Line of Business, said: “We are committed to abstracting away the hardware from the developer, so they can focus on creating world changing applications without having to worry about any technical complexities around performance or integration.”

This means that when the new version of Meta’s Llama, Google AI Edge’s MediaPipe and Tencent’s Hunyuan come online, developers can be confident that no performance is being left on the table with the Arm CPU.

Kleidi integrations are set to accelerate billions of AI workloads on the Arm Compute Platform, with the recent PyTorch integration leading to 2.5x faster time-to-first token on Arm-based AWS Graviton processors when running the Llama 3 large language model (LLM).

Finally, developers need a platform that is easy to access and use. Arm has made this a reality through significant software investments that ensure developing on the Arm Compute Platform is a simplified, seamless experience that “just works.”

As each Arm Tech Symposia keynote speaker summarized: “The power of Arm and our ecosystem is that we deliver what developers need to simplify the process, accelerate time-to-market, save costs and optimize performance.”

The role of the Arm ecosystem

The importance of the Arm ecosystem in making new technologies a reality was highlighted throughout the keynote presentations. This is especially true for new silicon designs that require a combination of core expertise across many different areas.

As Dermot O’Driscoll, VP, Product Management for Arm’s Infrastructure Line of Business, said at the Arm Tech Symposia event in Shanghai, China: “No one company will be able to cover every single level of design and integration alone.”

Empowering these powerful ecosystem collaborations is a core aim of Arm Total Design, which enables the ecosystem to accelerate the development and deployment of silicon solutions that are more effective, efficient and performant. The program is growing worldwide, with the number of members doubling since the program was launched in late 2023. Each Arm Total Design partner offers something unique that accelerates future silicon designs, particularly those that are built on Arm Neoverse Compute Subsystems (CSS).

One company that exemplifies the spirit and value of Arm Total Design is South Korea-based Rebellions. Recently, it announced the development of a new large-scale AI platform, the REBEL AI platform, to drive power efficiency for AI workloads. Built on Arm Neoverse V3 CSS, the platform uses a 2nm process node and packaging from Samsung Foundry and leverages design services from ADtechnology. This demonstrates true ecosystem collaboration, with different companies offering different types of highly valuable expertise.

Dermot O’Driscoll said: “The AI era requires custom silicon, and it’s only made possible because everyone in this ecosystem is working together, lifting each other up and making it possible to quickly and efficiently meet the rising demands of AI.”

Arm Total Design is also helping to enable a new thriving chiplet ecosystem that already involves over 50 leading technology partners who are working with Arm on the Chiplet System Architecture (CSA). This is creating the framework for standards that will enable a thriving chiplet market, which is key to meeting ongoing silicon design and compute challenges in the age of AI.

The journey to 100 billion Arm-based devices running AI

All the keynote speakers closed their Arm Tech Symposia keynotes by reinforcing the commitment that Arm CEO Rene Haas made at COMPUTEX in June 2024: 100 billion Arm-based devices running AI by the end of 2025.

However, this goal is only possible if ecosystem partners from every corner of the technology industry work together like never before. Fortunately, as explained in all the keynotes, there are already many examples of this work in action.

The Arm Compute Platform sits at the center of these ecosystem collaborations, providing the technology foundation for AI that will help to transform billions of lives around the world.

The post Arm Tech Symposia: AI Technology Transformation Requires Unprecedented Ecosystem Collaborations appeared first on Arm Newsroom.

As developers and platform engineers seek greater performance, efficiency, and scalability for their workloads, Arm-based cloud services provide a powerful and trusted solution. At KubeCon NA 2024, we had the pleasure of meeting many of these developers face-to-face to showcase Arm solutions as they migrate to Arm.   

Today, all major hyperscalers, including Amazon Web Services (AWS), Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure (OCI), offer Arm-based servers optimized for modern cloud-native applications. This shift offers a significant opportunity for organizations to improve price-performance ratios, deliver a lower total cost of ownership (TCO), and meet sustainability goals, while gaining access to a robust ecosystem of tools and support.  

At KubeCon NA, it was amazing to hear from those in the Arm software ecosystem share their migration stories and the new possibilities they’ve unlocked. 

Arm from cloud to edge at KubeCon

Building on Arm unlocks a wide range of options from cloud to edge. It enables developers to run their applications seamlessly in the cloud, while tapping into the entire Arm software and embedded ecosystem and respective workflows. 

Arm-based servers are now integrated across leading cloud providers, making them a preferred choice for many organizations looking to enhance their infrastructure. At KubeCon NA 2024, attendees learned about the latest custom Arm compute offerings available from major cloud service providers including: 

• AWS Graviton series for enhanced performance and energy efficiency; 

• Microsoft Azure Arm-based VMs for scalable, cost-effective solutions; 

• Google Cloud’s Tau T2A instances for price-performance optimization; and 

• OCI Ampere A1 Compute for flexible and powerful cloud-native services.

Ampere showcased their Arm-based hardware in multiple form factors across different partner booths at the show to demonstrate how the Arm compute platform is enabling server workloads both in the cloud and on premises.

System76 ‘s Thelio Astra, an Arm64 developer desktop, featuring Ampere Altra processors, was also prominently displayed in booths across the KubeCon NA show floor. The workstation is streamlining developer workflows for Linux development and deployment across various markets, including automotive and IoT.

During the show, the Thelio Astra showcased its IoT capabilities by aggregating and processing audio sensor data from Arduino devices to assess booth traffic. This demonstrated cloud-connected IoT workloads in action. 

Migrating to Arm has never been easier

Migrating workloads to Arm-based servers is more straightforward than ever. Today, 95% of graduated CNCF (Cloud Native Computing Foundation) projects are optimized for Arm, ensuring seamless, efficient, and high-performance execution.  

Companies of all sizes visited the Arm booth at KubeCon NA to tell us about their migration journey and learn how to take advantage of the latest developer technologies. They included leading financial institutions, global telecommunications providers and large retail brands.  

For developers ready to add multi-architecture support to their deployments, we demonstrated a new tool – kubearchinspect – that can be deployed on a Kubernetes cluster and scan for container images to check for Arm compatibility. Check out our GitHub repo to get started and how to validate Arm support for your container images. 

Hundreds of independent software vendors (ISVs) are enabling their applications and services on Arm, with developers easily monitoring application performance and managing their workloads via the Arm Software Dashboard.  

For developers, the integration of GitHub Actions, GitHub Runners, and the soon to be available Arm extension for GitHub Copilot, means a seamless cloud-native CI/CD workflow is now fully supported on Arm. Graduated projects can scale using cost-effective Arm runners, while incubating projects benefit from lower pricing and improved support from open-source Arm runners. 

Extensive Arm ecosystem and Kubernetes support 

As Kubernetes continues to grow, with 5.6 million developers worldwide, expanding the contributor base is essential to sustaining the cloud-native community and supporting its adoption in technology stacks. Whether developers are using AWS EKS, Azure AKS, or OCI’s Kubernetes service, Arm is integrated to provide native support. This enables the smooth deployment and management of containerized applications. 

Scaling AI workloads and optimizing complex inference pipelines can be challenging across different architectures. Developers can deploy their AI models across distributed infrastructure, seamlessly integrating with the latest AI frameworks to enhance processing efficiency.  

Through a demonstration at the Arm booth, Pranay Bhakre, a Principal Solutions Engineer at Arm, showcased AI over Kubernetes. This brought together Kubernetes, Prometheus and Grafana open-source projects into a power-efficient real-time, scalable, sentiment analysis application. More information about how to enable real-time sentiment analysis on Arm Neoverse-based Kubernetes clusters can be found in this Arm Community blog. 

Pranay also showcased the ability to run AKS on the very latest Arm Neoverse-powered Microsoft Azure Cobalt 100 processors. To jumpstart running Kubernetes via AKS on Microsoft Azure Cobalt 100, check out this learning path and the corresponding GitHub repo. 

Additionally, at Kubecon 2024, we launched a pilot expansion of our “Works on Arm” program into the CNCF community. This offers comprehensive resources to help scale and optimize cloud-native projects on the Arm architecture. Developers can click here to take a short survey and request to be included in this new initiative. 

Switch to Arm for smarter deployment and scalable performance 

As demonstrated at KubeCon 2024, Arm is transforming cloud-native deployment and accelerating the developer migration to Arm. 

In fact, now is the perfect time to harness Arm-based cloud services for better performance, lower costs, and scalable flexibility. Developers can start building or migrating today to deploy smarter, optimized cloud-native applications on Arm, for Arm. 

Developers are welcome to join us at KubeCon Europe in April 2025 to learn more about our latest advancements in platform engineering and cloud-native technologies.

The post Unlocking New Possibilities in Cloud Deployment with Arm at KubeCon NA 2024 appeared first on Arm Newsroom.

At AI Expo Africa 2024, Arm brought together AI developers, enthusiasts, and industry leaders through immersive workshops, insightful talks, exclusive networking opportunities, and an engaging booth experience. The event is Africa’s largest AI conference and trade show, with over 2,000 delegates from all over the African continent.

Arm has been attending AI Expo Africa for the past three years, and this year we noted a significant uptick in AI applications running on Arm and a definite thirst for knowledge in how to best to deploy and accelerate AI on Arm. Held at the Sandton Convention Centre in Johannesburg, South Africa, Arm’s presence at the event left a strong impact on the AI developer ecosystem, fostering connections and sparking innovation, with a range of expert insights from Arm tech leaders and Ambassadors from the Arm Developer Program.

Arm Ambassadors are a group of experts and community leaders developing on Arm who support and help lead the Developer Program through a host of Arm-endorsed activities like the various talks, workshops and engagements at AI Expo Africa. At the event, there were Arm Ambassadors from Ghana, Kenya, Switzerland and, of course, South Africa in attendance.

Day 1: Workshops and live demos

Arm kicked off with a high-energy workshop that saw an incredible turnout. Shola Akinrolie, Senior Manager for the Arm Developer Program, opened the session with a keynote introduction, setting the stage for a deep dive into Arm’s AI technology and its community-driven initiatives.

Distinguished Arm Ambassador Peter Ing then took the spotlight, showing how to run AI models at the edge on the Arm Compute Platform. He demonstrated the Llama 3.2 1B model running on a Samsung mobile device, showcasing real-time AI inference capabilities and illustrating how Arm is creating new opportunities for running small language models on the edge. The live demo left the audience captivated by the performance and efficiency of the Arm Compute Platform.

Another standout session was led by Distinguished Arm Ambassador Dominica Abena Oforiwaa Amanfo, who shared her expertise on the Grove Vision AI V2 microcontroller (MCU), which is powered by a dual-core Arm Cortex-M55 CPU and Ethos-U55 NPU NN unit. Dominica highlighted the TinyML’s capabilities, as well as its compatibility with PyTorch and ExecuTorch. This showcased the reach and versatility of low-power, high impact AI innovations that are powered by Arm.

The Arm booth: A hub of innovation

At AI Expo Africa, the Arm booth was bustling with energy, drawing hundreds of developers eager to experience Arm’s technology first-hand. The team engaged with visitors in discussions and hands-on demos. The booth was packed with excitement, from insightful tech exchanges to exclusive SWAG giveaways, including a highly sought-after Raspberry Pi MCU!

To end the day, Arm hosted an exclusive Arm Developer Networking Dinner. The evening was filled with lively discussions led by Arm’s Director of Software Technologies Rod Crawford and Arm Developer Program Ambassadors, as they shared their insights on AI’s future and the impact of edge computing across various industries.

Day 2: Inspiring talks and networking

On day two of the event, Arm’s Rod Crawford, captivated the audience with a powerful talk on “Empowering AI from Cloud to Edge.” Rod shared how Arm supports developers in harnessing the full potential of AI, from efficient cloud computing to high-performance, edge-based AI solutions. This means developers can create more powerful applications that work better and faster.

The tallk demonstrated how both generative AI and classic AI workloads could run across the entire spectrum of computing on Arm, from powerful cloud services to mobile and IoT devices. Through Arm Kleidi, Arm is engaging with leading AI frameworks, like MediaPipe, ExecuTorch and PyTorch, to ensure developers can seamlessly take advantage of AI acceleration on Arm CPUs without any changes to their code. Rod’s insights were met with enthusiasm as developers learned how Arm’s technologies accelerate AI deployment, even for the most demanding applications.

The final day wrapped up with a high-spirited “Innovation Coffee” session, offering attendees a relaxed environment to connect and reflect on Arm’s advancements. Stay tuned for highlights of this session on the Arm Software Developers YouTube channel.

A heartfelt thanks

Arm extends its deepest gratitude to everyone who contributed to and joined us at AI Expo Africa. Special thanks to the Arm team—Rod Crawford, Gemma Platt, and Stephen Ozoigbo—as well as the incredible Arm Developer Program Ambassadors Peter Ing, Dominica Amanfo, Derrick Sosoo, Brenda Mboya, and Tshega Mampshika for their hard work and passion. We also appreciate Marvin Rotermund, Nomalungelo Maphanga, Stephania Obaa Yaa Bempomaa, and Mia Muylaert for their energy and support at the booth.

Here are what some of the Arm Developer Program Ambassadors had to say about the event:

Brenda Mboya: “One of my favorite moments at the event was seeing the lightbulb go off for attendees who visited the Arm booth and realized how integral Arm has been in their lives. It was an honor to engage with young people interested in utilizing Arm-based technology in their school initiatives and I am glad that I was able to direct them to sign-up to be part of the Arm Developer Program.”

Derrick Sosoo: “Arm’s presence at AI Expo Africa 2024 marked a significant shift towards building strong connections with developers through immersive experiences. Our engaging workshops, insightful talks, Arm Developer meetup, and interactive booth showcase left an indelible mark on attendees.”

Dominica Amanfo: “We witnessed overwhelming interest from visitors eager to learn about AI on Arm and our Developer Program. I’m particularly grateful for the opportunity to collaborate with fellow Arm Ambassadors alongside our dedicated support team at the booth, which included students from the DUT Arm (E³)NGAGE Student Club.”

The future of AI is built on Arm

By uniting innovators, developers, and enthusiasts, Arm is leading the charge in shaping the future of AI. Together, we’re building a community that will drive the future of AI on Arm, empowering developers worldwide to innovate and bring cutting-edge technology to life.

Learn more about Arm’s developer initiatives and join the journey at Arm Developer Program.

The post Building the Future of AI on Arm at AI Expo Africa 2024 appeared first on Arm Newsroom.

Artificial intelligence (AI) in the automotive industry is no longer a future-looking buzzword. From smart navigation that learns from every journey to intelligent interactions between the driver and car, AI has been consistently revolutionizing the driving experience.

Moreover, AI is helping to save lives. It’s making roads safer with predictive safety features and driver assistance systems that feel like having a co-pilot with superhuman reflexes. But, contrary to popular belief, AI is not a recent phenomenon in the automotive sector and has been integrated into automotive applications for over two decades.

As Masashige Mizuyama, Representative Director, Vice President and CTO at Panasonic Automotive Systems, highlights in the recent Arm Viewpoints podcast: “AI has been integrated into automotive applications for over 20 years, evolving from simple voice commands to advanced deep learning models that understand natural language.”

This evolution goes beyond just adding new features; it’s about fundamentally transforming the driving experience. Advanced driver assistance systems (ADAS), Human Machine Interface (HMI), and in-vehicle infotainment (IVI) are prime examples of how AI enhances vehicle safety and user interaction. Moreover, the fusion of sensor data using AI improves safety and provides meaningful insights to both drivers and passengers.

AI in ADAS

One of the most prominent applications of AI in cars is ADAS. These systems enhance vehicle safety by providing real-time data processing and decision-making capabilities. According to a report by the Partnership for Analytics Research in Traffic Safety (PARTS), by 2023 five ADAS features – forward collision warning, automatic emergency braking, pedestrian detection warning, pedestrian automatic emergency braking (AEB), and lane departure warning—achieved market penetration rates higher than 90% in new vehicles.

AI in HMI

Another significant advancement is the HMI. AI-powered voice recognition systems allow drivers to keep their eyes on the road and hands on the wheel while interacting with their vehicles. This technology is rapidly evolving, making in-car interactions more seamless and enhancing overall driving safety.

AI enables cars to perceive and infer the intentions of drivers and passengers, allowing for smarter and more autonomous responses. For instance, if a driver expresses a desire for coffee, the AI can recommend a nearby coffee shop, set the navigation route, and even place an order—all while minimizing distractions.

Moreover, AI’s ability to process vast amounts of data from various sensors is essential for ensuring safety and enhancing the overall driving experience. By leveraging AI, vehicles can provide a more comfortable and creative environment, allowing occupants to make the most of their time on the road.

AI-powered voice recognition systems, for example, allow drivers to interact with their vehicles without taking their hands off the wheel or their eyes off the road. This technology is rapidly evolving, making in-car interactions more seamless and intuitive. In fact, according to GlobalData’s report, in the past three years, the automotive industry has seen over 720,000 patents filed and approved. This widespread use highlights the increasing reliance on voice technology for in-car interactions.

AI-based IVI systems

AI-powered IVI systems are set to transform the driving experience by integrating multiple advanced technologies that continuously adapt to the habits of drivers. Voice recognition will be used for seamless, hands-free interaction, enhancing safety and convenience. Natural language processing will enable intuitive communication, making interactions feel more human-like.

AI-based data analytics, meanwhile, will provide real-time, relevant updates for drivers to create a more enjoyable, efficient, and personalized driving environment and experience. In fact, according to ABIresearch, by 2030 consumers are expected to spend over 500 million hours annually using in-car video-on-demand apps.

The fusion of sensor data

Integrating various sensor data using AI is a critical advancement in automotive technology. This process, known as sensor fusion, combines data from multiple sensors to create a comprehensive understanding of the vehicle’s environment. This fusion not only improves the efficiency of data processing, but also enhances safety by providing meaningful insights to both drivers and passengers.

Sensor fusion technology allows autonomous vehicles to build a detailed model of their surroundings using data from RADAR, LiDAR, cameras, and ultrasonic sensors. 

Meanwhile, AI-driven sensor fusion also enables personalized in-car experiences. By analyzing data from various sensors, vehicles can adjust settings, such as seat position, climate control, and infotainment preferences based on the driver’s habits and preferences. 

Simon Teng, Senior Director of Automotive Partnerships at Arm, emphasizes the importance of integrating various sensor data using AI: “This fusion of information not only improves the efficiency of data processing but also enhances safety by providing meaningful insights to both drivers and passengers. The ability to process complex instructions and deliver personalized experiences marks a significant leap in automotive technology”.

By leveraging AI, vehicles can offer a more intuitive and seamless driving experience. For instance, AI can analyze data from in-cabin cameras to detect driver drowsiness and issue alerts or adjust the vehicle’s settings to keep the driver alert. This proactive approach to safety and comfort is a testament to the transformative potential of AI in the automotive industry.

The future of AI in Car

Looking ahead, AI advancements promise to significantly improve the in-vehicle experience. Mizuyama-san envisions a future where AI enhances comfort and hospitality, allowing cars to proactively offer suggestions and controls based on the inferred needs of drivers and passengers.

Vehicles will transform into versatile spaces that can adapt to various needs, such as becoming a mobile office or a relaxing environment. By leveraging AI, cars can create personalized experiences that make time spent in the vehicle more enjoyable and productive.

How Arm and Panasonic Automotive Systems are pioneering innovations

Both Arm and Panasonic Automotive Systems are at the forefront of automotive innovation, working together to push the boundaries of what is possible. Mizuyama-san shared Panasonic Automotive Systems’ vision to become the best “Joy in Motion” design company, focusing on eliminating the pains of mobility and enhancing the overall user experience.

To that effect, Arm and Panasonic Automotive Systems announced a partnership to help build a standardized architecture for software-defined vehicles (SDVs). This collaboration focuses on creating a flexible software stack to meet current and future automotive needs

Overall, the integration of AI in the automotive industry is not just about adding new features; it’s about transforming the entire driving experience. As AI technology continues to advance, we can expect even greater innovations that will redefine how we interact with our vehicles.

For a deeper dive into these insights, be sure to listen to the full podcast episode here: AI in the Car: A Look to the Future.

The post How is AI Being Used in Cars? appeared first on Arm Newsroom.

As artificial intelligence evolves, there is increasing excitement about executing AI workloads on embedded devices using small language models (SLM).  
 
Arm’s recent demo, inspired by Microsoft’s “Tiny Stories” paper and Andrej Karpathy’s TinyLlama2 project, where a small language model trained on 21 million stories generates text, showcases endpoint AI’s potential for IoT and edge computing. In the demo, a user inputs a sentence, and the system generates an extended children’s story based on it. 
 
Our demo featured Arm’s Ethos-U85 NPU (Neural Processing Unit) running a small language model on embedded hardware. While large language models (LLMs) are more widely known, there is growing interest in small language models due to their ability to deliver solid performance with significantly fewer resources and lower costs, making them easier and cheaper to train.  

Implementing A Transformer-based Small Language Model on Embedded Hardware

Our demo showcased the Arm Ethos-U85 as a small, low-power platform capable of running generative AI, highlighting that small language models can perform well within narrow domains. Although TinyLlama2 models are simpler than the larger models from companies like Meta, they are ideal for showcasing the U85’s AI capabilities. This makes them a great fit for endpoint AI workloads. 

Developing the demo involved significant modeling efforts, including the creation of a fully integer int8 (and int8x16) Tiny Llama2 model, which was converted to a fixed-shape TensorFlow Lite format suitable for the Ethos-U85’s constraints.  
 
Our quantization approach has shown that fully integer language models can successfully balance the tradeoff between maintaining strong accuracy and output quality. By quantizing activation, normalization functions, and matrix multiplications, we eliminated the need for floating-point computations, which are more costly in terms of silicon area and energy—key concerns for constrained embedded devices.  
 
The Ethos-U85 ran a language model on an FPGA platform at only 32 MHz, achieving text generation speeds of 7.5 to 8 tokens per second—matching human reading speed—while using just a quarter of its compute capacity. In a real system-on-chip (SoC), performance could be up to ten times faster, significantly enhancing speed and energy efficiency for AI processing at the edge. 

The children’s story-generation feature used an open-source version of Llama2, running the demo on TFLite Micro with an Ethos-NPU back-end. Most of the inference logic was written in C++ at the application level. Adjusting the context window enhanced narrative coherence, ensuring smooth, AI-driven storytelling.  
 
The team’s adaptation of the Llama2 model to run efficiently on the Ethos-U85 NPU required careful consideration of performance and accuracy due to the hardware limitations. Using mixed int8 and int16 quantization demonstrates the potential of fully integer models, encouraging the AI community to optimize generative models for edge devices and expand neural network accessibility on power-efficient platforms like the Ethos-U85. 

Showcasing the Power of the Arm Ethos-U85

Scalable from 128 to 2048 MAC units (multiply-accumulate units), the Ethos-U85 achieves a 20% power efficiency improvement over its predecessor, the Ethos-U65. A standout feature of the Ethos-U85 is its native support for transformer networks, which earlier versions could not support.  
 
The Ethos-U85 enables seamless migration for partners using previous Ethos-U NPUs, allowing them to capitalize on existing investments in Arm-based machine learning tools. Developers are increasingly adopting the Ethos-U85 for its power efficiency and high performance.

The Ethos-U85 can reach 4 TOPS (trillions of operations per second) with a 2048 MAC configuration in silicon. In the demo, however, a smaller configuration of 512 MACs on an FPGA was used to run the Tiny Llama2 small language model with 15 million parameters at just 32 MHz.   
 
This capability highlights the potential for embedding AI directly into devices. The Ethos-U85 effectively handles such workloads even with limited memory (320 KB of SRAM for caching and 32 MB for storage), paving the way for small language models and other AI applications to thrive in deeply embedded systems. 

Bringing Generative AI to Embedded Devices

Developers need better tools to navigate the complexities of AI at the edge, and Arm is addressing this with the Ethos-U85 and its support for transformer-based models. As edge AI becomes more prominent in embedded applications, the Ethos-U85 is enabling new use cases, from language models to advanced vision tasks.  
 
The Ethos-U85 NPU delivers the performance and power efficiency required for innovative, cutting-edge solutions. Like the “Tiny Stories” paper, our demo represents a significant advancement in bringing generative AI to embedded devices, demonstrating the ease of deploying small language models on the Arm platform.  
 
Arm is opening new possibilities for Edge AI across a wide range of applications, positioning the Ethos-U85 to power the next generation of intelligent, low-power devices.  

Read how Arm is accelerating real-time processing for edge AI applications in IoT with ExecuTorch.

The post Arm Ethos-U85 NPU: Unlocking Generative AI at the Edge with Small Language Models appeared first on Arm Newsroom.

When you’re driving hard to disrupt quantum computing paradigms, sometimes it’s smart to chill out. 

That’s Equal1’s philosophy. The Ireland-based company has notched another milestone on its journey deeper into the rapidly evolving field of quantum computing. Building on its success as winners of the “Silicon Startups Contest” in 2023, Equal1 has successfully tested the first chip incorporating an Arm Cortex processor at an astonishing temperature of 3.3 Kelvin (-269.85°C). That’s just a few degrees warmer than absolute zero, the theoretical lowest possible temperature where atomic motion nearly stops.

Equal1’s achievement is a crucial step in integrating classical computing components within the extremely power-constrained environment of a quantum cryo chamber. This brings the world closer to practical, scalable quantum computing systems. Cold temperatures reduce thermal noise that can cause errors in quantum computations and preserve quantum “coherence” – the ability of qubits to exist in multiple states simultaneously.

The Importance of Cryogenic Temperatures in Quantum Computing

What sets Equal1 apart in the quantum computing landscape is its pragmatic approach to quantum integration. Rather than creating entirely new infrastructure, Equal1’s vision was to build upon the foundation of the well-established semiconductor industry. This strategy became viable with the emergence of fully depleted silicon-on-insulator (FDSOI) processes, which the company’s founders recognized as having the potential to support quantum operations.

“Our thesis is that rather than tear up everything we’ve done and start anew, let’s try to build on top of what we’ve already built,” said Jason Lynch, CEO of Equal1. This philosophy has led to partnerships with industry leaders like Arm and NVIDIA, leveraging existing semiconductor expertise while pushing into quantum territory.

Cryo-Temperature Breakthrough

What makes this accomplishment particularly remarkable is the extensive engineering required to make it possible. 

“There is no such thing as a Spice Kit that works, that predicts what silicon is going to do at 3 Kelvin,” said Brendan Barry, Equal1’s CTO. “In fact, there’s no such thing as a methodology, no libraries you can get to make it happen.” 

Over five years, Equal1, which is part of the Arm Flexible Access program, developed its own internal Process Design Kit (PDK) and methodologies to predict and optimize logic behavior at cryogenic temperatures.

Equal1’s approach uses electrons or holes (the absence of electrons) as qubits, making their technology uniquely compatible with standard CMOS manufacturing processes. This choice wasn’t accidental; it’s fundamental to the company’s vision of creating practical, manufacturable quantum computers.

Working with commercial CMOS Fabs, Equal1 uses a standard process with proprietary design techniques developed over six years of research. These techniques enable operation at cryogenic temperatures while maintaining manufacturability. 

“We’re not changing anything in the process itself, but we are certainly pushing the limits of what the process can do,” Barry said.

Integrating the Arm Cortex-A55 Processor

Building on this success, Equal1 is now setting its sights even higher. The company plans to incorporate the more powerful Arm Cortex-A55 processor into its next-generation Quantum System-on-Chip (QSoC). This ambitious project aims to have silicon available by mid-2025, the company said.

The integration of Arm technology is crucial not just for processing power, but for power efficiency. At cryogenic temperatures, power management becomes critical as any heat generated can affect the quantum states. Arm’s advanced power-management features make it an ideal choice for this challenging environment.

Equal1’s technology targets three primary application areas:

• Chemistry and drug discovery, potentially reducing the current 15-year, $1.3 billion average cost of bringing new drugs to market.
• Optimization problems in finance, logistics, and other fields requiring complex variable management.
• Quantum AI applications, where quantum computing could dramatically improve efficiency.

Perhaps most revolutionary is Equal1’s approach to deployment. Unlike traditional quantum computers that require specialized facilities, Equal1 envisions rack-mounted quantum computers that can be installed in standard data centers at a fraction of the cost of current solutions. 

“They just rack in like any other standard high-performance compute,” said Patrick McNally, Equal1’s marketing lead.

The Road Ahead for Quantum Computing and Equal1

Equal1’s progress brings the world closer to the reality of compact, powerful quantum computers that can be deployed in standard high-performance computing environments. The company’s integration of Arm technology at cryogenic temperatures opens new possibilities for quantum-classical hybrid systems, potentially creating increased demand for Arm adoption across the quantum computing industry.

As quantum computing continues to evolve, Equal1’s practical approach to integration with existing semiconductor technology and infrastructure could prove to be a game-changer. With applications ranging from drug discovery to financial modeling and beyond, the future of quantum computing is looking increasingly accessible and practical.

And that’s pretty cool.

The post Equal1’s Quantum Computing Breakthrough with Arm Technology appeared first on Arm Newsroom.

Sir Robin Saxby, the founding CEO and former chairman of Arm, has been inducted into the City of London Engineering Hall of Fame. The ceremony, which took place on the High Walkway of Tower Bridge in London on October 31, 2024, announced the induction of seven iconic engineers who are from or connected to the City of London.

As Professor Gordon Masterton, Past Master Engineer, said: “The City of London Engineering Hall of Fame was launched in 2020 and now has 14 inductees whose lives tell the story of almost 500 years of world-beating engineering innovations that have created huge improvements in the quality of life and economy of the City of London, the United Kingdom and the world. Our mission is to celebrate these role models of exciting and inspirational engineering careers.”

Saxby joined Arm full-time as the first CEO in February 1991 where he led the transformation of the company from a 12-person startup to one of the most valuable tech companies in the UK with a market capitalization of over $10 billion.

As CEO, Saxby was the visionary behind Arm’s highly successful business model, which has been adopted by many other companies across the tech industry. Through this innovative business model, the Arm processor can be licensed to many different companies for an upfront license fee, with Arm receiving royalties based on the amount of silicon produced.

This paved the way for Arm to become the industry’s highest-performing and most power-efficient compute platform, with unmatched scale today touching 100 percent of the connected global population.

Under Saxby’s tenure at Arm, power-efficient technology became the foundation of the world’s first GSM mobile phones that achieved enormous commercial success during the 1990s, including the Arm-powered Nokia 6110. Today, more than 99 percent of the world’s smartphones are based on Arm technology. The success in the mobile market gave the company the platform to expand into other technology markets that require leading power-efficient technology from Arm, including IoT, automotive and datacenter.

Saxby stepped down as CEO in 2001 and chairman of Arm in 2006. In 2002, he was knighted in the 2002 New Year Honors List. Saxby is a visiting Professor at the University of Liverpool, a fellow of the Royal Academy of Engineering and an honorary fellow of the Royal Society.

Thanks to Saxby’s work, Arm has grown to be a global leader in technology, with nearly 8,000 employees worldwide today. Just as Saxby and the 12 founding members had originally envisioned, Arm remains committed to developing technology that will power the future of computing.

The post Arm Founding CEO Inducted into City of London Engineering Hall of Fame appeared first on Arm Newsroom.

As we move further into the era of advanced computing, Arm is continuing to lead the charge with groundbreaking tech innovations. October 2024 has been a month of significant strides in technology, particularly in AI, machine learning (ML), security, and system-on-chip (SoC) architecture.  

The Arm Editorial Team has highlighted the cutting-edge tech innovations that happened at Arm in October 2024 – all to shape the next generation of intelligent, secure, and high-performing compute systems. 

Enhancing AI, ML, and Security for Next-Gen SoCs with Armv9.6-A

Arm’s latest CPU architecture, Armv9.6-A, introduces key enhancements to meet evolving computing needs, focusing on AI, ML, security, and chiplet-based systems-on-chip (SoCs). Martin Weidmann, Director Product Management, discusses the latest features in the Arm A-Profile architecture for 2024. 

The 2024 updates enhance Scalable Matrix Extension (SME) with structured sparsity and quarter-tile operations for efficient matrix processing while improving memory management, resource partitioning, secure data handling, and multi-chip system support. 

Streamlining PyTorch Model Deployment on Edge Devices with ExecuTorch on Arm

Arm’s collaboration with Meta has led to the introduction of ExecuTorch, enhancing support for deploying PyTorch models on edge devices, particularly with the high-performing Arm Ethos-U85 NPU. Robert Elliott, Director of Applied ML, highlights how this collaboration enables developers to significantly reduce model deployment time and utilize advanced AI inference workloads with better scalability. 

With an integrated GitHub repository providing a fully supported development environment, ExecuTorch simplifies compiling and running models, allowing users to create intelligent IoT applications efficiently.  

Accelerating AI with Quantized Llama 3.2 Models on Arm CPUs

Arm and Meta have partnered to empower the AI developer ecosystem by enabling the deployment of quantized Llama 3.2 models on Arm CPUs with ExecuTorch and KleidiAI. Gian Marco Iodice, Principal Software Engineer, details how this integration allows quantized Llama 3.2 models to run up to 20% faster on Arm Cortex-A CPUs, while maintaining model quality and reducing memory usage. 

With the ExecuTorch beta release and support for lightweight quantized Llama 3.2 models, Arm is simplifying the development of AI applications for edge devices, resulting in notable performance gains in prefill and decode phases.  

Optimizing Shader Performance with Arm Performance Studio 2024.4

Arm’s latest Frame Advisor enhancement helps mobile developers identify inefficient shaders, boosting performance, memory usage, and power efficiency. Julie Gaskin, Staff Developer Evangelist, details the new features in Arm Performance Studio 2024.4, including support for new CPUs, improved Vulkan and OpenGL ES integration, and expanded RenderDoc debugging tools.   

This update provides detailed shader metrics – like cycle costs, register usage, and arithmetic precision – enabling developers to optimize performance and lower costs.  

Boosting Performance and Security for Arm Architectures with LLVM 19.1.0 

LLVM 19.1.0, released in September 2024, introduces nearly 1,000 contributions from Arm, including new architecture support for Armv9.2-A cores and performance improvements for data-center CPUs like Neoverse-V3. Volodymyr Turanskyy, Principal Software Engineer, highlights the features of LLVM 19.1.0, which deliver better performance and enhanced security.   
  
The update optimizes shader performance and Fortran intrinsics, adds support for Guarded Control Stack (GCS), security mitigations for Cortex-M Security Extensions (CMSE), enhancements for OpenMP reduction, function multi-versioning, and new command-line options for improved code generation. 

Introducing System Monitoring Control Framework (SMCF) for Neoverse CSS

Arm’s System Monitor Control Framework (SMCF) streamlines sensor and monitor management in complex SoCs with a standardized software interface. Marc Meunier, Director of Ecosystem Development, highlights how it supports seamless integration of third-party sensors, flexible data sampling, and efficient data collection through DMA, reducing processor overhead.   
  
The SMCF enables distributed power management and improves system telemetry, offering insights for profiling, debugging, and remote management while ensuring secure, standards-compliant data handling.   

Achieving Human-Readable Speeds with Llama 3 70B on AWS Graviton4 CPUs  

AWS’s Graviton4 processors, built with Arm Neoverse V2 CPU cores, are designed to boost cloud performance for high-demand AI workloads. Na Li, ML Solutions Architect, explains how deploying the Llama 3 70B model on Graviton4 leverages quantization techniques to achieve token generation rates of 5-10 tokens per second.   

This innovation enhances cloud infrastructure, enabling more powerful AI applications and improving performance for tasks requiring advanced reasoning.   

Superior Performance on Arm CPUs with Pardiso Sparse Linear Solver

Panua Technologies optimized the Pardiso sparse linear solver for Arm CPUs, delivering significant performance gains over Intel’s MKL. David Lecomber, Senior Director Infrastructure Tools, highlights how Pardiso on Arm Neoverse V1 processors outperform MKL, demonstrating superior efficiency and scalability for large-scale scientific and engineering computations.   

This breakthrough positions Pardiso as a top choice for industries like automotive manufacturing and semiconductor design, offering unmatched speed and performance.   

Built on Arm Partner Stories

Vince Hu, Corporate Vice President, MediaTek, talks about the Arm MediaTek partnership, which drives ongoing tech innovation and delivers transformative technologies to enhance everyday life. 

Eben Upton, CEO of Raspberry Pi, shares how the company has evolved from an educational tool to a key player in industrial and embedded applications, all powered by Arm technology. He highlights the development of new tools over the past decade and his personal journey with the BBC Microcomputer.  

Clay Nelson, Industry Solutions Strategy Lead at GitHub, discusses the partnership between GitHub and Arm, which combines GitHub Actions with Arm native hardware to revolutionize software development, leading to faster development times and reduced costs. 

Sy Choudhury from Meta Platforms Inc. explains how the collaboration with Arm is optimizing AI on the Arm Compute Platform, enhancing digital interactions through devices like AR smart glasses, and impacting everyday experiences with advanced AI applications.  

Highlights from PyTorch Conference 2024 

To accelerate the development of custom silicon solutions, Arm partners are tapping into the latest industry expertise and resources. Principal Software Engineer, Gian Marco Iodice discusses this in, “Democratizing AI: Powering the Future with Arm’s Global Compute Ecosystem,” from PyTorch Conference 2024. 

Iodice highlights KleidiAI-accelerated demos, key AI tech innovations from cloud to edge, and the latest Learning Paths for developers. 

The post What are the Latest Tech Innovations from Arm in October 2024? appeared first on Arm Newsroom.

One key message emerged from Open Compute Project (OCP) Global Summit 2024: AI scalability won’t progress unless we reduce design and development friction.

As the annual Silicon Valley event drew to a close, this crucial insight reverberated through the halls and informed discussions on the future of AI infrastructure and sustainable computing. 

While everyone understands the enormous opportunities, they also know the AI scalability challenges: 

• Unprecedented demands on computing infrastructure with AI model parameter counts doubling every 3.4 months.
• Global datacenter energy consumption is projected to triple by 2030.
• The traditional approach to chip design and development is struggling to keep pace with these demands, both in terms of performance and energy efficiency.
• As we push towards increasingly smaller process nodes, such as the current 3nm and the upcoming 2nm, the complexity and cost of manufacturing skyrocket. Design costs for a 2nm chip are estimated at a staggering $725 million. 

These challenges are compounded by the long development cycles of monolithic chips, which can take years from concept to production – a timeframe that’s increasingly out of sync with the rapid evolution of AI workloads. Additionally, the one-size-fits-all approach of traditional chip design is ill-suited to the diverse and specialized computing needs of modern AI applications, leading to inefficiencies in both performance and energy use.

Arm, as a key player in the semiconductor industry, is at the forefront of addressing this challenge, and at OCP, the company showcased innovative solutions and collaborative approaches to overcome the hurdles in AI scalability.

Eddie Ramirez (far left, image below), VP of Go to Market, Infrastructure at Arm, highlighted this challenge in his executive session, emphasizing that “the insatiable demand for AI performance is putting immense pressure on today’s datacenters. We need a paradigm shift in how we approach silicon design and development to meet these growing needs sustainably.”

Bottom image, from left: Eddie Ramirez (VP of Go to Market, Arm), Melissa Massa (Lenovo Global Sales Lead for cloud service providers), Thomas Gardens (VP of Solutions, Supermicro), Moderator Bill Carter (OCP).

Arm’s Vision: Reducing Friction Through Innovation

At OCP 2024, Arm presented a comprehensive strategy to address the AI scalability challenge, centered around two key pillars: chiplet technology and ecosystem collaboration.

Chiplets, the next frontier in silicon innovation, were a central theme in Arm’s OCP presence, representing a revolutionary approach to chip design that promises to reduce development friction significantly. By breaking down complex chip designs into smaller, modular components, chiplets offer several advantages:

• Lower development costs: Chiplets reduce manufacturing costs and improve yields compared to traditional monolithic designs.
• Faster time-to-market: The modular nature of chiplets allows for quicker iteration and product launches.
• Scalable performance: Companies can mix and match chiplets to create customized solutions for specific AI workloads.
• Improved power efficiency: Chiplet designs enable more granular power management, crucial for sustainable AI infrastructure.

In Arm’s Expo Hall session, “Accelerating AI Innovation with Arm Total Design: A Case Study,” Arm experts collaborated with Samsung to demonstrate how Arm Neoverse Compute Subsystems (CSS) rapidly brought an AI chiplet to market. This real-world example showcased the practical benefits of chiplet technology in reducing design and development friction.

Arm Total Design: Fostering Ecosystem Collaboration

Recognizing that no single company can solve the AI scalability challenge alone, Arm touted its Arm Total Design initiative, which has doubled in size in just one year. This collaborative approach brings together over 50 industry partners – foundries, third-party IP and EDA tools, design services, and OEMs – to create a standardized Chiplet System Architecture, ensuring interoperability and reusability of chiplet components across the ecosystem.

At OCP 2024, Arm highlighted new and expanding elements of the Arm Total Design:

• The introduction of new partners such as Egis, PUFsecurity, GUC, and Marvell, expanding the range of available chiplet solutions.
• A showcase of diverse chiplet applications, from AI accelerators to networking and edge computing solutions.
• The unveiling of a new AI CPU Chiplet Platform in collaboration with Samsung Foundry, ADTechnology, and Rebellions, promising approximately 3x power and performance efficiency compared to existing solutions.

All of these, taken in the aggregate, are meant to speed time to innovation, which is the name of the game.

Building a Sustainable AI Infrastructure

As we address the friction in AI development, sustainability remains a core focus. Arm’s approach to silicon design, particularly through chiplets and advanced process nodes, is crucial for building energy-efficient AI systems that can scale to meet future demands.

Arm’s initiatives for sustainable AI include demonstrating how Arm-based solutions can be optimized for specific AI workloads, improving overall system efficiency and collaborating on system firmware and chiplet standards to ensure interoperability and reduce development complexity, all contributing to AI scalability.

The Path Forward: Scaling AI Through Collaboration

The future of AI infrastructure lies in collaborative innovation. The challenges of scaling AI capabilities while maintaining energy efficiency are significant, but the advancements in chiplet technology and ecosystem-wide collaboration are paving the way for a more sustainable and scalable AI future.

Arm is committed to leading this transformation, providing the foundation for sustainable AI infrastructure through our Neoverse technology, Arm Total Design initiative, and extensive ecosystem partnerships.

So, what’s next?

• Expanded ecosystem collaboration: We’ll continue to grow the Arm Total Design network, bringing more partners into the fold to accelerate chiplet innovation and reduce development friction.
• Advanced AI optimizations: Expect to see more Arm-based solutions specifically tailored for AI training and inference workloads, designed to scale efficiently with growing demands.
• Sustainability-first approach: Energy efficiency will remain at the forefront of our design philosophy, helping our partners build more sustainable datacenter solutions that can support the exponential growth of AI.

OCP Global Summit 2024 served as a powerful reminder that the future of AI depends on our ability to innovate at the silicon level. By reducing design and development friction through chiplet technology and ecosystem collaboration, we’re opening new possibilities for scalable, sustainable AI infrastructure.

Eddie Ramirez put it best in his summit presentation: “The AI datacenter of tomorrow is being built today, and it’s being built on Arm.” With our technology at its core and our partners by our side, we’re not just scaling AI – we’re shaping a more efficient, sustainable future for computing.

The post Key Takeaways from OCP Global Summit 2024 appeared first on Arm Newsroom.

eXtended Reality (XR) is a term for technologies that enhance or replace our view of the world. This is often done by overlaying or immersing digital information and graphics into real-world and virtual environments, or even a combination of both, a process also known as spatial computing. 

XR encompasses augmented reality (AR), virtual reality (VR), and mixed reality (MR). While all three ‘realities’ share overlapping features and requirements, each technology has different purposes and underlying technologies. 

XR is set to play a fundamental role in the evolution of personal devices and immersive experiences, from being a companion device to smartphones to standalone Arm-powered wearable devices, such as a VR headset or pair of AR smartglasses where real, digital and virtual worlds converge into new realities for the user.  

While XR devices vary based on the type of AR, MR, and VR experiences and the complexity of the use cases that they are designed to enable, the actual technologies share some fundamental similarities. A core part of all XR wearable devices is the ability to use input methods, such as object, gesture, and gaze tracking, to navigate the world and display context-sensitive information. Depth perception and mapping are also enabled through the depth and location features.  

What are the advantages and challenges with XR?

XR technologies offer several advantages compared to other devices, including:  

• Enhanced interaction through more natural and intuitive user interfaces;  
• More realistic simulations for training and education;  
• Increased productivity with virtual workspaces and remote collaboration;  
• More immersive entertainment experiences; and  
• Alternative interaction methods for people with disabilities.  

However, there are still challenges that need to be overcome with XR devices. These include:  

• The initial perception around bulky and uncomfortable hardware.  
• Limited battery life for untethered devices.  
• Complex and resource-intensive content creation.  
• The need for low latency, and high performance.
• Ensuring data privacy and security for the end-user. 

What is augmented reality (AR)?

Augmented Reality enhances our view of the real world by overlaying what we see with computer-generated information. Today, this technology is prevalent in smartphone AR applications that require the user to hold their phone in front of them. By taking the image from the camera and processing it in real time, the app can display contextual information or deliver gaming and social experiences that appear to be rooted in the real world. 

Smartphone AR has improved significantly in the past decade, with some great examples being Snapchat where users can apply real-time face filters via AR, and IKEA place where users can visualize furniture in their homes through AR before making a purchase. However, the breadth of these applications remains limited. Increasingly, the focus is on delivering a more holistic AR experience through wearable smart glasses. These devices must combine an ultra-low-power processor with multiple sensors, including depth perception and tracking, all within a form factor that is light and comfortable enough to wear for long periods. 

AR smart glasses need always-on, intuitive, and secure navigation while users are on the move. This requires key advancements in features such as depth, 3D SLAM, semantics, location, orientation, position, pose, object recognition, audio services, and gesture and eye tracking. 

All these advancements and features will require supporting AI and machine learning (ML) capabilities on top of traditional computer vision (CV). In fact, new compact language models, which are designed to run efficiently on smaller devices, are becoming more influential across XR wearable technologies. These models enable real-time language processing and interaction, which means XR wearable devices can understand and respond to natural language in real time, allowing users to interact with XR applications using real-time voice commands.  

Since 2021, several smart glasses models have arrived on the market, including the Spectacle smartglasses from Snap, Lenovo ThinkReality A3, and in 2024, the Ray-Ban Meta Smart Glasses, Amazon Echo Frames, and, most recently, Meta’s Orion smartglasses. All of the devices are examples of how XR wearables are evolving to provide enhanced capabilities and features, like advanced AR displays and real-time AI video processing. 

What is virtual reality (VR)?

VR completely replaces a user’s view, immersing them within a computer-generated virtual environment. This type of XR technology has existed for a while, with gradual improvements over the years. It is used primarily for entertainment experiences, such as gaming, concerts, films, or sports but it’s also accelerating into the social domain. For VR, the immersive entertainment experiences will require capabilities like an HD rendering pipeline, volumetric capture, 6DoF motion tracking, and facial expression capture. 

VR is also used as a tool for training and in education and healthcare, such as rehabilitation. To make these experiences possible (and seamless) for the end-user, the focus of VR technology is often on high-quality video and rendering and ultra-low latency. 

Finally, VR devices started enhancing video conferencing experiences through platforms like Meta’s Horizon Workrooms that enable virtual meet-ups in different virtual worlds.  

Standalone VR devices, such as the latest Meta Quest 3, can deliver AAA gaming and online virtual worlds experiences. Powered by high-end Arm processors, these standalone VR devices can be taken anywhere.  

What is mixed Reality (MR)?

MR sits somewhere between AR and VR, as it merges the real and virtual worlds. There are three key scenarios for this type of XR technology. The first is through a smartphone or AR wearable device with virtual objects and characters superimposed into real-world environments, or potentially vice versa. 

The Pokémon Go mobile game, which took the world by storm back in 2016, overlays virtual Pokémon in real-world environments via a smartphone camera. This is often touted as a revolutionary AR game, but it’s actually a great example of MR – blending real-world environments with computer-generated objects. 

MR is revolutionizing the way we experience video games by enabling the integration of real-world players into virtual environments. This technology allows VR users to be superimposed into video games, creating a seamless blend of physical and digital worlds. As a result, real-world personalities can now interact within the game itself, enhancing the immersive experience for both players and viewers. 

This innovation is particularly impactful for streaming platforms like Twitch and YouTube. Streamers can now bring their unique personalities directly into the game, offering a more engaging and interactive experience for their audience. Viewers can watch their favorite streamers navigate virtual worlds as if they were part of the game, blurring the lines between reality and the digital realm. By incorporating MR, streamers can create more dynamic and visually captivating content, attracting larger audiences and fostering a deeper connection with their fans. This technology not only enhances the entertainment value but also opens up new possibilities for creative expression and storytelling in the gaming community.

XR is becoming more mainstream

With more XR devices entering the market, XR is becoming more affordable, with the technology transitioning from tech enthusiasts to mainstream consumers. 

XR is increasing the immersive experience, by adding more sensory inputs, integrating with more wearable technologies, and using generative AI to create faster and more realistic and interactive virtual environments for collaboration and meeting spaces, such as the Meta Horizon OS that will provide workspaces for regular work. This makes XR technologies more accessible and universally adopted in more markets beyond gaming, including: 

• Education e.g. Immersive simulation, exploring historical events virtually, virtual experiments, and augmenting museum tours 
• Healthcare e.g. More realistic medical training, removing the need for physical consultations, therapeutic applications, and AR-assisted surgeries 
• Retail: e.g. Virtual clothes fittings, product visualization, virtual shopping tours. 
• Industrial: e.g. Interactive training programs. 

XR is continuously evolving, increasingly at a faster pace thanks to the support of AI. This offers new ways to blur the frontier between virtual and physical worlds. 

Advancing XR Experiences 

Arm focuses on developing technology innovations that power the next generation of XR devices. Arm CPU and GPU technology delivers many benefits:   

• Efficient performance: Arm’s leadership in high-performance, low-power specialized processors is ideal for XR experiences. This includes the Cortex-X and Cortex-A CPUs as part of the new Arm Compute Subsystem (CSS) for Client that can be used in silicon solutions for wearables and mobile devices, providing the necessary compute capabilities for immersive XR experiences. These can also be combined with accelerator technologies like Ethos-U NPUs that can with Cortex-A-based systems to deliver accelerated AI performance. 
• Graphics capabilities: Arm’s Immortalis and Mali GPUs deliver exceptional graphics performance and efficiency for XR gaming experiences. 
• Real-Time 3D Technology: The pivot to more visually immersive real-time 3D mobile gaming content is at the heart of the Immortalis GPU. This technology brings ray tracing and variable rate shading to deliver more realistic mobile real-time 3D experiences. 
• Security and AI: Arm’s built-in technology features for security and AI are essential for the ongoing development of next-generation XR devices. 
• Strong software foundations: In many instances, companies that are developing XR applications are using versions of the Android Open Source Project as their base software. This ensures that they benefit from years of software investment from Arm, allowing their software enablement efforts to scale across a wide range of XR devices. 

Through the Arm Compute Platform, we are providing a performant, efficient, secure, and highly accessible solution with advanced AI capabilities that meet the needs of XR devices and experiences, now and in the future. Recent technology developments have shown that mainstream XR could be coming soon, with Arm’s technologies ideally placed to deliver truly immersive experiences for this next future of computing.  

The post XR, AR, VR, MR: What’s the Difference in Reality? appeared first on Arm Newsroom.

As a developer, you know how crucial it is to build applications that scale efficiently while keeping costs down. As the cloud landscape evolves, so does the technology running behind the scenes. In recent years, more and more companies are discovering the advantages of migrating their applications from x86-based architectures to Arm. With significant performance gains and lower total costs of ownership, Arm is quickly becoming the go-to architecture for companies looking to future-proof their workloads. 

Discover how to easily migrate your applications to Arm for better performance and cost savings. Our Arm Migration Guide will help you ensure a smooth transition for containerized workloads, cloud-managed services, and Linux applications. 

The Power of Arm: Performance and Efficiency

Arm processors, like those in AWS Graviton, Google Axion, and Microsoft Azure’s Ampere-based offerings, are designed to deliver superior performance at lower costs. With up to 60% energy savings and a 50% boost in performance, migrating to Arm-based cloud instances opens new opportunities for developers looking to optimize their workloads. Arm also offers a higher density of cores, which translates into improved scalability and the ability to handle more tasks simultaneously.

Moreover, Arm’s architecture is designed with flexibility in mind, allowing you to future-proof your development. Once you migrate your workloads to Arm, they are compatible across multiple cloud providers, giving you the agility to scale your applications on any Arm-based cloud platform, including AWS, Google Cloud, and Microsoft Azure.

Port to Arm Once, Open up our Entire Cloud Ecosystem and Workflows

 The growing adoption of Arm-based solutions by major cloud providers has spurred increased software compatibility and optimization, making it easier for developers to leverage Arm’s strengths. For AI workloads specifically, Arm’s focus on specialized processing elements and heterogeneous computing allows for efficient execution of machine learning algorithms. This combination of power efficiency, scalability, and AI acceleration capabilities positions the Arm ecosystem as a compelling choice for organizations looking to optimize their cloud infrastructure and AI applications.

Customer Success on Arm 

Honeycomb.io and FusionAuth both demonstrate how easy and beneficial it is to migrate to an Arm-based infrastructure.

• Honeycomb.io Reduces Infrastructure Costs by 50%
  A leader in the observability space, Honeycomb transitioned from a legacy architecture to Arm-based AWS Graviton processors to handle its massive data processing needs. The results were immediate and striking. Honeycomb realized a 50% reduction in infrastructure costs while maintaining high performance and using fewer instances. This migration allowed Honeycomb to focus on what they do best—providing deep insights into system behavior—without worrying about spiraling infrastructure costs.
  
• FusionAuth Increases Logins Per Second up to 49%
  Migrating to Arm wasn’t just an experiment—it was a breakthrough. After load testing on Arm-based AWS Graviton instances, FusionAuth saw a 26% to 49% increase in logins per second compared to legacy systems. A seamless transition, the company also achieved 8% to 10% cost savings along the way. FusionAuth now runs the majority of its cloud infrastructure on Arm-based instances, enabling them to support a wide range of use cases from IoT to high-performance cloud platforms.

The Path to Migration: It’s Easier Than You Think

Migrating from legacy architectures to Arm is a smooth process that doesn’t require a complete code overhaul. Companies like Honeycomb and FusionAuth successfully made the transition using Arm’s strong ecosystem of developer tools and support for adapting code, testing, debugging, and optimizing performance. Whether you’re running Java, Golang, or other popular languages, Arm provides compatibility with your existing tech stack. The flexibility of Arm’s architecture ensures that your applications perform better with fewer resource demands, leading to improved price-performance ratios.

Developers should start by assessing their current software stack, including operating systems, programming languages, development tools, and dependencies. Next, they should set up a development environment that supports Arm architecture, which can be done using emulation, remote hardware, or physical Arm hardware. The migration process typically involves recompiling applications written in compiled languages like C/C++, Go, and Rust, while interpreted languages such as Python, Java, and Node.js may require minimal changes.

Developers should also ensure that all necessary libraries and dependencies are available for Arm. Testing and validation are crucial steps to identify and resolve any compatibility issues. Finally, developers can deploy their Arm-compatible workloads to cloud platforms like AWS, Google Cloud, and Microsoft Azure, which offer robust support for Arm-based instances. 

Whether you are working on battery-powered devices, embedded systems, or IoT applications, migrating to Arm is a strategic decision that provides cost savings, superior performance, and sustainability. Developers around the world are choosing Arm to build more reliable, scalable, and power efficient applications. 

The post Why Developers are Migrating to Arm appeared first on Arm Newsroom.

In the rapidly evolving landscape of cloud computing and AI, businesses need ways to optimize performance, reduce costs and stay ahead of the competition. Enter Arm Neoverse – a game-changing architecture that’s reshaping the future of AI data centers and AI infrastructure.

Arm Neoverse has emerged as the go-to choice for industry leaders looking to drive innovation while minimizing total cost of ownership (TCO) in their AI data centers. With its unmatched performance, scalability, and power efficiency, Arm Neoverse is redefining what’s possible in modern computing environments.

Cloud Giants Lead the Way

It’s not just hype – major cloud service providers are already harnessing the power of Arm Neoverse:

• Amazon Web Services (AWS) with Graviton
• Microsoft with Cobalt
• Google with Axion

These trail-blazers recognize that Arm Neoverse delivers the critical performance and efficiency needed to meet today’s most demanding workloads. But the benefits of Arm aren’t limited to the cloud. 

Bringing Arm to Your Data Center

Enterprise customers can now leverage Arm technology on-premises, thanks to trusted OEM partners like HPE and Supermicro. As AI capabilities become increasingly central to enterprise applications, Arm-based solutions offer a path to consolidate outdated x86 servers onto fewer, high-performance, power-efficient machines.

We understand that considering and adopting new technology can seem daunting. That’s why we’ve created a comprehensive guide to help you navigate your Arm Neoverse journey. Our guide addresses common concerns, showcases real-world success stories, and provides a clear path forward for enterprises looking to harness the power of Arm for their AI data centers.

Click to read Accelerate Your AI Data Center Dreams

Ready to accelerate your AI data center dreams? Learn how Arm Neoverse can transform your infrastructure and propel your business into the future of AI-driven computing.

Don’t just keep pace – lead the AI revolution with Arm Neoverse.

The post How Arm Neoverse can Accelerate Your AI Data Center Dreams appeared first on Arm Newsroom.