Skymizer introduces the groundbreaking LLM accelerator IP for on-device LLM inference, EdgeThought, a game-changer in the on-device GenAI era.

Classified in: Science and technology
Topic: PDT

TAIPEI, May 31, 2024 /PRNewswire/ — Skymizer, a pioneer in compiler technology and optimized solutions, today announced the launch of a revolutionary artificial intelligence for software and hardware co-design ASIC IP address, EdgeThought, specifically designed to accelerate large-language models (LLM) at the edges. This cutting-edge innovation leverages advanced Skymizer compiler technology to set new industry standards in computing, memory utilization, energy efficiency and cost-effectiveness.

EdgeThought is designed to improve the performance of LLM applications on a wide range of edge devices, from IoT devices to automotive systems and AI computers/AI Edge servers, etc. By optimizing the design of EdgeThought using a compiler-centric approach, Skymizer ensures that these devices can run the most modern LLM models on the device, including the latest Llama3 8B.

Key features of Skymizer’s LLM accelerator:

• Optimized Compiler Technology: At the heart of the accelerator is the proprietary Skymizer compiler technology, which maximizes hardware utilization and performance, ensuring excellent performance even on resource-constrained edge devices.
• Increased compute and memory performance: The co-design approach minimizes latency and maximizes throughput while reducing memory footprint, enabling faster and more reliable LLM inference at the edge.
• Energy and cost efficiency: Skymizer dramatically reduces energy consumption and operational costs associated with implementing advanced AI models, making it an ideal choice for companies looking to sustainably scale their operations.
• Scalability and Flexibility: Designed to support a range of LLM applications, the accelerator can scale to a variety of sizes and performance requirements, including multiple users with multiple batches, to increase throughput for a high-performance edge server, offering unprecedented flexibility for device manufacturers and application developers.

“Today marks a significant milestone not only for Skymizer, but for the entire AI and edge computing industry,” he said Jim Lai, CEO of Skymizer. “Our innovative LLM accelerator redefines the performance capabilities of edge AI, making it both more accessible and cost-effective. This release reflects our commitment to pushing the boundaries of technology to empower our customers and enrich user experiences.”

With a decade of experience in the compiler and virtualization industry, Skymizer focuses on what it does best and designs EdgeThought as a compiler-optimized LLM ASIC The IP address specific to the inference task on the device. EdgeThought eliminated all the software and hardware needed for training and focused solely on inference. The result is a best-in-class LLM inference engine on your device. “If the Groq chip is the king of cloud LLM inference, then EdgeThought will be a game changer for on-device LLM inference,” he said. William Wei, Chief Marketing Officer and Vice President of Skymizer. “EdgeThought does not require the latest silicon manufacturing process, it could enable the production of lower-cost, mature silicon and specialty memory components that will revitalize the lower-cost memory industry in the GenAI era.”

EdgeThought IP is now available for licensing and can be integrated into existing hardware configurations without the need for extensive modifications. Skymizer has already begun working with leading semiconductor and device manufacturers to bring this advanced technology to market.

About Skymizer:

Skymizer is a global leader in compiler technology and AI optimization solutions. Based on Taipei, Taiwan, the company specializes in innovating how software and hardware interact to create more powerful, efficient and cost-effective computing solutions. Skymizer products are used in a variety of applications across multiple industries, driving the evolution of edge computing.

More product information:
Website: www.skymizer.ai

Note: This press release is for informational purposes only and does not constitute an offer to sell, a solicitation to buy or a recommendation of any security or product, nor does it constitute an offer to provide investment advisory or other services by Skymizer.

SOURCE Skymizer

You may also be interested in these press releases at 11:00 ICECO, a leading expert in portable refrigeration solutions, announces the launch of the world’s lightest dual-zone aluminum portable freezer APL35 on Indiegogo on June 1 at 8:00 a.m. PDT: https://igg.me/at/icecoapl35. APL35 redefines portable… at 10:05 Genmab A/S and BioNTech SE today announced preliminary data from the Phase 2 trial GCT1046-04 (NCT05117242) evaluating acasunlimab (DuoBody-PD-L1x4-1BB), an investigational bispecific antibody, also known as GEN1046/BNT311, as monotherapy and in combination. .. at 10:05 First Ascent Biomedical announced the results of an ongoing clinical trial in collaboration with Florida International University examining the company’s Functional Precision Medicine (FPM) platform in adults and children with… at 09:35 Tempus, a leader in artificial intelligence and precision medicine, today announces the expansion of its partnership with AstraZeneca, which uses Tempus Next to equip physicians with technology to support the delivery of guideline-based medicines… at 09:05 Ankyra Therapeutics, a clinical-stage oncology company developing anchored immunotherapies to improve the therapeutic window for immuno-oncology drugs, today announced that it is unveiling an ongoing study poster for the Phase 1 ANCHOR clinical trial… at 08:30 Stay up to date on current hot topics with free webinars from leading experts in pharma, biotechnology, medical devices…

News published on May 31, 2024 at 10:00 p.m and distributed by: