Advantech Launches Edge AI Server Solutions for Generative Artificial Intelligence – Company Announcement

TAIPEI
, June 4, 2024 /PRNewswire/ — Advantech, the global leader in industrial IoT, is excited to announce its breakthrough Edge AI server solution for generative artificial intelligence, featuring Phison’s patented aiDAPTIV+ technology. Powered by the AMD EPYC 7003 Series processor, the AIR-520 Edge AI server integrates SQ ai100 AI SSDs, NVIDIA RTX graphics cards, Edge AI SDK and NVIDIA AI Enterprise into a ready-to-deploy solution.

Generative AI tools, such as large-language models (LLM), are transforming enterprise knowledge management by automating data organization, search, and analysis, thereby increasing productivity and improving decision-making. Custom LLM increases accuracy, while edge training increases data privacy, although it may be more expensive. This solution supports LLM tuning with 1-4 SQ ai100 AI graphics cards and SSDs, enabling enterprises to cost-effectively train LLM while ensuring the security of sensitive data at the edge.

Four solution offers for various applications

Advantech offers four options: AIR-520-L13B/L33B/L70B and L70B-Plus, adapted to different scales and applications. The L13B is ideal for real-time applications such as chatbots and language translation. The L33B is suitable for more complex tasks, increasing productivity and innovation in content creation. The L70B excels in advanced data analysis and decision-making in specialized domains. Additionally, the L70B-Plus, powered by NVIDIA AI Enterprise, offers comprehensive, reliable and optimized AI SDKs with long-term support and specialized consulting services.

Fast installation optimized for profitability

All AIR-520 solutions include SQ ai100 AI SSDs, which feature Phison’s aiDAPTIV+ technology. These SSDs act as an extension of GPU vRAM, allowing the system to tune LLM with a minimum number of GPU cards. This approach not only reduces the budget barrier, but also makes the Edge AI server more compact compared to traditional large rack servers. It is comparable in size to a desktop computer and can be rack-mounted with the appropriate accessories, eliminating space and maintenance concerns.

Fast development with software services

In addition to the LLM fine-tuning capabilities, Advantech provides the Edge AI SDK with GenAI training studio, pre-loaded with Llama-2 models for applications such as chatbots and data analytics. This simplifies and accelerates client-specific LLM model training and inference assessment on the AIR-520. In addition, by Advantech DeviceOn provides OTA software/container updates and remote management, facilitating effective AI orchestration and long-term maintenance.

Early samples of the AIR-520 Edge AI server solution are now available. For more information, please contact your local sales team or visit our website. https://shorturl.at/WQze2

View original content to download multimedia: https://www.prnewswire.com/news-releases/advantech-launches-edge-ai-server-solutions-for-generative-ai-302162802.html

SOURCE Advantech