LATEST TECH ARTICLES

The following text has been translated from Korean to English using AssistAce . Sungjin (James) Kim, Ph.D. | LinkedIn  | YouTube Case Study of Translation LLM Fine-Tuning Introduction The technology of Large Language Models (LLMs) is advancing rapidly. There are various ways to utilize LLMs, including prompting, embedding, and fine-tuning. In this article, we will focus on fine-tuning, which requires a significant amount of GPU computing resources. While it is possible to sec

This article was translated from Korean into English using  AssistAce . What is On-Device AI? As artificial intelligence (AI) technology advances at a rapid pace, it is bringing many changes to our daily lives. Among these changes, 'On-Device AI', a key innovation to be significantly spotlighted in 2024, performs AI computations directly within the user's device, providing benefits such as personal information protection, reduced latency, and decreased dependency on internet

Status In the AI realm, the GPU landscape is starkly divided. The technological landscape is increasingly being divided into two distinct categories: 'GPU rich' and 'GPU poor'. This division, predominantly seen in the AI industry, is creating a significant gap in capabilities and advancements between different companies and regions. This gap is primarily due to the unequal distribution and accessibility of Graphics Processing Units (GPUs). Giants like Google, Microsoft, and M

Graphics processing units (GPUs) are specialized hardware devices that are designed to perform complex calculations for rendering graphics, such as 3D models, animations, and video games. GPUs are also used for other applications that require high-performance computing, such as artificial intelligence, machine learning, and cryptocurrency mining. However, in recent years, the demand for GPUs has far exceeded the supply, leading to a global shortage that has frustrated many co

Graphics processing units (GPUs) are specialized hardware devices that are designed to perform complex calculations for rendering graphics, such as 3D models, animations, and video games. GPUs are also used for other applications that require high-performance computing, such as artificial intelligence, machine learning, and cryptocurrency mining. There are two main companies that produce GPUs: Nvidia and AMD. Both companies have their own advantages and disadvantages, and cho

BACKGROUND The customer was looking to start an LLM project but was in a time crunch. The current solution was to purchase Nvidia’s DGX...