IEEE

A Systematic Literature Review on Large Language Models Applications in Computer Programming Teaching Evaluation Process

Abstract: Tools based on the use of Large Language Models (LLMs) have improved the computer programming teaching process, automated feedback processes, facilitated program repair, and enabled ...
Microsoft

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Recent research, such as BitNet, is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single ...
IEEE

Lookup Table Refactoring: Towards Efficient Logarithmic Number System Addition for Large Language Models

Abstract: Compared to integer quantization, logarithmic quantization aligns more effectively with the long-tailed distribution of data in large language models (LLMs), resulting in lower quantization ...