2024/06/16 by Suriya Ganesh Ayyamperumal, Ayyamperumal, Suriya Ganesh, Ge, Limin · 8 citations
Decision Sciences · Engineering · #Artificial Intelligence (cs.AI) #Cryptography and Security (cs.CR) #Digital Transformation in Industry #FOS: Computer and information sciences #Fault Detection and Control Systems #Human-Computer Interaction (cs.HC) #Risk and Safety Analysis
paper · pdf · doi:10.48550/arxiv.2406.12934
openalex publication_date 2024/06/16 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Large language models (LLMs) have become increasingly sophisticated, leading to widespread deployment in sensitive applications where safety and reliability are paramount. However, LLMs have inherent risks accompanying them, including bias, potential for unsafe actions, dataset poisoning, lack of explainability, hallucinations, and non-reproducibility. These risks necessitate the development of "guardrails" to align LLMs with desired behaviors and mitigate potential harm. This work explores the risks associated with deploying LLMs and evaluates current approaches to implementing guardrails and model alignment techniques. We examine intrinsic and extrinsic bias evaluation methods and discuss the importance of fairness metrics for responsible AI development. The safety and reliability of agentic LLMs (those capable of real-world actions) are explored, emphasizing the need for testability, fail-safes, and situational awareness. Technical strategies for securing LLMs are presented, including a layered protection model operating at external, secondary, and internal levels. System prompts, Retrieval-Augmented Generation (RAG) architectures, and techniques to minimize bias and protect privacy are highlighted. Effective guardrail design requires a deep understanding of the LLM's intended use case, relevant regulations, and ethical considerations. Striking a balance between competing requirements, such as accuracy and privacy, remains an ongoing challenge. This work underscores the importance of continuous research and development to ensure the safe and responsible use of LLMs in real-world applications.