Beyond Right and Wrong

Enterprise software resilience depends on deterministic architectural contracts and cryptographic migration standards.** In designing systems for Beyond Right and Wrong, engineering teams must evaluate network latency overhead, payload expansion factors, and fault isolation boundaries to maintain verified sub-second service level agreements. ### A Critical Look at Social Norm Understanding in Large Language Models Large Language Models (LLMs) have made tremendous progress in recent years, surpassing human performance in various tasks such as language translation, question-answering, and text generation. However, despite their impressive capabilities, LLMs often struggle to understand the nuances of human social behavior. This is particularly evident in their tendency to overpredict negative sanctions in response to social norm violations. ## The Problem with First-Order Social Norms Previous AI alignment efforts have focused primarily on teaching models what is socially acceptable or unacceptable. This approach is often referred to as first-order social norms, where the model learns to recognize and respond to specific social rules. For instance, a model might be trained to recognize that "stealing is wrong" and respond accordingly. However, social intelligence depends not only on norm recognition but also on anticipating who will enforce it and how. These second-order expectations, known as metanorms, govern how people respond when social rules are broken. For example, in the case of stealing, a metanorm might dictate that the person who stole will face public shame or even imprisonment. ## Evaluating Metanorm Reasoning in LLMs To evaluate metanorm reasoning in LLMs, researchers have proposed a novel framework along two dimensions: emotional appraisal and behavioral response. The framework involves predicting how an individual will respond to a social norm violation, taking into account their emotional state and behavioral intentions. ## The NormReact Dataset To help this evaluation, researchers have released a multi-perspective dataset called NormReact. The dataset consists of 450 norm violation scenarios, hand-annotated for emotions and behavioral responses across norm violators' gender and observers' social closeness. ## Current State of LLMs Current LLMs portray a harsher social world, overpredicting negative sanctions where humans would expect inaction. This is particularly evident in scenarios where social distance increases, and alignment with human judgments deteriorates. ## Implications for AI Systems These findings suggest that AI systems in norm-sensitive domains, such as conflict mediation and policy simulation, may risk producing a distorted picture of social regulation. One that over-represents punishment and under-represents the tolerance, restraint, and relational calibration that characterize actual norm enforcement in the real world. ## The Need for Improved Social Reasoning in AI To address this issue, researchers and developers must focus on improving the social reasoning capabilities of LLMs. This requires a deeper understanding of human social behavior, including the complexities of metanorms and the nuances of emotional appraisal and behavioral response. ## Future Directions Future research should focus on developing more sophisticated models that can accurately predict human behavior in response to social norm violations. This may involve incorporating more advanced cognitive architectures, such as theory of mind or mentalizing, to enable LLMs to better understand the mental states and intentions of others. Evaluating second-order social reasoning in LLMs is a critical step towards developing more effective and socially intelligent AI systems. By improving the social reasoning capabilities of LLMs, we can create AI systems that better understand and respond to human social behavior, leading to more accurate and nuanced predictions in norm-sensitive domains. ## Takeaway To develop more effective and socially intelligent AI systems, researchers and developers must focus on improving the social reasoning capabilities of LLMs, including their ability to understand metanorms and predict human behavior in response to social norm violations. The findings of this study highlight the importance of considering the complexities of human social behavior in the development of AI systems. By prioritizing social reasoning and metanorm understanding, we can create AI systems that better align with human values and promote more effective and nuanced social regulation.

Empirical Compute Sizing: Parameter Density vs. Inference Latency Evaluating modern language model architectures requires separating raw parameter scale from active execution memory bandwidth. A dense 70B parameter model operating at 4-bit precision (AWQ/GPTQ) demands approximately 38GB of dedicated VRAM, whereas speculative decoding pipelines can accelerate generation speed by 1.8x to 2.4x: ``` Total Memory Requirement (GB) = (Parameters in Billions * Precision Bytes per Weight) + KV Cache Footprint + Activations Buffer

| Model Tier & Precision | Minimum VRAM Footprint | Throughput (Tokens/s) | Context Window Limit | Primary Deployment Target |
|:--- | :--- | :--- | :--- | :--- |
|**8B Compact (Q4_K_M)** | 6.5 GB | 65 – 95 T/s | 32k – 128k | Local edge workstations, on-device assistants |
|**14B Intermediate (Q8)** | 16.0 GB | 38 – 55 T/s | 64k – 128k | Prosumer single-GPU setups (RTX 4090 / M3 Pro) |
|**70B Flagship (FP8 / Q4)** | 42.0 GB – 48.0 GB | 18 – 32 T/s | 128k | Multi-GPU local nodes or enterprise private inference |
|**Mixture-of-Experts (8x7B Active)** | 32.0 GB | 45 – 70 T/s | 64k | Production API backends requiring high reasoning density | *Benchmarked via vLLM inference engine on NVIDIA Ada Lovelace and Apple Metal Unified Memory architectures.* ### Scenario Decision Framework: Local Execution vs. Hosted API - **Choose Local Dedicated Inference if:** Your data compliance governance prohibits third-party data transit (HIPAA, GDPR, or proprietary codebases), or steady-state request volume exceeds 500,000 queries per month where fixed hardware depreciation is cheaper than token pricing.
- **Choose Serverless Hosted APIs if:** Your workload is bursty, context requirements regularly exceed 100k tokens, or your engineering team lacks dedicated MLOps infrastructure capacity to manage model quantization and driver patching.