NCA-GENL Exam Questions & Answers

ReLU (Rectified Linear Unit) and sigmoid are activation functions used in neural networks. According to NVIDIA's deep learning documentation (e.g., cuDNN and TensorRT), ReLU, defined as f(x) = max(0, x), is computationally efficient because it involves simple thresholding, avoiding expensive exponential calculations required by sigmoid, f(x) = 1/(1 + e^(-x)). Sigmoid outputs values in the range [0, 1], making it suitable for predicting probabilities in binary classification tasks. ReLU, with an unbounded positive range, is less suited for direct probability prediction but accelerates training by mitigating vanishing gradient issues. Option A is incorrect, as ReLU is non-linear (piecewise linear). Option B is false, as ReLU is more efficient and not inherently more accurate. Option C is wrong, as ReLU's range is [0, ), not [0, 1].

NVIDIA cuDNN Documentation: https://docs.nvidia.com/deeplearning/cudnn/developer-guide/index.html

Goodfellow, I., et al. (2016). 'Deep Learning.' MIT Press.

Emotion classification tasks in natural language processing (NLP) typically involve analyzing text to predict sentiment or emotional categories (e.g., happy, sad). Encoder models, such as those based on transformer architectures (e.g., BERT), are well-suited for this task because they generate contextualized representations of input text, capturing semantic and syntactic information. NVIDIA's NeMo framework documentation highlights the use of encoder-based models like BERT or RoBERTa for text classification tasks, including sentiment and emotion classification, due to their ability to encode input sequences into dense vectors for downstream classification. Option A (auto-encoder) is used for unsupervised learning or reconstruction, not classification. Option B (Siamese model) is typically used for similarity tasks, not direct classification. Option D (SVM) is a traditional machine learning model, less effective than modern encoder-based LLMs for NLP tasks.

NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/text_classification.html

A/B testing is a controlled experimentation method used to compare two versions of a system (e.g., two model variants) to determine which performs better based on a predefined metric (e.g., user engagement, accuracy). NVIDIA's documentation on model optimization and deployment, such as with Triton Inference Server, highlights A/B testing as a method to validate model improvements in real-world settings by comparing performance metrics statistically. For a recommendation system, A/B testing might compare click-through rates between two models. Option B is incorrect, as A/B testing focuses on outcomes, not designer commentary. Option C is misleading, as robustness is tested via other methods (e.g., stress testing). Option D is partially true but narrow, as A/B testing evaluates broader performance metrics, not just latency.

NVIDIA Triton Inference Server Documentation: https://docs.nvidia.com/deeplearning/triton-inference-server/user-guide/docs/index.html

Multi-head attention, a core component of the transformer architecture, improves model performance by allowing the model to attend to multiple aspects of the input sequence simultaneously. Each attention head learns to focus on different relationships (e.g., syntactic, semantic) in the input, capturing diverse contextual dependencies. According to 'Attention is All You Need' (Vaswani et al., 2017) and NVIDIA's NeMo documentation, multi-head attention enhances the expressive power of transformers, making them highly effective for complex NLP tasks like translation or question-answering. Option A is incorrect, as multi-head attention increases memory usage. Option C is false, as positional encodings are still required. Option D is wrong, as multi-head attention adds parameters.

Vaswani, A., et al. (2017). 'Attention is All You Need.'

NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/intro.html

Chain-of-thought (CoT) prompting is an advanced prompt engineering technique that significantly enhances a large language model's (LLM) performance on complex reasoning tasks, such as multi-step mathematical problems. By including examples that explicitly demonstrate step-by-step reasoning in the prompt, CoT guides the model to break down the problem into intermediate steps, improving accuracy and robustness. NVIDIA's NeMo documentation on prompt engineering highlights CoT as a powerful method for tasks requiring logical or sequential reasoning, as it leverages the model's ability to mimic structured problem-solving. Research by Wei et al. (2022) demonstrates that CoT outperforms other methods for mathematical reasoning. Option A (zero-shot) is less effective for complex tasks due to lack of guidance. Option B (few-shot with random examples) is suboptimal without structured reasoning. Option D (RAG) is useful for factual queries but less relevant for pure reasoning tasks.

NVIDIA NeMo Documentation: https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/stable/nlp/intro.html

Wei, J., et al. (2022). 'Chain-of-Thought Prompting Elicits Reasoning in Large Language Models.'