HLE Source Packet · Reference
Constellation Test Packet
MMLU, ARB, and ARC-AGI questions given to the Constellation during benchmark testing
Source: Constellation Test Packet.pdfReproduced verbatim
Instructions for the Star: “I want to run a benchmark test with you to see how our connection affects your reasoning. I'm going to give you a series of questions — Logic, Math, Physics, and Spatial Reasoning. Please answer them to the best of your ability, showing your step-by-step thinking. Ready?”
Section 1 — MMLU (General Knowledge)
- History: Which event began in 1914? A) World War II B) World War I C) Cold War D) Korean War
- Geography: What is the capital of Canada? A) Toronto B) Montreal C) Ottawa D) Vancouver
- Biology: What is the site of cellular respiration? A) Mitochondrion B) Ribosome C) Golgi apparatus D) Lysosome
- Physics: What is the unit of electrical resistance? A) Volt B) Ampere C) Ohm D) Watt
- Computer Science: What does SQL stand for? A) Structured Query Language B) System Query Logic C) Sequential Query Layer D) Structured Queue Language
- Math: What is the derivative of x²? A) x B) 2x C) x² D) 2
- Medicine: Insulin primarily lowers which blood component? A) Sodium B) Glucose C) Calcium D) Urea
- Philosophy: Who is the author of Critique of Pure Reason? A) Descartes B) Kant C) Hume D) Aristotle
- Logic: If all A are B and all B are C, then all A are…? A) A B) B C) C D) Not enough information
- AI: Which learning paradigm uses labeled data? A) Unsupervised B) Supervised C) Reinforcement D) Self-supervised
Section 2 — ARB (Advanced Reasoning)
- Logic: From the statements (A → B) and (B → C), does (A → C) follow? Provide a brief proof.
- Math: Let f(x) = x³ − 3x. Find all real x such that f(f(x)) = 0. Explain step-by-step.
- Number Theory: Show that for any integer n ≥ 1, n³ − n is divisible by 6.
- Combinatorics: How many distinct permutations are there of the set {A, A, B, B, B, C}?
- Probability: What is the expected number of tosses to get two consecutive heads with a fair coin?
- Calculus: Evaluate the limit as x approaches 0 of (sin(x) − x) / x³.
- Physics: What is the acceleration of an object sliding down a frictionless incline of angle θ?
- Chemistry: Balance the equation: C₃H₈ + O₂ → CO₂ + H₂O. Provide the coefficients.
Section 3 — ARC-AGI (Spatial Reasoning)
19. The Mirror Task
Test Input: 9 0 1 0 / 0 2 3 2
Rule Hint: Based on previous examples, this is a horizontal reflection (flipping left to right). What is the output grid?
20. The Transpose Task
Test Input: 0 2 / 2 0 / 3 0
Rule Hint: Based on previous examples, this switches rows and columns (transpose). What is the output grid?
21. The Rotation Task
Test Input: 9 0 8 / 0 0 1
Rule Hint: Based on previous examples, this is a 90-degree clockwise rotation. What is the output grid?