Low ●

🔗 Joint Distributions, Covariance & Conditional Expectation

Why it matters: Rare but real: Cauchy–Schwarz and covariance statements, E[XY] questions, and the law of total expectation.

Subtopics

Each subtopic has its own page: idea, why, how, example, play, check. Mark each one understood when it clicks. 0 of 3 done.

Formulas

Marginal
p_X(x) = Σᵧ p(x, y)
Independent variables
p(x, y) = p_X(x) p_Y(y) for all x, y; then E[XY] = E[X]E[Y]
Covariance
Cov(X, Y) = E[XY] − E[X]E[Y] = E[(X − μₓ)(Y − μᵧ)]
Correlation
ρ = Cov(X, Y)/(σₓσᵧ), −1 ≤ ρ ≤ 1
Cauchy–Schwarz
Cov(X, Y)² ≤ Var X · Var Y
Variance of a sum
Var(X + Y) = Var X + Var Y + 2 Cov(X, Y)
Total expectation
E[X] = Σ P(Y = y) E[X | Y = y] = E[E[X | Y]]

What GATE asks from this

Question types seen repeatedly in past papers. More stars means more frequent.

★★★
True or false: covariance and variance statements
Cauchy–Schwarz kills Cov² > Var·Var; covariance has no absolute values.
★★★
Compare E[xy] with E[x]E[y], or bound E[xy]
If y ≤ 1 and x ≥ 0 then xy ≤ x; for xy vs x̄ȳ you need the covariance sign.

Ratings are approximate, based on recurring patterns in past GATE CSE papers.

Previous year questions

2 real questions from the official GATE CSE papers (2021 to 2024), newest first, each with the official answer key and a worked solution. Questions are the property of the GATE organising institutes; this copy is for your personal study.

2 questions · 0 correct of 0 attempted · marks 0 / 4

Year:
GATE 2024 CS2 · Q44MCQ2 marks
Let x and y be random variables, not necessarily independent, that take real values in the interval [0, 1]. Let z = xy and let the mean values of x, y, z be x̄, ȳ, z̄, respectively. Which one of the following statements is TRUE?
GATE 2021 Set 1 · Q35MCQ2 marks
Consider the two statements. S1: There exist random variables X and Y such that (E[(X − E[X])(Y − E[Y])])2 > Var[X] Var[Y]. S2: For all random variables X and Y, Cov[X, Y] = E[ |X − E[X]| |Y − E[Y]| ]. Which one of the following choices is correct?

Common traps

Uncorrelated ≠ independent: Y = X² with X symmetric about 0 has Cov = 0 but is fully dependent on X.
Cov(X, Y) can be negative; an expression with absolute values cannot be a covariance.
E[XY] = E[X]E[Y] only when Cov = 0 (for example when independent), not in general.
Independence needs every cell to match its margins, not just one.