Skip to the content

Source document. This page reproduces the syllabus this course was written to, as published — its semesters, credits and paper numbers are that document’s, not this site’s. The course itself is studied on its own, in any order.

Course Information

TitleTheory of Probability and Mathematical Expectations
Theory Credits3 (3 hrs/week)
Practical Credits1 (2 hrs/week)

Course Outcomes

After successful completion of the course, students will be able to:

  1. Acquaint with the role of statistics in dealing with the univariate random variables.
  2. Learn the extension of the univariate data to bivariate data.
  3. Learn the measure of randomness mathematically by using expectations.
  4. Get familiarity about generating functions, law of large numbers and the central limit theorem, further to apply in research and allied fields.

Theory — Five Units

Unit 1: Elementary Probability

Basic Concepts of Probability, random experiments, trial, outcome, sample space, event, mutually exclusive and exhaustive events, equally likely and favourable outcomes. Mathematical, Statistical, axiomatic definitions of probability. Conditional Probability and independence of events, Addition and multiplication theorems of probability for 2 and for n events and simple problems. Boole's inequality, Bayes' theorem and its applications in real life problems.

Open Unit 1 study material →

Unit 2: Univariate Random Variables

Definition of random variable (r.v.), discrete and continuous random variables, functions of random variable. Probability mass function, Probability density function, Distribution function and its properties. Calculation of moments, coefficient of skewness and kurtosis for a given pmf and pdf.

Open Unit 2 study material →

Unit 3: Bivariate Random Variables

Bivariate random variable — meaning, joint, marginal and conditional distributions, independence of random variables and simple problems.

Open Unit 3 study material →

Unit 4: Mathematical Expectation

Mathematical expectation of function of a random variable. Moments and covariance using mathematical expectation with examples. Addition and Multiplication theorems on expectation. Properties of expectations, variance, covariance. Chebyshev and Cauchy-Schwartz inequalities and their applications.

Open Unit 4 study material →

Unit 5: Generating Functions

Definitions of Moment Generating Function, Cumulant Generating Function, Characteristic Function and Probability Generating Function and their properties. Weak Law of Large Numbers (WLLN), Strong Law of Large Numbers (SLLN). Convergence in probability and convergence in distribution, concept of Central limit theorem.

Open Unit 5 study material →

Practical — List of Experiments (7)

  1. Calculation of moments of univariate random variable to the given pmf.
  2. Calculation of coefficient of skewness and kurtosis of univariate random variable to the given pmf.
  3. Calculation of moments of univariate random variable to the given pdf.
  4. Calculation of coefficient of skewness and kurtosis of univariate random variable to the given pdf.
  5. Problem related to jpmf, mpmf and conditional pmf and its independence.
  6. Problem related to jpdf, mpdf and conditional pdf and its independence.
  7. Chebyshev's inequality application-oriented problems.

Open practical course study material →

Text Books

  1. S. C. Gupta & V. K. Kapoor — Fundamentals of Mathematical Statistics, Sultan Chand & Sons.
  2. K. Rohatgi & Ehsanes Saleh — An Introduction to Probability and Statistics, John Wiley & Sons.

References

  1. O. P. Gupta — Mathematical Statistics, Kedarnath Ramnath & Co.
  2. P. N. Arora & S. Arora — Quantitative Aptitude Statistics — Vol II, S. Chand & Company Ltd.

Suggested Co-Curricular Activities

  1. Training of students by related industrial experts.
  2. Assignments including technical assignments, if any.
  3. Seminars, Group Discussions, Quiz, Debates etc. on related topics.
  4. Preparation of audio and videos on tools of diagrammatic and graphical representations.
  5. Collection of material / figures / photos of related topics.
  6. Invited lectures and presentations of stalwarts on those topics.
  7. Visits / field trips of firms, research organizations etc.
UnitTopicApprox. Weightage
1Elementary Probability20 %
2Univariate Random Variables20 %
3Bivariate Random Variables15 %
4Mathematical Expectation25 %
5Generating Functions, LLN & CLT20 %