Source document. This page reproduces the syllabus this course was written to, as published — its semesters, credits and paper numbers are that document’s, not this site’s. The course itself is studied on its own, in any order.
This page reproduces the prescribed outline for the theory paper and for
Section B of its practical, so that the teaching pages can be checked against it line by line.
It is the syllabus, not a summary of it. Nothing about marks, duration or examination pattern
appears on this site.
Course Objectives
To understand the extension from univariate to multivariate probability distributions and
its importance, necessity and real time applications.
To derive the basic properties, applications and problems on multivariate probability
distributions (Multinomial and Multivariate normal) and Multivariate Sampling distributions
(Wishart, Hotelling T² and Wilks Lambda).
Basic concepts of various multivariate Statistical techniques for data analysis
(classification, identification, testing, clustering etc.)
Course Outcomes
Able to solve and derive the common and special properties of multinomial and multivariate
normal probability distributions and multivariate sampling distributions.
Able to carry out the analysis for any multivariate data set using the multivariate tools
Linear discriminant, Principal component, multi-dimensional scaling, Factor Analysis and
Cluster analysis.
Able to identify the real time applications of multivariate statistical tools.
Unit I
AS PRESCRIBED
Multinomial distribution. Multivariate normal distribution, marginal, conditional
distributions. Independence of multivariate vectors. Random sampling from a multivariate
normal distribution. Maximum likelihood estimators of parameters. Distribution of sample mean
vector. Independence of sample mean vector and variance-covariance matrix.
Wishart matrix, Wishart distribution and its properties. Distribution of sample generalized
variance. Null distribution of simple correlation coefficients. Null distribution of partial
and multiple correlation coefficients. Distribution of sample regression coefficients.
Application in testing and interval estimation.
Null distribution of Hotelling's T² statistic. Application in tests on mean vector for
one and more multivariate normal populations and also on equality of the components of a mean
vector in a multivariate normal population. Mahalanobi's D² statistic. Wilk's
Λ-criterion and statement of its properties with simple applications. Linear
Discriminant Analysis: Classification and discrimination procedures for discrimination between
two multivariate normal populations – sample discriminant function, tests associated with
discriminant functions, probabilities of misclassification and their estimation, classification
into two multivariate normal populations with equal covariance matrices.
Principal component analysis and its properties and applications. Canonical variables and
canonical correlations: definition, use, estimation and computation. Cluster analysis:
Definitions, Agglomerative hierarchical clustering methods, Single complete and average
linkages, K-means, KNN clustering. Multi-dimensional scaling methods (metric & non
metric). Introduction to Factor analysis, orthogonal factor model. Path analysis,
Correspondence analysis, conjoint analysis.
Practical Paper STS-205, Section B — List of Practicals
The practical paper is Estimation Theory and Multivariate Analysis
(Conventional). Section B belongs to this paper; Section A belongs to
Estimation Theory (STS-201) and is written
with that paper.
MLE of Mean vector and variance covariance Matrix based on the sample drawn from
p-Normal population.
Writing the density function based on Mean vector and covariance matrix and identification
of parameters from the p-variate normal density.
Hotelling's T² for test the mean vector based on single sample.
Mahalanobi's D² for test the mean vector based on single sample.
Hotelling's T² for testing equality of the mean vectors based on two samples.
Mahalanobi's D² for testing equality of the mean vectors based on two samples.
Computation of Principal Components.
Classification between two normal populations by discriminant analysis using Maximum
likelihood ratio approach and Bayesian misclassification.
Cluster analysis using Single, Complete and Average linkages.
Computation of Canonical variables and correlation.
Computation of Orthogonal Factor Model.
Computation of Path coefficients and drawing Path diagram.
Johnson, R. A. and Wichern, D. W. (2012): Applied Multivariate Statistical
Analysis, PHI, 6th edition.
Anderson, T. W. (1984): An Introduction to Multivariate Statistical Analysis,
2nd edition, Wiley.
Kshirsagar, A. M. (1972): Multivariate Analysis, Marcel Dekker.
Morrison, D. F. (1976): Multivariate Statistical Methods, 2nd edition,
McGraw Hill.
Author and publisher spellings above follow the
published books: the printed list gives “Kshirasagar” for Kshirsagar and
“Marcel Decker” for Marcel Dekker, and the first title is given in full so that the
book can be found.