1. Provide a brief description of what Principal Components Analysis (PCA) does. [Hint: See Appendix A and your lecture notes.] State what’s the input and what the output of PCA is.

2. What’s the difference between dimensionality reduction and feature selection?

3. Describe in detail 2 different techniques for feature selection.

4. Given a sample dataset (represented by a set of attributes, a correlation matrix, a co-variance matrix, …), apply feature selection techniques to select the best attributes to keep (or equivalently, the best attributes to remove).

5. What’s the difference between feature selection and feature extraction?

6. Give two examples of data in which feature extraction would be useful.

7. Given a sample dataset, apply feature extraction.

8. What’s data discretization and when is it needed?

9. What’s the difference between supervised and unsupervised discretization?

10. Given a sample dataset, apply unsupervised (e.g., equal width, equal frequency) discretization, or supervised discretization (e.g., using entropy).

11. Describe 2 approaches to handle nominal attributes with too many values.

12. Given a dataset, apply variable transformation: Either a simple given function, normalization, or standardization.

13. Definition of Correlation and Covariance, and how to use them in data pre-processing (see pp. 76-78).