| 
  • If you are citizen of an European Union member nation, you may not use this service unless you are at least 16 years old.

  • Stop wasting time looking for files and revisions. Connect your Gmail, DriveDropbox, and Slack accounts and in less than 2 minutes, Dokkio will automatically organize all your file attachments. Learn more and claim your free account.

View
 

ML101wk3

Page history last edited by hoffman.tricia@gmail.com 9 years, 10 months ago

 

Slides used for in Class Lecture:

This slides can be found on Professor Tibshirani's web site:  http://www-stat.stanford.edu/~tibs/stat315a.html

Ordinary Linear Regression    Ridge Regression

 

Reference Material:

Regression(stats315a).pdf

Why take out the mean before doing regression?  RidgeBiasDiscussion.txt 

 

Ridge Regression Slide (Lecture Notes on Linear Regression slide # 33) http://www-stat.stanford.edu/~tibs/stat315a.html

 

Example From Class:

In class example RegressionExamplesCamp

 

More Examples:

The Ordinary Least Squares Example (OLS) is sonar_regress_crossval.R

The Ridge Regression Example is RidgeRegSonarData.R

 

Data Files:

Here are the Data File to upload before you run the R programs:

                  sonar_test.csv   sonar_train.csv  test_data.csv   test_data.txt

 

Homework:

Homework03.pdf

 

Sonar Data from Above

Web Site for 1st problem Data Description  http://archive.ics.uci.edu/ml/machine-learning-databases/wine-quality/winequality.names

        Red Wine Data winequality-red.txt 

 

References:

Reference on Ridge Regression

Ridge Regression Section 3.4.1 on page 61 of the :

"The Elements of Statistical Learning - Data Mining, Inference, and Prediction"  by Trevor Hastie, Robert Tibshirani, and Jerome Friedman.   

   http://www-stat.stanford.edu/~tibs/ElemStatLearn

PracticalRegression_R.pdf

Matrix Computation Text by Golub

 

RidgeRegression.pdf

 

Preview of Next Week:

Start of Chapter 5 - nearest neighbor:

  chap5_alternative_classification.pdf      (start at slide 37)

   k Nearest Neighbor:  KfirstNearestNeighbor.R

 

 

Comments (0)

You don't have permission to comment on this page.