subject
Mathematics, 14.10.2020 01:01 CSelmon23

It is well-known that ridge regression tends to give similar coefficient values to correlated variables, whereas lasso may give quite different coefficient values to correlated variables. We will now explore this property in a very simple setting. Assume n are the number of training samples, p the number of dimensions, x in the input and y the output. Suppose that n = 2, p = 2, x11 = x12, and x21 = x22. Furthermore, suppose that y1 + y2 = 0 and x11 + x21 = 0 and x12 + x22 = 0, so that the estimate for the intercept in a least squares, ridge regression, or lasso model is zero: βˆ 0 = 0. (a) Write out the ridge regression optimization problem in this setting. (b) Argue that in this setting, the ridge coefficient estimates satisfy βˆ 1 = βˆ 2. (c) Write out the lasso optimization problem in this setting. (d) Argue that in this setting, the lasso coefficients βˆ 1 and βˆ 2 are not unique – in other words, there are many possible solutions to the optimization problem. Describe these solutions

ansver
Answers: 2

Other questions on the subject: Mathematics

image
Mathematics, 21.06.2019 14:30, meandmycousinmagic
Select the correct answer. what is the surface area of the victory podium shown here? include all surfaces of the podium, including the bottom. a. 61.5 square feet b. 61.75 square feet c. 65.25 square feet d. 69 square feet
Answers: 2
image
Mathematics, 21.06.2019 16:10, Tori122367
Convert 50 kilogram to pounds. (the conversion factor from kilogram to pound is 2.2046.) a. 52.2 lb. b. 110.2 lb. c. 22.6 lb. d. 47.8 lb.
Answers: 1
image
Mathematics, 21.06.2019 19:30, shay03littletop5kx2p
Simplify (1/2)4th power a. (1/16) b.(1/8) c.(1/4)
Answers: 2
image
Mathematics, 21.06.2019 20:30, donnafranks2003
If g^-1(x) is the inverse of g (x) which statement must be true
Answers: 3
You know the right answer?
It is well-known that ridge regression tends to give similar coefficient values to correlated variab...

Questions in other subjects:

Konu
Chemistry, 10.08.2021 14:00
Konu
Mathematics, 10.08.2021 14:00
Konu
History, 10.08.2021 14:00
Konu
Mathematics, 10.08.2021 14:00
Konu
Mathematics, 10.08.2021 14:00