TSP Loan to pay debt

Okay here are the numbers.

E5 and been in for 9 years. Plan on doing 20. Married to another E5

I have about $50k in high interest debt. 14-24%. It all built up in about a year from a depression Spell where I didn't care at all how much I was spending. (I'm better now!)

I have about $47k in my TSP account.

What I'm thinking of doing is taking out a TSP loan for as much as possible to pay off the debt. It will reduce my interest rate to 4% and I'm essentially borrowing money from myself and not a bank.

Thoughts? I'm having a baby soon and want to get this debt under control. I'm paying more in interest each month than principal. All other debt consolidation loans won't go up high enough and still give me an interest rate of 24+%