Will jb weld hold the caps on my ujoint?

I have a 1997 chevy 1500 with a 9inch lift, 35inch tires, but it's 2wd. The ujoints keep breaking because the drive shaft is at an angle( well it doesn't break the ujoint, it just pops the caps off everytime). I jb welded the caps on it, but I'm scared to drive it. Help!