Run latest installer click "Options..." in the lower left select "USB install" instead of "for all users"

It'll have its own profile then.