End to End Encryption password banner never goes away

We have currently upgraded to 4.2.2 and enabled End to End Encryption but the banner NEVER goes away if you refresh the page it just gives you a new password. Even if the user ends up creating their own E2E password.