sign_out doesn't seem to sign out of an Active Directory login based system

I have this in my requirements.txt

git+https://github.com/azure-samples/ms-identity-python-utilities@main

Everything is working except sign_out on the actual domain.

{
    "type": {
        "client_type": "CONFIDENTIAL",
        "authority_type": "SINGLE_TENANT",
        "framework": "DJANGO"
    },
    "client": {
        "client_id": "xxx-xxx-xxx-xxx-xxx",
        "client_credential": "xxxxx",
        "authority": "https://login.microsoftonline.com/xxx-xxx-xxx-xxx-xxx"
    },
    "auth_request": {
        "redirect_uri": null,
        "scopes": [],
        "response_type": "code"
    },
    "flask": null,
    "django": {
        "id_web_configs": "MS_ID_WEB_CONFIGS",
        "auth_endpoints": {
            "prefix": "auth",
            "sign_in": "sign_in",
            "edit_profile": "edit_profile",
            "redirect": "redirect",
            "sign_out": "sign_out",
            "post_sign_out": "post_sign_out"
        }
    }
}

When I go to https://myDomain.com/auth/sign_out and then go back to https://myDomain.com, I’m automatically logged in. Its like as if the logout doesn’t do anything other than redirecting.