After removing myself from https://src.fedoraproject.org/rpms/dx (I had admin rights), the Settings page reloaded and I got:
Forbidden You are not allowed to change the settings for this project
which was confusing. User should be redirected to main project page (https://src.fedoraproject.org/rpms/dx) once they have no admin rights for a project.
This is a duplicate of https://pagure.io/pagure/issue/2937 and is being fixed in https://pagure.io/pagure/pull-request/2953
Thanks for your report though, it's always appreciated :)
Metadata Update from @pingou: - Issue close_status updated to: Duplicate