Since July 2020, and as the name suggests, you can find your closed custom variables in Data Query and Explorer.
Previously, the Data Query interfaces only displayed custom page or site variables that were open on the current date. This prevented access to custom variables that were closed, on the periods where they collected data.
The mention (closed) therefore refers to all custom variables that may have existed but are now closed. If you don't need them, you can ignore them.