The only way to be sure is to cycle the suspected branch circuit breaker for the receptacles in question.
When disconnecting the power to a receptacle or other electrical device, I use this procedure:
- Disconnect power. Verify that power is no longer present.
- Reconnect power. Verify that power is again present.
- Disconnect power. Verify that power is no longer present.
- Lock out/tag out disconnect.
The purpose of this method is to guard against an inadvertent false reading, or simultaneous failure or misunderstanding between you and a helper. The lock out/tag out step is necessary to ensure that the circuit is not energized by someone else while you are working on it. Of course, lock out/tag out is not needed when you are just identifying circuits.